resources · data

Who is reading your website? Google's share of bot traffic drops to a third

by Johannes Zimmer · · 4 min read · Data
In short

According to Cloudflare Radar, Google's share of global bot traffic has fallen from 46.8 to 30.1 percent within a year. Not because Google crawls less, but because new players like Anthropic, Apple and Baidu have entered the market. When a bot reads a website today, it is far less likely to be a search crawler and far more likely to be an AI building an answer.

TL;DR
  • Google: 46.8% → 30.1% share of verified bot traffic (Cloudflare Radar, Q2 2025 vs. Q2 2026).
  • Anthropic, Apple and Baidu weren't in the top 9 a year ago, today they take 13.2 points combined.
  • Meta, OpenAI and Microsoft are basically flat: the market is fragmenting, not crowning a new leader.
  • For websites this means: the typical bot visit increasingly serves an AI answer, not a search index.

How has bot traffic changed?

A year ago, almost half of the world's bot traffic came from Google. Today it's barely a third. That's what our own query of the Cloudflare Radar API shows, based on verified bot traffic, Q2 2025 vs. Q2 2026, retrieved July 30, 2026:

  • Google: 46.8% → 30.1%
  • Meta: 14.6% → 14.9%
  • OpenAI: 8.7% → 7.6%
  • Microsoft: 5.2% → 5.3%
  • Others: 14.9% → 22.3%
Comparison table of verified bot traffic share, Q2 2025 vs. Q2 2026: Google drops from 46.8 to 30.1 percent, Anthropic, Apple and Baidu are new in the top 9, Semrush, Yandex and Huawei drop out, others grow from 14.9 to 22.3 percent.

Google loses almost 17 percentage points, and none of the established names picked them up. Meta, OpenAI and Microsoft are standing almost exactly where they stood a year ago.

Who are the new players?

Three names that weren't even in the top 9 bot operators a year ago: Anthropic (now #5 with 4.9%), Apple (4.3%) and Baidu (4.0%). Combined they take 13.2 points, almost as much as Google gave up. Semrush, Yandex and Huawei dropped out of the list. One year, a third of the list replaced.

Does Google crawl less now?

That can't be derived from the numbers, and it's probably not true. Cloudflare Radar measures shares, not absolute volumes. Google's slice of the pie got smaller because the pie itself grew: more machines are simply reading the web today than a year ago.

What are the new bots doing on your website?

The decisive difference isn't volume, it's purpose. A search crawler reads your page to file it into an index, and might send you visitors later. The new bots often read your page the moment someone asks a question: an AI fetches the content, builds an answer from it and, in the best case, cites the source. More and more of your website's readers are not human, and they decide whether you appear in the answer.

What does this mean for your visibility?

If the typical bot visit is less and less likely to be a search crawler, optimizing for rankings alone is no longer enough. Your content needs to be written so a machine can understand and cite it: direct answers, clear structure, sourced numbers. Written to be cited. Whether that already works today is what the answer check shows: do you appear in the AI answers to your audience's most important questions? That's exactly the loop flize automates: scouting, answer check, content production and attribution, bundled in one place.

Frequently asked questions

Does this mean Google crawls less than before?

+

No, that can't be derived from the numbers. Cloudflare Radar measures shares, not absolute volumes. Google's slice got smaller because the pie grew: far more bot operators are active than a year ago.

Should I block AI bots in my robots.txt?

+

If you want to be visible in AI answers, don't blanket-block answer bots like ClaudeBot, OAI-SearchBot or PerplexityBot. Make a deliberate per-bot decision: allow answer-serving access, and permit or exclude training crawlers depending on your content strategy.

Where do these numbers come from?

+

From our own query of the Cloudflare Radar API: verified bot traffic, Q2 2025 vs. Q2 2026, retrieved July 30, 2026. As a CDN provider, Cloudflare sees a large share of global web traffic and verifies bots via network and behavioral signals.

Is SEO dead, then?

+

No. Google remains the largest single bot operator, and classic search still delivers traffic. But the share of bots reading for AI answers is growing fast. GEO complements SEO, it doesn't replace it.

Johannes Zimmer
Johannes Zimmer is the founder of flize (sitebrunch GmbH) and helps companies and agencies become visible in AI answers.
free · no credit card

See what your audience is asking right now.

Enter your domain, start the free plan: score, open questions and the first research run.