Web crawler IP ranges, tracked daily

Every bot we track, every IP range its operator publishes, and every time those ranges change. 3,525 ranges across 14 verifiable crawlers.

Updated today 14/14 sources healthy Free JSON API No key, no sign-up

Snapshot generated 2026-08-13T17:24:08.759Z

Is this IP a real crawler?

Paste an IP address from your access logs. We check it against every range the operators publish.

Why this list changes

Publishing an IP range list does not mean it is stable. Some operators have not touched theirs in years. Others rewrite them constantly, because the crawler is triggered by users in real time and its capacity follows demand. Treating any of these lists as a one-off download is how you end up rejecting real traffic as spoofed.

Verifiable crawlers

These operators publish a machine-readable list of the addresses their crawlers use, so a hit claiming to be them can be confirmed or rejected. The movement column covers the last 90 days.

BotOperatorRangesMovement (90d)Source updated
Amazonbot Amazon 524 no change 2026-04-30
Amzn-SearchBot Amazon 512 no change 2025-11-21
Applebot Apple 12 no change 2023-10-27
Common crawlers (Googlebot) Google 315 +4 / -0 2026-08-13
Special crawlers (AdsBot...) Google 270 +4 / -0 2026-08-13
User-triggered agents Google 20 no change 2026-08-13
User-triggered fetchers Google 1056 +8 / -0 2026-08-13
User-triggered fetchers (Google) Google 494 +46 / -0 2026-08-13
bingbot Microsoft 28 no change 2024-01-03
ChatGPT-User OpenAI 226 +84 / -105 2026-08-13
GPTBot OpenAI 21 no change 2025-10-30
OAI-SearchBot OpenAI 35 no change 2026-01-02
Perplexity-User Perplexity 4 no change 2025-10-17
PerplexityBot Perplexity 8 no change 2025-02-07

Crawlers you cannot verify by IP

These operators publish no address list. Their user-agent can be copied by anyone, so a hit claiming to be one of them proves nothing on its own.

BotsOperatorVerificationNote
ClaudeBot, Claude-User, Claude-SearchBot Anthropic reverse-dns / robots.txt Anthropic ne publie pas de plages IP ; bots sur IP cloud publiques.
meta-externalagent, facebookexternalhit Meta aucune Aucune plage IP publiee.
GrokBot, xAI-Grok, Grok-DeepSearch xAI aucune Pas de doc ; IP residentielles rotatives, user-agent souvent masque.
MistralAI-User Mistral user-agent + robots.txt Pas de fichier IP ; voir docs.mistral.ai/robots.

Recent range changes

DateBotChangeTotal
2026-08-13 User-triggered fetchers (Google) +46 / -0 448 to 494
2026-08-13 User-triggered fetchers +8 / -0 1048 to 1056
2026-08-13 Special crawlers (AdsBot...) +4 / -0 266 to 270
2026-08-13 Common crawlers (Googlebot) +4 / -0 311 to 315
2026-08-13 ChatGPT-User +84 / -105 247 to 226

Use the data

Everything on this page is available as JSON, and as a flat text list you can drop straight into a firewall rule. No key, no sign-up, no rate limit beyond basic abuse protection.

GET /v1/bots every tracked bot and its metadata

GET /v1/ranges the full snapshot, all ranges

GET /v1/ranges.txt one CIDR per line, ready for a firewall rule

GET /v1/verify?ip=1.2.3.4 which bot owns this address

GET /v1/changes the full change history

GET /v1/volatility which bots move, and how much