Let the real crawlers in. Keep the impostors out.
Any client can send Googlebot's user agent, so a rule that lets crawlers in by name lets in everyone who copies it. These are the 98 bots Bot IP names, each with its operator and the way the operator lets you check that a request is really its own.
Check whose bot uses an address
Enter an IP address to open its page at the Bot IP card: whose bot uses it, the bots by name, what they do and whether their operator vouches for the address.
Every bot, by what it does
A published list or a documented reverse DNS name lets you prove a request is the operator's; a bot with none published can only be taken at its word.
Search engine
Indexes pages for a web search engine, such as Googlebot and Bingbot.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Applebot | Apple | Published list |
| Baiduspider | Baidu | Reverse DNS |
| bingbot | Microsoft | Published list |
| DuckDuckBot | DuckDuckGo | Published list |
| Googlebot | Published list | |
| MojeekBot | Mojeek | Published list |
| PetalBot | Huawei | Reverse DNS |
| SeznamBot | Seznam.cz | Published list |
| Sogou Spider | Sogou | None published |
| Yahoo Slurp | Yahoo | Reverse DNS |
| YandexBot | Yandex | Reverse DNS |
| Yeti | Naver | Published list |
AI training
Collects pages to train AI models, such as GPTBot, ClaudeBot and CCBot.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Ai2Bot | Allen Institute for AI | None published |
| Amazonbot | Amazon | Published list |
| Bytespider | ByteDance | None published |
| ClaudeBot | Anthropic | Published list |
| cohere-ai | Cohere | None published |
| Diffbot | Diffbot | None published |
| GPTBot | OpenAI | Published list |
| ImagesiftBot | ImageSift | None published |
| Meta-ExternalAgent | Meta | Registered space |
| PanguBot | Huawei | None published |
| Reflectionbot | Reflection AI | Published list |
AI search
Indexes pages an AI answer engine searches and cites, such as OAI-SearchBot and PerplexityBot.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Amzn-SearchBot | Amazon | Published list |
| Claude-SearchBot | Anthropic | Published list |
| ExaSearchBot | Exa | Signed requests |
| ExaSearchBot-Images | Exa | None published |
| Google-CloudVertexBot | Published list | |
| KeenableBot | Keenable | Published list |
| Meta-WebIndexer | Meta | Registered space |
| OAI-SearchBot | OpenAI | Published list |
| PerplexityBot | Perplexity | Published list |
| ShapBot | Parallel Web Systems | Published list |
| SofyaBot | Sofya | Published list |
| YouBot | You.com | None published |
AI assistant
Fetches a page because a person asked an AI assistant about it, such as ChatGPT-User and Claude-User.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Amzn-User | Amazon | Published list |
| ChatGPT-User | OpenAI | Published list |
| Claude-User | Anthropic | Published list |
| DuckAssistBot | DuckDuckGo | Published list |
| Google-NotebookLM | Published list | |
| Keenable-User | Keenable | None published |
| Meta-ExternalFetcher | Meta | Registered space |
| MistralAI-User | Mistral AI | Published list |
| Perplexity-User | Perplexity | Published list |
AI agent
Browses for a person, opening pages and filling in forms, such as ChatGPT agent and Google-Agent.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Google-Agent | Published list |
SEO
Audits sites and maps their links for SEO tools, such as AhrefsBot and SemrushBot.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| AhrefsBot | Ahrefs | Published list |
| AhrefsSiteAudit | Ahrefs | Published list |
| Barkrowler | Babbar | None published |
| BLEXBot | WebMeUp | None published |
| DataForSeoBot | DataForSEO | Reverse DNS |
| DotBot | Moz | None published |
| Lumar | Lumar | Published list |
| MJ12bot | Majestic | None published |
| SemrushBot | Semrush | None published |
| SERankingBacklinksBot | SE Ranking | None published |
| serpstatbot | Serpstat | None published |
Ads
Checks ad landing pages and where ads appear, such as AdsBot-Google and TTD-Content.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| AdsBot-Google | Published list | |
| IAS crawler | Integral Ad Science | Published list |
| OAI-AdsBot | OpenAI | None published |
| TTD-Content | The Trade Desk | Published list |
Link preview
Fetches a page to show its preview when someone shares the link, such as facebookexternalhit and Slackbot.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Discordbot | Discord | None published |
| Embedly | Embedly | None published |
| facebookexternalhit | Meta | Registered space |
| FlipboardProxy | Published list | |
| LinkedInBot | None published | |
| MicrosoftPreview | Microsoft | Published list |
| Pinterestbot | None published | |
| redditbot | None published | |
| Slackbot | Slack | None published |
| TelegramBot | Telegram | Published list |
| Twitterbot | X | None published |
Feed fetcher
Polls feeds for readers and aggregators, such as FeedFetcher-Google and FlipboardRSS.
Monitoring
Checks a site's uptime and speed for its owner, such as UptimeRobot and Pingdom.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| Better Uptime Bot | Better Stack | Published list |
| Datadog Synthetics | Datadog | Published list |
| InstatusBot | Instatus | None published |
| Pingdom | SolarWinds Pingdom | Published list |
| Site24x7 | Site24x7 | None published |
| StatusCake | StatusCake | Published list |
| UptimeRobot | UptimeRobot | Published list |
Archiver
Saves copies of pages for a web archive, such as archive.org_bot and CCBot.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| archive.org_bot | Internet Archive | None published |
| CCBot | Common Crawl | Published list |
Internet scanner
Probes addresses across the whole internet for research and exposure data, such as Censys and Shodan.
| BOT | OPERATOR | VERIFY BY |
|---|---|---|
| BinaryEdge | BinaryEdge | None published |
| CensysInspect | Censys | None published |
| Expanse | Palo Alto Networks | None published |
| InternetData | InternetData | Published list |
| InternetMeasurement | internet-measurement.com | None published |
| Onyphe | Onyphe | None published |
| Shadowserver | The Shadowserver Foundation | None published |
| Shodan | Shodan | None published |
| Stretchoid | Stretchoid | None published |
Webhook
Sends event callbacks to the URLs a platform's customers register, such as Stripe and GitHub.
The same check in every lookup
The lookup API answers is_bot on every plan, the free one included. A paid plan adds bot, whose bot it is and whether its operator vouches for the address, and with a request's user agent sent beside the address, a verdict on it: verified, spoofed or unverifiable.
Unlimited lookups, no sign-up.
Paste it into a terminal. Any address answers with its country, network, company and hostname, with no key and no daily or monthly cap. ASNs and domains answer too.
{"ip": "8.8.8.8","is_bogon": false,"is_tor": false,"is_relay": false,"is_bot": false,"is_anycast": true,"is_carrier": false,"is_satellite": false,"is_ssh": false,"is_smtp": false,"is_web": true,"is_dns_resolver": true,"is_bittorrent": false,"hostname": "dns.google","location": {"continent": "NA","continent_name": "North America","country": "US","country_name": "United States","timezone": "America/Los_Angeles","currency_code": "USD","currency_name": "Dollar","currency_symbol": "$","flag_emoji": "🇺🇸","flag_unicode": "U+1F1FA U+1F1F8"},"asn": {"asn": 15169,"name": "Google LLC","domain": "google.com","type": "hosting","prefix": "8.8.8.0/24","country": "US","rpki_status": "valid"},"company": {"name": "Google LLC","domain": "google.com"},"tor": {},"relay": {},"abuse": {"email": "network-abuse@google.com"}}
All of the data on a paid plan.
A free API key tries every field, with no card.