# Does example.com allow GPTBot? robots.txt has not been read yet

## In short

We hold no robots.txt reading for example.com yet.

| Fact | Value |
| --- | --- |
| Domain | example.com |
| AI crawler tokens resolved | 0 |
| Allowed for / | 0 |
| Disallowed for / | 0 |
| Checks that ran | none yet |
| robots.txt read (tier A) | 2026-09-06 |
| Full check (tier B) | 2026-09-06 |
| Last verified | 2026-09-07 |

## Every AI crawler token in the registry

| Crawler | Vendor | Observation | Evidence | Observed |
|---|---|---|---|---|
| GPTBot | OpenAI | no observation recorded |  |  |
| ClaudeBot | Anthropic | no observation recorded |  |  |
| PerplexityBot | Perplexity | no observation recorded |  |  |
| OAI-SearchBot | OpenAI | no observation recorded |  |  |
| CCBot | Common Crawl Foundation | no observation recorded |  |  |
| Bytespider | ByteDance | no observation recorded |  |  |
| Googlebot | Google | no observation recorded |  |  |
| ChatGPT-User | OpenAI | no observation recorded |  |  |
| Claude-User | Anthropic | no observation recorded |  |  |
| Claude-SearchBot | Anthropic | no observation recorded |  |  |
| Perplexity-User | Perplexity | no observation recorded |  |  |
| anthropic-ai | Anthropic | no observation recorded |  |  |
| Bingbot | Microsoft | no observation recorded |  |  |
| Applebot | Apple | no observation recorded |  |  |
| Amazonbot | Amazon | no observation recorded |  |  |
| meta-externalagent | Meta | no observation recorded |  |  |
| DuckAssistBot | DuckDuckGo | no observation recorded |  |  |
| Applebot-Extended | Apple | no observation recorded |  |  |
| Google-Extended | Google | no observation recorded |  |  |

Robots.txt history: https://bikoosh.com/aeo/site/example.com/history

Limitation: this test appends a labelled marker to our own honest User Agent, it never impersonates another agent. Rules keyed to an exact User Agent string, or to a vendor's IP ranges, are invisible to this method and are neither confirmed nor ruled out.

AEO Watch is an independent, factual monitor. It is not affiliated with, endorsed by or speaking for any crawler vendor. Every statement is an observation with the date it was made and the raw evidence behind it: a robots.txt line, an HTTP status code, a header. There are no scores, no grades and no verdicts here, and nothing on this page is advice. A site opts out at any time and the opt out is honoured automatically and permanently.