Can AI answer engines read and cite your site?

Type a domain: which of the 21 documented AI crawlers its robots.txt lets in, whether it publishes what a reader needs, and which recorded AI answers cite it. Free, no signup; a domain checked in the last 7 days is answered at once.

The check is real fetching of someone else's site, so it is deliberate and paced: robots.txt is law, the User Agent is our own and is never another agent's, and a labelled probe is used for the edge test. A fresh check takes about a minute, and the page tells you when it is done. Limits: 8 checks and 5 different domains per address per hour, and a repeat of the same domain inside 7 days is answered from what we already hold rather than fetched again. The summary is always visible.

What a check reports

• the robots.txt of the host, read under RFC 9309, with the exact line that decides each token
• every documented AI crawler token in our registry (21 of them) resolved for /
• whether the site publishes llms.txt, a sitemap, structured data and the headers a reader needs
• a labelled edge probe: we append a marker to our own honest User Agent and record whether the answer changes

Limitation: this test appends a labelled marker to our own honest User Agent, it never impersonates another agent. Rules keyed to an exact User Agent string, or to a vendor's IP ranges, are invisible to this method and are neither confirmed nor ruled out.

Does an AI answer engine cite your site?

Answer Watch records what one AI answer engine (Claude, with web search) cites for a set of 389 buyer questions, worked through night by night; every domain cited in at least 5 recorded answers has a dated record.

What you get

The checkout is titled Bikoosh Watch: one membership shared across Bikoosh products. After paying, come back to https://bikoosh.com/aeo/activate and enter the email you paid with. The check above is free and needs no address; a monitor is a double opt in, and every email it sends carries an unsubscribe link that switches the monitors off with it.

The AI crawler guides

One page per token: identity, vendor, purpose, the documented way to verify a request really came from it, its exact robots token and copy and paste snippets to allow or disallow it.

All 21 documented crawlers on one page: the identity table, the share of read domains disallowing each token, and one robots.txt block that names every one of them.

Aggregate pages

• The weekly AI crawler access index: the share of the domains we have read that disallow each token.
• What changed this week: counts only, no domain is ever named.
• Industry reports: aggregates over the domains a public registry lets us classify.

Coverage right now

Opting out

A site opts out at any time, and the opt out is honoured automatically and permanently. Publish either of these and our checker records it on its next visit, deletes what it holds and never fetches the domain again:

_bikoosh-aeo.<your-domain>  IN TXT  "optout"

https://<your-domain>/.well-known/bikoosh-aeo-optout  served as text/plain with the single word optout

AEO Watch is an independent, factual monitor. It is not affiliated with, endorsed by or speaking for any crawler vendor. Every statement is an observation with the date it was made and the raw evidence behind it: a robots.txt line, an HTTP status code, a header. There are no scores, no grades and no verdicts here, and nothing on this page is advice. A site opts out at any time and the opt out is honoured automatically and permanently.