AI crawler access index, week 2026-W43

Share of the seeded domains we have read a robots.txt for that disallow each documented AI crawler token for /. The denominator is the domains actually read, never the whole seeded list, because a domain we have not read yet says nothing either way.

History

Each week is frozen when it is first published, so a citation of this page keeps meaning what it meant.

Check your own site

The same checks, run on your domain now: what robots.txt tells each AI crawler, whether the edge answers them, and whether the text is readable without JavaScript. Free, no signup.

Limits: 8 checks and 5 different domains per address per hour; a repeat of the same domain inside 7 days is answered from what we already hold.

AEO Watch is an independent, factual monitor. It is not affiliated with, endorsed by or speaking for any crawler vendor. Every statement is an observation with the date it was made and the raw evidence behind it: a robots.txt line, an HTTP status code, a header. There are no scores, no grades and no verdicts here, and nothing on this page is advice. A site opts out at any time and the opt out is honoured automatically and permanently.