robots.txt history for msn.com
On 2026-09-06 the robots.txt of msn.com resolved 19 AI crawler tokens: 2 allowed for / and 17 disallowed for /.
| Domain | msn.com |
|---|---|
| AI crawler tokens resolved | 19 |
| Allowed for / | 2 |
| Disallowed for / | 17 |
| robots.txt | robots.txt present, 5245 bytes |
| Checks that ran | edge, llms, optout, render, robots, signals, structured, timing |
| robots.txt read (tier A) | 2026-09-06 |
| Full check (tier B) | 2026-09-06 |
| Last verified |
No robots.txt version has been recorded for this domain yet. Versions are kept from the weekly crawl, so this page fills in as the crawl reaches the domain again.
AEO Watch is an independent, factual monitor. It is not affiliated with, endorsed by or speaking for any crawler vendor. Every statement is an observation with the date it was made and the raw evidence behind it: a robots.txt line, an HTTP status code, a header. There are no scores, no grades and no verdicts here, and nothing on this page is advice. A site opts out at any time and the opt out is honoured automatically and permanently.