bulk web-scale · page mode · scorecard v0.2.0
How agent-ready is the web?
Page-mode agent-readability scores for 50,074 of the world's most-visited origins.
- The CrUX 100k most-visited list, deduped to one per registrable domain and filtered for adult/gambling/spam.
- Generated June 18, 2026.
50,074 Sites scored
50.5 Mean score
27% llms.txt
25% AGENTS.md
59% sitemap
88% robots.txt
Score distribution
Sites per 20-point score bucket. Most of the popular web scores low in page mode. Agent-readiness signals are still rare at scale.
Signal adoption
Share of scored sites exposing each agent-readiness signal.
llms.txt 27%
AGENTS.md 25%
sitemap 59%
robots.txt 88%
Leaderboard
Loading…
No sites match.
# Domain Score Signals Top failures
How this is built
Origins come from the CrUX most-visited list, deduped to one per registrable domain and filtered for adult/gambling/spam. Each homepage is scored in page mode against scorecard v0.2.0. Unreachable origins (DNS/TLS failures, bot/geo blocks) are dropped.