The Verge
Site checks · 2/7 passed
Evaluated once against the site's origin: discoverability surfaces like
llms.txt, AGENTS.md, and sitemap signals.
- FAIL llms-txt.exists No llms.txt or llms-full.txt found at /, /.well-known/, or /docs/
- PASS robots-txt.exists https://www.theverge.com/robots.txt
- FAIL robots-txt.allows-ai-bots Blocks: ClaudeBot, CCBot, Google-Extended
- PASS robots-txt.allows-llms-txt
- FAIL sitemap-xml.exists sitemap.xml not reachable
- FAIL sitemap-md.exists sitemap.md not reachable
- FAIL agents-md.exists No agent skill file found
Pages · 1
Single page audited: https://www.theverge.com/.
- PASS http.status-200 200
- PASS http.redirect-chain 0 hops
- PASS http.content-type-html text/html; charset=utf-8
- PASS http.no-noindex-noai no x-robots-tag
- PASS html.canonical-link https://www.theverge.com
- PASS html.meta-description 221 chars
- PASS html.og-title
- PASS html.og-description
- PASS html.lang-attribute en-US
- PASS html.json-ld 2 block(s)
- FAIL html.json-ld.date-modified no dateModified anywhere in JSON-LD
- FAIL html.json-ld.breadcrumb no BreadcrumbList node
- PASS html.headings 6 headings
- PASS html.text-ratio 40.4%
- FAIL html.glossary-link no glossary/terminology link
- FAIL markdown.mirror-suffix no .md/.mdx mirror found
- FAIL markdown.alternate-link no <link rel="alternate" type="text/markdown">
- FAIL markdown.content-negotiation text/html; charset=utf-8