Lobsters
Site checks · 1/7 passed
Evaluated once against the site's origin: discoverability surfaces like
llms.txt, AGENTS.md, and sitemap signals.
- FAIL llms-txt.exists No llms.txt or llms-full.txt found at /, /.well-known/, or /docs/
- PASS robots-txt.exists https://lobste.rs/robots.txt
- FAIL robots-txt.allows-ai-bots Blocks: GPTBot, ClaudeBot, CCBot, Google-Extended
- FAIL robots-txt.allows-llms-txt robots.txt disallows: https://lobste.rs/llms.txt, https://lobste.rs/.well-known/llms.txt
- FAIL sitemap-xml.exists sitemap.xml not reachable
- FAIL sitemap-md.exists sitemap.md not reachable
- FAIL agents-md.exists No agent skill file found
Pages · 1
Single page audited: https://lobste.rs/.
- PASS http.status-200 200
- PASS http.redirect-chain 0 hops
- PASS http.content-type-html text/html; charset=utf-8
- PASS http.no-noindex-noai no x-robots-tag
- FAIL html.canonical-link missing
- FAIL html.meta-description missing
- PASS html.og-title
- PASS html.og-description
- PASS html.lang-attribute en
- FAIL html.json-ld no parseable JSON-LD found
- FAIL html.headings only 0 headings
- FAIL html.text-ratio 6.5%
- FAIL html.glossary-link no glossary/terminology link
- FAIL markdown.mirror-suffix no .md/.mdx mirror found
- FAIL markdown.alternate-link no <link rel="alternate" type="text/markdown">
- FAIL markdown.content-negotiation text/html; charset=utf-8