LlamaIndex↗

Site checks · 6/13 passed

Evaluated once against the site's origin: discoverability surfaces like llms.txt, AGENTS.md, and sitemap signals.

• PASS llms-txt.exists Found llms.txt at https://developers.llamaindex.ai/python/framework/
• WARN llms-txt.content-type Content-Type is "text/html; charset=utf-8", expected text/plain
• PASS llms-txt.non-empty
• FAIL llms-txt.md-extensions 3/3 links are not .md/.mdx
• PASS robots-txt.exists https://developers.llamaindex.ai/python/framework/
• FAIL robots-txt.allows-ai-bots Blocks: GPTBot, ClaudeBot, CCBot, Google-Extended
• FAIL robots-txt.allows-llms-txt robots.txt disallows: https://docs.llamaindex.ai/llms.txt, https://docs.llamaindex.ai/.well-known/llms.txt
• PASS sitemap-xml.exists https://developers.llamaindex.ai/python/framework/
• FAIL sitemap-xml.valid sitemap.xml did not parse as urlset/sitemapindex
• PASS sitemap-md.exists https://developers.llamaindex.ai/python/framework/
• FAIL sitemap-md.has-structure sitemap.md is missing headings or links
• PASS agents-md.exists https://developers.llamaindex.ai/python/framework/
• FAIL agents-md.has-min-sections Found only: (none)

Pages · 5

Each page was audited against the same scorecard. Click a page to expand its check results.