LlamaIndex
Site checks · 6/13 passed
Evaluated once against the site's origin: discoverability surfaces like
llms.txt, AGENTS.md, and sitemap signals.
- PASS llms-txt.exists Found llms.txt at https://developers.llamaindex.ai/python/framework/
- WARN llms-txt.content-type Content-Type is "text/html; charset=utf-8", expected text/plain
- PASS llms-txt.non-empty
- FAIL llms-txt.md-extensions 3/3 links are not .md/.mdx
- PASS robots-txt.exists https://developers.llamaindex.ai/python/framework/
- FAIL robots-txt.allows-ai-bots Blocks: GPTBot, ClaudeBot, CCBot, Google-Extended
- FAIL robots-txt.allows-llms-txt robots.txt disallows: https://docs.llamaindex.ai/llms.txt, https://docs.llamaindex.ai/.well-known/llms.txt
- PASS sitemap-xml.exists https://developers.llamaindex.ai/python/framework/
- FAIL sitemap-xml.valid sitemap.xml did not parse as urlset/sitemapindex
- PASS sitemap-md.exists https://developers.llamaindex.ai/python/framework/
- FAIL sitemap-md.has-structure sitemap.md is missing headings or links
- PASS agents-md.exists https://developers.llamaindex.ai/python/framework/
- FAIL agents-md.has-min-sections Found only: (none)
Pages · 5
Each page was audited against the same scorecard. Click a page to expand its check results.
54 https://developers.llamaindex.ai/python/framework/ 13/24
- PASS http.status-200 200
- PASS http.redirect-chain 1 hops
- PASS http.content-type-html text/html; charset=utf-8
- PASS http.no-noindex-noai no x-robots-tag
- PASS html.canonical-link https://developers.llamaindex.ai/python/framework/
- FAIL html.meta-description missing
- PASS html.og-title
- FAIL html.og-description missing
- PASS html.lang-attribute en
- FAIL html.json-ld no parseable JSON-LD found
- PASS html.headings 17 headings
- FAIL html.text-ratio 14.8%
- FAIL html.glossary-link no glossary/terminology link
- PASS markdown.mirror-suffix https://developers.llamaindex.ai/python/framework/index.md
- PASS markdown.alternate-link /python/framework/index.md
- FAIL markdown.frontmatter missing: description, doc_version, last_updated
- FAIL markdown.canonical-header no Link header
- FAIL markdown.content-negotiation text/html; charset=utf-8
- FAIL markdown.sitemap-section no "## Sitemap" heading in mirror
- FAIL code.language-tags 2/2 blocks missing language
- FAIL discovery.indexed orphaned (not announced by any index)
- PASS markdown.navigation-stripped
- PASS markdown.size-reduction 96.2% smaller (10148B vs 268165B)
- PASS markdown.valid-markdown 0.0% HTML markup
54 https://developers.llamaindex.ai/python/framework/ 13/24
- PASS http.status-200 200
- PASS http.redirect-chain 1 hops
- PASS http.content-type-html text/html; charset=utf-8
- PASS http.no-noindex-noai no x-robots-tag
- PASS html.canonical-link https://developers.llamaindex.ai/python/framework/
- FAIL html.meta-description missing
- PASS html.og-title
- FAIL html.og-description missing
- PASS html.lang-attribute en
- FAIL html.json-ld no parseable JSON-LD found
- PASS html.headings 17 headings
- FAIL html.text-ratio 14.8%
- FAIL html.glossary-link no glossary/terminology link
- PASS markdown.mirror-suffix https://developers.llamaindex.ai/python/framework/index.md
- PASS markdown.alternate-link /python/framework/index.md
- FAIL markdown.frontmatter missing: description, doc_version, last_updated
- FAIL markdown.canonical-header no Link header
- FAIL markdown.content-negotiation text/html; charset=utf-8
- FAIL markdown.sitemap-section no "## Sitemap" heading in mirror
- FAIL code.language-tags 2/2 blocks missing language
- FAIL discovery.indexed orphaned (not announced by any index)
- PASS markdown.navigation-stripped
- PASS markdown.size-reduction 96.2% smaller (10148B vs 268165B)
- PASS markdown.valid-markdown 0.0% HTML markup
54 https://developers.llamaindex.ai/python/framework/ 13/24
- PASS http.status-200 200
- PASS http.redirect-chain 1 hops
- PASS http.content-type-html text/html; charset=utf-8
- PASS http.no-noindex-noai no x-robots-tag
- PASS html.canonical-link https://developers.llamaindex.ai/python/framework/
- FAIL html.meta-description missing
- PASS html.og-title
- FAIL html.og-description missing
- PASS html.lang-attribute en
- FAIL html.json-ld no parseable JSON-LD found
- PASS html.headings 17 headings
- FAIL html.text-ratio 14.8%
- FAIL html.glossary-link no glossary/terminology link
- PASS markdown.mirror-suffix https://developers.llamaindex.ai/python/framework/index.md
- PASS markdown.alternate-link /python/framework/index.md
- FAIL markdown.frontmatter missing: description, doc_version, last_updated
- FAIL markdown.canonical-header no Link header
- FAIL markdown.content-negotiation text/html; charset=utf-8
- FAIL markdown.sitemap-section no "## Sitemap" heading in mirror
- FAIL code.language-tags 2/2 blocks missing language
- FAIL discovery.indexed orphaned (not announced by any index)
- PASS markdown.navigation-stripped
- PASS markdown.size-reduction 96.2% smaller (10148B vs 268165B)
- PASS markdown.valid-markdown 0.0% HTML markup
54 https://developers.llamaindex.ai/python/framework/ 13/24
- PASS http.status-200 200
- PASS http.redirect-chain 1 hops
- PASS http.content-type-html text/html; charset=utf-8
- PASS http.no-noindex-noai no x-robots-tag
- PASS html.canonical-link https://developers.llamaindex.ai/python/framework/
- FAIL html.meta-description missing
- PASS html.og-title
- FAIL html.og-description missing
- PASS html.lang-attribute en
- FAIL html.json-ld no parseable JSON-LD found
- PASS html.headings 17 headings
- FAIL html.text-ratio 14.8%
- FAIL html.glossary-link no glossary/terminology link
- PASS markdown.mirror-suffix https://developers.llamaindex.ai/python/framework/index.md
- PASS markdown.alternate-link /python/framework/index.md
- FAIL markdown.frontmatter missing: description, doc_version, last_updated
- FAIL markdown.canonical-header no Link header
- FAIL markdown.content-negotiation text/html; charset=utf-8
- FAIL markdown.sitemap-section no "## Sitemap" heading in mirror
- FAIL code.language-tags 2/2 blocks missing language
- FAIL discovery.indexed orphaned (not announced by any index)
- PASS markdown.navigation-stripped
- PASS markdown.size-reduction 96.2% smaller (10148B vs 268165B)
- PASS markdown.valid-markdown 0.0% HTML markup
53 https://pipeshift.com/ 9/17
- PASS http.status-200 200
- PASS http.redirect-chain 0 hops
- FAIL http.content-type-html text/html
- PASS http.no-noindex-noai no x-robots-tag
- PASS html.canonical-link https://pipeshift.com/
- PASS html.meta-description 254 chars
- PASS html.og-title
- PASS html.og-description
- FAIL html.lang-attribute missing
- FAIL html.json-ld no parseable JSON-LD found
- FAIL html.headings only 0 headings
- FAIL html.text-ratio 3.8%
- FAIL html.glossary-link no glossary/terminology link
- FAIL markdown.mirror-suffix no .md/.mdx mirror found
- FAIL markdown.alternate-link no <link rel="alternate" type="text/markdown">
- PASS markdown.content-negotiation text/markdown; charset=utf-8
- PASS discovery.indexed