---
title: robots.txt does not disallow llms.txt
description: Publishing llms.txt and then disallowing it in robots.txt is a contradiction that confuses every well-behaved agent. This check catches the rare but visible case where the two files are out of sync.
doc_version: 0.2.0
last_updated: "2026-04-24T21:30:56.217Z"
---

## How the check decides

The check parses robots.txt and asks the universal user-agent `*` whether `/llms.txt` and `/.well-known/llms.txt` are allowed. Passes if both are reachable. Fails with the offending paths if either is disallowed. If no robots.txt exists the check passes (allow-all by default).

## How to implement it

If you've added a global `Disallow: /` for any user-agent, add an explicit `Allow: /llms.txt` line above it for the same user-agent. Or just don't disallow llms.txt in the first place.

### Pass

```text
User-agent: *
Allow: /
```

### Fail

```text
User-agent: *
Disallow: /llms.txt
```

## Sitemap

Full docs site index: [/sitemap.md](/sitemap.md).