ai-readiness-check

A tiny CLI that checks whether AI assistants can read a website: which AI crawlers your robots.txt allows or blocks, and whether you serve an /llms.txt.

No install, no dependencies, Node 18+.

Usage

npx github:oguzhanglotier/ai-readiness-check yoursite.com

Or clone and run:

git clone https://github.com/oguzhanglotier/ai-readiness-check
node ai-readiness-check/index.js yoursite.com

Example

$ npx github:oguzhanglotier/ai-readiness-check reddit.com

AI readiness for https://reddit.com

  x GPTBot              BLOCKED   OpenAI training
  + OAI-SearchBot       ok        ChatGPT search
  + ChatGPT-User        ok        ChatGPT user fetch
  ...

  llms.txt: missing

  1 of 13 AI crawlers blocked. llms.txt missing.

What it checks, and what it does not

It reads robots.txt and reports site-level access for each known AI crawler. That is useful, and it is only half the story.

"Allowed" is a permission you wrote down. It is not the same as cited. An assistant can be allowed to read you and still never name you, and it can name a competitor who did the same original work you did not. And "allowed" is not "crawled": crawling is an event in your logs, which this cannot see.

For the full picture, what an assistant can actually quote from your pages, and whether ChatGPT, Gemini and Perplexity name you in your category, see Glotier. The crawler list and the measurements behind it live in ai-visibility-data, and a curated set of GEO resources in awesome-ai-visibility.

License

MIT. Built by the team behind Glotier.