docs: agent/crawler readiness — robots.txt, sitemap lastmod, ship the LLM surface#1616

Merged

asclearuc merged 9 commits into

rocketride-org:developfrom

EdwardLien0426:docs/RR-1615-agent-readiness

Jul 18, 2026

Commits on Jul 17, 2026

docs: warn in robots.txt that named groups shadow the wildcard
EdwardLien0426
committed
ci(docs): fetch full history so sitemap lastmod is real
EdwardLien0426
committed
fix(docs): tolerate CRLF front matter when stamping last_update
EdwardLien0426
committed
feat(docs): give llms.txt absolute URLs and per-link descriptions
EdwardLien0426
committed
fix(docs): scope front-matter parsing in gather (CodeRabbit)
EdwardLien0426
committed