chore: update robots.txt and sitemap.xml with content signals and las…

[devaraj3]

What changed

• Added Content-Signal: ai-train=no, search=yes, ai-input=yes to public/robots.txt

Why

• Cloudflare's AI-readiness scanner flagged this as missing. Unlike most of that report's suggestions, this one is genuinely applicable — declares that AI models shouldn't train on this site's content, while still allowing AI search/citation and agent access when a user is actively looking something up
• Deliberately skipped the rest of that scanner's report (API catalog, OAuth discovery, MCP Server Card, WebMCP, DNS-AID, Markdown negotiation) — all built for sites with backend APIs, protected resources, and user auth, none of which this site has. Publishing fake metadata for capabilities that don't exist isn't worth chasing a score

Validation

• npm run build — confirm robots.txt still copies through to dist/ correctly, Allow/Sitemap directives unaffected
• Live check after deploy: https://cadviewer.xyz/robots.txt shows the new line alongside the existing ones

Notes

• Purely additive, single-line change, no other files touched

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
cad-viewer	Ready	Preview	Aug 7, 2026 4:59am