docs: add llms.txt, robots.txt, JSON-LD schema markup

- Add docs/llms.txt for AI crawler discovery with per-plugin doc links
- Add docs/robots.txt explicitly allowing GPTBot, ClaudeBot, PerplexityBot and other AI crawlers
- Add docs/overrides/base.html with JSON-LD Organization + WebSite + SoftwareApplication structured data on index page
- Fix mkdocs.yml site_url/repo_url/repo_name from .local placeholder to Borda/AI-Rig; add copyright, social links, git-revision-date-localized + social plugins
- Convert plugin docs (codemap/develop/foundry/oss/research) from bare symlinks to files with metadata frontmatter + snippets include
- Add FAQ section to docs/index.md (7 questions covering validate-first, calibration bias, blast-radius, plugin independence)
- Add separate mdformat pre-commit hook for docs/ with mkdocs-specific extensions
- Add mkdocs-git-revision-date-localized-plugin to docs/requirements.txt

---
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>

Author: 3 people

.github/workflows/docs.yml

@@ -32,19 +32,26 @@ jobs:
     timeout-minutes: 10
     steps:
       - name: Checkout (with symlinks)
-        uses: actions/checkout@v4
+        uses: actions/checkout@v6
         with:
           # Symlinks in docs/ point to plugins/*/README.md.
           # Default checkout preserves symlinks on Linux — no extra flag needed,
           # but stated here explicitly so the dependency is visible.
           persist-credentials: false
+          # git-revision-date plugin requires full history
+          fetch-depth: 0
 
       - name: Set up Python 3.12
         uses: actions/setup-python@v5
         with:
           python-version: "3.12"
           # Pin to exact minor so the build is reproducible across runner updates.
 
+      - name: Install native imaging dependencies
+        # Material's social plugin uses CairoSVG, which needs the native Cairo
+        # shared library in addition to the Python package.
+        run: sudo apt-get update && sudo apt-get install --yes libcairo2
+
       - name: Install MkDocs dependencies
         # python -m pip ensures we use the pip that belongs to the selected Python,
         # not a system pip that may point elsewhere.
@@ -53,6 +60,9 @@ jobs:
       - name: Build docs (strict — warnings are errors)
         # --strict turns every MkDocs warning into a build failure.
         # Remove --strict only if a plugin emits unavoidable warnings.
+        env:
+          # Material for MkDocs documents this opt-out for its MkDocs 2.0 notice.
+          NO_MKDOCS_2_WARNING: "1"
         run: python -m mkdocs build --strict
 
       - name: Configure GitHub Pages

.pre-commit-config.yaml

@@ -87,7 +87,7 @@ repos:
     hooks:
       - id: mdformat
         name: 📝 mdformat (general)
-        exclude: ^plugins/(?!.*README\.md$)
+        exclude: ^(plugins/(?!.*README\.md$)|docs/)
         args: ["--number", "--wrap=no"]
         additional_dependencies:
           - mdformat-gfm
@@ -97,6 +97,17 @@ repos:
           - mdformat-beautysh
           - mdformat-admon
           - mdformat-web
+      - id: mdformat
+        name: 📝 mdformat (docs)
+        files: ^docs/
+        args: ["--number", "--wrap=no"]
+        additional_dependencies:
+          - mdformat-mkdocs
+          - mdformat-ruff
+          - mdformat-frontmatter
+          - mdformat-config
+          - mdformat-beautysh
+          - mdformat-web
 
   - repo: https://github.com/lycheeverse/lychee.git
     rev: lychee-v0.23.0

README.md

@@ -532,17 +532,6 @@ Without the plugin: pre-pass review is skipped gracefully (skills check with `cl
 
 </details>
 
-## 🔌 MCP Servers
-
-Two optional MCP servers are defined in `.mcp.json` (defined at the repo root; enable per-machine in `settings.local.json`). Both are **disabled by default**.
-
-| Server        | Purpose                                                                                                                                   | Enable                                       |
-| ------------- | ----------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------- |
-| **openspace** | Skill auto-evolution — reduces token consumption on repeated tasks via `execute_task`, `search_skills`, `fix_skill`, `upload_skill` tools | add `"openspace"` to `enabledMcpjsonServers` |
-| **colab-mcp** | GPU workloads via Google Colab (used by `/research:run --colab`)                                                                          | add `"colab-mcp"` to `enabledMcpjsonServers` |
-
-→ New-machine setup and full reference: [`.claude/README.md` → MCP Servers](.claude/README.md#-mcp-servers)
-
 ## 🛠 Recommended Add-ons
 
 ### Token Savings (RTK)

docs/README.md docs/NOTES.mddocs/README.md renamed to docs/NOTES.md

@@ -0,0 +1,5 @@
+---
+description: 'Claude Code codemap plugin: Python structural indexer providing import graphs, blast-radius scores, and function call graphs for instant codebase-aware agent context.'
+---
+
+--8<-- "plugins/codemap/README.md"

docs/codemap.md

@@ -0,0 +1,5 @@
+---
+description: 'Claude Code develop plugin: six validate-first workflows — plan, feature, fix, refactor, debug, review — with mandatory test gates for Python/ML projects.'
+---
+
+--8<-- "plugins/develop/README.md"

docs/codemap.md

@@ -0,0 +1,5 @@
+---
+description: 'Claude Code foundry plugin: 8 specialist agents, calibration benchmarks, config audit, and a self-improvement loop for professional AI-assisted Python/ML development.'
+---
+
+--8<-- "plugins/foundry/README.md"