remove custom-metadata.md; canonical path is vdbs + notebooks

[kheiss-uwzoo]

Summary

• Remove docs/docs/extraction/custom-metadata.md (duplicate of notebook + VDB README content added in align metadata docs with VDB filtering guide #2108).
• Expand Metadata and filtering on �dbs.md with a short overview and links to the worked notebooks.
• Drop the separate MkDocs nav entry; add redirect custom-metadata.md -> �dbs.md#metadata-and-filtering.
• Update cross-links and doc-snippet test registry.

Follows Julio's NVBugs 6205401 guidance: VDB/metadata facts live on �dbs.md; runnable walkthroughs stay in notebooks.

Notebooks (canonical examples)

• metadata_and_filtered_search.ipynb
• nemo_retriever_retriever_query_metadata_filter.ipynb

Operator/API reference remains in nemo_retriever/src/nemo_retriever/vdb/README.md.

Test plan

• MkDocs build; confirm redirect from old custom-metadata URL
• Nav no longer lists a separate Custom metadata page
• Notebook links resolve on GitHub

[greptile-apps]

Greptile Summary

This PR removes custom-metadata.md and integrations-langchain-llamaindex-haystack.md, consolidating metadata guidance into vdbs.md#metadata-and-filtering and framework examples into notebooks/index.md, with MkDocs redirect rules covering the old URLs.

• Source-path corrections in vdbs.md update stale GitHub links (e.g. vdb/operators.py → operators/vdb.py, vdb/adt_vdb.py → common/vdb/adt_vdb.py); the old paths no longer exist in the repo, so these are accurate fixes.
• The doc-snippet test registry swaps the deleted custom-metadata.md for vdbs.md; Retriever() unsupported-kwargs coverage is preserved via the notebook entry already in _PUBLIC_RETRIEVER_DOCS.

Confidence Score: 5/5

Documentation-only restructuring with no logic changes; the deleted pages are fully covered by redirect rules and the cross-links all point to files that exist.

All changed files are Markdown docs, a YAML nav config, and a test registry update. The source-path corrections in vdbs.md are verified against the actual repo layout (old paths absent, new paths confirmed present). Redirect targets and anchor IDs were checked and are valid. The test change correctly substitutes the deleted file with its replacement in the snippet-validation registry.

docs/docs/extraction/vdbs.md — the #metadata-and-filtering section content and docs/docs/extraction/notebooks/index.md — missing notebook link were flagged in prior review threads and remain open items.

Important Files Changed

Filename	Overview
docs/docs/extraction/vdbs.md	Source-path corrections (vdb/ → operators/ and common/vdb/) verified against actual repo structure; metadata section reduced to a single sentence (previously flagged in review thread)
docs/mkdocs.yml	Nav renumbered and two pages removed; hash-fragment redirects for custom-metadata.md and integrations page follow the same pattern used by existing redirects in this file
nemo_retriever/tests/test_src_documentation_snippets.py	Registry updated from deleted custom-metadata.md to vdbs.md; Retriever() unsupported-kwargs coverage maintained through the notebook entry already in _PUBLIC_RETRIEVER_DOCS
docs/docs/extraction/notebooks/index.md	Entry text updated and cross-link to vdbs.md added; metadata_and_filtered_search.ipynb still absent (flagged in existing review thread)
docs/docs/extraction/custom-metadata.md	File deleted; all content was duplicate of notebook and VDB README; redirect rule added in mkdocs.yml
docs/docs/extraction/integrations-langchain-llamaindex-haystack.md	File deleted; redirect to notebooks/index.md added; LangChain and LlamaIndex notebooks still linked from notebooks/index.md

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    A["custom-metadata.md\n(deleted)"] -->|redirect| B["vdbs.md\n#metadata-and-filtering"]
    C["integrations-langchain-\nllamaindex-haystack.md\n(deleted)"] -->|redirect| D["notebooks/index.md"]

    E["workflow-agentic-retrieval.md"] -->|cross-link updated| B
    F["workflow-e2e-blueprints.md"] -->|cross-link updated| D
    G["agentic-retrieval-concept.md"] -->|cross-link updated| D
    H["overview.md"] -->|cross-link updated| D
    I["deployment-options.md"] -->|removed link to| C

    B -->|references| J["nemo_retriever_retriever_query_\nmetadata_filter.ipynb\n(notebook)"]
    D -->|lists| J

    K["test_src_documentation_snippets.py"] -->|registry: custom-metadata.md → vdbs.md| B

Loading

%%{init: {'theme': 'base', 'themeVariables': {"darkMode": true, "background": "#0d1117", "primaryColor": "#21262d", "primaryTextColor": "#e6edf3", "primaryBorderColor": "#8b949e", "lineColor": "#8b949e", "textColor": "#e6edf3", "edgeLabelBackground": "#161b22", "actorBkg": "#21262d", "actorBorder": "#8b949e", "actorTextColor": "#e6edf3", "actorLineColor": "#8b949e", "signalColor": "#8b949e", "signalTextColor": "#e6edf3", "noteBkgColor": "#373320", "noteBorderColor": "#d4a72c", "noteTextColor": "#f0e6c0", "labelBoxBkgColor": "#21262d", "labelBoxBorderColor": "#8b949e", "labelTextColor": "#e6edf3", "loopTextColor": "#e6edf3", "activationBkgColor": "#30363d", "activationBorderColor": "#8b949e"}}}%%
flowchart TD
    A["custom-metadata.md\n(deleted)"] -->|redirect| B["vdbs.md\n#metadata-and-filtering"]
    C["integrations-langchain-\nllamaindex-haystack.md\n(deleted)"] -->|redirect| D["notebooks/index.md"]

    E["workflow-agentic-retrieval.md"] -->|cross-link updated| B
    F["workflow-e2e-blueprints.md"] -->|cross-link updated| D
    G["agentic-retrieval-concept.md"] -->|cross-link updated| D
    H["overview.md"] -->|cross-link updated| D
    I["deployment-options.md"] -->|removed link to| C

    B -->|references| J["nemo_retriever_retriever_query_\nmetadata_filter.ipynb\n(notebook)"]
    D -->|lists| J

    K["test_src_documentation_snippets.py"] -->|registry: custom-metadata.md → vdbs.md| B

Loading

_{Reviews (27): Last reviewed commit: "Merge upstream/main into docs/consolidat..." | Re-trigger Greptile}

[kheiss-uwzoo]

Opened eng follow-up for Helm deployment guidance in the metadata-filtering notebook: #2261 (assigned @jioffe502 and @jdye64).

Per review: \�dbs.md#metadata-and-filtering\ stays notebook-only (no sidecar / retriever-service prose on the docs page). Part B of \examples/nemo_retriever_retriever_query_metadata_filter.ipynb\ will cover \POST /v1/ingest/sidecar, job-based ingest, and \meta_dataframe_id.