What is the problem this feature will solve?
Deployments migrating from the legacy pgvector-based retrieval backend to this service need the searchable document set to be unchanged — same documents, same selection logic. That is not automatic, and it is not currently checked anywhere.
It is also the safety net for statgpt-backend #536 (removing the deprecated DIAL file RAG backend): if scope silently narrowed during the swap, that removal would take answers with it, and the change would look like a quality regression rather than a missing-document problem.
What is the proposed feature or solution?
- Enumerate the document set indexed under the legacy backend and the set indexed here.
- Diff them and account for every difference.
- Confirm selection logic — filters, document types, date handling — behaves equivalently.
- Record the result, and use it as an input to the retrieval regression evaluation so a scope difference is not misread as a quality difference.
Acceptance criteria
What is the problem this feature will solve?
Deployments migrating from the legacy
pgvector-based retrieval backend to this service need the searchable document set to be unchanged — same documents, same selection logic. That is not automatic, and it is not currently checked anywhere.It is also the safety net for statgpt-backend #536 (removing the deprecated DIAL file RAG backend): if scope silently narrowed during the swap, that removal would take answers with it, and the change would look like a quality regression rather than a missing-document problem.
What is the proposed feature or solution?
Acceptance criteria