Skip to content

Optimize flat scan by pre-filtering low-similarity results #1001

Closed

Description

@arrayka

Some clients currently filter out low-similarity results during post-processing.
We should evaluate whether applying this filter earlier—before inserting candidates into the priority queue—provides measurable performance benefits.
If it does, we should add support for this optimization to the flat scan algorithm.

Activity

  1. harsha-simhadri commented on May 1, 2026

    @harsha-simhadri
    Contributor

    We do have range search in the graph index. Could you be more specific about the request

  2. changed the title [-]Support for range search (search within a distance radius)[/-] [+]Flat scan should support filtering out low-similarity results[/+] on May 5, 2026
  3. changed the title [-]Flat scan should support filtering out low-similarity results[/-] [+]Optimize flat scan by pre-filtering low-similarity results[/+] on May 5, 2026
  4. arrayka commented on May 5, 2026

    @arrayka
    ContributorAuthor

    We do have range search in the graph index. Could you be more specific about the request

    Done. I've added details to the description.

  5. harsha-simhadri commented on May 5, 2026

    @harsha-simhadri
    Contributor

    Alex, this is still confusing. Initially this issue was about range search. Now range search does not figure in the title/description.

    Further, are you asking about fallback to point looks for very selective filters or that we change the graph walk to aid in better accuracy. They are different and complementary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions