Skip to content

[diskann-quantization] Teach PQ training to return a BasicTable. - #1467

Merged
Mark Hildebrand (hildebrandmw) merged 26 commits into
mainfrom
mhildebr/basic-table
Oct 8, 2026
Merged

Mark Hildebrand (hildebrandmw) merged 26 commits into
mainfrom
mhildebr/basic-table

Conversation

@hildebrandmw

Copy link
Copy Markdown
Contributor

Now that PQ training is starting to be more diskann-quantization centric, it makes sense to return a more useful type.

@hildebrandmw
Mark Hildebrand (hildebrandmw) added this pull request to stack #1468 October 6, 2026 23:57
@codecov-commenter

Codecov Comments Bot (codecov-commenter) commented Oct 7, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 92.63158% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.95%. Comparing base (27cdd95) to head (1aa710d).

Files with missing lines Patch % Lines
diskann-quantization/src/product/train.rs 87.17% 5 Missing ⚠️
diskann-quantization/src/product/tables/basic.rs 92.59% 2 Missing ⚠️
Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #1467      +/-   ##
==========================================
- Coverage   91.97%   90.95%   -1.03%     
==========================================
  Files         586      586              
  Lines      118178   118173       -5     
==========================================
- Hits       108700   107485    -1215     
- Misses       9478    10688    +1210     
Flag Coverage Δ
miri 90.95% <92.63%> (-1.03%) ⬇️
unittests 90.64% <92.47%> (-1.28%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
diskann-benchmark/src/exhaustive/product.rs 77.88% <100.00%> (+0.07%) ⬆️
diskann-providers/src/model/pq/pq_construction.rs 93.90% <100.00%> (-0.03%) ⬇️
diskann-quantization/src/product/tables/padded.rs 95.85% <100.00%> (-0.05%) ⬇️
diskann-quantization/src/views.rs 98.82% <100.00%> (+0.05%) ⬆️
diskann-quantization/src/product/tables/basic.rs 98.40% <92.59%> (-0.98%) ⬇️
diskann-quantization/src/product/train.rs 94.39% <87.17%> (-1.81%) ⬇️

... and 47 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

The implementation and consumers are consistent; only a non-blocking documentation typo remains.

Review effort: Balanced
Findings: 1 Low severity

Open (1)
What changed in this PR

Updates PQ training to return a directly usable BasicTable.

Changes:

  • Packs trained pivots into BasicTable.
  • Adds checked chunk and pivot accessors.
  • Simplifies benchmark and provider consumers.
File Description
diskann-quantization/​src/​views.rs Adds checked chunk access.
diskann-quantization/​src/​product/​train.rs Returns packed BasicTable.
diskann-quantization/​src/​product/​tables/​padded.rs Reuses chunk pivot accessor.
diskann-quantization/​src/​product/​tables/​basic.rs Adds per-chunk pivot views.
diskann-providers/​src/​model/​pq/​pq_construction.rs Consumes trained table directly.
diskann-benchmark/​src/​exhaustive/​product.rs Removes manual table construction.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread diskann-quantization/src/views.rs
Base automatically changed from mhildebr/pq-lookup to main October 8, 2026 15:12
@hildebrandmw
Mark Hildebrand (hildebrandmw) merged commit 907d405 into main Oct 8, 2026
31 checks passed
@hildebrandmw
Mark Hildebrand (hildebrandmw) deleted the mhildebr/basic-table branch October 8, 2026 18:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants