Skip to content

build(deps): [2.6] update Tantivy for phrase-match optimizations - #54029

Merged
sre-ci-robot merged 2 commits into
milvus-io:2.6from
zhengbuqian:build/tantivy-phrase-optimizations-2.6
Oct 10, 2026
Merged

sre-ci-robot merged 2 commits into
milvus-io:2.6from
zhengbuqian:build/tantivy-phrase-optimizations-2.6

Conversation

@zhengbuqian

@zhengbuqian zhengbuqian commented Oct 8, 2026 •

Copy link
Copy Markdown
Collaborator

pr: #54023

Advance the locked Tantivy 0.23 revision to fef3c2a5748bdb2b2c2f8ca1d9fc125a0d1e8b71, including the no-scoring phrase optimizations from #30, #33, and the repeated-term correctness fix from #34. For example, a a with slop 1 must not match a document containing only one a. Milvus's phrase-match collectors disable scoring and reach the corrected path.

Revision and scope

  • Verified Fix Jenkins CI remove local docker images bug #34 merged at 2026-10-10 03:14:27 UTC. Its merge commit is the selected revision and was the upstream default branch main HEAD when this update began.
  • Its sole parent is the previous PR pin 596a0f65ba24dd94b15ef97b9b9a909b610b8f22 ([BUG] Fix Jenkins CI remove local docker images bug  #33), whose parent is 9ce00de9a822b2a1cfa8d2b91454d7ae017969b9 ([BUG] Some troubleshoot messages in Milvus do not provide enough information #30). GitHub state and local Git ancestry agree.
  • This follow-up changes only nine Tantivy workspace source hashes in internal/core/thirdparty/tantivy/tantivy-binding/Cargo.lock (+9/-9). The upstream increment changes four phrase-query source files, with no manifest changes.
  • The complete PR remains lockfile-only (+20/-11 from the branch base), retaining the original rust-stemmers 1.3.0 addition required by modern Tantivy. Legacy Tantivy 0.21.1, its rust-stemmers 1.2.0 pin, all registry packages, and Cargo.toml remain unchanged.

Current local validation (2026-10-10, fef3c2a57)

Used the separate 2.6 worktree and target directory, with the branch's default features and release profile; no master or 3.0 build outputs were reused.

  • cargo +1.89 build --release --locked: passed. Generated files unchanged.
  • Binding release text/phrase tests: 3 passed.
  • Analyzer tests: 4 passed, 1 failed. The unchanged legacy index_writer_v5::analyzer::analyzer::tests::test_lindera_analyzer requests IPADIC while the default feature set enables no dictionary, yielding lindera tokenizer with invalid dict_kind. This reproduces the previously documented configuration limitation; legacy code and pins are unchanged.
  • Shared selected upstream revision tested this round: 919 library tests passed, 5 ignored; 39 phrase tests passed, 1 ignored, including Fix Jenkins CI remove local docker images bug #34's repeated-term, property, clone-cache and explain regressions.
  • git diff --check and parsed lockfile comparison: passed; only nine source hashes changed in this follow-up.

Earlier results at 596a0f65 are historical. No full release-branch C++/Go build, live-cluster E2E or local performance benchmark was run. No test/source adjustments or #53986 changes are included. Upstream #34 reports some performance regressions; no universal speedup or measured Milvus gain is claimed. The fix covers unscored literal PhraseQuery, not scored, regex or prefix phrases.

Backport master PR milvus-io#54023. Advance the locked Tantivy 0.23 revision to the
merge containing zilliztech/tantivy#30 and #33, preserving the legacy
Tantivy and rust-stemmers pins.

(cherry picked from commit 53af8ef)

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
@sre-ci-robot sre-ci-robot added the size/M Denotes a PR that changes 30-99 lines. label Oct 8, 2026
@mergify mergify Bot added the dco-passed DCO check passed. label Oct 8, 2026
@sre-ci-robot sre-ci-robot added the do-not-merge/need-merge-master-first any pr merge to release branch need to merge master first label Oct 8, 2026
@sre-ci-robot

Copy link
Copy Markdown
Contributor

[ci-v2-notice]
Notice: New ci-v2 system is enabled for this PR.

To rerun ci-v2 checks, comment with:

  • /ci-rerun-code-check // for ci-v2/code-check
  • /ci-rerun-code-check-macos // for Code Checker MacOS (GitHub Actions)
  • /ci-rerun-build // for ci-v2/build
  • /ci-rerun-build-all // for ci-v2/build-all (multi-arch builds)
  • /ci-rerun-buildenv // for ci-v2/build-env (build milvus-env builder images; update .env after the new tag is ready)
  • /ci-rerun-ut-integration // for ci-v2/ut-integration, will rerun ci-v2/build
  • /ci-rerun-ut-go // for ci-v2/ut-go, will rerun ci-v2/build
  • /ci-rerun-ut-cpp // for ci-v2/ut-cpp
  • /ci-rerun-ut // for all ci-v2/ut-integration, ci-v2/ut-go, ci-v2/ut-cpp, will rerun ci-v2/build
  • /ci-rerun-e2e-default // for ci-v2/e2e-default
  • /ci-rerun-e2e-amd // for ci-v2/e2e-amd (e2e pool dispatcher)
  • /ci-rerun-e2e-dist-wp // for ci-v2/e2e-dist-wp (Tencent distributed woodpecker-service boundary)
  • /ci-rerun-build-ut-cov // for ci-v2/build-ut-cov (build + unit tests in one pipeline)
  • /ci-rerun-build-ut-cov-tcus // force TC-US build-ut-cov; respects Portal limit, never falls back to AWS
  • /ci-rerun-gosdk // for ci-v2/go-sdk (Go SDK E2E tests, ARM)
  • /ci-rerun-gosdk-std // for ci-v2/go-sdk-std (Go SDK E2E, standalone)
  • /ci-rerun-gosdk-dist-wp // for ci-v2/go-sdk-dist-wp (Go SDK E2E, distributed + Woodpecker service)

If you have any questions or requests, please contact @zhikunyao.

@sre-ci-robot sre-ci-robot added the do-not-merge/need-milestone generate by v2-label-manager label Oct 8, 2026
@sre-ci-robot

Copy link
Copy Markdown
Contributor

[INFO] PR Label Summary by Default
[FAILED] PR #54023 not merged

[WARNING] Milestone not set

You can set milestone by commenting:
/set-milestone
Example:
/set-milestone 2.5.0

Use /refresh-label to update related check and label manually

@codecov

codecov Bot commented Oct 8, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.13%. Comparing base (cb08db0) to head (18a8552).
⚠️ Report is 1171 commits behind head on 2.6.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##              2.6   #54029      +/-   ##
==========================================
+ Coverage   76.99%   79.13%   +2.14%     
==========================================
  Files        1700     2058     +358     
  Lines      262533   350600   +88067     
==========================================
+ Hits       202142   277463   +75321     
- Misses      53550    64827   +11277     
- Partials     6841     8310    +1469     
Components Coverage Δ
Client 79.55% <75.29%> (+1.40%) ⬆️
Core 86.37% <ø> (+4.15%) ⬆️
Go 76.54% <60.30%> (+1.15%) ⬆️
see 1597 files with indirect coverage changes
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@sre-ci-robot sre-ci-robot added the low-code-coverage add test-label from zhikun, diff coverage > 80% label Oct 8, 2026
@zhengbuqian

Copy link
Copy Markdown
Collaborator Author

/ci-rerun-e2e-default

@aoiasd

aoiasd commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

/lgtm

@sre-ci-robot

Copy link
Copy Markdown
Contributor

[INFO] PR Label Summary by Default
[FAILED] PR #54023 not merged

[WARNING] Milestone not set

You can set milestone by commenting:
/set-milestone
Example:
/set-milestone 2.5.0

Use /refresh-label to update related check and label manually

1 similar comment
@sre-ci-robot

Copy link
Copy Markdown
Contributor

[INFO] PR Label Summary by Default
[FAILED] PR #54023 not merged

[WARNING] Milestone not set

You can set milestone by commenting:
/set-milestone
Example:
/set-milestone 2.5.0

Use /refresh-label to update related check and label manually

@mergify mergify Bot added the ci-passed label Oct 9, 2026
Advance the nine modern Tantivy workspace pins to fef3c2a57 (zilliztech/tantivy#34). Preserve all other dependencies. Master PR: milvus-io#54023.

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
@sre-ci-robot sre-ci-robot added low-code-coverage add test-label from zhikun, diff coverage > 80% and removed lgtm low-code-coverage add test-label from zhikun, diff coverage > 80% labels Oct 10, 2026
@zhengbuqian zhengbuqian added this to the 2.6.25 milestone Oct 10, 2026
@zhengbuqian zhengbuqian removed the do-not-merge/need-milestone generate by v2-label-manager label Oct 10, 2026
@aoiasd

aoiasd commented Oct 10, 2026

Copy link
Copy Markdown
Contributor

/lgtm

@sre-ci-robot

Copy link
Copy Markdown
Contributor

[INFO] PR Label Summary by Default
[FAILED] PR #54023 not merged

Use /refresh-label to update related check and label manually

1 similar comment
@sre-ci-robot

Copy link
Copy Markdown
Contributor

[INFO] PR Label Summary by Default
[FAILED] PR #54023 not merged

Use /refresh-label to update related check and label manually

@sparknack

Copy link
Copy Markdown
Contributor

/approve

@sre-ci-robot

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sparknack

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot

Copy link
Copy Markdown
Contributor

[approval-status] effective-owner-approvals=1 [sparknack(comment)]; do-not-merge/disable-approve-self=not-required; do-not-merge/doc-need-two-approve=disabled; ignored=[none]

@sre-ci-robot

Copy link
Copy Markdown
Contributor

[INFO] PR Label Summary by Default
[FAILED] PR #54023 not merged

Use /refresh-label to update related check and label manually

@zhengbuqian zhengbuqian removed the do-not-merge/need-merge-master-first any pr merge to release branch need to merge master first label Oct 10, 2026
@sre-ci-robot
sre-ci-robot merged commit c7b0177 into milvus-io:2.6 Oct 10, 2026
17 of 19 checks passed
@zhengbuqian
zhengbuqian deleted the build/tantivy-phrase-optimizations-2.6 branch October 10, 2026 06:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved ci-passed dco-passed DCO check passed. lgtm low-code-coverage add test-label from zhikun, diff coverage > 80% size/M Denotes a PR that changes 30-99 lines.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants