Skip to content

Reuse sharded shared batch buffers - #51

Merged
bjmeetsfo merged 1 commit into
mainfrom
sharded-shared-batch-into
Sep 6, 2026
Merged

Reuse sharded shared batch buffers#51
bjmeetsfo merged 1 commit into
mainfrom
sharded-shared-batch-into

Conversation

@bjmeetsfo

Copy link
Copy Markdown
Collaborator

Summary

  • add ShardedMultiLayerCache::get_shared_batch_into for caller-owned result buffers
  • delegate colocated shared batches directly to the owning shard to avoid an extra merge allocation
  • add regression coverage for colocated and cross-shard result-buffer reuse

Validation

  • cargo fmt -- --check
  • cargo check --locked --no-default-features --examples -q
  • cargo test --locked --no-default-features "sharded_get_shared_batch" -- --test-threads=1
  • cargo test --locked --no-default-features -q
  • python3 -m py_compile tools/validate_backend_report.py tools/compare_backend_reports.py tools/emit_backend_operator_log.py tools/gen_metrics.py tools/validate_grafana_dashboard.py
  • python3 tools/validate_grafana_dashboard.py
  • git diff --check

@bjmeetsfo
bjmeetsfo merged commit f6ef7b3 into main Sep 6, 2026
4 of 5 checks passed
@bjmeetsfo
bjmeetsfo deleted the sharded-shared-batch-into branch September 6, 2026 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant