Skip to content

mlpstorage: pull vectordb aggregates into top-level results.{csv,json} #661

Description

@FileSystemGuy

Companion to #645 / #646 / kvcache aggregation issue — same shape, applied to vectordb.

vectordb aggregation is currently performed by an external vdb-aggregate binary invoked at mlpstorage_py/benchmarks/vectordbbench.py:508 — not Python code in mlpstorage_py. Its outputs (recall, QPS, latency percentiles) do not flow into Result.metrics, so the top-level results.{csv,json} restored by PR #620 has empty aggregate columns for vectordb runs.

Two implementation paths to decide when this is picked up:

  1. Read-and-forward — leave vdb-aggregate in place; add a step in report_generator._process_workload_groups that reads its output JSON and populates Result.metrics via the shared helper's vectordb branch.
  2. Reimplement — port vdb-aggregate math to Python inside the shared helper. Removes the external-binary dependency at the cost of a larger PR.

Related Rules.md context: §5.3.x — check whether the codified vectordb metric expectations prescribe an aggregation method or defer to the binary.

Related: #645, #646, kvcache aggregation issue.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions