Skip to content

feat(tests): add Mooncake production trace benchmark#94

Merged
GentleCold merged 1 commit into
masterfrom
feat/mooncake-trace-benchmark
Jul 16, 2026
Merged

feat(tests): add Mooncake production trace benchmark#94
GentleCold merged 1 commit into
masterfrom
feat/mooncake-trace-benchmark

Conversation

@GentleCold

Copy link
Copy Markdown
Owner

Summary

  • Replay the public Mooncake FAST'25 Tool/Agent trace with released arrival times, token lengths, and prefix-block relationships.
  • Support deterministic token prompts, context filtering, source windows, and online latency accounting.
  • Add focused schema, timing, prefix-sharing, coverage, and HTTP send-timing tests.

Motivation

DaseR needs a reproducible production-derived online workload rather than only synthetic request streams. The public Mooncake trace provides arrival timing and prefix sharing without exposing prompt text.

Test plan

  • Unit tests added / updated
  • PYTHONHASHSEED=0 pytest -q -m "not integration" --ignore=tests/integration --ignore=tests/connector/test_daser_connector.py --ignore=tests/connector/test_gds_transfer.py tests/ passes (362 passed)
  • Integration tests marked N/A; this PR adds an external service benchmark
  • Benchmark smoke: 100 selected rows, 98 eligible/completed, 2 explicit context skips, 0 failures
  • pre-commit run --all-files passes

Checklist

  • pre-commit run --all-files passes
  • Type hints and docstrings on all new/modified functions
  • New behavior includes tests
  • Existing CPU test suite passes

- Replay production arrival timing, token lengths, and deterministic shared prefix blocks.

- Support trace windows, context strata, and custom tokenizer loading.

- Record actual HTTP send timing and cover the benchmark contracts with focused tests.
@GentleCold
GentleCold merged commit 0c3bf12 into master Jul 16, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant