feat(proxy): native TOON kernel + off-thread token counting + streaming replay fix - #6502

Draft

arsenyinfo wants to merge 19 commits into

mainfrom

rustify-proxy-toon-kernel

Commits on Jul 10, 2026

bench(proxy): add TOON kernel and streaming replay baseline benchmarks
arsenyinfo
committed
e2f74ef
fix(proxy): O(k^2) tool-call SSE replay and wrapper event loss
arsenyinfo
committed
8bd4c02
feat(archestra-rs): proxy-transform crate pair with TOON kernel
arsenyinfo
committed
0048810
feat(proxy): native TOON kernel cutover for the OpenAI adapter
arsenyinfo
committed
43b3af9
build(platform): wire @archestra/proxy-transform-rs into build, dev, and Docker
arsenyinfo
committed
8016877
feat(proxy): cut remaining six adapters over to the native TOON kernel
arsenyinfo
committed
5690f1e
bench(proxy): dual-backend TOON kernel benchmarks + criterion diagnostic
arsenyinfo
committed
93f91ae
perf(archestra-rs): replace toon-format encoder with own linear implementation
arsenyinfo
committed
4223cca
chore(proxy): drop @toon-format/toon; docs for native TOON pipeline
arsenyinfo
committed
4b5a87d
fix(archestra-rs): saturating batch-input sum in aggregate TOON budget
arsenyinfo
committed
c83fbf2
ci(proxy-transform-rs): drop clippy from check:ci to match sibling crates
arsenyinfo
committed
2eee55f
test(proxy): deduplicate the per-adapter TOON golden suites
arsenyinfo
committed
955c6d2
Merge remote-tracking branch 'origin/main' into rustify-proxy-toon-kernel
arsenyinfo
committed
9596568
chore: regenerate openapi/client types after merging main
arsenyinfo
committed
672b28e
docs: tighten TOON compression wording
arsenyinfo
committed
1e5a7ba
feat(proxy-transform): fuse cl100k token counting into the native kernel
arsenyinfo
committed
61d15ce
feat(proxy): count TOON keep/reject tokens off the event loop
arsenyinfo
committed
6a0badf
test(proxy): compare adversarial inputs in the native token parity test
arsenyinfo
committed
5c490b7
docs: token counting can come from the native TOON call
arsenyinfo
committed
287bf34

Navigation Menu

Uh oh!

feat(proxy): native TOON kernel + off-thread token counting + streaming replay fix - #6502

feat(proxy): native TOON kernel + off-thread token counting + streaming replay fix#6502
arsenyinfo wants to merge 19 commits into
mainfrom
rustify-proxy-toon-kernel

Commits on Jul 10, 2026

bench(proxy): add TOON kernel and streaming replay baseline benchmarks

fix(proxy): O(k^2) tool-call SSE replay and wrapper event loss

feat(archestra-rs): proxy-transform crate pair with TOON kernel

feat(proxy): native TOON kernel cutover for the OpenAI adapter

build(platform): wire @archestra/proxy-transform-rs into build, dev, and Docker

feat(proxy): cut remaining six adapters over to the native TOON kernel

bench(proxy): dual-backend TOON kernel benchmarks + criterion diagnostic

perf(archestra-rs): replace toon-format encoder with own linear implementation

chore(proxy): drop @toon-format/toon; docs for native TOON pipeline

fix(archestra-rs): saturating batch-input sum in aggregate TOON budget

ci(proxy-transform-rs): drop clippy from check:ci to match sibling crates

test(proxy): deduplicate the per-adapter TOON golden suites

Merge remote-tracking branch 'origin/main' into rustify-proxy-toon-kernel

chore: regenerate openapi/client types after merging main

docs: tighten TOON compression wording

feat(proxy-transform): fuse cl100k token counting into the native kernel

feat(proxy): count TOON keep/reject tokens off the event loop

test(proxy): compare adversarial inputs in the native token parity test

docs: token counting can come from the native TOON call