You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
witness_prompt (crates/stella-pipeline/src/witness.rs) prepends a ~450-word fixed hard-requirements block to a per-call user message; the system message beside it (WITNESS_SYSTEM_PROMPT, pipeline.rs) is two sentences (~35 tokens). So the one verification role that runs a multi-step tool loop (author turn + repair turn, each with tool round-trips) pays uncached input for its entire instruction block on every call — exactly the failure the #1434ManagementPrompt split fixed for triage/verdict/guidance.
Second half (#1434's known caveat, management_prompt.rs): the split only pays off past provider cache minimums (Anthropic ≥1024 tokens). VERIFIER_INSTRUCTIONS measures ~522 tokens post-#1782-era additions, still below the minimum. Nothing measures or warns.
Measure: a small test or bench note recording each management role's stable-prefix token count vs the provider minimums, so "the split buys nothing here" is a stated fact instead of a hope. Consider whether padding via agents.<role>.prompt guidance belongs in docs.
Verify
Witness for 1: prompt-shape test asserting the hard-requirements text arrives as the system message and the user message starts with the volatile sections. Fails today.
Related
#1434, #1474; docs/spec/witness-protocol.md §7.3 (authoring is demand-driven — the block is paid only when a witness is warranted, which bounds the win but does not zero it).
Problem
witness_prompt(crates/stella-pipeline/src/witness.rs) prepends a ~450-word fixed hard-requirements block to a per-call user message; the system message beside it (WITNESS_SYSTEM_PROMPT,pipeline.rs) is two sentences (~35 tokens). So the one verification role that runs a multi-step tool loop (author turn + repair turn, each with tool round-trips) pays uncached input for its entire instruction block on every call — exactly the failure the #1434ManagementPromptsplit fixed for triage/verdict/guidance.Second half (#1434's known caveat,
management_prompt.rs): the split only pays off past provider cache minimums (Anthropic ≥1024 tokens).VERIFIER_INSTRUCTIONSmeasures ~522 tokens post-#1782-era additions, still below the minimum. Nothing measures or warns.Fix direction
agents.<role>.promptguidance belongs in docs.Verify
Witness for 1: prompt-shape test asserting the hard-requirements text arrives as the system message and the user message starts with the volatile sections. Fails today.
Related
#1434, #1474;
docs/spec/witness-protocol.md§7.3 (authoring is demand-driven — the block is paid only when a witness is warranted, which bounds the win but does not zero it).