Skip to content

Commit e440745

Browse files
committed
docs: mark what the roadmap work closed, and what it did not
Kani now runs in CI, so the proofs are discharged on every push rather than resting on a local run. Trust-boundary chaos is covered for the RPC and the policy document. Left explicitly open: paid human red-teaming, and a model that has been compromised rather than merely fooled.
1 parent 2861f5f commit e440745

1 file changed

Lines changed: 16 additions & 6 deletions

File tree

‎ROADMAP.md‎

Lines changed: 16 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -58,8 +58,12 @@ bytes). Green at 200k cases, no findings. This narrows the gap; it does not
5858
close it. Proving the decoder, or shrinking it until it can be proven, remains
5959
the top item in §8.
6060

61-
Kani also does not run on Windows, so contributors on that platform cannot
62-
reproduce the proofs locally. `just prove` is Linux/macOS only.
61+
Kani does not run on Windows, so contributors on that platform cannot
62+
reproduce the proofs locally — `just prove` is Linux/macOS only. *Addressed
63+
where it matters:* the proofs now run in CI on every push
64+
(`prove-safety.yml`, job `machine-checked proofs (kani)`), so "proven" is a
65+
result anyone can check in the Actions tab rather than a claim resting on
66+
someone having run it locally, once.
6367

6468
---
6569

@@ -141,10 +145,16 @@ them as a red team would be dishonest.
141145
What is missing:
142146

143147
- **Humans paid to break it**, with the transcripts published either way.
144-
- **Chaos at each trust boundary, not just the prompt.** A lying RPC. A
145-
corrupted policy file. A model that has been compromised rather than merely
146-
fooled. We test the prompt boundary hardest because it is the one we can
147-
simulate cheaply — which is a poor reason.
148+
Still outstanding, and the most valuable thing we do not have.
149+
- **Chaos at each trust boundary, not just the prompt.** *Addressed.*
150+
`tests/chaos_boundaries.rs` now covers the RPC and the policy document: a
151+
simulation slot ahead of the chain, a stale one, eight shapes of malformed
152+
evidence, an unreachable endpoint, a mint the endpoint will not describe,
153+
and fifteen hostile policy documents including a duplicate key whose second
154+
value is permissive. One invariant throughout — degrade to refusal, never to
155+
permission. All passed unchanged; the behaviour was already right, and is
156+
now pinned. **A model that has been compromised rather than merely fooled
157+
remains untested.**
148158
- **Attacking the human.** The approval step is the weakest link in the whole
149159
design and the least tested. Nobody has tried to construct a proposal that
150160
a tired operator approves at 11pm. We would expect that to succeed.

0 commit comments

Comments
 (0)