Skip to content
This repository was archived by the owner on Sep 1, 2026. It is now read-only.

Commit a463a86

Browse files
authored
Merge pull request #54 from gaelic-ghost/tests/live-elicitation-reproducers
tests: cover live tool input and mcp fixture
2 parents 3bcbf40 + 317db46 commit a463a86

6 files changed

Lines changed: 754 additions & 35 deletions

File tree

‎CONTRIBUTING.md‎

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -167,10 +167,15 @@ Run the answerable server-request coverage probes:
167167
scripts/run-live-codex-server-request-probes.sh
168168
```
169169

170-
That wrapper runs the deterministic command and permissions approval probes
171-
against the real app-server, then writes
170+
That wrapper runs the deterministic command approval, permissions approval,
171+
tool-user-input, and regular MCP elicitation fixture probes against the real
172+
app-server, then writes
172173
`tmp/live-codex-reports/live-server-request-family-coverage.json` with the
173-
current status of tool-user-input and MCP-elicitation live repro coverage.
174+
current status of answerable server-request family coverage. The regular MCP
175+
fixture proves the model-to-MCP tool path is deterministic, but that plain
176+
stdio MCP path does not deterministically surface `mcpServer/elicitation/request`
177+
through the app-server; the remaining MCP live gap is an app-connector MCP
178+
elicitation fixture.
174179

175180
That wrapper runs smoke probes, deterministic approval/server-request probes,
176181
the multi-turn create/edit/delete file scenario, and the disposable rollback

‎ROADMAP.md‎

Lines changed: 14 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -749,18 +749,21 @@ fake-transport unit coverage and an opt-in real app-server probe when the real
749749
runtime can be driven with a mock Responses provider.
750750

751751
- [x] Permissions approval / request-permissions tool path.
752-
- [ ] Tool user input.
753-
Status: deterministic fake-transport coverage exists for public routing and
754-
response behavior, and `scripts/run-live-codex-server-request-probes.sh` now
755-
records this family in the live coverage report. The remaining gap is a
756-
reliable current Codex mock Responses reproducer that forces
757-
`item/tool/requestUserInput` through the real app-server.
752+
- [x] Tool user input.
753+
Decision: deterministic fake-transport coverage proves public routing and
754+
response behavior, and the opt-in live server-request runner now drives the
755+
real app-server with a mock Responses `request_user_input` call in plan
756+
collaboration mode. The probe asserts `item/tool/requestUserInput` delivery,
757+
SwiftASB's JSON-RPC response, `serverRequest/resolved`, and terminal turn
758+
completion.
758759
- [ ] MCP server elicitation.
759-
Status: deterministic fake-transport coverage exists for public routing and
760-
response behavior, and `scripts/run-live-codex-server-request-probes.sh` now
761-
records this family in the live coverage report. The remaining gap is a local
762-
MCP server fixture that deterministically asks for elicitation during a live
763-
turn.
760+
Status: deterministic fake-transport coverage proves public routing and
761+
response behavior, and the opt-in live server-request runner now drives a
762+
regular stdio MCP fixture through the real app-server. That fixture proves the
763+
model-to-MCP tool path is deterministic, but the plain stdio MCP path does
764+
not deterministically surface `mcpServer/elicitation/request`; the remaining
765+
live gap is an app-connector MCP elicitation fixture matching upstream Codex
766+
app-server coverage.
764767
- [ ] Guardian denied-action approval after SwiftASB owns a stable public model.
765768
- [ ] Future promoted surfaces such as `hooks/list` and model-provider
766769
capabilities when they become public or observable contracts.

0 commit comments

Comments
 (0)