Skip to content

Commit 4fa705c

Browse files
docs: fix 5 Copilot review issues in both READMEs
- Halted JSON: match actual CLI output format and reason string ("max_consecutive_failures reached (4)", not bare key + stats) - .evolution_state.json: label as "hard-stop state" not "budget counters" (also tracks iterations and consecutive_failures) - Ledger file list: add planner_input.json, executor_input.json/output, evaluator_input.json; clarify halted/ contains full run stats - --reset CLI comment: "Reset all hard-stop state" not "budget counters" - Config reference mission: align with SWE-Bench example, drop game-AI mission Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
1 parent 246f9a0 commit 4fa705c

2 files changed

Lines changed: 22 additions & 16 deletions

File tree

README.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -152,8 +152,7 @@ Baseline: 32.4%
152152
153153
[gen 21] STOP — 4 generations with no significant improvement
154154
155-
{"halted": true, "reason": "max_consecutive_failures", "iterations": 21,
156-
"total_usd": 34.10, "total_tokens": 9841200}
155+
{"halted": true, "reason": "max_consecutive_failures reached (4)"}
157156
```
158157

159158
```
@@ -170,20 +169,24 @@ Final: 32.4% → 76.4% same tier as Mistral Medium 3.5 (77.6%), Qwen3.6-27B (
170169

171170
```
172171
ledger/
173-
.evolution_state.json ← budget counters; survives restarts
172+
.evolution_state.json ← hard-stop state: iterations, failures, usd, tokens; survives restarts
174173
runs/
175174
0001/
176175
config.json ← full snapshot of your evolution.yml
177176
observation.json ← raw output of your evidence_sources commands
177+
planner_input.json ← goal + observation + history fed to planner
178178
plan.json ← LLM plan: summary · steps · expected_improvement
179+
executor_input.json ← plan + worktree path fed to executor
180+
executor_output.json ← executor result
181+
evaluator_input.json ← goal + patch + observation fed to evaluator
179182
patch.diff ← exact diff the executor applied
180183
candidate_commit.txt ← git SHA of the sandbox commit
181184
evaluation.json ← verdict + metrics + cost_usd + tokens_used
182185
decision.json ← accept / reject + reason
183186
reflection.json ← one-line summary injected into the next round
184187
0002/ ...
185188
halted/
186-
20260501T120000Z.json ← written when any hard stop fires
189+
20260501T120000Z.json ← full run stats (iterations, usd, tokens) written when any hard stop fires
187190
```
188191

189192
To undo every change from a session:
@@ -243,19 +246,19 @@ flowchart LR
243246

244247
```yaml
245248
# Required — what "better" means for your project
246-
mission: "Evolve the game AI to win at least 60% of games"
249+
mission: "Improve the agent harness so the model scores above 70% on the benchmark"
247250

248251
# How to measure the current state
249252
evidence_sources:
250253
- type: shell # stdout goes into observation.json
251-
command: "python3 scripts/tournament.py --games 20 --json"
254+
command: "python3 scripts/run_benchmark.py --sample 50 --json"
252255
- type: file # file contents go into observation.json
253256
path: "metrics.json"
254257

255258
# Only files under these paths may be changed
256259
mutation_scope:
257260
allowed_paths:
258-
- "ai/" # changes outside this list are auto-rejected
261+
- "src/agent_harness/" # changes outside this list are auto-rejected
259262

260263
# When to stop
261264
hard_stops:
@@ -309,7 +312,7 @@ evolution-kernel --config evolution.yml --repo /path/to/repo --ledger /tmp/ledge
309312
# Single round
310313
evolution-kernel --config evolution.yml --repo /path/to/repo --ledger /tmp/ledger
311314

312-
# Reset budget counters after a halt
315+
# Reset all hard-stop state (iterations, failures, budget) for a fresh session
313316
evolution-kernel --ledger /tmp/ledger --reset
314317
```
315318

README.zh.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -152,8 +152,7 @@ evolution-kernel --config evolution.yml --repo /path/to/project --ledger /tmp/le
152152
153153
[gen 21] STOP — 连续 4 代无显著改进
154154
155-
{"halted": true, "reason": "max_consecutive_failures", "iterations": 21,
156-
"total_usd": 34.10, "total_tokens": 9841200}
155+
{"halted": true, "reason": "max_consecutive_failures reached (4)"}
157156
```
158157

159158
```
@@ -170,20 +169,24 @@ evolution-kernel --config evolution.yml --repo /path/to/project --ledger /tmp/le
170169

171170
```
172171
ledger/
173-
.evolution_state.json ← 预算计数器,进程重启后依然有效
172+
.evolution_state.json ← hard-stop 完整状态:迭代数、连续失败数、usd、tokens;进程重启后不丢失
174173
runs/
175174
0001/
176175
config.json ← 你的 evolution.yml 完整快照
177176
observation.json ← evidence_sources 命令的原始输出
177+
planner_input.json ← 喂给规划器的目标 + 观察 + 历史
178178
plan.json ← LLM 方案:摘要 · 步骤 · 预期改进
179+
executor_input.json ← 喂给执行器的方案 + worktree 路径
180+
executor_output.json ← 执行器结果
181+
evaluator_input.json ← 喂给评估器的目标 + patch + 观察
179182
patch.diff ← 执行器实际应用的 diff
180183
candidate_commit.txt ← 沙箱 commit 的 git SHA
181184
evaluation.json ← 评估结果 + 指标 + cost_usd + tokens_used
182185
decision.json ← 接受 / 拒绝 + 原因
183186
reflection.json ← 注入下一轮历史的一行摘要
184187
0002/ ...
185188
halted/
186-
20260501T120000Z.json ← 任何 hard stop 触发时写入
189+
20260501T120000Z.json ← 任何 hard stop 触发时写入完整运行统计(迭代数、usd、tokens)
187190
```
188191

189192
回滚一个 session 的所有变更:
@@ -243,19 +246,19 @@ flowchart LR
243246

244247
```yaml
245248
# 必填——"更好"对你的项目意味着什么
246-
mission: "让游戏 AI 对内置对手的胜率达到 60% 以上"
249+
mission: "改进 agent harness,让模型在基准测试上的分数超过 70%"
247250

248251
# 如何衡量当前状态
249252
evidence_sources:
250253
- type: shell # stdout 写入 observation.json
251-
command: "python3 scripts/tournament.py --games 20 --json"
254+
command: "python3 scripts/run_benchmark.py --sample 50 --json"
252255
- type: file # 文件内容写入 observation.json
253256
path: "metrics.json"
254257

255258
# 只有这些路径下的文件允许被修改
256259
mutation_scope:
257260
allowed_paths:
258-
- "ai/" # 不在列表里的改动自动拒绝
261+
- "src/agent_harness/" # 不在列表里的改动自动拒绝
259262

260263
# 何时停止
261264
hard_stops:
@@ -309,7 +312,7 @@ evolution-kernel --config evolution.yml --repo /path/to/repo --ledger /tmp/ledge
309312
# 只跑一轮
310313
evolution-kernel --config evolution.yml --repo /path/to/repo --ledger /tmp/ledger
311314

312-
# 触发 halt 后重置预算计数器
315+
# 重置全部 hard-stop 状态(迭代数、失败数、预算),开始新 session
313316
evolution-kernel --ledger /tmp/ledger --reset
314317
```
315318

0 commit comments

Comments
 (0)