Skip to content

Run the 200-episode StatefulPuzzle grid + Phase 1 report #6

Description

@pixiiidust

What to build

Execute the full Phase 1 grid and produce the SC/DD surface report.

Run 200 episodes (SC 5/10/15/20/25 × DD 1/2/4/6, T=40, 10 episodes/cell) on deepseek/deepseek-v4-flash with both caps live (est. ~24,000 calls, $10–20, cap $50). Then produce the Phase 1 report: all four heatmaps, collapse-onset table, token/cost summary, and at least five sample traces where world state diverges before the first invalid action. Evaluate the plan §9 acceptance checklist explicitly (visible gradient/cliff, ≥10 paired collapse episodes, pct_ws_first > 0.50, no single API/JSON failure mode explaining the result). If heatmaps come back flat, follow the plan §10 playbook and file the findings on this issue instead of the report.

Reference: docs/plan.md §6, §7, §9, §10.

Acceptance criteria

  • 200 episodes completed, or a clear cost/API blocker documented on this issue
  • Total spend within the $50 cap; token/cost summary included
  • Phase 1 report with all §7 outputs committed under the configured output paths
  • §9 acceptance checklist evaluated line-by-line in the report
  • Parse-failure audit: json_parse_failure does not dominate the collapse region

Blocked by

Metadata

Metadata

Assignees

No one assigned

    Labels

    ready-for-agentAFK: an agent can implement and merge without human input

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions