Skip to content

Report nested observations - #86

Merged
Anionix merged 2 commits into
mainfrom
codex/issue-82-reported-observations
Jul 14, 2026
Merged

Report nested observations#86
Anionix merged 2 commits into
mainfrom
codex/issue-82-reported-observations

Conversation

@Anionix

@Anionix Anionix commented Jul 14, 2026

Copy link
Copy Markdown
Owner

Fixes #82

  • transition benchmarked format entries to REPORTED after rendering
  • transition benchmarked claims and prompt observations to REPORTED
  • leave FAILED, UNSUPPORTED, and unmeasured observations unchanged
  • preserve idempotent report rerenders

Verification: 58 tests passed.

@Anionix

Anionix commented Jul 14, 2026

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c3dd242fc4

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/format_bench/report.py
@Anionix

Anionix commented Jul 14, 2026

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Already looking forward to the next diff.

Reviewed commit: 704d2c8a9a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@Anionix
Anionix merged commit 3f51431 into main Jul 14, 2026
4 checks passed
@Anionix
Anionix deleted the codex/issue-82-reported-observations branch July 14, 2026 04:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Propagate REPORTED state to nested observations

1 participant