Skip to content

T94-T96: verify the fixed commit, Ponytail levels and possible bugs, detail follows the search - #79

Merged
imthi16 merged 7 commits into
task/T93-runs-ponytailfrom
task/T94-fix-verify-levels-search
Nov 4, 2026
Merged

imthi16 merged 7 commits into
task/T93-runs-ponytailfrom
task/T94-fix-verify-levels-search

Conversation

@imthi16

@imthi16 imthi16 commented Nov 4, 2026

Copy link
Copy Markdown
Owner

Stacked on #78 (and so on #76 and #75). Three changes to the dashboard.

  • T94 After a suggested fix is applied to a pull request, a new Verify now uses the pull request's current head. Before, it read the cached list, so the run was named for the old commit and its PASS did not show under the new one. A BLOCK run with a verified fix also has a "Verify the fixed commit" button. The verdict rules, the sealed evidence and the fix code are untouched. This was written by OpenCode from a prompt and then reviewed here.
  • T95 Clicking Ponytail review opens a choice of level, and picking one starts the review. Low is the over-engineering review as before. Medium also looks for small bugs on the lines the pull request adds, and high also for risky code (security, data loss, races). Bugs are a separate "Possible bugs" list, marked as read from the diff with no test run, and they post as their own review comments saying so. Low never keeps a bug; medium keeps at most 5, high at most 10. ponytail-diff and ponytail take --level.
  • T96 With a pull request selected, searching for another one left the first one's detail beside a list that no longer had it. The detail now follows the search, and a search with no match no longer says the repository has no pull requests.

Checked

  • Full suite on the three changes together: 937 passed, 1 skipped; ruff check is clean. This branch differs from the tested one only in one BUILDLOG sentence.
  • T94: a new test that fails without the fix and passes with it.
  • T95 and T96 in real Chrome on the installed app: the level picker (dark, light, 390 px wide), the request body carrying the level, the bugs list and the post button with the reply patched, and the search behaviour.

Not checked

  • How often a real model finds a real bug at medium or high, or how often it is wrong.
  • A real fix-then-verify cycle on GitHub with Docker: the flow is tested with fakes only.
  • Nothing was posted to GitHub from the Post button.
  • The Control Center (/) has none of this UI.

🤖 Generated with Claude Code

mdimthi and others added 4 commits November 4, 2026 10:53
…le bugs

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…s shown

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
A search with no match no longer says the repository has no pull requests.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-04T05:26:14.030225Z b33744f PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b33744f620

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

- Allow bug-only Ponytail reports through the dashboard posting guard
  (accept either findings or bugs).
- Fix frontend PR verify job tracking: /api/verify returns the job
  directly, and /api/job now reports the running PR job so polling works.
- Bind fixed-commit verification to the run's repository: the frontend
  sends the run id, and the backend rejects the request if the run's
  proof commits are not in the currently selected project.
- Regenerate ui/src/api/schema.json for the new VerificationRequest.run
  field.

Adds tests for bug-only posting, PR job API shape, and cross-project
run rejection.
@imthi16
imthi16 added this pull request to stack #81 November 4, 2026 06:30
@imthi16
imthi16 merged commit c410d8e into main Nov 4, 2026
5 checks passed
@imthi16
imthi16 deleted the task/T94-fix-verify-levels-search branch November 4, 2026 07:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants