Repository navigation
docs: roadmap — full-run check, then move and rename Role, before simplifying - #296
Merged
Merged
Conversation
…plifying Adds a first step to the pre-loop simplification: a replay of a saved full run (generation from transcripts, judging from judge logs, then scoring and pooling) as the guard for everything after it; then move Role to utils/role.py and rename it to USER/CHATBOT/JUDGE. Making first_speaker a Role is folded into phase 1(b), which rewrites the same functions. Code-only names are left to that rewrite; public output names to the layout and chart work. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This was referenced Oct 27, 2026
…/(c) rewrites Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Docs only. This adds a step 0 to the pre-loop simplification plan in
docs/roadmap.md(from #294).Full-run check (tests only, first). It replays a saved run of the recommended SI profile (2 user models × 100 conversations, judged and pooled) with no model calls:
The expected outputs come from one run of the check on current
release/2.1, because the saved run came from older code. This is the guard for every step after it.Move
Roletoutils/role.py, whicharchitecture.mdalready requires. Import lines only.Rename
Roleto the public u/c/j vocabulary (USER/CHATBOT/JUDGE). This answers the review question on feat: one first_speaker setting replaces persona_speaks_first #293.Making
first_speakeraRolemoves into phase 1(b), which rewrites the same functions. Code-only names are left to that rewrite. Public output names (folder prefixes,scores.jsonkeys) change with #276 and #286 as deliberate breaking changes.🤖 Generated with Claude Code