Skip to content

Validate benchmark protocol schema strictly - #3

Merged
nipunbatra merged 1 commit into
mainfrom
codex/bench-protocol-schema
Jul 17, 2026
Merged

Validate benchmark protocol schema strictly#3
nipunbatra merged 1 commit into
mainfrom
codex/bench-protocol-schema

Conversation

@nipunbatra

Copy link
Copy Markdown
Member

Stacked on #2. This PR is limited to configuration and protocol semantics: strict types, finite thresholds, real SHA-256 syntax, time-zone and timestamp validation, non-empty unique appliances/windows, and explicit target-domain access. T3 is now labeled as no target access, with schema support for separate unlabeled-target-mains and labeled-target-appliance protocols so SSL or k-shot results cannot be presented as zero-shot.

@nipunbatra
nipunbatra changed the base branch from codex/bench-result-contracts to main July 17, 2026 12:40
@nipunbatra
nipunbatra merged commit ccafb8e into main Jul 17, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant