Skip to content

Add cross-corpus robustness milestone#11

Merged
almondsun merged 1 commit into
mainfrom
agent/cross-corpus-robustness
Jul 13, 2026
Merged

Add cross-corpus robustness milestone#11
almondsun merged 1 commit into
mainfrom
agent/cross-corpus-robustness

Conversation

@almondsun

Copy link
Copy Markdown
Owner

Summary

  • add a bounded deterministic Project Gutenberg body extractor with contract tests
  • add fixed Peter Pan character and ByteBPE512 experiment configs
  • document milestone 024 results, provenance, generation diagnostics, and external-validity theory

Result

ByteBPE512 reaches best full-validation BPC 2.153930 versus 2.172051 for the character control on near-size-matched Peter Pan, a narrow 0.83% advantage. The direction replicates the Alice result, but one seed does not establish a stable effect size.

Validation

  • make PYTHON=.venv/bin/python check: 146 passed, 91.51% coverage
  • make PYTHON=.venv/bin/python audit: no known vulnerabilities
  • deterministic extraction checksum reproduced
  • git diff --check

@almondsun
almondsun marked this pull request as ready for review July 13, 2026 04:44
Copilot AI review requested due to automatic review settings July 13, 2026 04:44

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@almondsun
almondsun merged commit eae9dc0 into main Jul 13, 2026
5 checks passed
@almondsun
almondsun deleted the agent/cross-corpus-robustness branch July 13, 2026 04:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants