Skip to content

feat(model): implement LLaMA-style RMSNorm and pre-norm residual architecture - #7

Merged
404khai merged 2 commits into
mainfrom
dev
Jul 29, 2026
Merged

feat(model): implement LLaMA-style RMSNorm and pre-norm residual architecture#7
404khai merged 2 commits into
mainfrom
dev

Conversation

@404khai

@404khai 404khai commented Jul 29, 2026

Copy link
Copy Markdown
Owner

Add OdysseyRMSNorm, residual helpers, NormConfig, and Phalanx cross-validation (ODY-0005) so train-side norms stay Spec-identical to the inference runtime.

404khai and others added 2 commits July 29, 2026 03:36
…itecture

Add OdysseyRMSNorm, residual helpers, NormConfig, and Phalanx cross-validation
(ODY-0005) so train-side norms stay Spec-identical to the inference runtime.

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@404khai
404khai merged commit cb9899c into main Jul 29, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant