Skip to content

Document CUDA training equivalence and cleanup - #2

Merged
ferdinandobons merged 1 commit into
mainfrom
agent/document-cuda-training-cleanup
Jul 22, 2026
Merged

ferdinandobons merged 1 commit into
mainfrom
agent/document-cuda-training-cleanup

Conversation

@ferdinandobons

Copy link
Copy Markdown
Owner

What changed

  • document the measured quality equivalence between separate-head and fused QKV attention
  • record the requirements for an unambiguous clean training start
  • record the removal of the 14 obsolete experiment checkpoints and the retained production checkpoint policy

Why

The CUDA training guide should contain the final verified configuration and clearly distinguish a one-time cleanup from normal checkpoint retention and resume behavior.

Impact

This is a documentation-only update. It does not modify the model, training loop, dataset, or checkpoint format.

Validation

  • python -B tools/validate_learngpt.py
  • git diff --check

@ferdinandobons
ferdinandobons marked this pull request as ready for review July 22, 2026 06:16
@ferdinandobons
ferdinandobons merged commit 39005d5 into main Jul 22, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant