Currently, new checkpoints are trained but not evaluated against previous versions.
Problem:
- Cannot confirm if a new checkpoint is stronger
- AlphaZero requires model replacement only if a new network wins in evaluation matches
Impact:
Risk of model regression (worse networks replacing better ones)
Recommendation:
- Implement evaluation function:
- New model plays N games vs previous best
- Replace only if win-rate crosses threshold (e.g., 55–60%)
Currently, new checkpoints are trained but not evaluated against previous versions.
Problem:
Impact:
Risk of model regression (worse networks replacing better ones)
Recommendation: