Skip to content
This repository was archived by the owner on Jul 8, 2026. It is now read-only.

Auto scaling factor tuning on FP8 weight gradients reduction for Megatron-LM - #21

Open
Kan Wu (wkcn) wants to merge 3 commits into
Azure:mainfrom
wkcn:wgrad_auto_scaling
Open

Auto scaling factor tuning on FP8 weight gradients reduction for Megatron-LM#21
Kan Wu (wkcn) wants to merge 3 commits into
Azure:mainfrom
wkcn:wgrad_auto_scaling

wgrad-auto-scaling-ratio 1e-3

e30155c
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs