Add tensor parallelism support for HF wrapper forward and lm_eval integration - #340

Merged

bigximik merged 12 commits into

mainfrom

denis/evaluate_tp

Sep 29, 2025

Commits on Jul 30, 2025

added model and sequence parallel to forward
bigximik
committed

Commits on Jul 31, 2025

added asserts for pipeline and sequence parallel to be 1 as not supported in forward
bigximik
committed

Commits on Aug 7, 2025

changed logits gathering for only tp and stp dimensions
bigximik
committed

Commits on Aug 19, 2025

added extended wait in key places, fix to right batch config, fix move to right gpu after scatter
bigximik
committed

Commits on Aug 20, 2025

Commits on Sep 15, 2025

Merge branch 'main' of github.com:ServiceNow/Fast-LLM into denis/evaluate_tp
bigximik
committed

Commits on Sep 18, 2025

Merge branch 'main' into denis/evaluate_tp
jlamypoirier
committed