From 156a86394dd43138c1a41bdd07bdd2c39e0d5936 Mon Sep 17 00:00:00 2001 From: Phongsiri Nirachornkul <89494368+bring-nirachornkul@users.noreply.github.com> Date: Thu, 31 Jul 2025 19:32:40 -0500 Subject: [PATCH] Update README.md add more description to number 3. correct the mistake in number 4 (changing 5 to 4) --- README.md | 26 ++++++++++++++++++++++++++ 1 file changed, 26 insertions(+) diff --git a/README.md b/README.md index fbcc47a..6878d58 100644 --- a/README.md +++ b/README.md @@ -199,29 +199,55 @@ The dataset is organized as: python humanml3d_272/prepare/download_Causal_TAE_t2m_272_ckpt.py ``` + 3. Train text to motion model: + > We provide scripts to train the original text to motion generation model with llama blocks, Two-Forward strategy and QK-Norm, using the motion latents encoded by the Causal TAE (trained in the first stage). + + 3.1 Get motion latents: + + > This step uses the pre-trained Causal TAE model to encode raw HumanML3D motion data into latent representations, saving them to humanml3d_272/t2m_latents for text-to-motion model training. + ```bash + python get_latent.py --resume-pth Causal_TAE/net_last.pth --latent_dir humanml3d_272/t2m_latents + ``` + 3.2 Download [sentence-T5-XXL model](https://huggingface.co/sentence-transformers/sentence-t5-xxl/tree/main) on Hugging Face: + ```bash + huggingface-cli download --resume-download sentence-transformers/sentence-t5-xxl --local-dir sentencet5-xxl/ + ``` + 3.3 Train text to motion generation model: + ```bash + bash TRAIN_t2m.sh ${NUM_GPUS} + ``` + > e.g., if you have 8 GPUs, run: bash TRAIN_t2m.sh 8 + + > The checkpoint will be stored at: + ``Experiments/t2m_model/`` + + > Tensorboard visualization: + ```bash + tensorboard --logdir='Experiments/t2m_model' + ``` 4. Train streaming motion generation model (MotionStreamer):