docs: Link HSTU AOTI example from PyTorch backend README - #201
Conversation
Signed-off-by: Yingge He <yinggeh@nvidia.com>
Greptile SummaryThis PR adds a new
Confidence Score: 5/5This is a documentation-only change with no code modifications; safe to merge once the linked tutorials PR is live. The change is a single 12-line documentation addition. The prose is technically accurate, the markdown formatting is consistent with surrounding sections, and the HSTU subsection is correctly placed within the AOT Inductor section it describes. No files require special attention. Important Files Changed
Flowchart%%{init: {'theme': 'neutral'}}%%
flowchart TD
A[HSTU Generative Recommender Model] --> B[Export via torch.export]
B --> C[Compile via torch._inductor.compile_and_package]
C --> D[model.pt2 archive]
D --> E[Triton Model Repository]
E --> F["config.pbtxt: platform: 'torch_aoti'"]
F --> G[Triton PyTorch Backend — AOT Inductor]
G --> H[Inference Response]
Reviews (3): Last reviewed commit: "docs: Refine HSTU sequence encoder wordi..." | Re-trigger Greptile |
| [HSTU tutorial](https://github.com/triton-inference-server/tutorials/tree/main/Popular_Models_Guide/HSTU) | ||
| and the | ||
| [recsys-examples HSTU inference docs](https://github.com/NVIDIA/recsys-examples/blob/main/examples/hstu/inference/README.md). |
There was a problem hiding this comment.
Tutorial link may not resolve at merge time
The HSTU tutorial URL points to a path in the tutorials repo that depends on a companion PR which the author acknowledges has not yet merged. If this PR lands before that tutorials PR, readers will hit a 404 on the primary guide link. Consider merging the tutorials PR first, or gating this PR's merge on that URL becoming live.
Signed-off-by: Yingge He <yinggeh@nvidia.com>
Signed-off-by: Yingge He <yinggeh@nvidia.com>
What does the PR do?
Adds an HSTU (Generative Recommenders) subsection at the end of the AOT Inductor Support section, pointing readers at the tutorials HSTU guide and the recsys-examples HSTU inference docs for end-to-end
platform: "torch_aoti"serving.Checklist
<commit_type>: <Title>Commit Type:
Check the conventional commit type
box here and add the label to the github PR.
Related PRs:
Where should the reviewer start?
README.md—### HSTU (Generative Recommenders)under AOT Inductor SupportTest plan:
Confirm the new subsection sits after
MODEL_INIT_LIBRARYand before PyTorch 2.0 / TorchScriptAfter the tutorials HSTU guide lands, verify both linked URLs resolve
CI Pipeline ID:
N/A (docs-only)
Caveats:
Background
HSTU generative recommenders are served on Triton via Torch AOTI. This cross-link surfaces that path from the backend README without duplicating recsys-examples runbooks.
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)