[https://nvbugs/6215107][fix] Namespace cnn_dailymail repo id in load_calib_dataset#15802
[https://nvbugs/6215107][fix] Namespace cnn_dailymail repo id in load_calib_dataset#15802Tabrizian wants to merge 1 commit into
Conversation
|
/bot run --disable-fail-fast |
|
PR_Github #56734 [ run ] triggered by Bot. Commit: |
…_calib_dataset
Newer huggingface_hub rejects the legacy bare "cnn_dailymail" dataset id
and raises HfUriError ("Repository id must be 'namespace/name'") while
resolving the dataset. load_calib_dataset() in convert_utils.py still
forwarded the bare id to datasets.load_dataset(), breaking the default
calibration path of the TensorRT convert scripts. This is the same root
cause already fixed for the ModelOpt path in quantize_by_modelopt.py.
Rewrite the bare id to the namespaced "abisee/cnn_dailymail" repo before
loading, mirroring the existing fix.
Signed-off-by: Iman Tabrizian <10105175+tabrizian@users.noreply.github.com>
d03a874 to
85881a7
Compare
|
/bot run --disable-fail-fast |
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthroughThis change modifies ChangesCalibration Dataset Loading
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
PR_Github #56736 [ run ] triggered by Bot. Commit: |
|
PR_Github #56736 [ run ] completed with state
|
|
/bot run --disable-fail-fast |
|
PR_Github #57399 [ run ] triggered by Bot. Commit: |
|
PR_Github #57399 [ run ] completed with state
|
|
/bot run --disable-fail-fast |
|
PR_Github #57789 [ run ] triggered by Bot. Commit: |
|
/bot kill |
|
The tests are being removed here: #15907 |
|
PR_Github #57791 [ ] completed with state |
|
PR_Github #57789 [ run ] completed with state |
Summary by CodeRabbit
cnn_dailymaildataset name in its newer namespaced form, helping avoid load failures with updated Hugging Face requirements.Description
Newer
huggingface_hubreleases reject the legacy barecnn_dailymaildataset id and raise:
The ModelOpt calibration path (
quantize_by_modelopt.get_calib_dataloader/get_nemo_calib_dataloader) was already fixed to rewrite the bare id to thenamespaced
abisee/cnn_dailymailrepo (#14930). However,tensorrt_llm/models/convert_utils.py::load_calib_dataset— the calibrationdataset loader used by the TensorRT-backend
convert.pyscripts (llama, gpt,qwen, chatglm, baichuan, bert, gemma, …), which all default
calib_datasetto
cnn_dailymail— still forwarded the bare id straight todatasets.load_dataset()and hit the sameHfUriError.This PR closes that remaining gap:
load_calib_datasetnow rewrites the barecnn_dailymailid to the namespacedabisee/cnn_dailymailrepo beforeloading, mirroring the existing ModelOpt fix. Already-namespaced ids (e.g.
ccdv/cnn_dailymail) and local dataset directories are unaffected.NVBug: https://nvbugs/6215107
Test Coverage
The change mirrors the already-merged ModelOpt fix (#14930) for the identical
root cause. It is exercised by the existing Triton-backend FP8 quantization
tests that originally hit the
HfUriError, e.g.:triton_server/test_triton_llm.py::test_llama_v3_speculative_decoding_blstriton_server/test_triton_rcca.py::test_rcca_bug_4714193as well as any TensorRT-backend
convert.pycalibration run that uses thedefault
--calib_dataset cnn_dailymail.PR Checklist
Please review the following before submitting your PR:
PR description clearly explains what and why.
PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.
Test cases are provided for new code paths (see test instructions)
If PR introduces API changes, an appropriate PR label is added - either
api-compatibleorapi-breaking. Forapi-breaking, includeBREAKINGin the PR title.Any new dependencies have been scanned for license and vulnerabilities
CODEOWNERS updated if ownership changes
Documentation updated as needed
Update tava architecture diagram if there is a significant design change in PR.
The reviewers assigned automatically/manually are appropriate for the PR.
Please check this after reviewing the above items as appropriate for this PR.
GitHub Bot Help
To see a list of available CI bot commands, please comment
/bot help.