Skip to content

Preload cuDNN/cuBLAS for the WhisperX encoder - #14

Merged
hollygrimm merged 1 commit into
mainfrom
cudnn-preload
Jul 17, 2026
Merged

Preload cuDNN/cuBLAS for the WhisperX encoder#14
hollygrimm merged 1 commit into
mainfrom
cudnn-preload

Conversation

@hollygrimm

Copy link
Copy Markdown
Collaborator

ctranslate2 dlopens libcudnn_cnn.so.9 by soname; pip's nvidia wheels aren't on the loader path, so the whisper encoder aborted (SIGABRT) on real speech — synthetic VAD-empty audio never reached the encoder, masking it. Preload with RTLD_GLOBAL before the heavy import. Verified end-to-end on real audio with diarization.

🤖 Generated with Claude Code

https://claude.ai/code/session_015NjFiMWkgrVy4foGF1Zbax

ctranslate2 dlopens libcudnn_cnn.so.9 by soname; the nvidia wheels'
libs aren't on the loader path, aborting the whisper encoder (SIGABRT)
on real speech — VAD-empty audio never hit the encoder, which is why
the synthetic smoke test passed. Preload with RTLD_GLOBAL from
site-packages before the heavy import. Verified on real audio with
diarization.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015NjFiMWkgrVy4foGF1Zbax
@hollygrimm
hollygrimm merged commit ca98cc8 into main Jul 17, 2026
2 checks passed
@hollygrimm
hollygrimm deleted the cudnn-preload branch July 17, 2026 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant