Unable to load any of {libcudnn_ops.so.9.1.0, libcudnn_ops.so.9.1, libcudnn_ops.so.9, libcudnn_ops.so}

[toanhuynhnguyen]

After installing:

pip install --force-reinstall "faster-whisper @ https://github.com/SYSTRAN/faster-whisper/archive/refs/heads/master.tar.gz"

I run the code:

from faster_whisper import WhisperModel, BatchedInferencePipeline

model = WhisperModel("medium", device="cuda", compute_type="float16")
batched_model = BatchedInferencePipeline(model=model)
segments, info = batched_model.transcribe("audio.mp3", batch_size=16)

for segment in segments:
    print("[%.2fs -> %.2fs] %s" % (segment.start, segment.end, segment.text))

I get this error:

Unable to load any of {libcudnn_ops.so.9.1.0, libcudnn_ops.so.9.1, libcudnn_ops.so.9, libcudnn_ops.so}
Invalid handle. Cannot load symbol cudnnCreateTensorDescriptor
Aborted (core dumped)

Can anyone help me on this error, thank you so much.

[jhj0517]

Currently there's a strict version matrix between faster-whisper and torch : #1086 (comment)

You have two options to fix this,

1. downgrade ctranslate2

pip install faster-whisper ctranslate2==4.4.0

2. Or install CUDA 12.4 and the latest torch

pip install faster-whisper torch --extra-index-url https://download.pytorch.org/whl/cu124

[toanhuynhnguyen]

Tried with: pip install faster-whisper torch --index-url https://download.pytorch.org/whl/cu124
I got the below error:
Looking in indexes: https://download.pytorch.org/whl/cu124
ERROR: Could not find a version that satisfies the requirement faster-whisper (from versions: none)
ERROR: No matching distribution found for faster-whisper

[jhj0517]

@toanhuynhnguyen Sorry, try with --extra-index-url :

pip install faster-whisper torch --extra-index-url https://download.pytorch.org/whl/cu124