Couldn't find Cuda Dll

[bigfordy1983]

Which OS are you using?

• OS: Windows 11 , Python 3.11.9

Cmd Log is thus:

Use "faster-whisper" implementation
Device "cuda" is detected
Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch().
Could not locate cudnn_ops_infer64_8.dll. Please make sure it is in your library path!
"launching the app"

Suspect it isn't detecting CUDA. It is installed.

[jhj0517]

Hi. Same with #253, I think it's a cuDNN & CUDA & torch version Incompatibility problem.

Can you check CUDA version that you're using?

nvcc --version

The recommended solution is Perfview's solution, which is to manually put the dll files corresponding to your CUDA version into the system32 folder. ( cuBLAS.and.cuDNN_CUDA12_win_v1.7z file if you're using CUDA 12.x )

[paolodalprato]

Same isssue here, Perfview's solution fixed well

[mark-wd]

Same issue. Also fixed with Perfview's solution.

[Tom-Neverwinter]

current version doesn't even have: cudnn_ops_infer64_8.dll
have to add as an extra.

cudnn_9.4.0_windows.exe

temp installs to:
C:\Users\user\AppData\Local\Temp\cudnn

cudnn for 11,8/12.6: cudnn_ops64_9.dll

[dropping in the stated files directly into system32 does resolve the issue though]

[jhj0517]

Investigated issue.

Since this was about version incompatibility between faster-whisper (CTranslate2) and torch >= 2.4.0
I downgraded torch in #318. ( Related issues are listed in the PR )
This is a temporary fix until CTranslate2 supports cuDNN 9 builds.

The bug was not reproducible with torch==2.3.1,
please let me know if anyone still encounters it.

[jhj0517]

Closing with #345,
Feel free to re-open if you face same issue.