CUDA does not appear to be working on Fedora with switchable graphics about dsnote HOT 5 CLOSED

Just FYI. Yesterday I have pushed Beta8 to flathub-beta. It brings CUDA support for Faster-Whisper STT and Coqui TTS.

from dsnote.

Thanks for the report.

I'm using EnvyControl and these instructions for installing CUDA + Machine Learning.

Actually, local CUDA installation doesn't really matter. Speech Note flatpak package comes with all needed CUDA libraries. This is an advantage - you don't need to install anything else - and also disadvantage because package size is huge.

This error:

[D] 13:46:29.136 0x7f676e20ed00 add_cuda_devices:227 - scanning for cuda devices
[D] 13:46:29.136 0x7f676e20ed00 add_cuda_devices:236 - cuda version: driver=0, runtime=0
[W] 13:46:29.136 0x7f676e20ed00 add_cuda_devices:241 - cudaGetDeviceCount returned: 35

indicates that NVIDIA card was not detected in your system. I see the same log on my computer with AMD card.

I have to admit I know nothing about PRIME technology and GPU switching on laptops. Most likely I won't tell you anything you already know. NVIDIA card needs to be somehow turn-on before starting an app. As I understand 'EnvyControl' should make this happen.

The Internet mentions also that there is prime-run tool which switches GPU by setting the following env variables:

__NV_PRIME_RENDER_OFFLOAD=1
__GLX_VENDOR_LIBRARY_NAME=nvidia

so, you might try to do:

__NV_PRIME_RENDER_OFFLOAD=1 __GLX_VENDOR_LIBRARY_NAME=nvidia flatpak run net.mkiol.SpeechNote --verbose

or set these variables inside flatpak sandbox using flatpak override:

flatpak override --env=__NV_PRIME_RENDER_OFFLOAD=1 --env=__GLX_VENDOR_LIBRARY_NAME=nvidia net.mkiol.SpeechNote

flatpak run net.mkiol.SpeechNote --verbose

Please have in mind that I'm just guessing.

from dsnote.

Maybe this guide: https://askubuntu.com/questions/1316566/how-do-you-offload-a-flatpak-application-to-run-on-the-nvidia-graphics-card-when

from dsnote.

Thanks!

I had tried __NV_PRIME_RENDER_OFFLOAD=1 __GLX_VENDOR_LIBRARY_NAME=nvidia flatpak run net.mkiol.SpeechNote --verbose and it wasn't working, but your instructions for setting the variables in the flatpak sandbox using flatpak override did actually seem to fix the issue. Really appreciate it!

from dsnote.

Wow! That is awesome!

from dsnote.