Git Product home page Git Product logo

wyoming-piper-gpu's People

Contributors

slackr31337 avatar

Watchers

avatar

wyoming-piper-gpu's Issues

CUDA doesn't work

Looks like this image doesn't utilise GPU

When I try voice in home assistant with a long text e.g. fairy tale I see high CPU utilisation, and my GPU is idle.

Here is my config:

docker-compose.yml

version: "3.8"

name: home-assistant-addons

services:
  piper-gpu:
    container_name: piper-gpu
    image: ghcr.io/slackr31337/wyoming-piper-gpu:latest
    ports:
      - 10200:10200
    volumes:
      - /srv/appdata/piper-gpu/data:/data
    command: --voice uk_UA-ukrainian_tts-medium
    extends:
      file: hwaccel.yml
      service: cuda
    restart: always

  whisper-gpu:
    container_name: whisper-gpu
    image: ghcr.io/slackr31337/wyoming-whisper-gpu:latest
    ports:
      - 10300:10300
    volumes:
      - /srv/appdata/whisper-gpu/data:/data
    command: --model medium-int8 --language uk --beam-size 5 --device cuda
    extends:
      file: hwaccel.yml
      service: cuda
    restart: always

hwaccel.yml

version: "3.8"

services:
  cuda:
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities:
                - gpu
                - utility # nvidia-smi
                - compute # CUDA

When I run nvidia-smi I see that only whisper process is runnng, and never saw any other process on GPU

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.147.05   Driver Version: 525.147.05   CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:01:00.0 Off |                  N/A |
|  0%   54C    P8    16W / 230W |   1142MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A   1507263      C   python3                          1138MiB |
+-----------------------------------------------------------------------------+

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.