Installing CUDA not required? about monika.i HOT 9 CLOSED

You need to setup CUDA and cudnn if you want to use heavy GPU features like locally running chatbots or Tortoise TTS. If these are not setup, these features won't use your GPU and will use your CPU, resulting in slower processing.

Be careful to distinguish your integrated GPU (Intel for example) and your dedicated GPU if you have one (only Nvidia GPU are supported for the libraries used).

from monika.i.

Hmm. Though, I clearly see my dedicated GPU (nvidia) being used in task manager when I do a chat session with Monika. Task manager reports that it utilizes almost 100% of the GPU. I tested this twice today. I also know that my CPU does not have integrated graphics.

from monika.i.

What options are you using? Is it the local chatbot or CAI ?

from monika.i.

Local chatbot

from monika.i.

What is the time response approximatively ? Quantified by seconds and words would be good

from monika.i.

I put in 2 words, and it took about 14 seconds to generate a response.

from monika.i.

I was talking about the amount of words generated by the model but anyway 14 seconds seems not too long to me. Which model did you use?

from monika.i.

The pygmalion 2.7b one.

from monika.i.

Okay if it works for you good, normally you would need to setup CUDA. Maybe it was already setup for you. I will close for now as it is working without issues for now, feel free to open another issue if you have another problem.

from monika.i.