Comments (9)
You need to setup CUDA and cudnn if you want to use heavy GPU features like locally running chatbots or Tortoise TTS. If these are not setup, these features won't use your GPU and will use your CPU, resulting in slower processing.
Be careful to distinguish your integrated GPU (Intel for example) and your dedicated GPU if you have one (only Nvidia GPU are supported for the libraries used).
from monika.i.
Hmm. Though, I clearly see my dedicated GPU (nvidia) being used in task manager when I do a chat session with Monika. Task manager reports that it utilizes almost 100% of the GPU. I tested this twice today. I also know that my CPU does not have integrated graphics.
from monika.i.
What options are you using? Is it the local chatbot or CAI ?
from monika.i.
Local chatbot
from monika.i.
What is the time response approximatively ? Quantified by seconds and words would be good
from monika.i.
I put in 2 words, and it took about 14 seconds to generate a response.
from monika.i.
I was talking about the amount of words generated by the model but anyway 14 seconds seems not too long to me. Which model did you use?
from monika.i.
The pygmalion 2.7b one.
from monika.i.
Okay if it works for you good, normally you would need to setup CUDA. Maybe it was already setup for you. I will close for now as it is working without issues for now, feel free to open another issue if you have another problem.
from monika.i.
Related Issues (20)
- Does this still work?? ("It seems theres a bug somewhere") HOT 1
- Save chat history HOT 3
- Facecam is not working. HOT 1
- Error Encountered during Run.bat HOT 3
- Executables doesn't open HOT 10
- character-ai open and stuck HOT 1
- Torch not compiled with CUDA enabled. HOT 4
- Not a bug, just a question HOT 6
- Pls Help HOT 8
- when i run run.bat with botchat and TTS HOT 11
- Allow KoboldAI backend support HOT 1
- Online support HOT 1
- Monikai Pimaker integratio HOT 1
- Need additional guidance HOT 4
- No module named 'accelerate' HOT 6
- is it possible to run this submod on the built-in graphics from amd, without a video card? HOT 1
- the mod take so much RAM HOT 8
- Could not load model sileod/deberta-v3-tasksource-nli
- Game Freeze during Monika is thinking HOT 2
- Linux on ext4 filesystems cant load images
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from monika.i.