Comments (4)
Hi. Is this issue about the compute type fp16 not working in some gpu?
I would add compute_type
in "Advanced Parameters" tab soon.
from whisper-webui.
some compute types appear to work here is what I found on the tesla m40
LargeV2, automatic, SRT [from youtube]
int8
worked as intended :)
int8_float32
worked as intended :)
int8_float16
Error: Requested int8_float16 compute type, but the target device or backend do not support efficient int8_float16 computation.
int8_bfloat16
Error: Requested int8_bfloat16 compute type, but the target device or backend do not support efficient int8_bfloat16 computation.
int16
Error: Requested int16 compute type, but the target device or backend do not support efficient int16 computation.
float16
Error: Requested float16 compute type, but the target device or backend do not support efficient float16 computation.
bfloat16
Error: Requested bfloat16 compute type, but the target device or backend do not support efficient bfloat16 computation.
float32
Error: CUDA failed with error out of memory
it should run most of these just fine, however it gets an error and ceases to go further sadly?
hmm maybe not: Regarding FP16, your GPU could support it but it does not have Tensor Cores. Currently we disable FP16 without Tensor Cores as it has worse performance than FP32 in my experience. You can override this behavior by setting the environment variable CT2_CUDA_ALLOW_FP16=1. SYSTRAN/faster-whisper#42
as an edit and I should say this first: THANK YOU! your work means a lot to people all over the world and will hopefully help many people
from whisper-webui.
I'm not 100% sure this would works fine, but I tried to display the available compute_type
by device in #50.
Please re-open it if it does not work.
from whisper-webui.
hmm, I would change it back but highlight the options it thinks are supported. would give more flexibility.
I should also note I am running multiple cards so I'm not sure how it picks.
the 1080 would be different from the m40/p40
from whisper-webui.
Related Issues (20)
- You are using gradio version 4.14.0, however version 4.29.0 is available, please upgrade. HOT 1
- WhisperX - Speaker Diarization HOT 12
- Can I install it on the MacOS system? HOT 3
- 괄호나 기호 같은것들도 srt이름에 적용되게 가능한가요? HOT 6
- Integrate with insanely-fast-whisper
- Is it possible to add fine-tuning functions? HOT 1
- Apple MBS support Not found in the master branch HOT 4
- Traceback (most recent call last): HOT 1
- translator input_length is bigger than 0.9 * max_length: 200 HOT 2
- Docker Image HOT 4
- Use files from local file/folder instead of uploading files HOT 5
- VAD VadOptions unexpected keyword argument 'window_size_samples' HOT 5
- Add all parameters from faster-whisper
- MacOS Ver.Whisper-WebUI-Mac.zip install.sh needed to convert to Unix format HOT 3
- Did not work in google colab even 1 week ago is working well ! HOT 3
- Generated subtitles are too long HOT 3
- Fix None Type parameters for faster-whisper
- when i use vad, the timestamp doesn't works HOT 4
- Modularize VAD feature
- New error , even one week ago everything work fine when I click to transcribe botton HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from whisper-webui.