Comments (2)
Atinoda
commented on July 22, 2024
@uogbuji Thank you for flagging that bug in AutoGPTQ. The separate install directives were removed from the Dockerfile because AutoGPTQ is now included by default in the upstream repository requirements (and should be picked up during the core installation process). There is certainly no intention for regression / removal and I definitely want that library included in all images.
I have tested the current docker hub image and AutoGPTQ is functional on my inference machine (PopOS 20.04, RTX 3090) so I do not think this repo is currently affected. Would you mind testing it on your machine to see if that is also the case? Or - are you trying to build the image and running into a problem? Either way, it's good to know because it's an important feature.
I will leave this issue open for the time being. Input and experiences from other users is also welcomed!
from text-generation-webui-docker.
Atinoda
commented on July 22, 2024
AutoGPTQ is functional in the latest version and was also functional in the previous version so I am going to close this issue. Thank you again for bringing the upstream repo's docker build issue to my attention, and please open a new issue if you have any further problems or suggestions.
from text-generation-webui-docker.
Related Issues (20)
- New Cuda HOT 5
- Error response from daemon: could not select device driver "nvidia" with capabilities: HOT 5
- Not running Apple M1: third_party/cuda/bin/ptxas --version died with <Signals.SIGTRAP: 5>. HOT 1
- Trying to load EXL2 with default-nightly image fails HOT 1
- Error when loading some GGUF files with llama.cpp HOT 1
- Unable to load coqui_tts HOT 8
- No such file or directory error HOT 2
- no launch args --subpath HOT 2
- exec /scripts/docker-entrypoint.sh: exec format error HOT 2
- Error 804 HOT 1
- Intel Arc support HOT 6
- make settings.yaml persistent!!! HOT 2
- EXTRA_LAUNCH_ARGS only accepts the fist Argument
- load model failed HOT 3
- Cannot load exllamav2 models HOT 8
- Container instantly crashes when trying to load GGUF HOT 33
- Unable to run oobabot-plugin, missing python oobabot_plugin module HOT 5
- Can't launch the UI by docker compose up HOT 1
- Missing ffmpeg dependency for whisper sst HOT 1
- Alltalk_tts extension doesn't run properly? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from text-generation-webui-docker.