Comments (4)
Could you provide the command you used to start docker process? @agilob
from tabby.
Just as in docs, but i use podman
❯ podman run \
-it --rm \
-v ~/dockers/tabby/data:/data \
-v ~/dockers/tabby/data/hf_cache:/home/app/.cache/huggingface \
-p 5000:5000 \
-e MODEL_NAME=TabbyML/J-350M \
tabbyml/tabby
from tabby.
Thanks, could you try again with --gpus all? Please note that we have updated the README.md to reflect our removal of Python backend support. Currently, we only support CUDA environments for downstream applications. We apologize for any inconvenience this may cause."
from tabby.
I dont have nvidia gpu, only amdgpu
from tabby.
Related Issues (20)
- Codestral API Integration not working HOT 8
- Not able to enter token for endpoint HOT 3
- Dedupe background job queue tasks HOT 2
- Suggestion to Add a Startup Service Example in the Documentation
- Is the Tabby with Replicas reverse proxy a relatively immature solution? HOT 3
- llama-server exited with status code -1
- There is no response in chat when stream=false HOT 1
- ROCm and Vulkan seems like doesn't work HOT 4
- Can't seem to get Tabby to run on GPU HOT 6
- Why does he reset every once in a while HOT 2
- [VSCode] Add an command item for [command-shift-p] to trigger inline chat (command-i). HOT 2
- [VSCode] Combine all the chat streaming edit steps as one undo-redo step HOT 2
- Suggestions regarding the timing for triggering code completion.
- Discovering FIM prompt templates for ollama use HOT 2
- Cannot run on offline device HOT 4
- How to setup local http api_endpoint HOT 2
- libgomp is not static linked in manylinux2014 cpu binary HOT 6
- Can i connect without check token?
- [VSCode] Add a 'Generate Commit Message' icon button HOT 2
- [VSCode] Enhance Answer Engine to Auto-Add References from Open File
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tabby.