Comments (8)
cowmix
commented on August 15, 2024
1
name, pci.bus_id, vbios_version
NVIDIA GeForce RTX 3060, 00000000:01:00.0, 94.06.25.00.FD
from tabby.
cowmix
commented on August 15, 2024
1
@wsxiaoys - weird.. Everything should be contained within the Docker container, right?
from tabby.
wsxiaoys
commented on August 15, 2024
Could you provide the output of nvidia-smi?
from tabby.
ghthor
commented on August 15, 2024
What's the output from this?
sudo docker run --rm --runtime=nvidia --gpus all nvidia/cuda:11.6.2-base-ubuntu20.04 nvidia-smiThe verification command from the nvidia container runtime setup.
from tabby.
cowmix
commented on August 15, 2024
Sun Apr 9 18:09:43 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.65.01 Driver Version: 515.65.01 CUDA Version: 11.7 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce ... Off | 00000000:01:00.0 Off | N/A |
| 37% 34C P8 16W / 170W | 67MiB / 12288MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
+-----------------------------------------------------------------------------+
from tabby.
wsxiaoys
commented on August 15, 2024
What is your GPU? The nvidia-smi output cuts off after "GeForce"...
from tabby.
wsxiaoys
commented on August 15, 2024
I haven't found any clues, but a Google search shows that it might be related to an unmatched CUDA version.
from tabby.
ghthor
commented on August 15, 2024
I was wondering that too, but to be safe I made sure the host OS had the
latest nvidia driver as well. Haven’t tested without installling that
driver on the host
…On Mon, Apr 10, 2023 at 10:51 M March ***@***.***> wrote:
@wsxiaoys <https://github.com/wsxiaoys> - weird.. Everything should be
contained within the Docker container, right?
—
Reply to this email directly, view it on GitHub
<#68 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AABHEKWJS6554QEJXZRNDA3XAQM63ANCNFSM6AAAAAAWXYBQLY>
.
You are receiving this because you commented.Message ID:
***@***.***>
from tabby.
Related Issues (20)
- Tabbyml docker image scheduler issue HOT 2
- [TAB-437] Mail Delivery capabilities.
- Authentication / Authorization
- Copy to clipboard doesn't work for non-secure context (e.g http://127.0.0.1:8080)
- Tabby not starting, no logs are displayed HOT 5
- Failed to fetch model 'TabbyML/DeepseekCoder-6.7B' due to 'Invalid mirror <modelscope.cn> HOT 3
- Supports cpu without avx2 instruction set
- Implement GraphQL api for repository configurations
- [TabbyML][EE][Playground] Chat completion result could not be shown at playground chat panel HOT 1
- Add event logging for `dismiss` event type
- Add event logging for `/v1beta/chat/completions` HOT 5
- [TAB-457] Repository configurations front end implementation HOT 1
- Is there any ways to reduce latency?
- method/class analysis feature HOT 1
- --device gpu is broken - cuBLAS error 15 at crates/llama-cpp-bindings/llama.cpp/ggml-cuda.cu:7398: the requested functionality is not supported HOT 1
- how to set authentication token? HOT 4
- CUDA error 711 at /root/workspace/crates/llama-cpp-bindings/llama.cpp/ggml-cuda.cu:6826: peer mapping resources exhausted HOT 1
- Why cuda doen't work? HOT 3
- the provided PTX was compiled with an unsupported toolchain HOT 3
- Add Modal (serverless GPU provider) example with advanced features (config.toml) HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tabby.