Comments (7)
gajavelli
commented on September 24, 2024
1
Sorry for the delay in response. After running Vulcan Info, , in addition to that I also tried GPUtil to as secondary method to diagnose about GPU availability.I was able to find that my Ubuntu machine was using a (Nouveau display driver listed at teh bottom of the screenshot)
After selecting Nvidia-535 and rerunning the code fixed the problem
from gpt4all.
gajavelli
commented on September 24, 2024
The issue appears to with the code in llmodel C-API that gets the pointers to devices. Either It is not getting the pointers or returning nothing based on some underlying criteria.
Is there a workaround ?
from gpt4all.
cebtenzzre
commented on September 24, 2024
Does vulkaninfo --summary work? It would help if you posted its output.
from gpt4all.
gajavelli
commented on September 24, 2024
Sure thing. Here is the output from the
vulkaninfo --summary
ERROR: [Loader Message] Code 0 : loader_scanned_icd_add: Could not get 'vkCreateInstance' via 'vk_icdGetInstanceProcAddr' for ICD libGLX_nvidia.so.0
WARNING: [Loader Message] Code 0 : terminator_CreateInstance: Failed to CreateInstance in ICD 2. Skipping ICD.
==========
VULKANINFO
==========
Vulkan Instance Version: 1.3.204
Instance Extensions: count = 20
-------------------------------
VK_EXT_acquire_drm_display : extension revision 1
VK_EXT_acquire_xlib_display : extension revision 1
VK_EXT_debug_report : extension revision 10
VK_EXT_debug_utils : extension revision 2
VK_EXT_direct_mode_display : extension revision 1
VK_EXT_display_surface_counter : extension revision 1
VK_EXT_swapchain_colorspace : extension revision 4
VK_KHR_device_group_creation : extension revision 1
VK_KHR_display : extension revision 23
VK_KHR_external_fence_capabilities : extension revision 1
VK_KHR_external_memory_capabilities : extension revision 1
VK_KHR_external_semaphore_capabilities : extension revision 1
VK_KHR_get_display_properties2 : extension revision 1
VK_KHR_get_physical_device_properties2 : extension revision 2
VK_KHR_get_surface_capabilities2 : extension revision 1
VK_KHR_surface : extension revision 25
VK_KHR_surface_protected_capabilities : extension revision 1
VK_KHR_wayland_surface : extension revision 6
VK_KHR_xcb_surface : extension revision 6
VK_KHR_xlib_surface : extension revision 6
Instance Layers: count = 4
--------------------------
VK_LAYER_INTEL_nullhw INTEL NULL HW 1.1.73 version 1
VK_LAYER_MESA_device_select Linux device selection layer 1.3.211 version 1
VK_LAYER_MESA_overlay Mesa Overlay layer 1.3.211 version 1
VK_LAYER_NV_optimus NVIDIA Optimus layer 1.3.242 version 1
Devices:
========
GPU0:
apiVersion = 4206847 (1.3.255)
driverVersion = 1 (0x0001)
vendorID = 0x10005
deviceID = 0x0000
deviceType = PHYSICAL_DEVICE_TYPE_CPU
deviceName = llvmpipe (LLVM 15.0.7, 256 bits)
driverID = DRIVER_ID_MESA_LLVMPIPE
driverName = llvmpipe
driverInfo = Mesa 23.2.1-1ubuntu3.1~22.04.2 (LLVM 15.0.7)
conformanceVersion = 1.3.1.1
deviceUUID = 6d657361-3233-2e32-2e31-2d3175627500
driverUUID = 6c6c766d-7069-7065-5555-494400000000
ADDITIONAL INFORMATION FROM RUNNING BELOW COMMANDS
lspci | egrep -i "vga|display|3d"
OUTPUT
01:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1)
grep 10de /lib/udev/rules.d/*
OUTPUT
/lib/udev/rules.d/71-nvidia.rules:SUBSYSTEM=="pci", ATTRS{vendor}=="0x10de", DRIVERS=="nvidia", TAG+="seat", TAG+="master-of-seat"
/lib/udev/rules.d/71-nvidia.rules:ACTION=="add", SUBSYSTEM=="pci", ATTR{vendor}=="0x10de", ATTR{class}=="0x03[0-9]*", TEST=="power/control", ATTR{power/control}="auto"
/lib/udev/rules.d/71-nvidia.rules:ACTION=="add", SUBSYSTEM=="pci", ATTR{vendor}=="0x10de", ATTR{class}=="0x040300", TEST=="power/control", ATTR{power/control}="auto"
/lib/udev/rules.d/71-nvidia.rules:ACTION=="add", SUBSYSTEM=="pci", ATTR{vendor}=="0x10de", ATTR{class}=="0x0c0330", TEST=="power/control", ATTR{power/control}="auto"
/lib/udev/rules.d/71-nvidia.rules:ACTION=="add", SUBSYSTEM=="pci", ATTR{vendor}=="0x10de", ATTR{class}=="0x0c8000", TEST=="power/control", ATTR{power/control}="auto"
from gpt4all.
B1Q
commented on September 24, 2024
did anyone find a solution to this?
from gpt4all.
cosmic-snow
commented on September 24, 2024
did anyone find a solution to this?
I can't really help you, but you probably want to post your own vulkaninfo --summary too.
As for @gajavelli: while I can't really say much, I can tell you that one thing certainly looks wrong:
deviceName = llvmpipe (LLVM 15.0.7, 256 bits)
driverID = DRIVER_ID_MESA_LLVMPIPE
driverName = llvmpipe
This is not your video card GPU. LLVMPIPE is a software emulation of a GPU.
from gpt4all.
cebtenzzre
commented on September 24, 2024
These errors would explain why your NVIDIA GPU can't be found:
ERROR: [Loader Message] Code 0 : loader_scanned_icd_add: Could not get 'vkCreateInstance' via 'vk_icdGetInstanceProcAddr' for ICD libGLX_nvidia.so.0
WARNING: [Loader Message] Code 0 : terminator_CreateInstance: Failed to CreateInstance in ICD 2. Skipping ICD.
There is something wrong with the way your nvidia driver is installed. GPT4All can only use your GPU if vulkaninfo --summary shows it. This is not an issue with GPT4All.
Do you actually have a package like nvidia-driver-xxx-server installed? It's not clear to me why you are installing version 525 of libgl and version 535 of nvidia-utils. You should really just use the latest version of the complete driver package.
from gpt4all.
Related Issues (20)
- Running faster on CPU than GPU HOT 10
- Stuck processing
- Hailo-Support[Feature] Feature request title...
- Please add inkubaLM
- [Feature] please add Idefics 3 8B Llama 3
- CUDA 12.0 error while trying to run in CPU HOT 2
- [Python SDK] No Windows/Linux Release of 2.8.0 HOT 3
- Can't change GPU Layers setting for any model with a number larger than default
- Chats not retained if UI crash HOT 2
- Intel ARC device not listed as GPU HOT 1
- [Feature] Non-CUDA download option HOT 1
- [Feature] Keyboard shortcut to close current tab HOT 2
- [Feature] Play sound when answer is finished.
- [Feature] Save as screenshot HOT 1
- [Feature] Show processing time
- [Feature] Allow to start typing question while the model is loading
- how to uninstall gpt4all on Macbook (M) HOT 17
- Llama 3.1 8B model not working with Metal GPU (Mac M2) HOT 4
- [Feature] Close to tray
- After Updating to v3.2.0: GPT4All Replies with 'GGGG' and Crashes When Using RAG HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt4all.