Comments (3)
Note this is done in #1588 and a vulkan binary has been added in https://github.com/TabbyML/tabby/actions/runs/8179533225, consider give it a try!
cc @boxbeam
from tabby.
related:webonnx/wonnx#169
from tabby.
The recent merges of two Vulkan-based implementations in llama.cpp are as follows:
- The first merge: ggerganov/llama.cpp@2307523
- The second merge: ggerganov/llama.cpp@fbf1dde
We are quite interested in integrating one of these implementations into Tabby. For example, by adding a vulkan
device option, similar to the metal
option, we can make Tabby compatible with certain GPUs, such as the Intel Arc.
from tabby.
Related Issues (20)
- Code Completion Quality - Ideas HOT 2
- [intellij plugin] Get error when initializing Tabby HOT 10
- local models won't start
- how to set up model id HOT 2
- repository creation crash - 0.13 HOT 8
- Debug mode for Answer Engine
- Tabby server crashing with sqlite database is locked error. HOT 6
- I just want to start a service that uses the openai big model interface, what should I do? HOT 1
- [IntelliJ Plugin Dev] Plugin Disappears After Upgrading from Version 1.4.0 to 1.6.3 in Custom Plugin Repository HOT 2
- Windows build fails to start if http_proxy is set HOT 1
- Gitea Context Provider HOT 1
- tabbyml 0.14 compile fails - libggml.so wants to install at /usr/local/lib64
- tabbyml 0.14 - access control permissions HOT 2
- Can get work on tabby 0.13.1 or 0.14.0 follow by the quick-start guide
- Deploy Tabby in Air-Gapped Environment with Docker Guide does not work. HOT 2
- sftp Uploads folders
- tabbyml 0.14 - multiple local gitlab providers not queried by answer engine HOT 3
- tabbyml 0.14 - gitlab fetch issues failed - data from JSON: invalid type: null, expected a string HOT 1
- tabbyml 0.14 - code 500 - input is too large to process. increase the physical batch size HOT 1
- How to use the dialog window in tabby home HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tabby.