Comments (3)
I'm going to try to reproduce this, but "Qwen 1.5 1.8B" is not specific enough. Please provide the exact filename of the model you are using. This includes the quantization type, as well as the precise name of the model (since there is a model called "Qwen1.5-1.8B-Chat" that is applicable to GPT4All, and a model called "Qwen1.5-1.8B" which is a model that has not been trained to understand user/assistant conversations and is intended as a base for finetuning).
It would be even better if you provided a link to where I can download the model, or at least a checksum so I can be sure I am using the same one.
Also, you'll have to be more specific than "repeat the exercise". Do I restart GPT4All, clear the chat, make a new chat, click "regenerate response", or simply type the same message into the box again and press enter?
from gpt4all.
Model file is: qwen1_5-1_8b-chat-q4_0.gguf downloaded directly from the Qwen page on huggingface.
% cksum qwen1_5-1_8b-chat-q4_0.gguf
1501852466 1120235360 qwen1_5-1_8b-chat-q4_0.gguf
Default prompt templates.
For me, just typing that query will have it write continuously until the chat crashes after 7 seconds. If it doesn't, try regenerate, but I haven't had to do that much, it was reliably generating for 7-15 seconds until crash.
from gpt4all.
Links:
https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat-GGUF/tree/main
https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat-GGUF/resolve/main/qwen1_5-1_8b-chat-q4_0.gguf?download=true
from gpt4all.
Related Issues (20)
- Some questions about java calling gpt4all HOT 2
- python binding does not use explicitly requested NVIDIA GPU
- Cannot move window to see which models to choose to install HOT 3
- Update 2.8.0 error HOT 1
- Crash on long prompts (CPU) v2.8.0 HOT 2
- [Feature] Add support for local Nomic Text Embed models compatible models for local docs HOT 1
- Gibberish Response when using GPU (Quadro K6000) HOT 1
- How to mimic the GPT4ALL GUI output using Python library gpt4all() and embed4all() HOT 2
- Gpt4all shows only a gray screen HOT 1
- [Feature] Use CUDA device as default HOT 1
- [Feature] Button to save chat individually manually
- Download of models stuck HOT 1
- Unable to set the max context limit
- dolphin-2.9.2-qwen2-72b-gguf, Cannot run, cannot use, error HOT 1
- Screen Turns Black Intermittently When Opening GPT4all on Desktop HOT 1
- [Feature] flathub verified HOT 1
- Crashes when indexing RAG
- GPT4All version inconsistency in winget upgrade on Windows HOT 8
- [Feature] Support for Linux ARM64 HOT 1
- [Feature] Custom stopping word list HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt4all.