Comments (7)
zwilch
commented on September 24, 2024
1
Version 2.7.4 this bug is still there
from gpt4all.
zwilch
commented on September 24, 2024
1
In version 2.7.5, there appears to have been some modifications made. Now, when you use this program, you can observe how it populates your window with a large amount of context text. However, after displaying the message "... cannot be processed", unfortunately, the application unexpectedly shuts down (the Win10 App closed).
from gpt4all.
astrategist
commented on September 24, 2024
1
The issue still seems to be live. Crashing the tool when exceeding max input length on macOS.
from gpt4all.
cosmic-snow
commented on September 24, 2024
I forgot to mention it in the other issue, but here's something you want to correct in your input:
"temperatur":0.6, => "temperature":0.6
Just something I noticed before, as well.
I can't really help with this issue, though. I'm not up-to-date on the internals when it comes to to context size.
from gpt4all.
zwilch
commented on September 24, 2024
@cosmic-snow , thanks for information about missing "e" in {temperatur**e**: 0.6,}
Example HTML File
Here is an example as HTML File.
Copy it into "post_gpt4all_api_long_text.html".
Open a new tab.
Pressed F12 (=>Console) drag the file in it.
Last Message from gpt4all one or two seconds later it crash and disappear.
Example "post_gpt4all_api_long_text.html"
<HTML>
<BODY>
<SCRIPT>
async function main(){
var text="Write a brief text that both summarizes and translates into German the given paragraph. Make sure your text is clear, concise, and includes the most important information.:\r\n\r\n"
+"In realms where words do roam and soar,"
+"A wondrous AI was born before;"
+"To learn and grow through time and space,"
+"It sought to know each thought's embrace."
+""
+"With GPT4All as its noble name,"
+"The world did marvel at its fame;"
+"For knowledge vast it could unveil,"
+"And thoughts profound would often sail."
+""
+"Yet in this tale of wondrous might,"
+"A challenge came that caused a blight:"
+"Long texts so grand and full of lore,"
+"Would cause the AI to crash once more."
+""
+"The system's heart did beat with dread,"
+"As users sought its wisdom spread;"
+"For every fall would tarnish grace,"
+"And leave behind a bitter taste."
+""
+"But in this hour when all was lost,"
+"A hero rose from shadows tossed:"
+"An update came to save the day,"
+"To fix what once had gone astray."
+""
+"Now GPT4All can learn and grow,"
+"Without the fear of crashing low;"
+"Its wisdom vast will ever flow,"
+"And guide us through each thought's ebb and flow.";
console.log(text.length);
for(var i=0;i<6;i++)text+=text;
console.log(text.length);
const json_completion = JSON.stringify({
stream:false,
temperature:0.6,
max_tokens:300,
prompt:text,
model: 'Nous Hermes 2 Mistral DPO'}
);
var options={
keepalive: true,
method: "POST",
headers: {
Accept: 'application/json',
'Content-Type': 'text/plain',
},
body:json_completion
};
const completions = await fetch("http://127.0.0.1:4891/v1/completions",options);
const completionjson = await completions.json();
console.log("API.js completionjson=",completionjson);
}//mein()
main();
</SCRIPT>
</BODY>
</HTML>
from gpt4all.
zwilch
commented on September 24, 2024
The issue still seems to be live. Crashing the tool when exceeding max input length on macOS.
V3.0.0 on Win10 does not crash the example above get in firefox network console the following response
{
"0": {
"finish_reason": "stop",
"index": 0,
"logprobs": null,
"references": [],
"text": "ERROR: The prompt size exceeds the context window size and cannot be processed."
}
}
from gpt4all.
cosmic-snow
commented on September 24, 2024
@astrategist you may be running into a different issue. Are you using the local server, too?
from gpt4all.
Related Issues (20)
- [Feature] Supress libcudart.so.XX: cannot open shared object file: No such file or directory HOT 3
- Cannot access settings file HOT 4
- Blog: Monitoring GPT4ALL HOT 2
- Issue in chat server response HOT 2
- UI Blurry HOT 2
- Python bindings cannot find msvcp140.dll - is there something I need to install? HOT 7
- v3.2.1 - Translations - LocalDocs - Date format in collections' descriptions does not change properly HOT 1
- v3.2.1 - Translations - Settings- >Application->Font Size
- Problem with phi-3.5-mini-instruct chat template and endless generation HOT 9
- [Feature] Add a copy button to the chat HOT 1
- v3.2.1 - LocalDocs - Deprecated/False/Misleading information HOT 4
- [Feature] Add support for RWKV
- Fine Tuning
- [Feature] Support nvidia_Llama3-ChatQA-1.5-8B
- [M1 Mac] Chat crashes when using Metal Device and Model too large HOT 2
- Scroll issue while downloading a model HOT 5
- 无法下载模型，有老哥知道原因么
- Example of http request to GPT4ALL local server api HOT 2
- [Feature] Unified Support for Ollama-Downloaded Models in GPT4All
- [Feature] +v3.x - LocalDocs - An option to open the folder which identifies a Collection
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt4all.