e-johnstonn / briefgpt Goto Github PK
View Code? Open in Web Editor NEWLocally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.
License: MIT License
Locally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.
License: MIT License
Hi!
Thank you for sharing your good. Its really a great help to understand langchain and LLMs.
I am running the model using NVIDIA V100 32GB ram. The model takes a lot of time to response to the questions. The size pdf document I am loading is around 1.4 MB.
Can you please comment on how to improve the response time?
Regards
chat_utils.py line 99
When the llm is None, the "output = llm(message)" will throw error.
It'd be a good idea to support other endpoints of OpenAI services (like Microsoft Azure). Presumably the env file would need other variables like OPENAI_API_BASE.
The repo is missing a license, which makes it technically a closed sourced, even though I believe it is intended to be open source. I suggest adding an MIT license
models/ggml-vic13b-q5_1.bin
llama.cpp: loading model from models/ggml-vic13b-q5_1.bin
error loading model: unknown (magic, version) combination: 67676a74, 00000002; is this really a GGML file?
llama_init_from_file: failed to load model
In test.env, it mentions MODEL_TYPE = LlamaCpp or GPT4ALL
However, in local_app.py the if statement is as follows:
elif model_type == 'GPT4All':
This causes it to never match, as the L's are uppercase in test.env, but lowercase in the if statement.
I tried to create a branch and submit a PR for this but got 401, though that could be entirely my fault
Hello,
I think it would be great and handy if multiple files could be searched just like main.py for local_app.py. Since similar code/feature already exist in main.py, it could be quickly added. Thank you for the project.
rt
Can you please help with how to create API key using test.env
Hey! Is there any way to get the summarizer working off a local LMM?
The only way I've found to use the summarizer is with an OpenAI key with gpt3.5 or gpt4.
Testing
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.