akoval61 / yt-chat Goto Github PK

After cloning the repository, and with poetry installed, run the following command from the repository root:

poetry install

To run yt-chat, simply do:

poetry run chainlit run yt_chat/app.py -w

If you don't want to bother, you can also use try the online version (only handles OpenAI).

If you wish to use an OpenAI model, for example gpt-3.5, you will need your OpenAI API key.

Once you've input your OpenAI API key requested by yt-chat, select the ChatGPT chat profile in the UI.

If you wish to use a local ollama model, for example mistral-7b, you will need to install ollama on your machine.

First, make sure your ollama server is running. Then, run yt-chat (when running yt-chat for the first time, you will asked for an OpenAI API key; this is irrelevant for local models, enter anything to continue).

Once yt-chat is running, simply select the Mistral chat profile in the UI.

Check out yt_chat/config.py and yt_chat/config_messages.py for configuring the app parameters and prompts.

If you wish to use yt-chat with other models than gpt-3.5 or mistral-7b, check out this tutorial.

We provide Docker support:

docker-compose up -d --build

yt-chat is powered by chainlit, qdrant, and ollama.