This is a basic chainlit web app to run Llama2 in CPU machines. Its knowledge is constrained to the pdf file you store in the data folder. It is a simple way to get started with Llama2.

1. Clone the repo

2. Download the model from the link below and put it in the model folder at root level Llama2-7B-Quantized model

3. Install the requirements using pip:

   pip install -r requirements.txt

4. Get your knowledge source into data folder and run the following command:

   Depending on the size of your knowledge source, this might take a while.

   python ingest.py

   This will create a directory called vectorstores in the root folder. This is where the knowledge source is stored in a vectorized format.

5. Run the following command to start the web app:

   chainlit run model.py -w  

   This will start the web app on port 8000. You can access it at http://localhost:8000

6. Ask questions and enjoy!