Langchain PDF Bot is a Streamlit-based application that allows users to upload a PDF, ask questions about its content, and receive AI-generated answers. Inspired by Alejandro AO's video , this application was created only for experimental purpose. It runs locally on the CPU(without requiring GPU) and is terribly slow. It utilizes all-MiniLM-L6-v2 for embeddings, and Llama-2-7B-Chat-GGUF as LLM.
- PDF Interaction: Upload PDF documents and ask questions about their content.
- Local Processing: Utilizes the Llama-2-7B-Chat model for generating responses locally.
- Interactive UI: Streamlit interface for a user-friendly experience.
-
Clone the repository:
git clone https://github.com/soumyanjaleemahapatra/langchain-pdf-bot.git
-
Navigate to the project directory:
cd langchain-pdf-bot
-
Install the required dependencies (preferably to venv):
pip install -r requirements.txt
-
Run the Streamlit application:
streamlit run app.py
-
Access the application in your web browser at the provided URL.
-
Upload a PDF file, ask the question, wait patiently. You can check the terminal for insights into what is happening in the background.