Jump-start your LLM project by starting from an app, not a framework. This repository aggregates high-quality, functioning web applications for use cases including Chatbots, Natural Language Interfaces, Assistants, and Question Answering Systems. It compares projects along important dimensions for these use cases, to help you choose the right starting point for your application.

To ensure the utmost quality and usability, projects must adhere to the following criteria to be included:

• Licensed under Open Source terms 💸
• Actively Maintained, meaning updated within the past month or under active monitoring 🚨

The projects span a wide range of complexity, from straightforward API wrappers to production-ready systems with multi-source RAG backends, conversation logging, and authentication/user management. There should be something for almost every need.

Contributions are the backbone of this list! If you're aware of a project that meets our criteria but isn't listed, we'd love to hear about it. Please also notify us if any of the listed projects becomes unmaintained or changes its licensing. Additionally, if there's a project detail that you'd like to compare that's not currently tracked, submit an issue for it. Finally, if you're the maintainer of a project that's already listed and would like to update or modify the listing, submit it again with the desired modifications.

To submit a project:

1. Create an issue.
2. Ensure your submission adheres to the listed criteria and includes all relevant details.
3. Submissions will be reviewed and the projects list will be updated within a day.

If you'd like to help maintain this project, contact clharman via email.

Currently seeking submissions for:

• Lightweight chatbots
• Projects with advanced prompting
• Non-chatbot interfaces (question answering, etc)
• Projects with image support
• Projects in different languages e.g. Python only

Project	Demo	Brief Description	Architecture	Conversation Context Carry	Conversation History	Authentication	Model Support	Rich Text Support	Image Support	(RAG) Search Engine	(RAG) Show Sources	(RAG) Data ingestion	Quick Deploy	Other Features
Hugging Face Chat UI	🟢 Link	Full featured chat interface	SvelteKit, MongoDB	🟢	🟢	🟢 OpenID	Hugging Face Inference API, local, Amazon SageMaker	🟢	🔴	🟢 Google search	🟢	🔴	🟢 Hugging Face Spaces	Theme configuration
Weaviate Verba	🟢 Link	Chat interface for RAG applications	React frontend, FastAPI backend, Weaviate	🔴	🔴	🔴	OpenAI	🟢	🔴	🟢 Weaviate	🟢	🟢 Via CLI	🟢 Docker	Semantic caching
Microsoft Azure Chat	🔴	Azure-based private chat tenant over data and files	Next.js, LangChain.js, CosmosDB	🟢	🟢	🟢 NextAuth	OpenAI	🟢	🔴	🟢 Azure Cognitive Search	🔴	🟢 UI single-file upload	🟢 Azure
AWS GenAI LLM Chatbot	🔴	AWS-based chatbot with RAG and selectable LLMs	React frontend, LangChain.js, cloud services backend	🟢	🟢	🟢 Amazon Cognito	Bedrock, SageMaker, Hugging Face Inference Endpoints, OpenAI, Anthropic, AI21, Cohere	🔴	🔴	🟢 Postgres/ Kendra/ OpenSearch	🟢	🟢 UI file upload	🟢 AWS	User-selectable model and search backend
PrivateGPT	🔴	API, pipeline, and UI for RAG applications. Supports private models.	FastAPI, LlamaIndex, Gradio	🟢	🔴	🔴	Local, OpenAI, Sagemaker	🔴	🔴	🟢 Qdrant, Chroma	🟢	🟢 UI file upload	🔴
Ollama Web UI	🔴	Full featured GPT clone	Sveltekit, Ollama backend	🟢	🟢	🟢	Local: Any Ollama supported model	🟢	🟢	🔴	🔴	🔴	🟢 Docker Compose
Azure GPT-RAG	🔴	Enterprise-ready RAG framework	All-Azure services	🟢	🟢	🟢 Azure Active Directory	OpenAI	🟢	🔴	🟢 Azure Cognitive Search	🟢	🟢 Data source connections	🟢 Azure	Microsoft Teams bot integration, costs estimator
Danswer	🔴	Full featured RAG system with prebuilt data connectors for many source systems	FastAPI, Next.js, Vespa, Postgres, Celery	🟢	🟢	🟢	OpenAI, Local	🟢	🔴	🟢 Vespa	🟢	🟢 Selection of data connectors	🟢 Docker Compose, Kubernetes	Slack bot
LLM Answer Engine	🔴	Perplexity style answer engine with web search	React, LangChain.JS, Brave, Serper, OpenAI	🟢	🔴	🔴	Mixtral, Ollama, OpenAI	🔴	🔴	🟢 Brave, Serper	🟢	🔴 Web search, not ingestion	🔴
Dify	🔴	App development platform for GenAI	Next.js, Flask, Postgres	🟢	🟢	🟢	Various	🟢	🟢	🟢 Various	🟢	🟢 UI file upload	🟢 AWS, Kubernetes	Agents, observability
Flowise	🔴	Drag-and-drop LLM flow builder	React, Node	🟢	🟢	🟢	Various	🔴	🔴	🟢 Various	🟢	🟢 UI file upload	🟢 AWS, Kubernetes	GUI/no-code LLM app logic builder
RAGFlow	🟢 Link	Enterprise-RAG engine based on deep document understanding	React, DeepDoc	🟢	🟢	🟢	Various	🟢	🟢	🟢 Elasticsearch/Infinity	🟢	🟢 UI file upload / file management	🟢 Docker Compose	Document structure recognition / Table structure recognition