repos-ai-local Goto Github PK

anything-llm

Open-source multi-user ChatGPT for all LLMs, embedders, and vector databases. Unlimited documents, messages, and users in one privacy-focused app. Now available as a desktop application!

candle

Minimalist ML framework for Rust

cognita

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

continue

⏩ The easiest way to code with any LLM—Continue is an open-source autopilot for VS Code and JetBrains

danswer

Ask Questions in natural language and get Answers backed by private sources. Connects to tools like Slack, GitHub, Confluence, etc.

deepseek-coder

DeepSeek Coder: Let the Code Write Itself

distributed-llama

Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

fooocus

Focus on prompting and generating

gpu-benchmarks-on-llm-inference

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

h2ogpt

Private Q&A and summarization of documents+images or chat with local GPT, 100% private, Apache 2.0. Supports LLaMa2, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/

insanely-fast-whisper

invokeai

InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multiple commercial products.

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

librechat

Enhanced ChatGPT Clone: Features OpenAI, GPT-4 Vision, Bing, Anthropic, OpenRouter, PaLM 2, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

llama-coder

Replace Copilot with a more powerful and local AI

llamafile

Distribute and run LLMs with a single file.

llocalsearch

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

localai

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others

macospilot-ai-assistant

Voice + Vision powered AI assistant that answers questions about any application, in context and in audio.

mirror

mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

ollama

Get up and running with Llama 2, Mistral, and other large language models locally.

ollama-webui

ChatGPT-Style Web UI Client for Ollama 🦙

ollama-webui-lite

Ollama WebUI Stripped 🦙

open-interpreter

OpenAI's Code Interpreter in your terminal, running locally

powerinfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs