Topic: llamacpp Goto Github

👇 Here are 344 public repositories matching this topic...

1b5d / llm-api
llamacpp,Run any Large Language Model behind a unified API
User: 1b5d
chatgpt gptq huggingface langchain llama llamacpp llm llm-inference machine-learning python

alexpinel / dot
llamacpp,Text-To-Speech, RAG, and LLMs. All local!
User: alexpinel
Home Page: https://dotapp.uk/
document-chat embeddings faiss langchain llamacpp llm local phi-3 privategpt rag self-hosted standalone standalone-app tts whisper-cpp

alexrozanski / llamachat
llamacpp,Chat with your favourite LLaMA models in a native macOS app
User: alexrozanski
Home Page: https://llamachat.app
ai llama llamacpp machine-learning macos swift swiftui

atome-fe / llama-node
llamacpp,Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
Organization: atome-fe
Home Page: https://llama-node.vercel.app/
ai gpt large-language-models llama llama-rs llm napi napi-rs nodejs llama-node

av / harbor
llamacpp,Effortlessly run LLM backends, APIs, frontends, and services with one command.
User: av
Home Page: https://github.com/av/harbor
cli docker docker-compose llm tools ai exllamav2 llama llamacpp mistral

brutalcoding / aub.ai
llamacpp,AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
User: brutalcoding
Home Page: https://pub.dev/packages/aub_ai
android dart flutter gen-ai ios ipados linux llamacpp macos mistral-7b native-apps pubdev localllama nlp on-device-ai gemini on-device gemini-nano genai indiedev

chenhunghan / ialacol
llamacpp,🪶 Lightweight OpenAI drop-in replacement for Kubernetes
User: chenhunghan
ai helm kubernetes langchain llm python openai cloudnative ggml gpu

dicklesworthstone / swiss_army_llama
llamacpp,A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
User: dicklesworthstone
embedding-similarity embedding-vectors embeddings llama2 llamacpp semantic-search

distantmagic / paddler
llamacpp,Stateful load balancer custom-tailored for llama.cpp
Organization: distantmagic
ai llamacpp llm llmops load-balancer

distantmagic / resonance
llamacpp,PHP Framework designed to build IO-intensive web applications.
Organization: distantmagic
Home Page: http://resonance.distantmagic.com/
framework php swoole ai llamacpp llm

erikbjare / gptme
llamacpp,LLMs in your terminal equipped with local tools: executes python and bash, edits local files, browses the web, vision. Extensible. Tiny.
User: erikbjare
Home Page: http://erik.bjareholt.com/gptme/docs/
autogpt chatbot chatgpt gpt-engineer llamacpp llm openai cli ai-agents ai-assistant

floneum / floneum
llamacpp,Instant, controllable, local pre-trained AI models in Rust
Organization: floneum
Home Page: http://floneum.com/kalosm
ai llm rust llamacpp kalosm candle llama mistral floneum-v3 dioxus

fuzzy-search / realtime-bakllava
llamacpp,llama.cpp with BakLLaVA model describes what does it see
Organization: fuzzy-search
cpp demo-application inference llama llamacpp llm bakllavva

fynnfluegge / codeqai
llamacpp,Local first semantic code search and chat powered by vector embeddings and LLMs
User: fynnfluegge
faiss langchain llamacpp llm openai huggingface llama2 gpt sentence-transformers codellama ollama

getumbrel / llama-gpt
llamacpp,A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Organization: getumbrel
Home Page: https://apps.umbrel.com/app/llama-gpt
ai chatgpt gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp

gotzmann / booster
llamacpp,Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
User: gotzmann
llm chatgpt gpt llama openai llama-cpp ggml exllama vllm llamacpp

huggingface / llm-ls
llamacpp,LSP server leveraging LLMs for code completion (and more?)
Organization: huggingface
ai code-generation huggingface ide llamacpp llm lsp lsp-server openai self-hosted

inferflow / inferflow
llamacpp,Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
User: inferflow
llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm

intel / neural-speed
llamacpp,An innovative library for efficient LLM inference via low-bit quantization
Organization: intel
Home Page: https://github.com/intel/neural-speed
cpu fp8 gaudi2 gpu int4 int8 llm-inference low-bit sparsity fp4

jakobdylanc / discord-llm-chatbot
llamacpp,A Discord LLM chat bot that supports any OpenAI compatible API (OpenAI, Mistral, Groq, OpenRouter, ollama, oobabooga, Jan and more)
User: jakobdylanc
chatgpt gpt openai gpt-4 discord chatbot llm llmcord bot ai oobabooga ollama litellm gpt-4o llama3 llava llama mistral groq lmstudio

janhq / cortex
llamacpp,Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan
Organization: janhq
Home Page: https://cortex.so
gguf llama2 llamacpp tensorrt-llm accelerated ai inference-engine openai-api stable-diffusion cuda

janhq / jan
llamacpp,Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
Organization: janhq
Home Page: https://jan.ai/
llama2 llamacpp localai self-hosted electron gpt

joone / loz
llamacpp,Loz is a command-line tool that enables your preferred LLM to execute system commands and utilize Unix pipes, integrating AI capabilities with other Unix tools.
User: joone
cli git typescript llm ollama openai-api codellama gpt llama2 llamacpp

josh-xt / agixt
llamacpp,AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
User: josh-xt
Home Page: https://AGiXT.com
ai automation artificial chromadb intelligence llama llamacpp openai python agi

khoj-ai / khoj
llamacpp,Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.
Organization: khoj-ai
Home Page: https://khoj.dev
semantic-search emacs obsidian-md chat chatgpt ai llm productivity agent self-hosted

llmware-ai / llmware
llamacpp,Unified framework for building enterprise RAG pipelines with small, specialized models
Organization: llmware-ai
Home Page: https://llmware-ai.github.io/llmware/
parsing retrieval-augmented-generation agents generative-ai-tools llamacpp llm vector-db small-specialized-models

lxe / llavavision
llamacpp,A simple "Be My Eyes" web app with a llama.cpp/llava backend
User: lxe
ai artificial-intelligence computer-vision llama llamacpp llm local-llm machine-learning multimodal webapp

maximilian-winter / llama-cpp-agent
llamacpp,The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
User: maximilian-winter
agents llamacpp llm llms function-calling parallel-function-call llm-agent llm-framework

mgonzs13 / llama_ros
llamacpp,llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
User: mgonzs13
cpp gpt llama llm ros2 ggml gguf llamacpp llava vlm

mintplex-labs / anything-llm
llamacpp,The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.
Organization: mintplex-labs
Home Page: https://anythingllm.com
rag lmstudio localai vector-database ollama local-llm chromadb desktop-app llama3 llamacpp

mobile-artificial-intelligence / maid
llamacpp,Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Organization: mobile-artificial-intelligence
android chatbot chatgpt facebook flutter gguf large-language-models llama llama-cpp llama2

morpheuslord / hackbot
llamacpp,AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.
User: morpheuslord
ai chatbot cli-chat-app llama2 automation cybersecurity cybersecurity-education cybersecurity-tools llama2-7b llamacpp

mrdbourke / mac-ml-speed-test
llamacpp,A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.
User: mrdbourke
apple-silicon benchmark deep-learning llama2 llamacpp llm m1 m1-mac m2-mac m3-mac

ngxson / wllama
llamacpp,WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
User: ngxson
Home Page: https://ngxson.github.io/wllama/examples/basic/
llama llamacpp llm wasm webassembly

nuked88 / comfyui-n-nodes
llamacpp,A suite of custom nodes for ConfyUI that includes GPT text-prompt generation, LoadVideo, SaveVideo, LoadFramesFromFolder and FrameInterpolator
User: nuked88
comfyui gpt llama llamacpp loadvideo savevideo stablediffusion videonode

pythops / tenere
llamacpp,🔥 TUI interface for LLMs written in Rust
User: pythops
Home Page: https://crates.io/crates/tenere
chatgpt llm rust tui cli ratatui llamacpp ollama

rahulschand / gpu_poor
llamacpp,Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
User: rahulschand
Home Page: https://rahulschand.github.io/gpu_poor/
ggml huggingface llm quantization gpu language-model pytorch llama llama2 llamacpp

reid41 / qa-pilot
llamacpp,QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.
User: reid41
ai chatbot llm openai python chromadb langchain huggingface postgresql svelte

reorproject / reor
llamacpp,Private & local AI personal knowledge management app.
Organization: reorproject
Home Page: https://reorproject.org
ai lancedb llama llamacpp local-first markdown note-taking pkm vector-database rag

scisharp / llamasharp
llamacpp,A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Organization: scisharp
Home Page: https://scisharp.github.io/LLamaSharp
chatbot gpt llama llamacpp llm semantic-kernel llava multi-modal llama2 llama3

serge-chat / serge
llamacpp,A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
Organization: serge-chat
Home Page: https://serge.chat
alpaca docker fastapi llama llamacpp nginx python svelte sveltekit tailwindcss web

silasmarvin / lsp-ai
llamacpp,LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
User: silasmarvin
ai auto-completion developer-tools ide language-client llama llamacpp llm lsp self-hosted

staghado / vit.cpp
llamacpp,Inference Vision Transformer (ViT) in plain C/C++ with ggml
User: staghado
cpu ggml vision-transformer whisper-cpp edge-computing llamacpp ai computer-vision image-classification c

su77ungr / casalioy
llamacpp, ♾️ toolkit for air-gapped LLMs on consumer-grade hardware
User: su77ungr
langchain llm qdrant llamacpp question-answering

twinnydotdev / twinny
llamacpp,The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.
Organization: twinnydotdev
Home Page: https://twinny.dev
artificial-intelligence code-generation vscode-extension code-completion copilot codellama llama2 ollama ollama-api code-chat

vercel / modelfusion
llamacpp,The TypeScript library for building AI applications.
Organization: vercel
Home Page: https://modelfusion.dev
chatbot gpt-3 javascript js llm openai ts typescript whisper ai

vicuna-tools / vicuna-installation-guide
llamacpp,The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B
Organization: vicuna-tools
large-language-models llamacpp llm vicuna vicuna-installation-guide

xnul / code-llama-for-vscode
llamacpp,Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
User: xnul
code-llama code llama studio visual vscode llm local continue copilot

xorbitsai / inference
llamacpp,Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
Organization: xorbitsai
Home Page: https://inference.readthedocs.io
ggml pytorch chatglm deployment flan-t5 llm wizardlm artificial-intelligence machine-learning whisper

zatevakhin / obsidian-local-llm
llamacpp,Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.
User: zatevakhin
obsidian-md obsidian-plugin ggml llama llamacpp