Topic: llmops Goto Github

👇 Here are 259 public repositories matching this topic...

agenta-ai / agenta
llmops,The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
Organization: agenta-ai
Home Page: http://www.agenta.ai
langchain llmops large-language-models llm llm-tools llms prompt-engineering prompt-management llama-index llm-evaluation llm-framework prompt-toolkit rag rag-evaluation human-annotation

ajndkr / lanarky
llmops,The web framework for building LLM microservices
User: ajndkr
Home Page: https://lanarky.ajndkr.com/
fastapi python3 web llmops microservices

arize-ai / phoenix
llmops,AI Observability & Evaluation
Organization: arize-ai
Home Page: https://docs.arize.com/phoenix
ml-observability model-observability ai-roi llmops mlops ai-monitoring ai-observability ml-monitoring model-monitoring umap

bentoml / bentoml
llmops,The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Organization: bentoml
Home Page: https://bentoml.com
ai ai-infra bentoml deep-learning generative-ai inference-api kubernetes llmops lmops machine-learning microservices ml-platform mlops model-deployment model-inference model-management model-serving multimodal-deep-learning

bentoml / openllm
llmops,Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Organization: bentoml
Home Page: https://bentoml.com
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna

berriai / litellm
llmops,Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
Organization: berriai
Home Page: https://docs.litellm.ai/docs/
anthropic langchain langchain-python llm llmops openai

bionic-gpt / bionic-gpt
llmops,BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
Organization: bionic-gpt
Home Page: https://bionic-gpt.com
architecture full-stack llmops llms rust

dagworks-inc / hamilton
llmops,Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Organization: dagworks-inc
Home Page: https://hamilton.dagworks.io/en/latest/
data-science python dag data-engineering dataframe etl etl-framework etl-pipeline feature-engineering featurization

datadreamer-dev / datadreamer
llmops,DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤
Organization: datadreamer-dev
Home Page: https://datadreamer.dev
deep-learning machine-learning natural-language-processing nlp nlp-library python pytorch transformers alignment fine-tuning

dillionverma / llm.report
llmops,📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
User: dillionverma
Home Page: https://llm.report
gpt-3 gpt-4 llm llmops openai nextjs open-source nodejs react shadcn-ui

dot-agent / nextpy
llmops,🤖Self-Modifying Framework from the Future 🔮 World's First AMS
Organization: dot-agent
Home Page: https://dotagent.ai
agent agi ai autogpt gpt llmops mlops ai-agents fastapi fullstack-development llm openai python fastapi-framework fastapi-template pydantic sqlmodel streamlit webdev webdevelopment

explodinggradients / ragas
llmops,Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
Organization: explodinggradients
Home Page: https://docs.ragas.io
llm llmops

getmetal / motorhead
llmops,🧠 Motorhead is a memory and information retrieval server for LLMs.
Organization: getmetal
Home Page: https://getmetal.io
machine-learning ml mlops rust llmops llms

giskard-ai / giskard
llmops,🐢 Open-Source Evaluation & Testing framework for LLMs and ML models
Organization: giskard-ai
Home Page: https://docs.giskard.ai
mlops ml-validation ml-testing ai-testing ai-safety ml-safety llmops ethical-artificial-intelligence responsible-ai fairness-ai

ianarawjo / chainforge
llmops,An open-source visual programming environment for battle-testing prompts to LLMs.
User: ianarawjo
Home Page: https://chainforge.ai/docs
ai evaluation large-language-models llmops llms prompt-engineering

infiniflow / ragflow
llmops,RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
Organization: infiniflow
Home Page: https://ragflow.io
document-understanding llm ocr rag table-structure-recognition data-pipelines deep-learning document-parser information-retrieval llmops

iusztinpaul / hands-on-llms
llmops,🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
User: iusztinpaul
bytewax comet-ml huggingface mlops qdrant transformers beam langchain generative-ai llms

jina-ai / jina
llmops,☁️ Build multimodal AI applications with cloud-native stack
Organization: jina-ai
Home Page: https://docs.jina.ai
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline

josh-xt / agixt
llmops,AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
User: josh-xt
Home Page: https://AGiXT.com
ai automation artificial chromadb intelligence llama llamacpp openai python agi

langfuse / langfuse
llmops,🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Organization: langfuse
Home Page: https://langfuse.com/docs
analytics llm llmops gpt large-language-models openai self-hosted ycombinator monitoring observability

liguodongiot / llm-action
llmops,本项目旨在分享大模型相关技术原理以及实战经验。
User: liguodongiot
Home Page: https://www.zhihu.com/column/c_1456193767213043713
llm llm-inference llm-serving llm-training llmops

maplemx / agently
llmops,[AI Agent Application Development Framework] - 🚀 Build AI agent native application in very few code 💬 Easy to interact with AI agent in code using structure data and chained-calls syntax 🧩 Enhance AI Agent using plugins instead of rebuild a whole new agent
User: maplemx
Home Page: http://agently.tech
agent agent-framework python framework agent-based-framework chatglm ernie google-gemini gpt llm-agent

microsoft / aici
llmops,AICI: Prompts as (Wasm) Programs
Organization: microsoft
ai rust wasm wasmtime inference language-model llm llm-framework llm-inference llm-serving llmops model-serving transformer

microsoft / autogen
llmops,A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
Organization: microsoft
Home Page: https://microsoft.github.io/autogen/
agent-based-framework agent-oriented-programming chat chat-application chatbot chatgpt gpt gpt-35-turbo gpt-4 llm-agent

msoedov / langcorn
llmops,⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
User: msoedov
Home Page: https://langcorn.vercel.app/docs
fastapi langchain langchain-python large-language-models api llm vercel vercel-serverless-functions openai-api rest-api

neumtry / neumai
llmops,Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
Organization: neumtry
Home Page: https://neum.ai
ai data embeddings etl llm vector-database chatgpt data-engineering database pipeline

onlyphantom / llm-python
llmops,Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone
User: onlyphantom
Home Page: https://www.youtube.com/playlist?list=PLXsFtK46HZxUQERRbOmuGoqbMD-KWLkOS
langchain chromadb gpt-3 langchain-python llamaindex openai-api llm llmops pinecone tutorial

openpipe / openpipe
llmops,Turn expensive prompts into cheap fine-tuned models
Organization: openpipe
Home Page: https://openpipe.ai
ai llm llmops prompt-engineering

pathwaycom / llm-app
llmops,LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.
Organization: pathwaycom
Home Page: https://pathway.com/developers/showcases/llm-app-pathway/
chatbot hugging-face llm llm-local llm-prompting llm-security llmops pathway real-time vector-index

pezzolabs / pezzo
llmops,🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
Organization: pezzolabs
Home Page: https://pezzo.ai
ai gpt-3 openai devtools gpt-4 prompt-engineering nodejs platform langchain monitoring

phidatahq / phidata
llmops,Add memory, knowledge and tools to LLMs
Organization: phidatahq
Home Page: https://docs.phidata.com
developer-tools python aws ai llm llmops gpt-4

portkey-ai / gateway
llmops,A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.
Organization: portkey-ai
Home Page: https://portkey.ai/features/ai-gateway
gateway generative-ai llmops llms prompt-engineering ai-gateway langchain llama-index openai router

predibase / lorax
llmops,Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Organization: predibase
Home Page: https://loraexchange.ai
fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

promptfoo / promptfoo
llmops,Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
Organization: promptfoo
Home Page: https://www.promptfoo.dev/
llm prompt-engineering prompts llmops prompt-testing testing rag evaluation evaluation-framework llm-eval

protectai / llm-guard
llmops,The Security Toolkit for LLM Interactions
Organization: protectai
Home Page: https://llm-guard.com/
large-language-models llm chatgpt security-tools adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

protectai / rebuff
llmops,LLM Prompt Injection Detector
Organization: protectai
Home Page: https://playground.rebuff.ai
llm llmops prompt-engineering prompts security prompt-injection

ray-project / ray-llm
llmops,RayLLM - LLMs on Ray
Organization: ray-project
Home Page: https://aviary.anyscale.com
distributed-systems large-language-models ray serving transformers llm llm-inference llm-serving llmops

stoyan-stoyanov / llmflows
llmops,LLMFlows - Simple, Explicit and Transparent LLM Apps
User: stoyan-stoyanov
Home Page: https://llmflows.readthedocs.io
ai llm llm-inference llmops llms machine-learning openai prompt-engineering question-answering vector-database chatgpt gpt-4 python

superduperdb / superduperdb
llmops,🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
Organization: superduperdb
Home Page: https://superduperdb.com
ai mlops torch transformers mongodb python pytorch ml database data

tencentmusic / cube-studio
llmops,cube studio开源云原生一站式机器学习/深度学习AI平台，支持sso登录，多租户/多项目组，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Organization: tencentmusic
kubernetes inference mlops workflow ai pytorch spark argo kubeflow automl aihub gpt llmops notebook pipeline vgpu

tensorchord / awesome-llmops
llmops,An awesome & curated list of best LLMOps tools for developers
Organization: tensorchord
awesome-list mlops ai-development-tools llmops

tensorchord / envd
llmops,🏕️ Reproducible development environment
Organization: tensorchord
Home Page: https://envd.tensorchord.ai/
developer-tools development-environment docker buildkit hacktoberfest llmops mlops mlops-workflow model-serving

thousandbirdsinc / chidori
llmops,A reactive runtime for building durable AI agents
Organization: thousandbirdsinc
Home Page: https://docs.thousandbirds.ai
agents ai debugging framework llmops llms orchestration

traceloop / openllmetry
llmops,Open-source observability for your LLM application, based on OpenTelemetry
Organization: traceloop
Home Page: https://www.traceloop.com/openllmetry
llmops observability open-telemetry metrics monitoring opentelemetry datascience ml model-monitoring opentelemetry-python

transformeroptimus / superagi
llmops,<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
User: transformeroptimus
Home Page: https://superagi.com/
agents agi ai artificial-general-intelligence artificial-intelligence autonomous-agents gpt-4 hacktoberfest llm llmops nextjs openai pinecone python superagi

truera / trulens
llmops,Evaluation and Tracking for LLM Experiments
Organization: truera
Home Page: https://www.trulens.org/
explainable-ml llm llmops machine-learning neural-networks

trypromptly / llmstack
llmops,No-code platform to build LLM Agents, workflows and applications with your data
Organization: trypromptly
Home Page: https://llmstack.trypromptly.com
agents ai ai-agents-framework generative-ai llm-agents llm-chain llm-framework llmops llms no-code-ai platform

uptrain-ai / uptrain
llmops,UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
Organization: uptrain-ai
Home Page: https://uptrain.ai/
machine-learning experimentation llm-prompting llm-test llmops monitoring prompt-engineering autoevaluation evaluation llm-eval hallucination-detection jailbreak-detection openai-evals root-cause-analysis

vllm-project / vllm
llmops,A high-throughput and memory-efficient inference and serving engine for LLMs
Organization: vllm-project
Home Page: https://docs.vllm.ai
gpt llm pytorch llmops mlops model-serving transformer llm-serving inference llama

zenml-io / zenml
llmops,ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Organization: zenml-io
Home Page: https://zenml.io
mlops machine-learning data-science production-ready devops-tools zenml pipelines metadata-tracking deep-learning pytorch