Topic: llama2 Goto Github

Some thing interesting about llama2

👇 Here are 755 public repositories matching this topic...

ashishpatel26 / llm-finetuning

llama2,LLM Finetuning with peft

User: ashishpatel26

falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch

augustdev / enchanted

llama2,Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

User: augustdev

ios large-language-model llm ollama ollama-app swift llama llama2 mistral

b4rtaz / distributed-llama

llama2,Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

User: b4rtaz

distributed-computing llama2 llm llm-inference neural-network llms open-llm distributed-llm llama3

baichuan-inc / baichuan2

llama2,A series of large language models developed by Baichuan Intelligent Technology

Organization: baichuan-inc

Home Page: https://huggingface.co/baichuan-inc

artificial-intelligence benchmark ceval chatgpt chinese gpt gpt-4 huggingface large-language-models llama2

bentoml / openllm

llama2,Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

Organization: bentoml

Home Page: https://bentoml.com

llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna bentoml llama2 llm-inference llm-ops open-source-llm openllm ai mistral ml mlops

bigscience-workshop / petals

llama2,🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Organization: bigscience-workshop

Home Page: https://petals.dev

bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism

brucemacd / chatd

llama2,Chat with your documents using local AI

User: brucemacd

Home Page: https://chatd.ai

chat desktop electron llm ollama rag llama2 mistral mistral-7b

llama2,⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️, supports OpenAI, Azure, LLaMA, Google Gemini, HuggingFace, Claude, Grok, etc., chat bot demo: https://demo.casibase.com, admin UI demo: https://demo-admin.casibase.com

Organization: casibase

Home Page: https://casibase.org

ai aigc chatgpt gpt knowledge-base casibase langchain claude huggingface openai

chenking2020 / findthechatgpter

llama2,ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利

User: chenking2020

chatglm llama belle vicuna chatgpt alpaca guanaco lora llava minigpt4

crazyboym / llama3-chinese-chat

llama2,Llama3 中文仓库（聚合资料：各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、部署教程视频 & 文档）

User: crazyboym

Home Page: https://huggingface.co/shareAI

llama llama2 llama3 llama3-chinese llama3-finetune

curiousily / get-things-done-with-prompt-engineering-and-langchain

llama2,LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.

User: curiousily

Home Page: https://www.mlexpert.io/prompt-engineering

chatgpt gpt-4 gpt4 prompt-engineering artificial-intelligence deep-learning language-models openai python langchain large-language-models llama2

dicklesworthstone / swiss_army_llama

llama2,A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

User: dicklesworthstone

georgian-io / llm-finetuning-toolkit

llama2,Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

Organization: georgian-io

classification fine-tuning finetuning large-language-models nlp nlp-machine-learning summarization falcon flan-t5 llama2

getumbrel / llama-gpt

llama2,A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Organization: getumbrel

Home Page: https://apps.umbrel.com/app/llama-gpt

ai chatgpt gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp

h2oai / h2o-llmstudio

llama2,H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/

Organization: h2oai

Home Page: https://gpt-gm.h2o.ai

ai chatbot chatgpt fine-tuning finetuning generative generative-ai gpt llama llama2

h2oai / h2ogpt

llama2,Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/

Organization: h2oai

Home Page: http://h2o.ai

chatgpt llm ai embeddings generative gpt gpt4all pdf private privategpt

haotian-liu / llava

llama2,[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

User: haotian-liu

Home Page: https://llava.hliu.cc

chatbot chatgpt foundation-models gpt-4 instruction-tuning llama llama-2 llama2 llava multi-modality multimodal vision-language-model visual-language-learning

higgsfield-ai / higgsfield

llama2,Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

Organization: higgsfield-ai

cluster-management deep-learning distributed llama llama2 llm machine-learning mlops pytorch

internlm / lmdeploy

llama2,LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Organization: internlm

Home Page: https://lmdeploy.readthedocs.io/en/latest/

cuda-kernels deepspeed fastertransformer llm-inference turbomind internlm llama llm codellama llama2

internlm / xtuner

llama2,An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

Organization: internlm

baichuan chatglm2 internlm large-language-models llama2 llm llm-training peft qwen chatbot

janhq / cortex

llama2,Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

Organization: janhq

Home Page: https://nitro.jan.ai/

accelerated ai cuda gguf inference-engine llama llama2 llamacpp llm llms openai-api stable-diffusion tensorrt-llm

janhq / jan

llama2,Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

Organization: janhq

Home Page: https://jan.ai/

electron gpt llama2 llamacpp localai self-hosted

langgenius / dify

llama2,Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Organization: langgenius

Home Page: https://dify.ai

ai backend-as-a-service gpt langchain llm openai python llama2 rag orchestration

liltom-eth / llama2-webui

llama2,Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.

User: liltom-eth

llama-2 llama2 llm llm-inference

linksoul-ai / chinese-llama-2-7b

llama2,开源社区第一个能下载、能运行的中文 LLaMA2 模型！

Organization: linksoul-ai

deep-learning llama2 llama2-docker llm pytorch

lobehub / lobe-chat

llama2,🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Bedrock / Azure / Mistral / Perplexity ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.

Organization: lobehub

Home Page: https://chat-preview.lobehub.com

chatgpt nextjs openai ai chat function-calling gpt gpt-4 azure-openai gpt-4-vision

ludwig-ai / ludwig

llama2,Low-code framework for building custom LLMs, neural networks, and other AI models

Organization: ludwig-ai

Home Page: http://ludwig.ai

deep-learning deeplearning deep learning machine-learning machinelearning natural-language-processing natural-language computer-vision data-centric

melih-unsal / demogpt

llama2,Create 🦜️🔗 LangChain apps by just using prompts🌟 Star to support our work! | 只需使用句子即可创建 LangChain 应用程序。给个star支持我们的工作吧！

User: melih-unsal

Home Page: https://demogpt.io/

chatgpt demo langchain llms streamlit streamlit-application chatgpt-api gpt3-turbo langchain-python langchain-app

meta-llama / llama-recipes

llama2,Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

Organization: meta-llama

ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm

mobile-artificial-intelligence / maid

llama2,Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Organization: mobile-artificial-intelligence

android chatbot chatgpt facebook flutter gguf large-language-models llama llama-cpp llama2

ollama / ollama

llama2,Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Organization: ollama

Home Page: https://ollama.com

llama llm llama2 llms go golang ollama mistral

open-compass / opencompass

llama2,OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Organization: open-compass

Home Page: https://opencompass.org.cn/

evaluation benchmark large-language-model chatgpt llm llama2 openai llama3

ray-project / llm-applications

llama2,A comprehensive guide to building RAG-based LLM applications for production.

Organization: ray-project

llms machine-learning ray anyscale fine-tuning llama2 openai serving

rjmacarthy / twinny

llama2,The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.

User: rjmacarthy

Home Page: https://marketplace.visualstudio.com/items?itemName=rjmacarthy.twinny

artificial-intelligence code-generation vscode-extension code-completion copilot codellama llama2 ollama ollama-api code-chat free ollama-chat private llamacpp

safevideo / autollm

llama2,Ship RAG based LLM web apps in seconds.

Organization: safevideo

anthropic bedrock cohere fastapi langchain large-language-models llama-index llama2 llm openai

scisharp / llamasharp

llama2,A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently.

Organization: scisharp

Home Page: https://scisharp.github.io/LLamaSharp

chatbot gpt llama llamacpp llm semantic-kernel llava multi-modal llama2 llama3 llama-cpp

semanser / codel

llama2,✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

User: semanser

Home Page: https://discord.gg/uMaGSHNjzc

agent ai autonomous-agents devin openai bot llms ollama llama2

smallcloudai / refact

llama2,WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

Organization: smallcloudai

Home Page: https://refact.ai

ai autocompletion chat refactoring fine-tuning self-hosted llama2 llms starchat starcoder

squeezeailab / llmcompiler

llama2,LLMCompiler: An LLM Compiler for Parallel Function Calling

Organization: squeezeailab

Home Page: https://arxiv.org/abs/2312.04511

function-calling llm llm-agent llm-agents llms parallel-function-call efficient-inference large-language-models llama llama2

tairov / llama2.mojo

llama2,Inference Llama 2 in one file of pure 🔥

User: tairov

Home Page: https://www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov

inference llama llama2 modular mojo parallelize performance simd tensor transformer-architecture vectorization

tigerresearch / tigerbot

llama2,TigerBot: A multi-language multi-task LLM

Organization: tigerresearch

Home Page: https://www.tigerbot.com

llm nlp chinese data llama2

unslothai / unsloth

llama2,Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

Organization: unslothai

Home Page: https://unsloth.ai

ai finetuning fine-tuning llama llms lora mistral qlora llama2 gemma

wenge-research / yayi

llama2,雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

User: wenge-research

Home Page: https://www.wenge.com/yayi/index.html

bloom chinese llama llama2 llm yayi chat lora

xorbitsai / inference

llama2,Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Organization: xorbitsai

Home Page: https://inference.readthedocs.io

ggml pytorch chatglm chatglm2 deployment flan-t5 llm wizardlm artificial-intelligence machine-learning

xusenlinzy / api-for-open-llm

llama2,Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

User: xusenlinzy

docker langchain llms nlp openai chatglm llama moss phoenix baichuan

yangjianxin1 / firefly

llama2,Firefly: 大模型训练工具，支持训练Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

User: yangjianxin1

gpt alpaca llm baichuan llama lora qlora peft llama2 internlm