ai-getting-started-prem

A Javascript AI getting started stack for weekend projects, including image/text models, vector stores, auth, and deployment configs

burn

Burn - A Flexible and Comprehensive Deep Learning Framework in Rust

burn-model-serving

End to end example on How to Serve a Burn Model

burn-with-wasm

Example of using Burn with Web Assembly

chat.petals.dev

Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

danswer-prem

Ask Questions in natural language and get Answers backed by private sources. Connects to tools like Slack, GitHub, Confluence, etc.

deep-learning-with-rust

Examples and snippets to get started with Deep Learning and Rust.

dev-portal

embedchain-prem

Framework to easily create LLM powered bots over any dataset.

filopedraz

go-llama2

Llama 2 inference in one file of pure Go

gprc-microservice

Simple Microservice with gRPC

health.petals.dev

Health monitor for a Petals swarm

hello-world-nomad

Testing Nomad as Cross Platform Orchestrator

hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

langchainjs

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

llama-explorer

🚀 Get instant insights in the open-source AI landscape. Most starred repositories, top contirbutors and most used programming languages in a single simple UI.

llama2-burn

Llama2 LLM ported to Rust burn

llm-fastapi-docker-template

localai

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others

localai-website

LocalAI website, powered by Hugo

machine-learning-with-rust

Repository containing Machine Learning snippets and examples using Rust and the most known ML frameworks.

nba-cba-ai-chat-prem

Use AI to ask questions about the new 676-page NBA CBA.

nip05

Nostr Nip05 verification service

openplayground

An LLM playground you can run on your laptop

petals

🌸 Run large language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

petals-model-converter

Convert any HF Model to Petals Optimized Format

prem-app

Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure

prem-daemon