Run multiple same or different open source large language models such as Llama2, Mistral and Gemma in parallel simultaneously powered by Ollama.
Screen.Recording.April.4.mov
You need Ollama installed on your computer.
cd backend
bun run index.ts
cd frontend
pnpm run dev
โ ๏ธ Still work in progress