Trying out ollama.
Linux Mint 20.04, Docker installed locally. RTX 4070 TI, 32GB RAM.
Before running the docker container you'll want to check some of the docs for running ollama in docker : https://github.com/ollama/ollama/blob/main/docs/docker.md
docker compose -f compose.yaml up -d