mer0mingian / runpod-worker-tgi Goto Github PK
View Code? Open in Web Editor NEWThis project forked from runpod-workers/worker-tgi
The RunPod worker template for serving our large language model endpoints. Powered by Text Generation Inference.
License: MIT License