GPUStack

An open-source GPU cluster manager for running Large Language Models (LLMs).

https://gpustack.ai/