QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.

Stars · 199

Language · Python

License · MIT

Ask anything about this repo to start.

Full explanation on explaingit →