gitaskhub

Running large language models on a single GPU for throughput-oriented scenarios.

Stars · 9,361
Language · Python
License · Apache-2.0
Ask anything about this repo to start.
Full explanation on explaingit →

By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).