Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).