alicankiraz1/gemma-4-31b-mtp-vllm-server · gitaskhub

alicankiraz1/gemma-4-31b-mtp-vllm-server↗

A production-minded FastAPI sidecar for serving Gemma 4 31B on vLLM with Gemma 4 Multi-Token Prediction (MTP) speculative decoding.

Stars · 59

Language · Python

License · Apache-2.0

Ask anything about this repo to start.

Full explanation on explaingit →