The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).