C++23 inference engine for Qwen3-4B on Apple Silicon. 125.77 tok/s (1.62x llama-cli). OpenAI-compatible streaming server. No Python, no llama.cpp, no Ollama.
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).