Fully offline tiny LLM chatbot on the ESP32-S3 Cardputer ADV - 8M params, Q4 weights baked into the firmware, ~5 tok/s.
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).