Semantic cache for LLM calls with no torch, no server, no API key and no GPU. One file, CPU static embeddings. Benchmarked on 5,000 real question pairs: 70% of rephrasings served from cache, 28% false matches.
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).