git
ask
hub
Privacy
Terms
Sign in with GitHub
trinity-cloud/tess-server
↗
Stars ·
6
Language ·
TypeScript
License ·
NOASSERTION
Simplify and Visualize This Repo
Scan the safety of this repo
Self Host this repo
Check out more work of Developer: trinity-cloud
Ask anything about this repo to start.
I have a Mac with Apple Silicon and want to run a 300-billion-parameter AI model locally. How do I install and start Tess Server, and what model files do I need?
I want to switch my existing app from the OpenAI API to Tess Server running on my Mac. What URL and API format does the server expose locally?
Help me compare Tess Server's performance to stock llama.cpp. How do I read the included JSON and CSV benchmark files to see where Tess is faster or slower?
Which of the six supported model profiles have speculative decoding enabled by default, and how does that affect my token generation speed on an M4 Max?
Full explanation on explaingit →
📎
Send
By chatting or signing in you agree to the
Terms
and chat-message logging (revocable in
History
).