git
ask
hub
Privacy
Terms
Sign in with GitHub
aryangonsalves/trl-token-reduction
↗
Stars ·
2
Language ·
Python
License ·
Apache-2.0
Simplify and Visualize This Repo
Scan the safety of this repo
Self Host this repo
Check out more work of Developer: aryangonsalves
Ask anything about this repo to start.
Explain how the caching, compression, retrieval, and cascade levers in this project each reduce token usage.
Walk me through running the heavy_bench.py or bigcode_bench.py benchmarks to reproduce the results.
Show me how to point the retrieval tool at my own codebase to measure its token reduction.
Help me integrate this token-reduction layer in front of my own Claude or GPT API calls.
Full explanation on explaingit →
📎
Send
By chatting or signing in you agree to the
Terms
and chat-message logging (revocable in
History
).