git
ask
hub
Privacy
Terms
Sign in with GitHub
ehoogeboom/discrete-diffusion-lm
↗
Stars ·
5
Language ·
Python
License ·
MIT
Simplify and Visualize This Repo
Scan the safety of this repo
Self Host this repo
Check out more work of Developer: ehoogeboom
Ask anything about this repo to start.
Walk me through setting up discrete-diffusion-lm on a RunPod A100 and training the md teacher on OpenWebText
Show me how to point distill.py at an md checkpoint and run the k=16 D-MMD student
Explain how the AR, MD, and D-MMD trainers share the transformer backbone in src/discrete_diffusion_lm/model.py
Help me add a new SampleEval metric alongside GenerativeLLMMetricConfig for gpt2-large
Scale this repo from the 6L/8H/512d backbone up to the GPT-2-small sized 12L/12H/768d setup
Full explanation on explaingit →
📎
Send
By chatting or signing in you agree to the
Terms
and chat-message logging (revocable in
History
).