git
ask
hub
Privacy
Terms
Sign in with GitHub
karpathy/ng-video-lecture
↗
Stars ·
4,851
Language ·
Python
Simplify and Visualize This Repo
Scan the safety of this repo
Self Host this repo
Check out more work of Developer: karpathy
Ask anything about this repo to start.
I'm following Karpathy's Zero To Hero lecture and want to run the nanoGPT training code. Walk me through the Python file structure, what data to use, and how to start training on my machine.
Looking at the ng-video-lecture code, explain how the self-attention mechanism is implemented and how it differs from a simple feedforward layer.
How do I use the git log history of ng-video-lecture to follow the code as it was written during the lecture, step by step?
The README says weight initialization wasn't covered in depth and training converges slowly. What PyTorch weight initialization change would fix this for the transformer blocks in this code?
I want to train the nanoGPT model from this repo on a custom text dataset. What do I need to change to use my own data instead of the default?
Full explanation on explaingit →
📎
Send
By chatting or signing in you agree to the
Terms
and chat-message logging (revocable in
History
).