🔥 New (1h56m) video lecture: "Let's build GPT: from scratch, in code, spelled out."
www.youtube.com/watch?v=kCc8FmEb1nY
We build and train a Transformer following the "Attention Is All You Need" paper in the language modeling setting and end up with the core of nanoGPT.