Toppertube › Programming & Tech
The spelled-out intro to language modeling: building makemore
Andrej Karpathy · Programming & Tech · 1 h 57 min · 1.3 million views · published 2022-09-07
We implement a bigram character-level language model, which we will further complexify in followup videos into a modern Transformer language deep learning language model gpt bigram neural network pytorch torch tensor
Watch this lesson free on Toppertube, take notes beside the video, and add it to a course to track your progress and earn a certificate.
More from Andrej Karpathy
- How I use LLMs Andrej Karpathy
- Deep Dive into LLMs like ChatGPT Andrej Karpathy
- Let's reproduce GPT-2 (124M) Andrej Karpathy
- Let's build the GPT Tokenizer Andrej Karpathy
- [1hr Talk] Intro to Large Language Models Andrej Karpathy
- Let's build GPT: from scratch, in code, spelled out. Andrej Karpathy
- Building makemore Part 5: Building a WaveNet Andrej Karpathy
- Building makemore Part 4: Becoming a Backprop Ninja Andrej Karpathy
More in Programming & Tech
- The Agents Were Fine. Everything Around Them Broke. - Joey Wang, Harvey AI Engineer
- 60% of Our Data PRs Now Merge With No Human Review - Chetas Joshi, Robinhood AI Engineer
- An Agent That Fixes Its Own Mistakes - Saloni Gandhi & Ziwei Guo, LinkedIn AI Engineer
- Stop Chatting With Spreadsheets — Francesco Galletta & Felippe Felisola Caso, Monzo AI Engineer
- Your Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAP AI Engineer
- OpenAI spent $1.2 million hacking Linux... and it was a bargain Fireship
- How Gemini 4 Argon & Carbon were built (ft. DeepMind’s Head of Gemini Product) Google Cloud Tech
- How Are People Making Games Like This? Traversy Media