Lets build GPT 2 from scratch in 100 steps

One effective way to learn the basics of LLMs is by building GPT from scratch. Our plan is to guide you through creating GPT-2 in 100 small, manageable steps. We will deliver approximately 20 newsletters, each containing about 5 practical steps that can be completed in under an hour. The only prerequisite for participation is basic Python knowledge.

Throughout the series, we will progressively cover fundamental topics such as deep learning concepts, PyTorch, the attention mechanism, and transformer models etc. This hands-on series aims to provide practical experience. While the content itself is nothing new—you'll find similar resources available online—our goal is to present it in 100 bite-sized, easily digestible steps.

If you're interested, please sign up here: https://letter.boltu.ai/subscribe