Language Model Builder — Build models. Understand AI.

A short textbook with interactive playgrounds I often find myself explaining how language models are built and trained to friends and family. I finally wrote the introduction I always wanted: It’s friendly to non-programmers, contains many interactive examples, and covers all the fundamentals without treating the reader like a child or a machine learning expert. Interactive from the first pageRun the experiments yourself: build a tokenizer, move through embedding space, inspect attention, and watch a tiny model learn. Interactive from the first page Run the experiments yourself: build a tokenizer, move through embedding space, inspect attention, and watch a tiny model learn. Go as deep as you likeNo coding, machine learning, or math experience required. Where useful, I’ve added opportunities for those curious to dive a little deeper. No coding, machine learning, or math experience required. Where useful, I’ve added opportunities for those curious to dive a little deeper. No artificial additivesThe educational content is only as long as it needs to be, without generated filler content. The educational content is only as long as it needs to be, without generated filler content.