how-to-train-your-gpt

This project is a 12-part interactive textbook about building, training and running a modern language model from scratch. It offers examples of code that are interpreted each line containing the basic components of the Transformer architecture. Tokenizer explains issues such as burials, attention mechanisms, and training cycles by clearing them of technical terms.