The official version of the microgpt triptych from Andrej Karpathy. microgpt is a single file of 200 lines of pure Python with no dependencies that trains and inferences a GPT. This file contains the full algorithmic content of what is needed: dataset of documents, tokenizer, autograd engine, a GPT-2-like neural network architecture, the Adam optimizer, training loop, and inference loop. Everything else is just efficiency. I cannot simplify this any further. This script is the culmination of multiple projects (micrograd, makemore, nanogpt, etc.) and a decade-long obsession to simplify LLMs to their bare essentials, and I think it is beautiful 🥹. It even breaks perfectly across 3 columns, making it a perfect target for a triptych. Find more information in this microgpt post. This is the triptych version. Each pane is of size 18x12 inches and there are 3 total (for each of the 3 columns of code). Therefore, if put side by side with no padding this works out to to approximately 18 inches tall and 36 inches wide.
