from-scratch
1 articles
Karpathy's Ultimate Reduction: 243 Lines of Pure Python, Zero Dependencies, Train a GPT From Scratch
Karpathy's 'art project': a GPT model in 243 lines of pure Python, zero dependencies. Every operation uses atomic math (add, mult, exp, log). Efficiency is secondary. It's the nand2tetris for AI education.