open-source
22 articles
Karpathy Trained GPT-2 for Just $72 — OpenAI Spent $43,000 Seven Years Ago
Karpathy open-sourced nanochat — a minimal LLM training framework. With 8 H100 GPUs running for 3 hours at $72, you can train a GPT-2 level model. OpenAI spent $43,000 training the same model in 2019. That's a 600x cost reduction. On spot instances, it's just $20.
The Father of Terraform Fights Back: AI Broke Open Source Trust, So Mitchell Hashimoto Built Vouch
Mitchell Hashimoto (Terraform creator) says AI destroyed open source trust by enabling low-quality contributions. His solution: Vouch, a trust management system on Ghostty where trusted people vouch for others.