Product manager, technologist, and builder. I write about product management, AI, books, and other fun things!

View all →
How Many R's in Strawberry? Training Echo, My Own LLM

How Many R's in Strawberry? Training Echo, My Own LLM

I trained Echo, a 1.38B-parameter GPT, from scratch on 8 H100s using nanochat and Claude Code. She beats 2019's GPT-2 on CORE for $69, after $104 of failures.

nanochatPyTorchRunPodHugging Face

View all →