Writing
Notes on LLM scaling, distributed training, and building the research environment and teams.
-
If you're a tech manager and can't outperform your team, your role is going away
AI collapsed the implementation gap. Orgs just flipped from compute-bound to communication-bound — and middle management is the All-to-all you optimize away.
-
On Assessing the Value of a Project
A simple framework for picking the most impactful work — with practical tips for estimating chance of success, effect size, and applicable scenarios.
-
Determining Model Size and Training Horizon through Scaling Laws
A framework for optimizing model size and training token count from scaling-law coefficients — accounting for inference cost, data repetition, and system efficiency.