AI & Compute
Small models, distillation and the case against always using the biggest
Capability per parameter has improved faster than parameter counts have grown, which changes the economics of what to deploy.
Topic
Every Muskeology article tagged efficiency — 5 pieces across 3 sections.
AI & Compute
Capability per parameter has improved faster than parameter counts have grown, which changes the economics of what to deploy.
Energy
A genuinely useful decarbonisation tool for a specific set of applications, promoted enthusiastically for several where it is a poor fit.
Energy
A technology that delivers several units of heat per unit of electricity, and a set of practical obstacles that have very little to do with the physics.
AI & Compute
Training is a large one-off cost. Inference is a small cost repeated an enormous number of times, and it is the one that scales with success.
Electric Vehicles
The number on the sticker comes from a laboratory cycle. The number on your screen comes from a Tuesday in February.