Muskeology
Frontier tech, minus the hype

AI & Compute

Where AI Data Centers Get Built And Why

Siting a large computing campus is decided by available electrical capacity, water, land and local permitting, which is why clusters form in a few American regions rather than near users.

Detailed image of a circuit board featuring capacitors and intricate pathways, ideal for tech-related content.
Detailed image of a circuit board featuring capacitors and intricate pathways, ideal for tech-related content. · Photo via Pexels

Large training and inference campuses are not distributed evenly across the United States. They cluster, and the clustering follows the grid rather than the population.

Power availability is the first filter

A large campus needs an interconnection to high-voltage transmission and a utility willing to commit capacity. Both are scarce, and both take years to arrange.

Developers therefore search for locations where substation capacity already exists or where a retired industrial load has freed it up. Finding spare electrons is harder than finding land.

This is why former aluminum smelters, paper mills and coal plant sites reappear as computing sites: the wires are already there.

Latency matters for some workloads and not others

Serving an interactive application benefits from being physically close to users, because signals take time to travel and each round trip adds delay.

Training does not care. A job that runs for weeks inside one building can sit anywhere the power is, which decouples the largest facilities from the coasts.

The result is a split: smaller inference sites near metropolitan areas, and very large training campuses in places chosen for energy.

Cooling ties the site to water and climate

Heat has to leave the building. Evaporative systems use water and are efficient; closed-loop and air-cooled systems use less water and more electricity.

Dry regions with cheap power therefore force a trade, and communities increasingly negotiate over which side of it a project takes.

Cooler climates reduce the energy penalty of avoiding water use altogether, which has made northern sites attractive despite distance from customers.

Local government decides the timeline

Zoning, noise limits, backup generator permits and tax arrangements are decided county by county. A jurisdiction that has done this before can move quickly.

Places that have not may take longer or refuse, and opposition now commonly focuses on electricity bills and water rather than on the buildings themselves.

Because approval risk is as real as construction risk, developers concentrate where precedent exists, which reinforces the clustering.

Why the pattern is self-reinforcing

Once a region hosts several campuses, it accumulates electrical contractors, transmission upgrades, trained technicians and a permitting process that understands the use.

Each of those lowers the cost of the next project there. The geography of computing ends up looking like the geography of heavy industry, for the same underlying reasons.

Tobias Nkemelu
AI & Compute, Muskeology

Tobias builds and breaks machine learning systems for a living, which makes him a difficult audience for benchmark announcements.

More from Tobias →

Also by Tobias Nkemelu

AI & Compute

What to actually worry about with AI

A great deal of the risk discussion is about scenarios, and a shorter list of problems is already causing measurable harm.

Tobias Nkemelu··3 min read

AI & Compute

Where AI systems actually fail in production

Not in the model. In the data pipeline, the distribution shift, the feedback loop and the assumption that the world stays still.

Tobias Nkemelu··3 min read

AI & Compute

Evaluating an AI product claim

A short checklist for reading announcements, which mostly consists of asking what was measured and against what.

Tobias Nkemelu··3 min read

Robotics

Autonomous mobile robots outside the warehouse

Hospitals, hotels, factories and pavements — where wheeled autonomy has spread, and the specific reasons each environment is harder than a warehouse.

Lena Brandt··3 min read