Muskeology
Frontier tech, minus the hype

AI & Compute

How Compute Is Counted And Why It Is Controlled

Restrictions on advanced chips depend on measuring computing capability, and the metrics chosen determine which hardware falls inside the rules and which does not.

Detailed image of a circuit board featuring capacitors and intricate pathways, ideal for tech-related content.
Detailed image of a circuit board featuring capacitors and intricate pathways, ideal for tech-related content. · Photo via Pexels

Governments have moved to restrict access to advanced computing hardware, which requires defining what counts as advanced. The definitions are technical, and they shape both policy and product design.

Capability is measured, not described

Rules cannot reference product names, since those change constantly. They instead reference measurable properties such as arithmetic throughput and interconnect bandwidth.

Those figures are published by manufacturers and can be verified, which makes them administrable in a way that qualitative descriptions would not be.

The consequence is that a threshold expressed in numbers determines which products may be sold where, with no discretion at the point of sale.

Thresholds create design incentives

When a limit exists, products appear just beneath it, configured to deliver as much capability as the rules permit.

Manufacturers can reduce one measured property while preserving others, producing hardware that is compliant yet substantially useful for the workloads of concern.

Regulators respond by adding or adjusting metrics, which produces an iterative cycle rather than a stable settlement.

Interconnect matters as much as raw speed

Large models are trained across many chips, so the rate at which those chips exchange data limits what can be built regardless of individual performance.

This is why communication bandwidth appears alongside arithmetic throughput in restrictions, and why limiting it is an effective lever.

It also means that a large number of modest chips is not simply equivalent to a smaller number of powerful ones, since the coordination overhead grows.

Access can be rented rather than owned

Controls on physical shipment do not by themselves prevent remote use of hardware located elsewhere, since computation can be purchased as a service.

Addressing that requires rules about who may be provided with capacity, which involves service providers rather than manufacturers and is harder to verify.

The distinction between owning hardware and using it has therefore become a substantive policy question rather than a commercial detail.

Measurement lags the technology

Metrics that captured capability well at one point can become poor proxies as architectures change and specialised units for particular operations appear.

A chip optimised for one numerical format may score modestly on a general measure while performing extremely well on the workloads that matter.

Keeping definitions current is an ongoing administrative task, and the gap between technical reality and written thresholds is where most of the practical difficulty lives.

Tobias Nkemelu
AI & Compute, Muskeology

Tobias builds and breaks machine learning systems for a living, which makes him a difficult audience for benchmark announcements.

More from Tobias →

Also by Tobias Nkemelu

AI & Compute

What to actually worry about with AI

A great deal of the risk discussion is about scenarios, and a shorter list of problems is already causing measurable harm.

Tobias Nkemelu··3 min read

AI & Compute

Where AI systems actually fail in production

Not in the model. In the data pipeline, the distribution shift, the feedback loop and the assumption that the world stays still.

Tobias Nkemelu··3 min read

AI & Compute

Evaluating an AI product claim

A short checklist for reading announcements, which mostly consists of asking what was measured and against what.

Tobias Nkemelu··3 min read

Robotics

Autonomous mobile robots outside the warehouse

Hospitals, hotels, factories and pavements — where wheeled autonomy has spread, and the specific reasons each environment is harder than a warehouse.

Lena Brandt··3 min read