Muskeology
Frontier tech, minus the hype

Neurotech

Sham Controls And Why Brain Studies Need Them

Stimulation research depends on convincing placebo conditions, because expectation, sensation on the skin and attention from researchers all produce measurable changes without any neural effect.

Intricate MRI brain scan displayed on a computer screen for medical analysis and diagnosis.
Intricate MRI brain scan displayed on a computer screen for medical analysis and diagnosis. · Photo via Pexels

Any study that applies energy to the head has to answer a hard question: how much of the improvement came from the stimulation and how much from everything that surrounds it. The sham condition is the tool designed to separate them.

Expectation produces real, measurable change

Belief that a treatment is working alters reported symptoms and can alter physiology. In studies of mood, pain, attention and fatigue, that effect is often substantial relative to the effect being tested.

It is not imagination in the dismissive sense. The changes appear in the same outcome measures used to judge the active condition, which is precisely why they are difficult to exclude.

Without a comparison group receiving a convincing inactive procedure, a study cannot distinguish the device from the expectation of the device.

A good sham must feel like the real thing

Electrical stimulation tingles, magnetic stimulation clicks and taps, and both can cause visible muscle twitches. A participant who feels nothing knows which group they are in.

Designs therefore ramp current briefly and then stop, use devices that produce the sound without the field, or apply sensation at the skin without the intended deeper effect.

Each of these compromises something, and researchers routinely ask participants to guess their assignment as a check on whether the blind held.

Blinding the experimenter matters as much

Someone who knows which condition a participant received will subtly adjust encouragement, timing and how ambiguous responses are scored. This is well documented and does not require any intent to bias.

Serious protocols keep the person delivering the intervention separate from the person assessing the outcome, and encode device settings so neither knows.

Studies that omit this are not worthless, but their effect sizes should be read with the possibility of inflation in mind.

Crossover designs help and introduce a problem

Having each participant receive both active and sham conditions controls for individual differences, which is valuable when responses vary widely between people.

The difficulty is carryover: if a stimulation session has effects lasting days, the second condition is not measuring a clean baseline, and the washout period between sessions becomes a design assumption.

Longer washouts reduce this at the cost of dropouts and study duration, which is a real constraint on small academic trials.

What this means when reading a headline

The first question about any stimulation finding is whether there was a sham group, whether participants could tell which group they were in, and who scored the outcome.

Open-label studies, in which everyone knows what they received, are appropriate early in development for safety and feasibility, but they do not establish that the intervention itself did anything.

Ravi Shankaran
Editor, Muskeology

Ravi spent nine years as a powertrain engineer before turning to writing. He is unimpressed by anything that has only ever worked on a stage.

More from Ravi →

Also by Ravi Shankaran

Neurotech

Reading a neurotechnology paper

What to look for in a study, and which sections tell you whether the headline is supported.

Ravi Shankaran··3 min read

Robotics

Autonomous mobile robots outside the warehouse

Hospitals, hotels, factories and pavements — where wheeled autonomy has spread, and the specific reasons each environment is harder than a warehouse.

Lena Brandt··3 min read