The Knowledge Assembly

In her October 6 Aeon essay, “How to assemble science,” journalist Helen Pearson recounts statistician Gene Glass’s objection to influential reviews dismissing psychotherapy. Their author, psychologist Hans Eysenck, had excluded hundreds of studies because they appeared in theses or dissertations rather than academic journals. According to Pearson, Glass and psychologist Mary Lee Smith went looking more widely, eventually gathering more than 370 studies comparing psychotherapy with a control group or another therapy.

The disagreement was partly about treatment. It was also about the entrance requirements for knowledge.

The work between findings

Pearson describes how Glass and Smith combined measurements across studies using a standardised effect size, rather than simply counting studies that found a benefit against those that did not. Glass presented the approach he called meta-analysis in 1976. Their synthesis found a beneficial effect of psychotherapy; that historical finding does not settle which therapies help which people today.

The important move was to make the relationship between findings itself an object of research. A pile of papers could become something other than a choice of papers to quote.

Systematic reviews give that work a structure: search for relevant studies, assess their reliability, extract their findings and bring them together. Some include a meta-analysis. As Pearson explains, the two terms are related, not interchangeable.

There is an awkward cultural proposition here. Producing another finding and improving what people can know are not always the same achievement. Pearson describes academic incentives to publish individual papers and journalism’s appetite for fresh results. Assembly offers less obvious glamour. “Researchers carefully checked what everyone already said” has a difficult relationship with the headline economy.

Yet without that checking, the reader is left to perform an impossible private task: reconcile the latest alarming result with yesterday’s reassuring one, usually between other obligations. Calling this reader insufficiently scientifically literate would be a convenient way to avoid asking who was supposed to build the bridge.

Someone has to keep looking

Pearson’s account follows the work into an institution. In 1993, Iain Chalmers and colleagues founded the Cochrane Collaboration to produce systematic reviews of healthcare evidence. The machinery included searching databases, checking journals by hand and recruiting volunteers. Knowledge needed people to find it, not merely somewhere to exist.

This is where coherenceism’s commitment to a commons becomes practical. Shared material is only part of the undertaking. People also need usable routes through it: explanations of what was searched, why some evidence counted, how uncertainty was handled and when the answer needs revisiting. Those routes require sustained work. They should remain open to challenge by the people relying on them.

A review’s authority can otherwise conceal the same exclusions it was meant to correct. Pearson notes criticism that conventional reviews privilege quantitative research and can leave out qualitative work, lived experience and Indigenous knowledge. She also describes mixed-methods approaches and reviews updated as new research arrives. Assembly is a set of choices, not a machine that washes judgment out of evidence.

That does not mean every account answers every question equally well. It means the choice of evidence needs an explanation beyond its convenience for the method. A treatment’s measured effect and a patient’s experience of receiving it can answer different, necessary questions.

Pearson’s essay is an argument for synthesis, not a certification of every review carrying the label. Nor can assembling findings decide, by itself, whose priorities should govern a policy or which burdens people should accept.

The invitation is smaller and more demanding than “trust the experts.” When the next finding arrives, ask what it changes in the wider evidence—and who has done the work of checking. Then ask whether the people left outside the summary have a way to be heard.

The thesis on the shelf cannot nominate itself for inclusion.