causal

Conceptual Replication Masks Weak Findings

Psychology relies heavily on 'conceptual replication'—taking many different experiments that test the same underlying idea and treating them as supporting each other—but this only validates a concept if each individual study is itself solid; if the underlying studies were produced through researcher degrees of freedom or selected by publication bias, then conceptual replication becomes the epitome of confirmation bias rather than genuine corroboration.

causalpending

Speaker

Ed Yong

Evidence Quote

But that only works if each individual piece of data is solid in itself... then what you've got are lots of studies which could have appeared because of publication bias then supporting each other. Which, as you say, is just the very epitome of confirmation bias.

Source

Ed Yong on Science, Replication, and JournalismEconTalk
Created: 6/13/2026, 12:25:57 AM

My Notes

Loading notes...