The “bias blind spot” (“everyone else is more biased than me”) just replicated

Psychology's replication crisis receives a lot of airtime, with plenty of examples of failed replications and methodological issues that cast doubt on past research findings. But there is also good news: several key results in cognitive psychology and personality research, for example, have been successfully replicated.

Now researchers have reproduced the results of another highly-cited study. Back in 2002, Emily Pronin and colleagues first described the "bias blind spot", the finding that people believe they are less biased in their judgments and behaviour than the general population – that is, they are "blind" to their own cognitive biases. And while that study kick-started a whole line of related research, no one had attempted to directly replicate the original experiments.

But in a preregistered preprint published recently to ResearchGate, Prasad Chandrashekar, Siu Kit Yeung and colleagues report reproducing the original study, first in a small group of Hong Kong undergraduates, and then in two larger samples of 303 and 621 Americans who completed online surveys. 

Each group was given detailed descriptions of eight cognitive biases such as "hostile media bias" (where people view neutral media reports as hostile towards their own point of view) and "self-serving bias" (where people take responsibility for their successes but not failures). They were also given descriptions of three visible "personal shortcomings", like procrastination and fear of public speaking.

The participants rated the extent to which they thought they exhibited these biases and shortcomings, before rating how much other people generally show these tendencies. Consistent with Pronin's original result, across all three studies participants thought that their own susceptibility to biases was lower than that of others. 

When it came to rating personal shortcomings, the results diverged from the original study. While Pronin had found no difference in how people rated their own and others' shortcomings, the new research found that participants rated their own shortcomings as less severe. However, this difference was small, suggesting that people are more "blind" to their cognitive biases – which remain invisible – than to personal weaknesses which may have much more obvious effects (e.g. being late to hand in an assignment due to procrastination).

Chandrashekar's team also added a new spin to the original study by investigating whether participants' blind spot bias was influenced by their belief in free will (rated by their agreement with statements like "I am in charge of the decisions I make"), which is known to affect how people judge themselves and others.

Participants with a stronger belief in free will had a greater blind spot when it came to personal shortcomings. That is, the gap between how they rated their own and others' shortcomings was larger than the gap for people with a weaker belief in free will. The authors suggest that this is because people who believe more strongly that someone's behaviours and decisions are completely under their own control are less likely to see such shortcomings in themselves: for them, such an admission would imply they have some innate weakness that can't be overcome through their own choices. Belief in free will did not have any effect on the blind spot for cognitive biases, however. 

The authors write that their results "provide reasonable support" for the findings of the original study, suggesting that the bias blind spot is a robust phenomenon. But it's perhaps surprising that it is reportedly the first direct replication of a piece of research that is more than 15 years old and has received nearly 1,000 citations. Hopefully, the new effort is a sign that the field is increasingly recognising the value in well-designed replication attempts – something the authors themselves acknowledge. "The study contributes to the recent call for systematic, large-scale, and preregistered replication and validation studies," they write.

Further reading

—Agency and self-other asymmetries in perceived bias and shortcomings: Replications of the Bias Blind Spot and extensions linking to free will beliefs [this paper is a preprint meaning that it has not yet been peer reviewed and the final published version may differ from the version that this report was based on]

About the author

Matthew Warren (@MattbWarren) is Staff Writer at BPS Research Digest