Sunday, October 13, 2019

"The Bias That Can Cause Catastrophe"

From the BBC:
The outcome bias erodes your sense of risk and makes you blind to error, explaining everything from fatal plane crashes to the Columbia crash and the Deepwater Horizon oil spill.

magine a pilot is taking a familiar flight along a known route, during which the weather takes a turn for the worst. She knows that flying through the storm comes with some serious risks – and according to her training, she should take a detour or return. But she has flown the same route before, in similar weather – and she hadn’t experienced any problems then. Should she continue? Or should she turn back?
If you believe that she is safe to fly on, then you have fallen for a cognitive quirk known as the “outcome bias”. Studies have shown that we often judge the quality of a decision or behaviour by its endpoint, while ignoring the many mitigating factors that might have contributed to success or failure – and that this can render us oblivious to potentially catastrophic errors in our thinking.
We often judge the quality of a decision or behaviour by its endpoint, while ignoring
 the many mitigating factors that might have contributed to success or failure
In this example, the decision to take the previous flight was itself very risky – and the pilot may have only avoided an accident through a combination of lucky circumstances. But thanks to the outcome bias, she might ignore this possibility and assume that either the dangers had been overrated, or that it was her extraordinary skill that got her through, leading her to feel even happier taking the risk again in the future. And the more she does it, the less concerned about the danger she becomes.

Besides leading us to become increasingly risky in our decision-making, the outcome bias can lead us to ignore incompetence and unethical behaviour in our colleagues. And the consequences can be truly terrifying, with studies suggesting that it has contributed to many famous catastrophes, including the crash of Nasa’s Columbia shuttle and the Deepwater Horizon oil spill....
...MORE