Human extinction does not feel as terrible as it should: a LessWrong essay examines the reasons for this gap, and an Oxford experiment found that only 23% of people judged extinction categorically worse than the death of 80% of the world's population
Human extinction does not feel as terrible as it should: a LessWrong essay examines the reasons for this gap, and an Oxford experiment found that only 23% of people judged extinction categorically worse than the death of 80% of the world's population
A LessWrong user going by mxbutterfree admits to being convinced that human extinction is the worst possible outcome, yet unable to find any fear of it. The post was published on September 26, the anniversary of the decision by officer Stanislav Petrov that, according to historians, very likely prevented a retaliatory Soviet nuclear strike in 1983.
The author writes: "'The death of everyone' does not feel as bad to me as it should. I understand intellectually that it is very bad, but it is as though the corresponding feeling is simply absent." He immediately clarifies: "I am not a death enthusiast and I do not enjoy the thought of disappearance. I want all of us to live forever." The trigger was a phrase about superintelligent artificial intelligence, "if someone builds it, everyone dies," the title of a 2025 bestseller by Eliezer Yudkowsky and Nate Soares.
Ordinary death is frightening in part because people are left behind to grieve, while the death of everyone leaves no one to mourn. The injustice of "dying before others" also vanishes: the end comes for everyone at once, and no one is left alone. Extinction is confused with the image of a computer being switched off, with no violence and no visible agony. The usual ways of making peace with death ("that is just how life works," belief in an afterlife) transfer readily to the extinction of the species. There is no precedent for total disappearance, so the scenario registers more as science fiction than as a real possibility.
One mechanism has been confirmed by separate research: a single vivid image influences emotion more powerfully than the scale of a tragedy. In a classic experiment, people were asked how much they would pay to save 2,000, 20,000, and 200,000 birds from an oil spill. On average they named $80, $78, and $88: a hundredfold increase in the number of birds barely changed willingness to pay. Psychologists call this scope insensitivity, and the same bias operates when people contemplate the fate of the species.
Psychologists at the University of Oxford, Stefan Schubert, Lucius Caviola, and Nadira Faber, confirmed the effect in 2019 in Scientific Reports. Participants were asked to compare two steps: from a world without catastrophe to the death of 80% of the population, and from the death of 80% to total extinction. Although the surviving 20% still have a future while an extinct species does not, only 23% judged the second step to be worse. A higher score on a test of reflective thinking increased the likelihood of recognizing extinction as uniquely bad.
In the comments, Vladimir Nesov objects: feelings are not obliged to match a rational conclusion. They are a signal independent of calculation, and forcing them to conform to reason's verdict would strip them of that function.
Commenter Dagon put the stakes into a number, a quadrillion, a one followed by fifteen zeros:
"Ten to the fifteenth power and more potential future humans who simply will never come into existence provoke almost no emotional response in many of us"
The author ends the post with the words: "And happy Petrov Day. May death be destroyed." The essay focuses on extinction from AI, but the same mechanism applies to a far more probable scenario: death from aging. The philosopher Nick Bostrom calculated that 170,000 deaths from aging every day outweigh nearly any risk from superintelligence. The same formula, "everyone dies," from Yudkowsky describes aging just as well. In the Oxford experiment, it was precisely the habit of thinking slowly rather than trusting an initial reaction that raised the chance of recognizing extinction as uniquely bad. The same habit can correct how people relate to death from aging.
- https://www.lesswrong.com/posts/xak4GixbKD9W5jzqn/extinction-does-not-feel-as-bad-as-it-should
- https://en.wikipedia.org/wiki/1983_Soviet_nuclear_false_alarm_incident
- https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_Dies
- https://www.lesswrong.com/posts/2ftJ38y9SRBCBsCzy/scope-insensitivity
- https://www.nature.com/articles/s41598-019-50145-9
- https://www.lesswrong.com/posts/xak4GixbKD9W5jzqn/extinction-does-not-feel-as-bad-as-it-should/comment/i8JMySqEQZkXHtkNP
- https://t.me/UkhvatNews/47