The choice between a human future and a future ruled by AI is the central question of our time, Geoffrey Miller writes in his foreword to a new edition of Stapledon's Last and First Men
The choice between a human future and a future ruled by AI is the central question of our time, Geoffrey Miller writes in his foreword to a new edition of Stapledon's Last and First Men
In his 1930 novel, Olaf Stapledon described humanity evolving through eighteen human species over two billion years. Ark Press will release a new edition on December 15. Evolutionary psychologist Miller announced his foreword on November 17, and the publisher has already published it in full.
Miller describes San Francisco Bay Area “transhumanists” (advocates of using technology to enhance humans) and “effective accelerationists” (advocates of rapid AI development) as welcoming a future ruled by artificial superintelligences. In that future, human descendants either become extinct within a few decades or survive as “amusing curiosities.” Many humanists, advocates of higher birth rates, and AI safety specialists, by contrast, see AI as the greatest extinction risk and want to protect human descendants from being exterminated by AI or reduced to powerless zoo animals.
Stapledon's future, Miller writes, remains human: the novel's protagonist is humanity as a biological lineage. Selective breeding and genetic manipulation turn human descendants into giant brains and telepathic collectives, while intelligence remains “in organic brains, rather than graphics processing units.” The novel also features organic superintelligence: the third human species breeds the fourth, a species of giant brains. The brains subjugate their creators and, when they rebel, exterminate them through an obedient variety of humans whose will they control completely. Recognizing that they lack an understanding of human values, the brains breed their own successors. Stapledon's biographer Robert Crossley says this episode seems to anticipate the development of AI and its risks.
In December 1931, Winston Churchill recounted the book in The Strand Magazine without naming its author. In his account, a state eventually emerged “whose citizens lived as long as they wished.” At the end of the novel, the last human species, also accustomed to expecting many thousands of years of life, learns that the Sun will die and accepts its fate. To send artificial seeds of a new humanity out among the stars nonetheless, they turn to the past and learn “loyalty to the forces of life fighting against the forces of death.” They can then struggle as though victory alone mattered to them. Miller writes that Stapledon taught him this same loyalty to the forces of life.
In the early 1990s, Miller faced a choice between a human future and an AI future. He was being paid to build autonomous robots and could become an AI researcher, building machines capable of replacing humans, or remain an evolutionary psychologist and study the human mind. Reading the novel in 1993 steered him toward the human path. Evolutionary thinkers like Miller see our generation as “a very small link in a very long chain of ancestors,” but rarely extend that view into the distant future. Stapledon gave Miller that perspective. Soon afterward, Miller had his first child. Having a child, he says, is “the most authentic vote for a human future that anyone can cast.”
Two days before Miller announced the foreword, programmer Eric Raymond explained that his support for rapid AI development was partly motivated by his desire to avoid death. Miller replied that he “would rather die of aging” than impose a 10-percent risk of extinction on his children and humanity.
The foreword ends with the hope that the book will help readers regain some optimism: “our future can remain our own.”