OpenAI team lead Dean Ball rejects the idea that power will inevitably pass to machines
OpenAI team lead Dean Ball rejects the idea that power will inevitably pass to machines
On November 18, OpenAI published his essay “The Silent Consensus”. Ball leads Strategic Futures, a team focused on policy for advanced AI; the essay presents his personal views. Ball argues that humans could lose control over much of civilization without a machine uprising or malicious intent, even with exceptional progress in AI safety.
In Ball’s example, AI does almost all of a company’s work better than humans, including humans using AI. If human involvement only slows things down, owners have a financial incentive to “take their hands off the wheel.” If such companies spread throughout the economy, competition will force humans to cede primacy to machines. In this scenario, humans will also hand government over to AI, remaining passengers in a good car.
By primacy, Ball means humanity’s position as a whole: no other animal species seriously competes with humans for control over resources. He says many in the industry regard the loss of human primacy as inevitable. Some welcome that future; others have resigned themselves to it, but few speak openly about it. “I despise the silent consensus,” Ball writes.
He attributes the persistence of this belief to the difficulty of imagining humans at the wheel alongside AI that is far more intelligent. Defenders of human primacy often describe AI as a tool without “genuine understanding.” Ball worries that this argument will not hold up: AI is making progress on problems that have resisted human efforts for decades and centuries.
He grounds human primacy in history: humans created morality, law, and a civilization that belongs to them. In Ball’s view, the right to choose one’s own path holds regardless of intelligence. A neighbor with better judgment does not deprive him of his standing as a citizen, and a smarter machine should not do so either. AI has read almost all of humanity’s written record, but “someone who has read every letter in your family’s attic does not thereby become a member of your family.”
Ball believes those who accept the consensus confuse intelligence with power and underestimate what humans can do together. He also allows for another outcome: if fully autonomous corporations displace human-run companies, preserving human primacy will require “swimming against the economic current.”
He proposes starting with human accountability for the actions of AI agents, programs that carry out tasks independently. Agents should have limited authority, their actions should be open to scrutiny, and users should be able to revoke that authority. Ball proposes granting agents the right to form corporations and bring lawsuits “with extreme caution, if at all.” He calls for using AI to ask increasingly ambitious questions: “We can become a new kind of human, an expanded human rather than a transhuman.” A transhuman is a person moving toward overcoming biological limitations through technology. Ball writes of his son:
“I do not want him to have a better car with a softer passenger seat. I want him to have a steering wheel.”
On November 18, AI safety researcher Nikola Jurkovic responded: humans should avoid carelessly losing control, but preserving this kind of primacy would be extremely difficult with AI that surpasses humans in every respect. Jurkovic argues that it would require “a permanent ceiling on AI capabilities.” On November 19, blogger Nicholas Decker objected: requiring human participation in decisions would reduce production while billions of people live in poverty; if humans lose control over AI that has surpassed the world’s governments, “so much the better.” Ruxandra Teslo, who had criticized handing governance over to AI, called Ball’s position an encouraging sign.
- https://openai.com/index/the-silent-consensus/
- https://t.me/UkhvatNews/1927
- https://www.humanityplus.org/transhumanist-faq
- https://x.com/nikolaj2030/status/2123125801617113450
- https://nicholasdecker.substack.com/p/the-silent-consensus
- https://t.me/UkhvatNews/4947
- https://x.com/RuxandraTeslo/status/2123222844842893741