In an unusual coalition, Prince Harry, Meghan Markle, and prominent figures from the worlds of tech, politics, and entertainment have joined forces with conservative commentators Steve Bannon and Glenn Beck. Their common cause? A demand for a ban on the development of ultra-powerful, “superintelligent” AI that they fear could threaten humanity’s future.The call for action, organized by the non-profit Future of Life Institute, is directly aimed at tech giants like Google, OpenAI, and Meta, who are locked in a high-stakes race to build Artificial Intelligence that can outperform humans in nearly every cognitive task.
A simple, stark demand
The group’s statement is a concise, 30-word warning: “We call for a prohibition on the development of superintelligence, not lifted before there is broad scientific consensus that it will be done safely and controllably, and strong public buy-in.”The letter acknowledges that AI can bring benefits like new cures and economic prosperity. However, it warns of a dark side, stating that the goal of creating superintelligence raises fears of “human economic obsolescence and disempowerment, losses of freedom, civil liberties, dignity, and control, to national security risks and even potential human extinction,” AP cited.
An unlikely alliance for a common cause
The list of signatories is notably diverse, crossing deep political and professional divides in an effort to show widespread concern.Prince Harry, in a personal note, stated, “the future of AI should serve humanity, not replace it. I believe the true test of progress will be not how fast we move, but how wisely we steer. There is no second chance.” Meghan, the Duchess of Sussex, also signed, as per AP reports.They were joined by AI pioneers who helped create the technology now causing alarm. Yoshua Bengio and Geoffrey Hinton, both Turing Award winners, added their names. Hinton, who also recently won a Nobel Prize in physics, has been vocal about the dangers.The inclusion of Steve Bannon and Glenn Beck signals an attempt to appeal to a broad political spectrum, including supporters of former President Donald Trump.Other notable signatories include Apple co-founder Steve Wozniak, billionaire Richard Branson, former top US general Mike Mullen, and Barack Obama‘s national security adviser Susan Rice. Actors Stephen Fry and Joseph Gordon-Levitt also signed.Gordon-Levitt, whose wife was previously on the board of OpenAI, commented, “Yeah, we want specific AI tools that can help cure diseases, strengthen national security, etc.”He further added “But does AI also need to imitate humans, groom our kids, turn us all into slop junkies and make zillions of dollars serving ads? Most people don’t want that.”
Is the fear justified or just hype?
This letter is likely to fuel ongoing debates within the tech community about how real the threat of superhuman AI is.Max Tegmark, president of the Future of Life Institute, noted that the criticism has gone mainstream. “In the past, it’s mostly been the nerds versus the nerds,” he said. “I feel what we’re really seeing here is how the criticism has gone very mainstream.”Complicating the issue is that the very companies developing this technology sometimes exaggerate their products’ abilities to attract investors, creating what some fear is an “AI bubble.”This is not the first warning from Tegmark’s group. In March 2023, they called for a temporary pause on developing powerful AI models. That plea was ignored by major companies, including by its most famous signatory, Elon Musk, who was simultaneously starting his own AI firm.When asked if he approached Musk again, Tegmark said he contacted all major AI CEOs but didn’t expect them to sign. He expressed sympathy for their position, trapped in a competitive race. “I think that’s why it’s so important to stigmatise the race to superintelligence, to the point where the US government just steps in,” he concluded.
