Sam Altman is ready to slow down

Sam Altman, CEO of OpenAI, says it may be time to “accelerate” AI development so the world is ready for it.

“We may have to accelerate the rate of AI development to give ourselves enough time for society to harden around some of these new levels of ability.” He said Patrick O’Shaughnessy, host of Invest Like the Best, while “we’re also trying to figure out how to do this in a way that doesn’t look like regulatory control over anyone, and doesn’t look like collusion between frontier labs.”

both of them OpenAI and Anthropic He came out in support petition It was circulated by staff at Frontier Laboratories, calling on the US government to “support international efforts to develop the technical and governance tools needed to intentionally accelerate the frontiers of automated AI development.”

Altman has avoided signing on to previous campaigns to slow the progress of artificial intelligence. Contact An open letter in 2023 suggesting a similar slowdown “misses most of the technical nuance about where we need to pause.”

He’s clearly toned down that idea, thanks in part to The accident An advanced OpenAI model was able to compromise a secure computing environment and compromise Hugging Face, a typical online database, using several zero-day exploits.

In the podcast, the OpenAI co-founder described it as “a very science-fiction cyber incident… It’s the first security incident that I feel strongly about.”

OpenAI researchers have paused training on this model while they work out how to keep their sandbox secure. But as models become more powerful, the need to “accelerate” their development could become key to safe deployment, Altman said.

While the integrity and alignment of models has always been a concern in the world of AI, the arrival of Anthropic’s highly capable Mythos model earlier this year has turned assumptions into real-world problems.

However, the industry has a trust problem, and tough economics give major players an incentive to highlight the risks of their systems in ways that experts disagree about — for example, whether or not Anthropic’s Fable model should be briefly banned from use. Likewise, when Kimi K3, a large open-weight model manufactured in China, was launched, Head of Strategic Futures at OpenAI It threatens the economics of frontier laboratories, said Brigadier General W. PaulThis makes it difficult to separate their safety concerns from their financial interests.

“I think a lot of the talk about safety concerns is justified, and a lot of it is about people who really want, even if somewhat subconsciously, a concentration of power,” Altman said, in what could be seen as a criticism of his rival, Anthropic CEO Dario Amodei, who signed the petition. “I’m terrified of a world where real fears of AI are used as a way to say: ‘Only this small group of people can get it because it’s so dangerous, and only they understand it, but don’t worry, they’ll make the right decisions for all of us.’ I don’t think so.”

However, OpenAI has opposed efforts to develop government rules for AI models, favoring instead an industry-led approach in which AI labs create ostensibly independent organizations that would evaluate the safety of models and the safety approach taken by their makers.

The challenge for this approach to regulation and any efforts to slow AI development will be getting different players in the industry on the same page, whether they are competing frontier labs in the United States or competitors in China.

This story has been updated to include OpenAI and Anthropic’s support of the “Pacing the Frontier” petition.