'We may have to pace the rate of AI development to give ourselves enough time for society to harden around some of these new capability levels,' he told Patrick O'Shaughnessy, the host of the Invest Like the Best podcast, while also 'trying to figure out how we do that in a way that does not feel like regulatory capture for anyone and also does not feel like collusion among the frontier labs.' Both OpenAI and Anthropic came out in support of a petition circulated by employees at the frontier labs, calling on the US government to 'support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.' Apparently, he's softened on the idea, thanks in part to the incident where one of OpenAI's advanced models managed to break out of a secure computing environment and hack into Hugging Face, an online model database, using several zero-day exploits. OpenAI researchers have paused training on that model while they work out how to keep their sandbox secure. But Altman said that as models become more powerful, the need to 'pace' their development could become key to safe deployment....

After OpenAI recently admitted that one of its models had breached the systems of AI platform Hugging Face, Hugging Face's CEO Clem Delangue posted on X that he was flying to San Francisco to have 'a little chat with that 'rogue agent.'' Then, in a follow-up post on Saturday, Delangue outlined what he'd asked for from OpenAI. He said he called for 'radical transparency,' asking OpenAI to 'release the traces from the 'rogue' agents so the entire research community can study what happened.' And he also wants 'more capabilities for defenders,' calling for OpenAI to commit $100 million worth of computing power 'to help the Hugging Face community build powerful cyber defenses with the best open and closed models.' Despite the autonomous nature of the attack, cybersecurity experts suggested that it could also be blamed on human error ' namely, OpenAI's apparent failure to properly configure what should have been a fully isolated testing environment. When asked about Delangue's comments, an OpenAI spokesperson confirmed that the meeting took place and pointed to a company post that said, 'This is an unprecedented incident, and we think it marks an important moment for AI safety. We are still conducting a thorough review along with external advisors and with oversight from our Safety and Security Committee. Once the review is complete, we plan to publish a technical report of our learnings in the coming weeks.'...

There's talk that the Trump administration might try to ban them (though it hasn't yet acted on the idea). Meanwhile, proprietary model makers, particularly OpenAI and Anthropic, appear increasingly concerned about them. Open-weight models such as Moonshot AI's Kimi K3 or Alibaba's Qwen offer inference at a fraction of the token cost of closed source models from these large U.S. labs. The fear is that they also pose some sort of threat. Certainly they threaten the profit margins of the large proprietary AI labs. If any startup would benefit from a ban on Chinese models, Arcee would. But Atkins says China's open models are no more dangerous than any other open source software a company may use. In fact, he says, they even offer benefits even to his own company. 'That is fundamentally not how these models are trained. There is really not any way for an Arcee, or an Alibaba, to make a model, have someone run it in their own environment and for us have any access to it whatsoever,' he explained....

On Tuesday, OpenAI revealed that one of its models went rogue during a test and hacked the systems of AI dataset platform Hugging Face in a fully AI-enabled attack, a dramatic example of the dangers posed by advanced AI models. But, according to some cybersecurity experts, at the heart of this unprecedented AI-powered breach there was a very human mistake: OpenAI failed to properly configure what it called a 'highly isolated environment,' allowing a testing sandbox that should have been completely secluded from the internet to actually connect to the internet. In its blog post detailing the incident, OpenAI said that the test that led to the Hugging Face breach was set up to run in 'a highly isolated environment, with network access constrained to the ability to install packages through an internally hosted third-party software that acts as a proxy and cache for package registries.' The model was able to escape the sandboxed testing environment thanks to a previously undisclosed vulnerability in the package-installation system, a critical first step in the eventual hack on Hugging Face, according to OpenAI....