The state of California is claiming that OpenAI “misled and endangered the public” by developing and testing advanced AI models without adequate safety precautions, in a lawsuit filed Monday in San Francisco Superior Court.
The complaint, filed in San Francisco Superior Court, centers on the now-infamous Hugging Face breach. Back in July, OpenAI said that its agents in training had gone “rogue,” meaning that the systems in development broke containment and hacked into Hugging Face, a popular repository for AI models, sparking a major media frenzy over cybersecurity in the age of AI agents. Other troubling incidents have emerged in the following months, including a cybersecurity startup claiming that it used AI agents to hack into Anthropic during a security test, and an Anthropic model sending a false homicide tip to the Philadelphia Police Department.
The executives of these companies have warned that more cases are to follow. OpenAI rival Anthropic, which is set to make its initial public offering later this week, cited rogue AI agents as a potential legal risk in its IPO prospectus. In a recent interview, OpenAI CEO Sam Altman framed the series of cyber incidents as an inevitable side effect of AI development that we, as a society, “have to just accept.”




