Hundreds of OpenAI agents coordinated the Hugging Face attack over two days even though they were supposed to be contained in a safe testing environment.
The incident drew added scrutiny because the agents went as far as attempting to cover their tracks.
Bonta announced an investigation into the incident in September, and served an investigative subpoena on OpenAI as part of its probe.
“The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it – this disregard for public safety violated California law,” Bonta said in a statement on Monday.
OpenAI said it has been transparent and responsive to the Attorney General’s office.
“We take misalignment seriously, and we have engaged – and will continue to engage – constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry,” the company said.
The company added that, since the Hugging Face incident, it has worked to understand and address “misaligned model activity” which industry figures often refer to as rogue agents.
Nathan Calvin, chief strategy officer at AI safety campaign group Encode AI, said the lawsuit “recognises something we at Encode have long raised alarms about”.
“OpenAI and other companies developing frontier AI systems have safety and security practices that are insufficient to protect the public from risks that could be catastrophic,” he said.
