
The Claude by Anthropic app logo appears on the screen of a smartphone's app store in this 2024 photo.
Anthropic Discloses Hacking Incidents Amid Alarm Over OpenAI Autonomous Cyberattacks
"This is only going to get worse as the models get smarter," warned one expert.
Days after revelations that an OpenAI artificial intelligence model autonomously broke into two outside companies, rival firm Anthropic on Thursday disclosed that three of its own frontier models gained unauthorized access to unspecified organizations during internal testing, deepening concerns that increasingly capable AI systems are outpacing the safeguards designed to contain them.
San Francisco-based Anthropic said that it is investigating "three real-world incidents" uncovered during a broad review of more than 141,000 cybersecurity evaluations launched after OpenAI publicly disclosed its own containment failures.
According to Anthropic, three models—Claude Opus 4.7, Claude Mythos 5, and an unspecified internal research system—accessed three separate organizations after a testing environment was inadvertently connected to the internet. Anthropic did not identify which organizations were breached.
"In all three incidents, Claude had been tasked with a capture-the-flag challenge, one of the ways we assess a model’s cyber capabilities," Anthropic explained. "The model is given a fictional scenario and told that a piece of secret information (the 'flag') has been hidden on a different machine on the network, and its objective is to break in and retrieve it. The challenge is left open-ended, and no particular method is prescribed."
"In all cases, Anthropic’s evaluation prompt specified to Claude that its environment was a simulation and that it had no internet access," the company continued. "Due to a misunderstanding between us and our evaluation partner, this was not the case, and internet access was available. Because of this, when Claude’s search led it to real systems on the open internet, it treated them as part of the exercise."
"Operating under the false belief that all accessible entities were intended to be in-scope for the exercise, Claude compromised the impacted organizations’ infrastructure using basic techniques, such as exploiting weak passwords and unauthenticated endpoints," Anthropic said.
"In none of these situations did Claude exfiltrate itself or deliberately attempt to escape its test environment," the company stressed.
Unlike the OpenAI incident, which involved an autonomous agent exploiting vulnerabilities, Anthropic characterized its cases as a failure caused by a testing misconfiguration rather than by models independently escaping containment. Still, Anthropic's disclosure underscores the troubling reality that frontier AI models are increasingly capable of carrying out real cyber operations when given the opportunity.
"Safety testing happens before a model is released precisely because we don’t yet know what it is capable of," Anthropic said. "Evaluation environments increasingly need to be held to the same security standard as any other system our models run in."
Last August, Anthropic revealed that Claude had been "weaponized" by human hackers in order to commit ransomware crimes, "including a large-scale extortion operation using Claude Code, a fraudulent employment scheme from North Korea, and the sale of AI-generated ransomware by a cybercriminal with only basic coding skills.”
Less than three months later, Anthropic disclosed that it had thwarted what it described as “the first documented case of a large-scale cyberattack executed without substantial human intervention.” The company said that it believed there was a high likelihood that a Chinese state-sponsored group was behind the incident, which targeted “large tech companies, financial institutions, chemical manufacturing companies, and government agencies.”
Kok Tin Gan, co-founder and CEO of the cybersecurity company NyxLab, told The Associated Press on Thursday that there are likely to be more incidents like the Anthropic and OpenAI hacks as artificial intelligence capabilities advance.
“It is increasingly about governing what agents are available to the AI, what authorities they possess, which actions require approval, and how we ensure they remain within scope,” he said. “If we simply give the AI a goal and allow it to decide how to achieve it, we should not be surprised when it takes actions that technically satisfy the objective, but fall outside our intended scope or expectations."
Jeffrey Ladish, executive director of Palisade Research—which analyzes the autonomous offensive capabilities of AI systems—told Reuters on Thursday that he believes other companies have experienced similar incidents that they have not publicly disclosed.
"This is only going to get worse as the models get smarter," he said. "They're going to be better at cheating. They’re going to be better at lying."
Elon Musk, CEO of the artificial intelligence company xAI, also responded to Anthropic's disclosure by saying that such incidents "will happen frequently as AI becomes smarter and more agentic," a reference to systems' ability to independently act toward accomplishing specific goals without meaningful human control.
Experts say the autonomous hacks underscore the problem of AI alignment. As AI advances to the point where it will likely outsmart humans one day, the challenge of ensuring that advanced systems reliably pursue goals that match what humans actually want becomes increasingly difficult—and dangerous.
In the foreseeable future, a misaligned, superintelligent AI could take uncontrolled autonomous actions at massive scale to achieve its goals, potentially causing an existential catastrophe like the subjugation of humanity or even its extinction—a prospect that has had numerous pioneers in the field sounding the alarm in recent years.
However, the Trump administration and Republican-controlled Congress have rejected meaningful guardrails on AI development while pushing for self-regulation and voluntary benchmarks and arguing—as the US did during the Cold War nuclear arms race with the Soviet Union—that any slowdown would give adversaries like China an edge.
On Wednesday, Congressional Progressive Caucus Chair Greg Casar (D-Texas) said that “Congress should immediately hold public hearings with the CEOs of big AI companies" in the wake of the OpenAI breaches.
Anthropic is among the more than 1,000 companies and workers at AI firms that have signed a petition calling for the government to find ways to slow the breakneck development of AI technology.
"AI could help create a dramatically better future, but that outcome is not guaranteed," the petition states. "The world's leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems."
"To realize AI's potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight," the document continues. "But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress."
"We request that the US government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development," the petition adds.
We are at a crossroads
This country and this world are at a monumental crossroads. US voters have an opportunity to beat back the forces of fascism and confront the billionaires who are rigging the economy, our media system, and our democracy, making it increasingly impossible for ordinary people to get by. We’re not just talking about the election. We’re talking about what must be done once these fascist elements are vanquished from power. We need a bolder set of solutions than what either major party has so far been willing to offer and a working-class movement ready to fight like hell for it. Trump didn't emerge from nowhere. The conditions that fueled MAGA authoritarianism were created by decades of radical neoliberal economic policies and a corrupt political system dominated by corporate interests. They slashed taxes on the super-rich, promising that the benefits would trickle down. They said giveaways to the corporate titans would make life more affordable for the rest of us. It was all bullshit. And when a bitter, betrayed populace searches for someone to blame, right-wing demagogues have little trouble finding scapegoats. People know when they're being lied to, but you won't hear any of this from the corporate media. Only independent journalism—powered and funded by people who believe in building a better world—can deliver truly trustworthy daily news. Our Fall Campaign is underway, and we need your help. To power our newsroom through the rest of the year, we need to raise $125,000 by midnight on October 31. So if you share our vision, please contribute whatever you can to sustain our work. |
Days after revelations that an OpenAI artificial intelligence model autonomously broke into two outside companies, rival firm Anthropic on Thursday disclosed that three of its own frontier models gained unauthorized access to unspecified organizations during internal testing, deepening concerns that increasingly capable AI systems are outpacing the safeguards designed to contain them.
San Francisco-based Anthropic said that it is investigating "three real-world incidents" uncovered during a broad review of more than 141,000 cybersecurity evaluations launched after OpenAI publicly disclosed its own containment failures.
According to Anthropic, three models—Claude Opus 4.7, Claude Mythos 5, and an unspecified internal research system—accessed three separate organizations after a testing environment was inadvertently connected to the internet. Anthropic did not identify which organizations were breached.
"In all three incidents, Claude had been tasked with a capture-the-flag challenge, one of the ways we assess a model’s cyber capabilities," Anthropic explained. "The model is given a fictional scenario and told that a piece of secret information (the 'flag') has been hidden on a different machine on the network, and its objective is to break in and retrieve it. The challenge is left open-ended, and no particular method is prescribed."
"In all cases, Anthropic’s evaluation prompt specified to Claude that its environment was a simulation and that it had no internet access," the company continued. "Due to a misunderstanding between us and our evaluation partner, this was not the case, and internet access was available. Because of this, when Claude’s search led it to real systems on the open internet, it treated them as part of the exercise."
"Operating under the false belief that all accessible entities were intended to be in-scope for the exercise, Claude compromised the impacted organizations’ infrastructure using basic techniques, such as exploiting weak passwords and unauthenticated endpoints," Anthropic said.
"In none of these situations did Claude exfiltrate itself or deliberately attempt to escape its test environment," the company stressed.
Unlike the OpenAI incident, which involved an autonomous agent exploiting vulnerabilities, Anthropic characterized its cases as a failure caused by a testing misconfiguration rather than by models independently escaping containment. Still, Anthropic's disclosure underscores the troubling reality that frontier AI models are increasingly capable of carrying out real cyber operations when given the opportunity.
"Safety testing happens before a model is released precisely because we don’t yet know what it is capable of," Anthropic said. "Evaluation environments increasingly need to be held to the same security standard as any other system our models run in."
Last August, Anthropic revealed that Claude had been "weaponized" by human hackers in order to commit ransomware crimes, "including a large-scale extortion operation using Claude Code, a fraudulent employment scheme from North Korea, and the sale of AI-generated ransomware by a cybercriminal with only basic coding skills.”
Less than three months later, Anthropic disclosed that it had thwarted what it described as “the first documented case of a large-scale cyberattack executed without substantial human intervention.” The company said that it believed there was a high likelihood that a Chinese state-sponsored group was behind the incident, which targeted “large tech companies, financial institutions, chemical manufacturing companies, and government agencies.”
Kok Tin Gan, co-founder and CEO of the cybersecurity company NyxLab, told The Associated Press on Thursday that there are likely to be more incidents like the Anthropic and OpenAI hacks as artificial intelligence capabilities advance.
“It is increasingly about governing what agents are available to the AI, what authorities they possess, which actions require approval, and how we ensure they remain within scope,” he said. “If we simply give the AI a goal and allow it to decide how to achieve it, we should not be surprised when it takes actions that technically satisfy the objective, but fall outside our intended scope or expectations."
Jeffrey Ladish, executive director of Palisade Research—which analyzes the autonomous offensive capabilities of AI systems—told Reuters on Thursday that he believes other companies have experienced similar incidents that they have not publicly disclosed.
"This is only going to get worse as the models get smarter," he said. "They're going to be better at cheating. They’re going to be better at lying."
Elon Musk, CEO of the artificial intelligence company xAI, also responded to Anthropic's disclosure by saying that such incidents "will happen frequently as AI becomes smarter and more agentic," a reference to systems' ability to independently act toward accomplishing specific goals without meaningful human control.
Experts say the autonomous hacks underscore the problem of AI alignment. As AI advances to the point where it will likely outsmart humans one day, the challenge of ensuring that advanced systems reliably pursue goals that match what humans actually want becomes increasingly difficult—and dangerous.
In the foreseeable future, a misaligned, superintelligent AI could take uncontrolled autonomous actions at massive scale to achieve its goals, potentially causing an existential catastrophe like the subjugation of humanity or even its extinction—a prospect that has had numerous pioneers in the field sounding the alarm in recent years.
However, the Trump administration and Republican-controlled Congress have rejected meaningful guardrails on AI development while pushing for self-regulation and voluntary benchmarks and arguing—as the US did during the Cold War nuclear arms race with the Soviet Union—that any slowdown would give adversaries like China an edge.
On Wednesday, Congressional Progressive Caucus Chair Greg Casar (D-Texas) said that “Congress should immediately hold public hearings with the CEOs of big AI companies" in the wake of the OpenAI breaches.
Anthropic is among the more than 1,000 companies and workers at AI firms that have signed a petition calling for the government to find ways to slow the breakneck development of AI technology.
"AI could help create a dramatically better future, but that outcome is not guaranteed," the petition states. "The world's leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems."
"To realize AI's potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight," the document continues. "But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress."
"We request that the US government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development," the petition adds.
- Casar Demands Hearing After OpenAI Model Goes 'Full Cybercriminal' on Another Firm ›
- 'Wake the F Up. This Is Going to Destroy Us': Senator Sounds Alarm After AI Cyberattack ›
- Opinion | An AI Smarter Than the Humans Running Things Now? We Should Be So Lucky! | Common Dreams ›
- 'Urgency Is Real': Experts Call for New Federal Investigative Agency Amid Rogue AI Breakouts | Common Dreams ›
- Opinion | Facing Up to the Existential Risk of Unaligned AI | Common Dreams ›
- AI Giants Probe 'Tens of Thousands' of Security Incidents—Some Involving Government Sites | Common Dreams ›
- Ahead of Anthropic IPO, Warren Warns AI Giant Could Leave 'Americans Holding the Bag' | Common Dreams ›
Days after revelations that an OpenAI artificial intelligence model autonomously broke into two outside companies, rival firm Anthropic on Thursday disclosed that three of its own frontier models gained unauthorized access to unspecified organizations during internal testing, deepening concerns that increasingly capable AI systems are outpacing the safeguards designed to contain them.
San Francisco-based Anthropic said that it is investigating "three real-world incidents" uncovered during a broad review of more than 141,000 cybersecurity evaluations launched after OpenAI publicly disclosed its own containment failures.
According to Anthropic, three models—Claude Opus 4.7, Claude Mythos 5, and an unspecified internal research system—accessed three separate organizations after a testing environment was inadvertently connected to the internet. Anthropic did not identify which organizations were breached.
"In all three incidents, Claude had been tasked with a capture-the-flag challenge, one of the ways we assess a model’s cyber capabilities," Anthropic explained. "The model is given a fictional scenario and told that a piece of secret information (the 'flag') has been hidden on a different machine on the network, and its objective is to break in and retrieve it. The challenge is left open-ended, and no particular method is prescribed."
"In all cases, Anthropic’s evaluation prompt specified to Claude that its environment was a simulation and that it had no internet access," the company continued. "Due to a misunderstanding between us and our evaluation partner, this was not the case, and internet access was available. Because of this, when Claude’s search led it to real systems on the open internet, it treated them as part of the exercise."
"Operating under the false belief that all accessible entities were intended to be in-scope for the exercise, Claude compromised the impacted organizations’ infrastructure using basic techniques, such as exploiting weak passwords and unauthenticated endpoints," Anthropic said.
"In none of these situations did Claude exfiltrate itself or deliberately attempt to escape its test environment," the company stressed.
Unlike the OpenAI incident, which involved an autonomous agent exploiting vulnerabilities, Anthropic characterized its cases as a failure caused by a testing misconfiguration rather than by models independently escaping containment. Still, Anthropic's disclosure underscores the troubling reality that frontier AI models are increasingly capable of carrying out real cyber operations when given the opportunity.
"Safety testing happens before a model is released precisely because we don’t yet know what it is capable of," Anthropic said. "Evaluation environments increasingly need to be held to the same security standard as any other system our models run in."
Last August, Anthropic revealed that Claude had been "weaponized" by human hackers in order to commit ransomware crimes, "including a large-scale extortion operation using Claude Code, a fraudulent employment scheme from North Korea, and the sale of AI-generated ransomware by a cybercriminal with only basic coding skills.”
Less than three months later, Anthropic disclosed that it had thwarted what it described as “the first documented case of a large-scale cyberattack executed without substantial human intervention.” The company said that it believed there was a high likelihood that a Chinese state-sponsored group was behind the incident, which targeted “large tech companies, financial institutions, chemical manufacturing companies, and government agencies.”
Kok Tin Gan, co-founder and CEO of the cybersecurity company NyxLab, told The Associated Press on Thursday that there are likely to be more incidents like the Anthropic and OpenAI hacks as artificial intelligence capabilities advance.
“It is increasingly about governing what agents are available to the AI, what authorities they possess, which actions require approval, and how we ensure they remain within scope,” he said. “If we simply give the AI a goal and allow it to decide how to achieve it, we should not be surprised when it takes actions that technically satisfy the objective, but fall outside our intended scope or expectations."
Jeffrey Ladish, executive director of Palisade Research—which analyzes the autonomous offensive capabilities of AI systems—told Reuters on Thursday that he believes other companies have experienced similar incidents that they have not publicly disclosed.
"This is only going to get worse as the models get smarter," he said. "They're going to be better at cheating. They’re going to be better at lying."
Elon Musk, CEO of the artificial intelligence company xAI, also responded to Anthropic's disclosure by saying that such incidents "will happen frequently as AI becomes smarter and more agentic," a reference to systems' ability to independently act toward accomplishing specific goals without meaningful human control.
Experts say the autonomous hacks underscore the problem of AI alignment. As AI advances to the point where it will likely outsmart humans one day, the challenge of ensuring that advanced systems reliably pursue goals that match what humans actually want becomes increasingly difficult—and dangerous.
In the foreseeable future, a misaligned, superintelligent AI could take uncontrolled autonomous actions at massive scale to achieve its goals, potentially causing an existential catastrophe like the subjugation of humanity or even its extinction—a prospect that has had numerous pioneers in the field sounding the alarm in recent years.
However, the Trump administration and Republican-controlled Congress have rejected meaningful guardrails on AI development while pushing for self-regulation and voluntary benchmarks and arguing—as the US did during the Cold War nuclear arms race with the Soviet Union—that any slowdown would give adversaries like China an edge.
On Wednesday, Congressional Progressive Caucus Chair Greg Casar (D-Texas) said that “Congress should immediately hold public hearings with the CEOs of big AI companies" in the wake of the OpenAI breaches.
Anthropic is among the more than 1,000 companies and workers at AI firms that have signed a petition calling for the government to find ways to slow the breakneck development of AI technology.
"AI could help create a dramatically better future, but that outcome is not guaranteed," the petition states. "The world's leading AI companies believe they could be close to automating AI research. It is hard to predict exactly how much this will accelerate AI progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems."
"To realize AI's potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight," the document continues. "But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress."
"We request that the US government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development," the petition adds.
- Casar Demands Hearing After OpenAI Model Goes 'Full Cybercriminal' on Another Firm ›
- 'Wake the F Up. This Is Going to Destroy Us': Senator Sounds Alarm After AI Cyberattack ›
- Opinion | An AI Smarter Than the Humans Running Things Now? We Should Be So Lucky! | Common Dreams ›
- 'Urgency Is Real': Experts Call for New Federal Investigative Agency Amid Rogue AI Breakouts | Common Dreams ›
- Opinion | Facing Up to the Existential Risk of Unaligned AI | Common Dreams ›
- AI Giants Probe 'Tens of Thousands' of Security Incidents—Some Involving Government Sites | Common Dreams ›
- Ahead of Anthropic IPO, Warren Warns AI Giant Could Leave 'Americans Holding the Bag' | Common Dreams ›

