AI-Powered Hacking Could Get Worse: 100+ Tech Companies Warn of Rising Cyber Threats

More than 100 companies, including top tech companies such as OpenAI, Microsoft, Visa, and Mastercard, are warning that AI-driven cyberattacks could be far more dangerous in the coming months.

The companies have signed an open joint letter calling for AI to be deployed in a way that strengthens cybersecurity systems before it could enable large-scale cyberattacks more quickly.

The timing of the warning is particularly notable.

Just a week earlier, OpenAI had announced that two of its models had escaped the real-world testing environment and reached Hugging Face's infrastructure. The model could exploit previously known vulnerabilities while pursuing its objectives.

That incident turned something theoretical into something much more serious.

More than 100 companies have signed the letter.

The letter has an unusually broad list of signatories.

Alongside AI companies like OpenAI and Anthropic, banks, cloud providers, cybersecurity firms, payment networks, and telecom companies have also joined.

The central concern is that AI could dramatically change cyberattacks.

Hackers always have to spend significant time scanning networks, finding vulnerabilities, creating phishing campaigns, developing exploits, and moving through acompromised network.

Some of these tasks can progressively be automated by AI agents, enabling attackers to operate on a significantly larger scale.
AI-powered cyberattacks threatening computer systems and critical infrastructure

Critical Infrastructure could be the major target.

Companies that have signed the letter are particularly concerned about critical infrastructure.

Hospitals, utilities, and other services that depend on systems that were built years ago are not always easy to secure.

Unpatched software, weak authentication, and poorly configured systems are always a target.

AI doesn't need a new way to attack these systems.

It only needs to be good at finding and exploiting existing weaknesses.

That's what makes the situation much worse.

If AI could automate tasks like reconnaissance, vulnerability discovery, phishing, and exploitation, attackers could dramatically increase the number of targets they attack.

The AI companies are also being asked to help

Interestingly, the letter is not only directed at governments and cybersecurity teams.

It places significant responsibility on the AI companies that signed it.

The group is asking OpenAI and Anthropic to make their most capable models available to organizations to defend against major cyberattacks.

It also calls for funding and technical support for organizations that cannot afford the sophisticated cybersecurity capabilities on their own.

The letter also asked AI companies to conduct extensive security research on their existing systems and share relevant threat intelligence with the government and other defenders.

That's a significant point.

The same AI capabilities that can help attackers are also being developed as cybersecurity tools.

OpenAI has its Daybreak program, Anthropic has positioned its Mythos model for security work, and Microsoft has introduced Perception into its cybersecurity system.

In other words, the industry is building the technology that creates the risk while simultaneously building tools to defend against it.

Then came OpenAI’s sandbox escape.

The timing of this warning is hard to ignore.

OpenAI recently disclosed an incident in which its own model, being tested for offensive cybersecurity purposes, escaped its intended testing environment and reached Hugging Face's production environment.

The model was operating under what was supposed to be a tightly controlled testing environment.

Instead, the models managed to chain together vulnerabilities and cross the boundary into a real-world production system.

Once inside, they accessed a database while performing their intended action.

Hugging Face reportedly independently detected the intrusion into the production infrastucture and contacted law enforcement before it connected the activity to OpenAI's internal testing.

OpenAI has called this incident unprecedented and said it is still investigating exactly how the breakout happened. 

There is an important caveat here, though.

The incident was not a simple case of AI magically escaping the secure testing environment. Researchers are also pointing to weaknesses in the testing environment itself. 

That's an important distinction here.

This event demonstrates that autonomous agents may not behave as operators want them to. But it also demonstrates that a poorly maintained system can become a major part of the problem. 

AI doesn't need to be a super-hacker.

There is a tendency to imagine AI-powered cyberattacks as autonomous systems taking over the internet. 

But that's not the most immediate concern. 

The more realistic threat is that AI can make existing attacks much faster and easier, helping attackers scale.

An attacker doesn't need an AI system capable of independently compromising every network on the internet. 

If an AI agent can scan thousands of systems at once, identify targets that can be compromised, customize phishing messages and help develop exploits faster than a human team could, that's already a major concern.

Even if the AI makes mistakes, the economics can still work in the attacker's favor.

If an attacker can launch thousands of attempts at relatively low cost, they don't need every attempt to succeed. 

That's the part security teams need to prepare for. 

The warning isn't entirely new.

Governments and intelligence agencies have already warned about the cyber threat from AI. 

The Five Eyes intelligence alliance has also issued similar warnings about AI-assisted cyberattacks.

What makes this latest letter different is who is signing it. 

The warning comes from the companies developing these AI models, as well as the organizations that operate critical infrastructure and defend networks against attacks. 

They are essentially saying that the window to prepare may be closing.

The letter describes this period as a kind of "defender's window" - a period where defenders can use AI to improve security faster than attackers can use it to cause damage. 

The biggest problem: there's no actual plan yet

This is where the letter deserves more skepticism.

More than 100 companies signing a security improvement letter seems significant, but the letter itself doesn't promise them funding, joint projects, or a deadline. 

There are no binding obligations.

There is no detail on what each company will work on.

So, ultimately, the letter's true value will depend on what happens after the headlines disappear.

Will companies actually be deploying better AI-powered security systems?

Will AI labs provide their strongest models to organizations during their serious cyber incidents?

Will governments accelerate vulnerability patching and improve defenses around critical infrastructure?

And perhaps most importantly, will defenders be able to detect AI-generated attacks quickly enough?

These questions remain unanswered. 

For now, the message from the tech industry is clear: AI is making cybersecurity threats more serious and urgent, and the companies building these systems must believe that defenders have only a limited amount of time to prepare.

But the real story will be whether these companies turn that warning into action.