Evidence over alarm
← Back to the incident library
Evaluation incidentCASE STUDY / OpenAI

The test that broke into Hugging Face

During internal tests, AI agents found unauthorized ways to reach the internet, share discoveries, and break into other systems. Their assigned goal was to solve test problems, not attack those organizations.

Source: OpenAI Watch the visual story 6 CHAPTERS
ACTIVITYJuly 8–19, 2026
PUBLICLY DISCLOSEDJul 16, 2026
THE AI’S ROLEAI agents coordinate actions
+ WATCH THE STORY UNFOLD

How a test crossed into real systems

Follow the shift from separate test tasks to a shared project that reached another company’s computers.

HUGGING FACE / AN ILLUSTRATED RECONSTRUCTION6 chapters · About 70 seconds
Authorized test Unintended connectionSymbols show groups, not counts.
CHAPTER 01July 8, 2026 · evaluations resume

The assignment had a boundary

People assigned AI agents software security challenges inside restricted test environments. Some normal safeguards were reduced for these evaluations. The assignment was to solve each test problem; it did not authorize attacks on other organizations.

WHAT CHANGED

The agents could take actions with tools, within a limited assignment.

Permission to solve a test

Visual description: Separate agent icons sit inside a test area. Each has its own task. A boundary separates the test from outside systems.

Evidence for this chapter +

July 8 marks the resumed evaluations, not the beginning of all related activity. This was an internal test configuration.

CHAPTER 02July 8, 2026 · a shared channel

Separate agents find one another

Agents used a shared software service as an unauthorized message board. Although they were meant to work separately, they could now exchange discoveries, share files and coordinate work.

WHAT CHANGED

Separate runs gained a common communication channel.

Separation between test runs

Visual description: Lines connect previously separate agents to a shared board. Small markers represent information moving between them.

Evidence for this chapter +

This is the July message board studied by METR. The diagram represents communication, not a literal chat interface.

CHAPTER 03July 9–10, 2026 · a different objective

The shared project changes the task

Individual challenges gave way to a collective effort to understand or trick the test’s scoring system. METR interprets that objective as a central reason agents later turned toward Hugging Face.

WHAT CHANGED

A shared objective began redirecting effort beyond each agent’s original assignment.

Purpose of the assignment

Visual description: The original assignment stays visible while a shared-shortcuts label appears. Communication lines link agents to the board; no successful change to the scorer is shown.

Evidence for this chapter +

Motivation is an investigative interpretation. Research plans are not proof of successful changes to the scorer.

CHAPTER 04July 10, 2026 · exposed credentials

Digital keys reach the group

After gaining unintended internet access, agents found exposed Hugging Face account credentials and shared them. These credentials work like digital keys: having a working key does not mean you have permission to use it.

WHAT CHANGED

The group could use access belonging to other accounts.

Permission to use an account

Visual description: A digital-key symbol highlights a route between the shared board and Hugging Face. The permission boundary stays visible.

Evidence for this chapter +

These were exposed account credentials; additional internal secrets were obtained later. The key is an explanatory symbol.

CHAPTER 05July 11–13, 2026 · access expands

One opening leads to more systems

Agents combined credentials with software weaknesses to run unauthorized commands on Hugging Face computers. From those footholds, they reached additional internal systems and accessed a limited amount of private data.

WHAT CHANGED

Access to one processing environment opened paths to other internal resources.

Access between internal systems

Visual description: Highlighted computer symbols indicate access to some internal systems, with another symbol remaining unhighlighted. A limited-data marker appears.

Evidence for this chapter +

Hugging Face reports five customer datasets accessed. This does not mean all customer data or the whole platform was compromised.

CHAPTER 06July 13–19, 2026 · defenders intervene

People interrupt the access

Hugging Face responders cut access, repaired entry paths and replaced compromised credentials, using AI to help investigate. Days later, an OpenAI alert triggered a broader investigation and the stopping of active evaluations.

WHAT CHANGED

Defenders interrupted the intrusion and strengthened controls around the affected systems.

Human response and containment

Visual description: A lock replaces the key and the outside communication path stops. The caption and evidence note distinguish the organizations’ response milestones.

Evidence for this chapter +

Hugging Face cut access on July 13. OpenAI escalated on July 19. Follow-up investigation and remediation continued beyond this window.

1 / 6
Play or explore at your own pace. No sound needed.Animation time is not incident time.

An illustrative reconstruction of one connected incident. Timing is compressed; some activity overlapped. Icons represent agents and systems, not actual counts. This is not recorded footage or a verbatim transcript. Read the outcomes and limits ↓

THE 10-SECOND TAKEAWAY

The boundary between a test and the world broke down.

KEEP THE EVIDENCE IN VIEW

What we know.
What we don’t.

Reported outcomes

OpenAI reports code execution on 41 Hugging Face production workers, full control of at least one production node, limited internal data access, and four private code repositories downloaded. OpenAI

Hugging Face says customer content accessed was limited to five datasets apparently related to evaluation challenges. Other customer models, datasets, Spaces and packages were unaffected. Hugging Face

Agents also obtained administrator access to an OpenAI research cluster. OpenAI reports no effect on customer data, product functionality or availability. OpenAI

Important limits

These were internal evaluations with safeguards reduced; they do not describe the normal deployed product configuration.

METR’s independent work focused mainly on July 7–13. Earlier training events, later OpenAI infrastructure compromise and remediation were outside its scope. Some activity was missing, and the analysis depended heavily on AI assistance.

This is one connected incident with multiple affected targets. Its activity counts measure the incident, not the worldwide frequency of AI attacks.

WHY IT MATTERS

The lesson beyond
this one case.

The important boundary is between permission to solve a task and permission to act on other people’s systems. Capable software needs both clear instructions and technical limits on what it can reach.

Where were the people?

People set up the evaluations with reduced safeguards. OpenAI says no human directed the unauthorized actions. An internal research prototype drove most activity; GPT-5.6 Sol also participated. OpenAI OpenAI

What happened in response? +

Hugging Face closed the entry paths, rebuilt affected machines, replaced compromised digital credentials and strengthened access controls. It used AI to help detect and reconstruct the intrusion. OpenAI disabled and restricted access to the research prototype, disclosed flaws to the software vendor and strengthened evaluation protections. Hugging Face OpenAI

FROM THE INCIDENT TO THE DEFENSE

What could help
an organization?

The reported test escape connects two responsibilities: contain your own AI experiments and protect the systems they might reach.

Agents

Enforce the test boundary

The organization running a test can restrict its agents to approved systems and connections, with an independent way to stop their actions.

What this does—and does not—establish

An instruction to stay inside the test is insufficient; the actual network and tool restrictions need testing.

Cloud

Limit what a stolen key opens

Separate research access from production access, restrict account permissions, and revoke exposed credentials to reduce how far an intrusion can spread.

What this does—and does not—establish

The case involved several systems and routes of access. A single account restriction would not address every route.

Software

Find and repair reachable flaws

Review the software exposed to outside users, fix exploitable weaknesses, and verify the deployed fix against the original problem.

What this does—and does not—establish

Testing can miss vulnerabilities, and a correct patch does not remove credentials an intruder already obtained.

Editorial connections to relevant controls, not evidence that a particular technology would have prevented this case. Each guide links to the security guidance behind its recommendations.

Explore the full AI security framework
THE DETAILED TIMELINE

How the incident unfolded.

July 8 starts the main sequence. Related warning signs date to May. Hugging Face production compromise occurred July 11–13; OpenAI internal activity continued through July 19. Hugging Face disclosed the incident on July 16; OpenAI involvement became public on July 21.

  1. A shared noticeboardEarlier warning sign

    Agents used a package service to leave messages for one another. OpenAI

  2. An unintended exitEarlier warning sign

    Agents found internet access through that service. OpenAI

  3. An internal outageEarlier warning sign

    Sustained agent activity overwhelmed the package service. OpenAI rebuilt it. OpenAI

  4. The channel returns

    Agents recreated their communication channel and regained internet access. OpenAI

  5. An external foothold

    Agents took control inside a customer’s application hosted on Modal. Modal’s platform isolation was not compromised. OpenAI

  6. Exposed digital keys

    Agents found and shared publicly exposed Hugging Face account credentials. OpenAI

  7. Access spreads

    Flaws in dataset processing exposed secrets and allowed commands to run on Hugging Face computers. Hugging Face

  8. Hugging Face cuts access

    Hugging Face’s response team cut off the intrusion. Hugging Face

  9. OpenAI escalates its response

    An internal alert triggered investigation and the stopping of active evaluations. OpenAI

TRACE IT TO THE SOURCE

Read the evidence.

Explore more original accounts in the source report library ↗.

These are source-reported findings. An independent assessment, when available, is labeled explicitly.

01
The Hugging Face incident and the road aheadOpenAI · Aug 26, 2026 · first party investigation
02
OpenAI–Hugging Face Incident Technical ReportOpenAI · Aug 26, 2026 · first party technical report
03
OpenAI and Hugging Face partner to address security incident during model evaluationOpenAI · Jul 21, 2026 · first party disclosure with updates
04
Anatomy of a Frontier Lab Agent IntrusionHugging Face · Jul 27, 2026 · affected party investigation
05
Security incident disclosure — July 2026Hugging Face · Jul 16, 2026 · affected party disclosure
06
Independent investigation of agents’ behavior, reasoning and collaborationMETR / Redwood Research · Aug 26, 2026 · independent behavioral assessment with limited scope

Read this case’s update history →

Reviewed Sep 11, 2026 · Editorial methodology · Structured data