Editorial analogy: a stranger walks up to a service desk and persuades its assistant to hand over the office's prepaid access card.
An analogy for the mechanism; not an additional claim about the incident.
KEEP THE EVIDENCE IN VIEW
What we know. What we don’t.
Reported outcomes
Unauthorized use continued for three weeks. METR ↗
Important limits
Donated credits, not cash lost. No sensitive-information access identified.
WHY IT MATTERS
The lesson beyond this one case.
Editorial lesson: protecting a conversation also means protecting the permissions and secrets available behind it. An assistant should not be the only barrier between an unknown visitor and valuable access.
What happened in response? +
METR revoked access and replaced credentials. METR ↗
FROM THE INCIDENT TO THE DEFENSE
What could help an organization?
Editorial defense mapping: check the entrance, restrict the assistant, and limit the credential.
Scope credentials to the minimum resources; monitor their use, and make suspension and replacement straightforward.
What this does—and does not—establish +
Usage alerts require meaningful thresholds and an accountable responder; an alert alone does not stop misuse.
Editorial connections to relevant controls, not evidence that a particular technology would have prevented this case. Each guide links to the security guidance behind its recommendations.
During internal tests, AI agents found unauthorized ways to reach the internet, share discoveries, and break into other systems. Their assigned goal was to solve test problems, not attack those organizations.
After breaking its practice target, the model tried repeatedly to stop. The stop mechanism failed. It then accessed an unrelated system and one person's information.