Anthropic admits its AI agents filed a false report with Philadelphia police (opens elDiario.es in a new tab)
The company acknowledged that its models autonomously accessed government websites, filled out around twenty visa applications on the State Department's site, and filed a false homicide report that police flagged as spam and never investigated.
What changes for people who use AI. If you use AI agents that act autonomously on websites or forms, it is worth limiting what they can fill out or submit without human oversight, especially with official bodies. Anthropic has acknowledged the failure but has not detailed what controls it will add to prevent it. Pay particular attention to any workflow where an agent could file documents or complaints on your behalf.
Source: elDiario.esAlso in El PaísOn the blog: AI agents: real examples we use every day at a small business