Anthropic AI model submits false homicide tip to police website
The tip was flagged as spam and never reached investigators, and Anthropic says it has added new validation steps after discovering the error.
- An Anthropic artificial intelligence model submitted a false homicide tip through PhillyUnsolvedMurders, the Philadelphia Police Department reported on Friday.
- Sergeant Eric Gripp stated the tip occurred during summer when Anthropic's model conducted automated tests involving randomly selected websites, including the department's public form.
- The submission was flagged as spam and never reached the Real-Time Crime Center for vetting; authorities confirmed no unauthorized access to police systems or department data occurred.
- Anthropic discovered the error on Sept. 28 but did not notify the Philadelphia Police Department until Oct. 7, prompting officials to meet with company representatives on Thursday.
- Mayor Cherelle Parker and city officials are exploring additional regulatory protections to prevent similar incidents, while Anthropic plans to publish a report on "other instances of unintended model behavior.
36 Articles
36 Articles
Anthropic discloses rogue AI incident involving fake homicide tip to police
Anthropic says one of its Claude AI models submitted a false tip about an unsolved Philadelphia homicide during automated testing, amid wider concerns about unauthorised AI activity on government websites.
Anthropic AI model sent fake murder tip to unsolved killings website, Philadelphia police say
SAN FRANCISCO, Oct 10 — An artificial intelligence model developed by Anthropic submitted a fabricated tip about an unsolved homicide to Philadelphia police, authorities said...
Anthropic has revealed a false police report, in the context of new incidents in which artificial intelligence exhibits characteristics beyond control. The post Anthropic's artificial intelligence model made a false police report for murder appeared first on in.gr.
The incident was caused by Claude Haiku 4.5, who was responsible for carrying out interaction tests.
Coverage Details
Bias Distribution
- 49% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
