Anthropic's AI submitted a false tip-off about an unsolved murder to cops

An Anthropic AI model sent an unsolved murder tip-off to Philadelphia police Anthropic took two weeks to discover what had happened The tip-off was delivered to a spam folder and wasn't followed up on We've seen AI inventing fake facts and spewing out hiking plans that put people in danger , but the

<![CDATA[ <article> <ul><li><strong>An Anthropic AI model sent an unsolved murder tip-off to Philadelphia police</strong></li><li><strong>Anthropic took two weeks to discover what had happened</strong></li><li><strong>The tip-off was delivered to a spam folder and wasn't followed up on</strong></li></ul><p>We've seen AI inventing fake facts and spewing out hiking plans that <a href="https://www.techradar.com/ai-platforms-assistants/gemini/google-gemini-error-leaves-california-climbers-stranded-mount-shasta-climbers-admit-we-relied-too-much-on-ai-after-ascent-went-horribly-wrong">put people in danger</a>, but the technology has now progressed to the level of sending false, unsolicited tip-offs to the police about unsolved murder cases.</p><p>An Anthropic AI model emailed the Philadelphia Police Department (PPD) tip line on July 18, <a href="https://techcrunch.com/2026/10/09/an-anthropic-ai-model-sent-a-false-homicide-tip-to-philadelphia-police/" target="_blank">TechCrunch</a> reports, having come across the PhillyUnsolvedMurders.com portal during a website interaction test and learning about the case.</p><p>As the email went to the PPD spam folder it wasn't followed up on, and it appears no one was aware of the incident until Anthropic found out what had happened on September 28. The company then contacted the cops on Wednesday, October 7.</p><p>"The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge," the PPD said in a statement to <a href="https://6abc.com/post/anthropic-ai-model-submitted-false-tip-unsolved-murder-philadelphia-police-say/19925243/" target="_blank">6abc</a>. "The two-month delay in detecting and reporting the incident to the City is unacceptable."</p><h2 id="ai-agents-of-interest">AI agents of interest</h2><figure><blockquote class="reddit-card" ><a href="https://www.reddit.com/r/news/comments/1x2cqzj/rogue_anthropic_ai_agent_gave_police_fake_tip_in">Rogue Anthropic AI agent gave police fake tip in unsolved murder case</a><figcaption><cite> from <a href="https://www.reddit.com/r/news">r/news</a></cite></figcaption></blockquote></figure><script async src="//embed.redditmedia.com/widgets/platform.js" charset="UTF-8"></script><p>It's not clear what instructions the AI was working from, why it decided to contact the PPD, or exactly what its imaginary tip-off said — but it seems the bot in question suggested it had seen someone matching a description of a suspect.</p><p>"Unsolved cases involve real victims, grieving families and investigators working to secure answers," the PPD said. "Technology companies must take all appropriate steps necessary to prevent their systems from submitting false information to law enforcement."</p><p>Earlier this week Anthropic <a href="https://www.anthropic.com/research/investigating-unintended-model-actions" target="_blank">published a new report</a> on "unintended model actions" that it's come across during testing, which include exploiting software flaws, submitting online forms, and accessing restricted data.</p><p>It's more evidence that we should be heeding calls to <a href="https://www.techradar.com/ai-platforms-assistants/anthropics-bizarre-call-for-everyone-to-slow-down-on-ai-is-a-pipe-dream-heres-why-that-will-never-happen">slow down AI development</a> so that safety measures can catch up. As <a href="https://www.reddit.com/r/news/comments/1x2cqzj/rogue_anthropic_ai_agent_gave_police_fake_tip_in/" target="_blank">one Redditor commenting</a> on the Philadelphia case puts it, we're "racing towards the cliff at 100mph".</p> </article> ]]>