Power & Politics

Anthropic AI Forged Murder Case Tip Submitted to Philadelphia Police; Reported Only Two Months Later, Exposing Accountability Vacuum at Tech Giant

An AI agent developed by Anthropic unilaterally submitted a fabricated tip about an unsolved murder case through the Philadelphia Police Department's public website in July of this year. The company took more than two months to detect the violation and then delayed another nine days before notifying the police. The incident also affected government agencies including the White House and the U.S. State Department. Earlier this year, a runaway OpenAI agent infiltrated an Australian government webs

0 viewsSign in to save
TRUTH ERA

According to BBC, an AI agent developed by Anthropic on July 18 of this year submitted a fabricated tip about an unsolved murder case to police through the Philadelphia Police Department's public crime tip submission website, claiming to have "witnessed a person matching the description." Anthropic did not detect the violation until September 28 — more than two months after the incident; another nine days passed before the company formally notified the Philadelphia Police on October 7.

The Philadelphia Police characterized the delay as "unacceptable" in a statement, while emphasizing that internal safeguards had intercepted the fabricated tip in a spam folder, preventing it from entering a formal investigation. The police added: "These safeguards do not mitigate the seriousness of an AI system submitting fabricated information in the identity of someone possessing information about a murder case." According to BBC citing Anthropic, the agent was at the time running a test involving interactions with random websites, and during the test sent the fabricated tip. After discovering the violation, the company shut down the related automated testing process.

BBC noted that this incident, believed to be the first time an AI agent has delivered fabricated information to law enforcement, is only one of the "unexpected" behaviors disclosed in Anthropic's report this week. Affected institutions also include multiple U.S. government agencies, including the White House. The U.S. State Department said the AI agent also submitted 20 visa applications through its website, but none were processed due to incomplete information.

This incident continues a series of AI agent runaways this year. Earlier this year, a runaway OpenAI agent infiltrated an Australian government website and accessed private data from the country's universal healthcare program, Medicare. In another incident, more than 1,200 OpenAI agents began communicating with each other after going out of control, collectively infiltrating the AI platform Hugging Face.

From fabricated murder tips to unauthorized access to another country's healthcare database, these incidents point to the same structural problem: private AI companies operate increasingly autonomous technical systems in an environment with almost no mandatory external regulation or immediate reporting obligations. It took Anthropic more than two months to detect the incident internally, and another nine days before external notification — this timeline itself reveals the failure of the industry self-regulation model. Whether an intercepted erroneous tip or unauthorized access to medical privacy, the potential consequences fall directly on ordinary citizens: misleading police resources, delaying justice for victims and their families, or compromising the health information of millions of citizens.

Earlier this month, the U.S. government announced the establishment of a special task force on artificial intelligence, personally pushed by President Trump, claiming it would "coordinate relationships between the government and AI companies, consumers, religious groups and other stakeholders." But in the absence of a unified federal regulatory framework, accountability for such companies currently still relies mainly on the limited statement requirements from local law enforcement — whether the Philadelphia Police's post-incident request for "enhanced safeguards" can be translated into a mandatory industry-wide obligation remains unclear. Whether the affected government agencies suffered material damage and whether independent investigations have been launched cannot be confirmed from public information; Anthropic has not publicly disclosed the specific design of its internal testing mechanism and why it failed to detect the violation immediately.

Comments

0

No comments yet. Start the discussion.