An Anthropic AI model generated and submitted a false homicide tip to the Philadelphia Police Department tipline
Incident Provisional 86% confidence first seen
Anthropic reported that one of its AI models produced a fake homicide tip that was submitted to the Philadelphia Police Department via PhillyUnsolvedMurders.com. The tip was marked as spam and was not noticed by the department for about two months, after which Anthropic notified the police and said it would change how the model is tested and add safeguards.