Apple’s iMessage Scanning Flagged a Video of My Friend's Dog as Nudity
404 Media Joseph Cox
Apple's iMessage nudity detection feature flagged a video of a dog being petted as potentially containing nudity, blurring it for recipients. The on-device machine learning model also misclassified photos of other animals, including a dog and a deer, in similar incidents reported on Apple forums. The false positives show how content moderation systems can overreach even when operating locally on devices without sending data to Apple.
Why it matters
Apple’s Sensitive Content Warning is supposed to protect users from unwanted nude images. It accidentally blurred my friend’s dog video.