The problem AI content moderation cannot solve

Rest of World · 3 months ago · 58

Meta released Muse Image, an AI tool allowing manipulation of public Instagram photos, but withdrew it within 72 hours due to abuse concerns. Research in Pakistan and South Asia found that image-based abuse predominantly involves non-explicit everyday images that violate consent, not explicit content, leaving millions of women unprotected under current Western-focused policies. Content moderation requires human reviewers trained to understand cultural context and consent rather than relying solely on AI systems that cannot account for the absence of permission or intention of harm.