The problem AI content moderation cannot solve
Rest of World Hera Hussain
Meta released Muse Image, an AI tool allowing manipulation of public Instagram photos, but withdrew it within 72 hours due to abuse concerns. Research in Pakistan and South Asia found that image-based abuse predominantly involves non-explicit everyday images that violate consent, not explicit content, leaving millions of women unprotected under current Western-focused policies. Content moderation requires human reviewers trained to understand cultural context and consent rather than relying solely on AI systems that cannot account for the absence of permission or intention of harm.
Why it matters
Meta and other big tech companies are increasingly using AI for content moderation, but as the backlash to Muse Image shows, it cannot protect users because it does not account for consent.
