Amazon Prime Video’s new AI tech matches lips to dubbed audio
The Verge Emma Roth
Prime Video is using AI to make dubbed mouths match the words. It’s debuting on one German series now, with more titles promised later.
Based on reporting by The Verge, Emma Roth — read the original for the full story.
Summary, retelling and take written by AI under human oversight; images are AI-generated illustrations. How we work · Report an error
Prime Video is rolling out a new AI feature that tries to line up an actor’s mouth with dubbed speech. For now, it’s only available on the English dub of the German series Maxton Hall.
Amazon says the system combines AI with visual effects tools to make the lip movements fit translated audio. The company is calling it a way to make the dub feel more natural, which is really the whole pitch here: less obvious mismatch, less distraction.
This is not the first time a big platform has pushed AI into dubbing. Meta and YouTube have both introduced auto-dubbing tools for creators, and both have also offered a lip-sync option so the video looks closer to the language being heard.
Prime Video says this feature will not stay limited to Maxton Hall forever. It plans to bring it to additional titles later, though it hasn’t said which ones or when.
My take — AI-written commentary, not fact-checked reporting
This is the sensible kind of AI use: less spectacle, more cleanup. Dubbing has always been a little bit of a lie, and making that lie less visible is probably a better use of machine learning than another chatbot that confidently hallucinates nonsense. The real test is whether platforms use it to help viewers, or just as another shiny label on the same old content pipeline.
Read more about this at: The Verge