Amazon Prime Video debuts AI lip-sync technology for dubbed content

Amazon Prime Video has introduced a new lip-sync technology that uses artificial intelligence and visual effects (VFX) to synchronize actors' mouth movements with human-dubbed audio. The goal is to eliminate the visual disconnect often found in traditional dubbing, where mouth movements do not match the translated dialogue.

Unlike fully automated AI dubbing, this system uses audio recorded by professional voice actors. The AI specifically modifies the visual image to align the actors' lips with the spoken words. The technology is debuting on the German series ‘Maxton Hall’, Prime Video’s most-watched international original. Currently, the feature is available globally for the first two seasons of the show in English, and it will be applied to the third and final season when it premieres on December 9.

Raf Soltanovich, Vice President of Technology at Prime Video and Amazon MGM Studios, stated that the tool is intended to create a ‘more seamless and immersive way for customers to enjoy global content’ while ensuring creative oversight to preserve artistic integrity. Amazon plans to expand this technology to additional titles in the future.