Explainer
Dubbed dialogue can leave a mismatch between the words and the movements of a speaker’s mouth. This archival explanation introduces Flawless AI’s proposal to change those movements digitally. It considers an application of AI while leaving claims about perfect results open to testing.
Explore the subject
Original recording: TikTok, 2021-05-21.
Video transcript
Read the original recording’s transcript
Automatically transcribed from the original recording. Small transcription errors may remain.
We all hate how a dubbed movie sounds and looks. It's so long-winded. It's a miracle you ever get to fighting at all. It takes away quite a bit of the storytelling magic the original version had in its intended language. All of that, however, is about to change as startup Flawless AI created a tool they claim can accurately recreate lip sync and dubbing without altering the actor's performance. The tool analyzes how actors move their mouths and swap the movements out according to the dubbed words in different languages, making Tom Hanks speak perfect Japanese or Jack Nicholson in French. French. Flawless AI is now working with studios to integrate the technology into post-production, so expect to see it at work by 2022.
