Wav2Lip
In short: Wav2Lip is a foundational open-source lip sync model that generates accurate mouth movements from any audio input, created by the researchers who went on to found Sync (sync.so).
About Wav2Lip
Wav2Lip, introduced in the paper "A Lip Sync Expert Is All You Need," is one of the most influential models in the AI lip sync space. It uses a discriminator trained on real lip sync to guide the generator toward producing accurate mouth movements for any given audio track.
The model works in a zero-shot manner, meaning it does not require speaker-specific training data. The researchers behind Wav2Lip went on to found Sync (sync.so), building on this foundational work to create a production-grade lip sync platform with significantly improved visual quality and processing speed.
How Wav2Lip Connects to Lip Sync
Wav2Lip relates to several other concepts in the AI lip sync pipeline: Zero-Shot Lip Sync , and GAN (Generative Adversarial Network) .
Explore More
Related Terms
Try AI Lip Sync
Experience studio-quality lip synchronization for videos in any language.