关于 Lip Sync 模型
A curated collection of lip-sync AI models.
全部 Lip Sync 模型
skywork/sky-lipsync
**[Core Function]** SkyReels Lip Sync (retalking) re-drives a talking video so the subject's lips match a given audio track. **[Strengths]** Accurate lip re-synchronization on an existing talking-head video. **[Best For]** Dubbing, re-voicing talking-head video, and localizing spoken video. **[Limitations]** Do NOT use this to generate new motion or content from scratch; it only re-times lips on an existing video. Requires video_url and audio_url. Output resolution is fixed at 720p. **[Routing]** Provide the source video_url and the target audio_url; optionally provide reference_char_url to guide the driven face.
pixverse/lipsync
[Core Function] PixVerse Lip Sync drives a talking video so the subject's lips match given audio or text-to-speech. [Strengths] Accurate lip synchronization for talking-head videos; supports either an existing audio track or TTS from a chosen speaker voice. [Best For] Dubbing, virtual presenters, character dialogue, localizing spoken video. [Limitations] Do NOT use this to generate new motion or change content; it only re-times the subject's lips on an existing video. It requires an input video, and you must provide EITHER audio_url OR (speaker_id + tts_content), not both. [Routing] Use when the user has a video and wants the speaker's lips to match speech. Use audio_url for an existing voice track; use speaker_id (a named voice code) + tts_content (max 140 chars) to synthesize speech from text.
vidu/lip-sync
[Core Function] Vidu Lip Sync is a video-to-video audio synchronization model. [Strengths] It excels at reanimating lip movements in an existing video to precisely match a new replacement audio track, while preserving the original face identity. [Best For] Highly recommended for: dubbing videos into different languages, correcting spoken dialogue post-production, and creating realistic digital avatars. [Limitations] Do NOT use this model if you need to change body movements or generate a new video from scratch. It requires a pre-existing video and a clear audio track. [Routing] Use this model specifically when the user wants to change what a person in a video is saying. If the user wants to transfer body movements, use Vidu Motion Sync instead.
