LiveTalking
LiveTalking
A digital-human conversation engine supporting several lip-sync backends, interruption handling and WebRTC, RTMP or virtual-camera output.
A collection of models, SDKs and integrations that turn recorded or streamed audio into lip-sync and expressive 3D facial animation.
View repository ↗NVIDIA Audio2Face-3D
Adjacent animation layer for a virtual host, producing rig controls rather than a finished broadcast video.
This is source code, not a hosted channel. You need to inspect, configure, and deploy it with your own keys and runtime before anything can broadcast.
Adjacent · 3D animation · streaming audio · SDK
Best for: Audio-driven 3D facial animation
Access note: Read the repository setup and license before running. Hardware, model downloads and API access vary by project.
2026-09-05: Official collection README reviewed. SDK, model weights, NIM and datasets have different licenses; a renderer and host application are required.
LiveTalking
A digital-human conversation engine supporting several lip-sync backends, interruption handling and WebRTC, RTMP or virtual-camera output.
MuseTalk
A lip-sync model that updates a prepared face video from incoming audio clips, with a documented real-time inference workflow.
Ditto TalkingHead
A talking-head synthesis project with online and offline streaming pipelines and released inference models.