Open source / Audio-driven 3D facial animation

NVIDIA Audio2Face-3D

A collection of models, SDKs and integrations that turn recorded or streamed audio into lip-sync and expressive 3D facial animation.

Adjacent · 3D animation · streaming audio · SDKSelf-host required

View repository ↗

Source code</>

The unlock

Why this one is on the map.

Adjacent animation layer for a virtual host, producing rig controls rather than a finished broadcast video.

The clearest product signal is “Drive a character's face from speech”. That interaction model—not a generic AI feature list—is the reason to compare it with the rest of this directory.

This is source code, not a hosted channel. You need to inspect, configure, and deploy it with your own keys and runtime before anything can broadcast.

#ai host #talking head #open source repo #self host

How to read it

What happens when you open it.

Open the official destination and look for the current adjacent · 3d animation · streaming audio · sdk workflow. Controls, access and live activity can change after this editorial check.

Best for: Audio-driven 3D facial animation

Access note: Read the repository setup and license before running. Hardware, model downloads and API access vary by project.

Sources & status

Keep the link, keep the caveat.

2026-09-05: Official collection README reviewed. SDK, model weights, NIM and datasets have different licenses; a renderer and host application are required.