Delighted to be able to release this new demo of our Red9 TalkBack Facial Lip-Syncing service, taking raw audio data and mapping it to accurate facial motion. This has been in development for over 5 years now and with each new project we pass through the systems, the articulation and calibrations get better and better.
This demo is running on one of our Red9 Facial Rigs in Maya and the results are raw data, straight out of the solver with no animator input at all. The only input is the audio file itself. Being an offline process we can do a lot more tricks on the data than some of the current engine based real-time solutions 😉
TalkBack now runs on any rig, with training, and is a service we offer to all clients. Perfect if your budget won’t stretch to full performance capture! The system also works just as well with cartoon based rigs.