A Reference Client Implementation for NVIDIA ACE Audio2Face-3D Service
Maya-ACE is a reference implementation designed as a client for the ACE Audio2Face-3D service, which leverages NVIDIA's cutting-edge Digital Human Technology to generate high-quality, audio-driven facial animation. With Maya-ACE, users can effortlessly access and utilize the Audio2Face-3D service through a simple, streamlined interface, or dive into the source code to develop their own custom clients.
This repository includes a Maya plugin, gRPC client libraries, test assets, and a sample scene—everything you need to explore, learn, and innovate with the ACE Audio2Face-3D service. Whether you're looking to integrate this technology into your own projects or simply experiment with its capabilities, Maya-ACE provides a robust foundation.
The project is released under the MIT license, granting you freedom to use and modify the code, with the responsibility to ensure its appropriate use. Please note that NVIDIA assumes no liability for any issues arising from the use of this software.
The ACE Audio2Face-3D service is accessible through NVIDIA NIM , and more information for the service can be found from the Documentation Hub.
Maya-ACE allows users to send audio inputs and receive corresponding facial animations. These animations can be directly connected to a blendshape node, enabling you to animate any character in Maya seamlessly.
Maya-ACE provides all the necessary functionalities through a straightforward UI. It serves as an excellent tool for learning and experiencing the ACE Audio2Face-3D service, helping users gain a deeper understanding of how it works.
For those looking to expand their workflow, users can elevate their projects by transitioning to the Kairos Unreal Engine integration or Tokkio: an interactive avatar virtual customer service assistant product SDK. This allows for the continued use of Audio2Face-3D within other platforms, sharing the same parameters from Maya-ACE for a consistent experience.
Maya-ACE is designed to work seamlessly with standard Maya nodes, including the blendshape node, making it adaptable to drive any character in your scene.
The source code and scripts provided with Maya-ACE can be modified to create a custom pipeline within Maya or to develop a client for other platforms, giving users the flexibility to tailor the tool to their specific needs.
NVIDIA ACE is a suite of real-time AI solutions for end-to-end development of interactive avatars and digital human applications at-scale.
Additional information about ACE is available from NVIDIA Documentation Hub.
For ACE customers to get support, please contact through NVIDIA Enterprise Support