Digital Human Technologies By NVIDIA: Revolutionising AI Characters

NVIDIA introduces next-generation digital human technologies, redefining realism in AI avatars and game characters across Industries. NVIDIA's ACE technology sparks a new era of interactive engagement from realistic healthcare assistants to immersive gaming experiences. Leading AI developers, including Hippocratic AI, Inworld AI, and UneeQ, are demonstrating these advancements.

NVIDIA showcased how its digital human technologies are transforming industries by enabling the creation of lifelike avatars and dynamic game characters. Leading AI developers, including Hippocratic AI, Inworld AI, and UneeQ, are demonstrating these advancements.

NVIDIA’s suite of digital human technologies, comprising the NVIDIA Avatar Cloud Engine (ACE) for speech and animation, NVIDIA NeMo™ for language, and NVIDIA RTX™ for ray-traced rendering, empowers developers to create digital humans capable of natural, AI-driven conversations, making interactions more engaging and realistic.

According to John Spitzer, Vice President of Developer and Performance Technologies at NVIDIA

“NVIDIA provides developers with cutting-edge AI technologies essential for creating lifelike digital humans. These tools support the intricate animations and conversational abilities needed for authentic digital interactions.”

Innovative digital human technologies

NVIDIA's digital human technologies suite includes several advanced tools and services. The NVIDIA Avatar Cloud Engine (ACE) supports lifelike facial animation through NVIDIA Audio2Face™ and offers advanced speech capabilities with NVIDIA Riva automatic speech recognition (ASR) and text-to-speech (TTS). ACE microservices are versatile, operating across both cloud and PC to optimise user experience based on local GPU capabilities.

Additionally, NVIDIA NeMo is an end-to-end platform for delivering enterprise-ready generative AI models. It features precise data curation, advanced customisation, and enhanced performance. Complementing these is NVIDIA RTX, which includes technologies like RTX Global Illumination (RTXGI) and DLSS 3.5, enabling real-time path tracing in games and applications.

Cross-industry collaborations and demonstrations

NVIDIA has collaborated with various industry leaders to showcase the capabilities of its digital human technologies. Hippocratic AI has developed a healthcare agent designed for patient follow-ups, preoperative instructions, and post-discharge management tasks. For GTC, NVIDIA helped extend this solution using ACE microservices, Audio2Face, Animation graph, and Omniverse™ Streamer Client.

UneeQ specialises in AI-powered avatars for customer service and interactive applications. UneeQ integrated NVIDIA Audio2Face with its Synanim ML technology to create highly realistic avatars, enhancing customer experience and engagement. Inworld AI partnered with NVIDIA to develop Covert Protocol, a demonstration showcasing how NVIDIA ACE and Inworld's AI engine can bring game characters to life. This collaboration integrates NVIDIA Riva for speech-to-text and Audio2Face for realistic facial animations.

Developers across multiple sectors adapt NVIDIA's ACE technology

Top developers in healthcare, gaming, financial services, media & entertainment, and retail are leading the way in adopting NVIDIA's ACE and generative AI technologies to transform interactions between users and non-playable characters (NPCs) in games and applications.

The developers and platforms integrating ACE are Convai, CyberAgent, Data Monsters, Deloitte, Hippocratic AI, IGOODI, Inworld AI, Media.Monks, miHoYo, NetEase Games, Perfect World, Openstream, OurPalm, Quantiphi, Rakuten Securities, Slalom, SoftServe, Tencent, Top Health Tech, Ubisoft, UneeQ, and Unions Avatars.

About NVIDIA

Founded in 1993, NVIDIA (NASDAQ: NVDA) has been at the forefront of accelerated computing. The company's groundbreaking invention of the GPU in 1999 revolutionised computer graphics and spurred the growth of the PC gaming market. This innovation also ignited the era of modern AI, enabling significant advancements in various fields.

Today, NVIDIA is a full-stack computing infrastructure company that offers data-center-scale solutions, reshaping industries through AI and digitalisation. NVIDIA's technologies are now central to gaming, healthcare, financial services, media, entertainment, and more developments, driving the next wave of industrial digitalisation.