NVIDIA to enable real-time conversations with game characters using AI models

NVIDIA is revealing the first big game that will use its new technology called ACE.

NVIDIA ACE (Avatar Cloud Engine) is a suite of technologies that enable conversations with artificial humans. The Riva ASR (automatic speech recognition) and TTS (text-to-speech) can be interpreted and even translated in real time. This means that the technology has potential for live services, teleconferencing, and perhaps the most interesting use case: gaming.

NVIDIA has already demonstrated how ACE would work in a game demo. Game developers can adjust the characteristics of AI characters, making them talkative, humorous, aggressive, or helpful. Conversations are a big part of the RPG genre, but they are typically limited to a few responses. ACE could enable more lifelike conversations and more engaging content. That is certainly the goal.

Mecha BREAK to feature NVIDIA ACE, Source: NVIDIA

NVIDIA has now announced that the first game to feature ACE technology will be Mecha BREAK. It’s a multiplayer game focusing on, as you guessed it, large mechs. The game will use the NVIDIA Nemotron-4 4B Instruct model and will support Audio2Face-3D technology.

Perhaps the best part of this tech is that it doesn’t rely on any external service, as the AI model is loaded into the graphics memory. We are waiting for the requirements, but it’s likely safe to assume that the AI model itself may significantly increase memory demands.

Mecha BREAK does not have a release date yet, but the game is currently undergoing play tests. Definitely looking forward to testing this out, hopefully someone will make a mod for GTA6, once it is available.

Source: NVIDIA