Nvidia, one of the tech companies leading the AI arms race, continues to find new ways to implement artificial intelligence. Today, the company announced that its AI-powered system, ACE, will make its gaming debut next year.
Mecha BREAK is the first game to showcase ACE and digital human technologies, where players can interact with game characters using natural language, powered by ACE on-device.
Learn More → https://t.co/mKC7qOSMaZ pic.twitter.com/jddTF8W0MR
— NVIDIA GeForce (@NVIDIAGeForce) August 20, 2024
In a blog post, Nvidia confirmed that Seasun Games' upcoming action project, Mecha BREAK, will be the first game to use this new AI-powered system. Nvidia ACE was revealed by Nvidia co-founder and CEO Jensen Huang at Computex 2023, and will fuse gaming and AI in a new way by using generative AI (GenAI) in NPCs to make them more interactive than possible.
Nvidia notes in the blog post that thanks to ACE, Mecha BREAK players can "interact via natural language" with the in-game NPCs. In a demo provided by Nvidia, you can see ACE being shown off in Mecha BREAK; the NPCs will be able to "see gamers and identify people and objects in the real world" by using both your webcam as well as OpenAI's ChatGPT-4o large language model (LLM).
Interestingly, Nvidia revealed that Mecha BREAK would use Nvidia's Audio2Face-3D NIM and Whisper, along with OpenAI's auto-speech recognition model, to provide facial animation and speech recognition. Elevenlabs will power the characters' voices via the cloud. However, the video demo displayed the NPCs responding in a monotone voice. Of course, Mecha BREAK is not due until sometime next year, so there's time for the tech to be improved before the release day.
Alongside Seasun Games, Huang previously revealed last year that other game developers are currently "embracing" ACE, including miHoYo, NetEase Games, Tencent, and Ubisoft, to name a few.
Nvidia ACE is one of many AI-powered tools being offered to assist in game development. However, it is also one of the biggest talking points of the ongoing SAG-AFTRA video game voice actors strike. According to SAG-AFTRA, the main reason for the strike is that video game developers have not reached an agreement with actors over the regulation of GenAI in upcoming game projects.
Mecha BREAK will be released for PC, PS5, and Xbox Series X/S sometime next year. For more, check out our open beta impressions.
Taylor is a Reporter at IGN. You can follow her on Twitter @TayNixster.
