Yesterday, Microsoft Xbox introduced a fascinating new tool called Muse. They describe it as a “generative AI model designed for gameplay ideation.” If “gameplay ideation” has you scratching your head, you’re not alone. Microsoft refers to it as creating “game visuals, controller actions, or both.” However, its current capabilities are pretty narrow and don’t eliminate the need for the traditional game development process.
Even so, some findings from this project are remarkable. Muse was trained using H100 GPUs, and the process was extensive. About a million training updates were necessary to stretch just one second of actual gameplay into nine additional seconds of simulated gameplay that matches the original’s quality. Most of the training data came from existing multiplayer gaming sessions.
Implementing this wasn’t a small feat. Unlike running a game on a single PC, Microsoft had to use a cluster of 100 Nvidia H100 GPUs. This approach is much more costly and energy-hungry, and only produced nine extra seconds of gameplay at a modest resolution of 300×180 pixels.
A core demonstration of Muse was its ability to replicate existing elements like props and enemies within the game environment, mirroring their functions. Yet, one might ponder, with all the expenses and energy consumption, why not stick to conventional development tools for creating game elements?
While it’s noteworthy that Muse maintained object permanence and mimicked original game behavior, its utility feels lackluster against the backdrop of established game development techniques.
Though Muse may evolve to accomplish more intriguing tasks in the future, at present, it seems to join a lengthy roster of initiatives aiming to replicate gameplay through AI. Despite some success in engine accuracy and object permanence, the method remains an inefficient alternative for video game development. After thoroughly examining the details, I still question the practical appeal of employing Muse in its current form.
Stay updated with the latest from Tom’s Hardware, including news and in-depth reviews, delivered straight to your inbox.
