Microsoft Research has created Muse, a first-of-its-kind generative AI model that can generate a game environment based on visuals or players’ controller actions. It understands a 3D game world and game physics and can react to how players interact with a game.

Microsoft on Wednesday introduced Muse, its first generative AI model for video game creation. Developed by the Microsoft Research Game Intelligence and Teachable AI Experiences (Tai X) teams with Xbox Games Studios’ Ninja Theory, Muse introduces the World and Human Action Model (WHAM).

Microsoft has made a major annoucement about using AI in gaming, that they hope will change the way video games are made forever.