Zac Zuo

Muse — AI that dreams up new gameplay

Featured
5
Muse is a new kind of generative AI model that lets you play and create. From developer ideation to one day supporting game preservation, Muse holds potential to unlock new possibilities.

Add a comment

Replies
Best
Zac Zuo
Hunter
📌

Hi everyone!

Sharing Muse, a fascinating new project from Microsoft Research, in collaboration with Xbox Game Studios' Ninja Theory.

Muse is a "World and Human Action Model" (WHAM) trained on human gameplay data (from the game Bleeding Edge). It can actually generate new gameplay sequences, including both the visuals and the controller actions. Think of it as an AI that can "dream up" new levels, scenarios, or character behaviors.

Key aspects:
🎮 Generates gameplay, not just visuals.
🧠 Learns game dynamics from human play data.
🛠️ Includes a "WHAM Demonstrator" for experimentation.
🔓 Open-source: model weights, data, and demonstrator available.

Can't wait for AI-created game content! Westworld, here we come?

BTW, if you're a game developer, you can explore Muse and its capabilities on Azure AI Foundry.

We’ve seen AI create assets and NPC behaviors, but Muse pushing into actual game mechanics is a massive leap. That’s next-level! 😻

Grace

Extending AI's role in human learning to games sounds so interesting! I will continue to pay attention!


Kenny Hawkins
This makes me giddy. Can’t wait to play untethered and unimaginable games that will be new every time!
Henry Habib

Another milestone in AI development, plus it's open-source.