Generative Doom

The way I’ve been imagining the use of AI in game development is that it would create assets for a game, but there would be a traditional game engine running the game.

The generative game engine used for this Doom example, GameNGen, skips all that and goes straight to generating the output pixels. No 3D models, no renderer in the traditional sense. It’s quite a leap.

We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality. GameNGen can interactively simulate the classic game DOOM at over 20 frames per second on a single TPU.

More from the authors at the GameNGen github page.