Google DeepMind's Genie 4 generates playable worlds with sound that you can change mid-scene by typing
DeepMind's post shows the model in action; TechCrunch adds what Google's team said at the briefing and the known gaps.
Google DeepMind released Genie 4, its newest "world model," as a research preview for trusted testers on Oct. 27. It generates interactive, real-time simulated worlds that users steer with the keyboard and change with text prompts mid-simulation, for example switching the weather or camera angle or adding people and objects. DeepMind calls it its first real-time world model to generate audio natively, including music, ambient sound and dialogue.
TechCrunch reports that Genie 4 keeps a scene consistent for up to two minutes, double Genie 3, with Gemini acting as a director that plans steps and checks frames. Google pitches uses in gaming, learning and robotics, and testers point to prototyping films. DeepMind says details and objects can drift over longer sessions, and that audio accuracy and legible in-world text remain open problems. Output carries SynthID watermarks. It will roll out in the coming weeks to Google AI Ultra subscribers in Project Genie and to early-access partners of the Gemini API and AI Studio.
-
World model (artificial intelligence)
After exploring Genie 4: A new generation of world simulation — Google DeepMind, the idea behind it is explained in World model (artificial intelligence).
Explains world models: systems that build an internal representation of an environment and predict how it changes in response to actions, used to help agents plan without real-world trial and error.
Wikipedia · Swim · 30 min
0