Google DeepMind 发布其最具真实感与互动性的世界模型 Genie 4。该模型支持用户通过自然语言实时动态操控世界和音景,其背后由 Gemini 充当模拟大脑来翻译请求并规划事件,同时引入了环境音频与实时互动对话。
Introducing Genie 4 from @GoogleDeepMind, our most realistic and interactive world model yet 🌍
Now you can use natural language to dynamically steer the world and its soundscape in real-time, whether you're changing the weather, moving the camera, or introducing new elements to the environment.
So, how does the model do that?
Behind the scenes, Gemini acts as the "brain" of the simulation. It translates your requests into actions, plans out complex events, watches the scene unfold to keep track of what's happening, and adjusts as you change the story. Genie 4 also introduces ambient audio and real-time interactive human dialogue that adapts on the fly.
来源:Google AI · x.com