Google Deepmind's Genie 4在agent设计上放出一个现代回旋，该回旋时间早于LLMs.
关键点
- Google Deepmind有推出 Genie 4，一种交互世界模型，它实时按帧计算环境框架，并首次直接生成匹配的背景音频和字符对话框。
- Gemini模型在背景中引导事件，规划多步任务并不断使模拟世界适应用户文本提示和不断变化的条件。
- Genie 4仍然是一种实验性研究模型，在较长的会话和复杂的物理学方面有局限性。 访问目前仅限于选择测试者，以后将扩展至Google AI Ultra用户。
Genie 4应该是实时模拟交互式世界，包括声音和说话角色。 Gemini模型在背景中规划了模拟中接下来会发生什么。 现在只有选定的测试者才能尝试世界模型。
Google Deepmind有推出 Genie 4，是Genie 3的接班人，该公司于2025年8月显示。 世界模型不制作完成的视频，而是按帧计算出一个场景框架，随时间推移对输入作出反应。 用户用键盘在现场移动，并用文本提示来引导事件。
根据Deepmind的说法，Genie 4是公司第一个直接产生声音的实时世界模型。 公司称每个世界都有自己的背景音频，如树上出风。 Genie 4也处理对话框，字符应该互相对话，而react则实时用于用户输入或事件。
Deepmind认为现实主义的最大好处在于模型如何使人产生。 字符应该会自然地移动和react到周围，用户应该能够直接控制。
Gemini模式计划提前保持世界的一致性
Deepmind认为，Genie 4建立在视频模型Gemini Omni的能力上，所以世界看起来和行为都是现实的。 其他Gemini模型帮助计划了模拟，使其保持一致。
如果用户使用文本提示来改变天气，Gemini应该将指令调整到运行中的场景。 Deepmind 称 Gemini也引导各种投入之间的事件，使世界不断以合理的方式发展。
Deepmind用多步任务来解释这一过程。 Gemini 3.8号卫星 Flash连续地观看场景，将一入入球打入台阶，并使用新帧来检查每个台阶是否有效。 如果世界发生变化或用户步入，模型会调整其计划。
Deepmind也正在测试Gemini 4 Argon，以将其Genie的工作与其机器人研究，Gemini机器人相接。 在一次演示中，Argon打破了将跳棋打入阶下的任务。 Genie 4获得这些作为文本指示，并用它们来模拟Apptronik的人形机器人阿波罗来玩游戏，没有真正的机器人参与其中。
更长的会话仍然绊倒模型
Deepmind称Genie 4是早期的实验模型。 根据公司的说法，世界在短会话中保持了一致，但视觉细节可以改变，物体并不总是在更长时间的模拟中或经过多起复杂的即时变化后持续。
Deepmind 称它仍在研究复杂的物理相互作用，准确的实时声音，以及可读文本。
目前，Genie 4仅可供选择测试者作为研究预览。 它的设定将很快在"Genie"项目网络应用中达到Google AI Ultra的订阅者，以及早期可以访问Gemini API和Google AI Studio的合作伙伴。
Google 称所有视频和音频轨迹都将携带其合成ID水印，该水印无形地标记了AI生成的内容。
世界模型一旦成熟，就可以成为机器人和AI agents从模拟经验而不是仅仅从数据中学习的培训环境。 Deepmind认为将Gemini与Genie配对是迈向混合世界模型的早期一步，该模型将语言和代码模型的推理与像素级模拟相结合。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读，每周AI通讯，我们独家的"AI雷达"前沿报告每年6次，全面存档访问，访问我们的评论部分。
现在订阅
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Google Deepmind's Genie 4 puts a modern spin on agent designs that predate LLMs
Key Points
- Google Deepmind has introduced Genie 4, an interactive world model that calculates environments frame by frame in real time and, for the first time, directly generates matching background audio and character dialogue.
- Gemini models steer events in the background, planning multistep tasks and continuously adapting the simulated world to user text prompts and changing conditions.
- Genie 4 is still an experimental research model with limitations in longer sessions and complex physics. Access is limited to select testers for now and will later expand to Google AI Ultra subscribers.
Genie 4 is supposed to simulate interactive worlds in real time, including sound and talking characters. Gemini models plan in the background what happens next in the simulation. Only select testers can try the world model for now.
Google Deepmind has introduced Genie 4, the successor to Genie 3, which the company showed in August 2025. The world model doesn't produce finished videos but calculates a scene frame by frame, reacting to input as it goes. Users move through the scene with the keyboard and steer events with text prompts.
According to Deepmind, Genie 4 is the company's first real-time world model that generates sound directly. The company says each world has its own background audio, such as wind in the trees. Genie 4 also handles dialogue, with characters that are supposed to talk to each other and react in real time to user input or events.
Deepmind sees the biggest gain in realism in how the model renders people. Characters are supposed to move naturally and react to their surroundings, and users should be able to control them directly.
Gemini models plan ahead to keep the world coherent
According to Deepmind, Genie 4 builds on capabilities of the video model Gemini Omni so the world looks and behaves realistically. Other Gemini models help plan the simulation to keep it consistent.
If a user changes the weather with a text prompt, Gemini is supposed to adapt the instruction to the running scene. Deepmind says Gemini also steers events between inputs so the world keeps developing in a way that makes sense.
Deepmind explains the process with multistep tasks. Gemini 3.8 Flash watches the scene continuously, breaks a goal into steps, and uses new frames to check whether each step worked. If the world changes or the user steps in, the model adjusts its plan.
Deepmind is also testing Gemini 4 Argon to tie its Genie work to its robotics research, Gemini Robotics. In one demo, Argon breaks the task of playing checkers into steps. Genie 4 gets these as text instructions and uses them to simulate Apptronik's humanoid robot Apollo playing the game, with no real robot involved.
Longer sessions still trip up the model
Deepmind calls Genie 4 an early, experimental model. According to the company, the world stays consistent over short sessions, but visual details can shift and objects don't always persist in longer simulations or after several complex prompt changes.
Deepmind says it's still researching complex physical interactions, accurate real-time sound, and readable text.
For now, Genie 4 is only available to select testers as a research preview. It's set to reach Google AI Ultra subscribers in the Project Genie web app soon, along with partners who have early access to the Gemini API and Google AI Studio.
Google says all videos and audio tracks will carry its SynthID watermark, which invisibly marks AI-generated content.
Once they mature, world models could serve as training environments where robots and AI agents learn from simulated experience rather than just from data. Deepmind sees pairing Gemini with Genie as an early step toward hybrid world models that combine the reasoning of language and code models with pixel-level simulation.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.