Google DeepMind有发布 Genie 4作为可信任测试者的研究预览。 Genie 4世界模型从文本和图像提示实时生成可扩展的世界。 它还产生出声音景：环境噪声，音乐和人物对话。 用户使用键盘控制来移动，并以平话提示来引导事件。 更大的变化是建筑学。 Gemini模型现在作为计划员运行在模拟回路内部。 这种模式对于任何为agents或机器人建立训练环境的人都很重要。
TL; DR 数据
- 运行在：Google - 仅托管(Project Genie Web app, Gemini API 早期访问).
- 性能：具有本地音频和实时文本引导的相片现实主义世界。
- 最佳：场景一致性可达2分钟，每TechCrunch简报一次为双等精灵3分。
- 最糟糕的是：会话持续几分钟，对象在反复的即时编辑后会漂移。
精灵4是什么？
Genie 4是来自Google DeepMind的世界模型，通过帧来模拟交互环境框架。 这不是一个视频剪辑生成器。 每个帧在到达时响应用户输入。
DeepMind表示，该模型是本土多式的。 音频、音乐和对话与视觉一起产生。 这是DeepMind第一个在本地生成音频的实时世界模型。
它于2025年8月接任了Genie 3，宣布。 Genie 3以每秒720p和24帧的速度跑出，视觉内存可回溯到1分钟。
Genie 4 如何使用 Gemini?
Genie 4从Gemini家族的两部分借来。 Gemini Omni锁定了每个世界的外观和行为。 其他Gemini模型处理保持模拟一致性的推理。
运行时间循环是这样工作的：
- 解说：当您输入一个提示时，Gemini 将它适应运行中的场景。
- 计划：Gemini 3.8 闪光将一入入球打入一行步。
- 验证：它审查收到的框架，以确认每个步骤是否成功。
- 适应：如果世界变了或者你干预，它会修改计划。
在用户输入之间，Gemini还引导了场景，使世界不断进步。 DeepMind团队将这个设定为迈向混合世界模式的早期步骤。 在这个设计中，一个语言模型处理结构和叙事，而Genie则使像素和声音。
你能在精灵4世界里做什么？
- 以文字指向：您可以改变天气，移动相机或添加新人或对象中间会话。
- 模拟物理学和人：DeepMind引用了空气动力学和相撞。 它称人类运动是最大的飞跃，其人物为react到他们的周围。
- 倾听世界：每个世界都带有环境音频。 字符也可以持有react对您实时输入的对话。
- 测试机器人任务：在一次研究演示中，Gemini 4 Argon将一个跳棋任务分成了步骤。 Genie 4作为文本标题收到了每一步，并模拟了Apptronik的阿波罗人形游戏。
Genie 4与其他世界模型相比如何？.
DeepMind 发布没有Genie 4的基准测试表格。 以下的比较仅使用从每个项目本身来源披露的规格。
谁可以使用Genie 4，什么时候？
Genie 4今天为信任的测试者直播。 根据DeepMind，预计很快可以提供给Genie项目中的Google AI Ultra用户。 Gemini API和Google AI Studio的早期访问合作伙伴来接下。
所有Genie 4的视频和音频将携带合成ID水印。 DeepMind表示，它在预览前进行内部安全评价。
迄今为止，试验者跨越创意产业、新闻、教育、游戏和工程。
所报告的用途包括：
- 电影制作人为预视进行多次现场直播。
- 摄影记者们把一张档案照片变成模拟
- 游戏开发者在写出引擎代码之前先测试样式和力学。
- 企业伙伴产生零比一的模拟情景。
Genie 4的局限性是什么？
DeepMind在Genie 4模式页面上列出了几个打开的问题：
- 视觉细节和物体永久性在较长的会话中漂移，经过复杂的即时编辑，或在导航期间漂移。
- 互动限于几分钟，而不是延长会期。
- 真实世界的位置并不是完全准确的模拟。
- 可修正文本通常只在输入描述中出现。
- 实时音频精度和多agent相互作用仍未解决。
关键外卖
- Genie 4 实时生成世界，环境音频和对话。
- Gemini 3.8区快速计划，检查框架和重新规划在循环。
- 没有披露参数、分辨率、帧率或基准测试。
- 访问始于信任的测试者，然后是AI Ultra和Gemini API合作伙伴。
- 流动和短会仍然是主要的实际限制。
请检查access-date=中的日期值 (帮助) Genie 4公告，Genie 4模式页和"工程 Genie"等列表。 并加入我们的通讯。 等等，你在电报里吗？现在你也可以加入我们的电报。
需要和我们合作推广您的 GitHub Repo OR Hugging Face Page OR Product Release OR Webinar等吗？联系我们
米哈尔·萨特(Michal Sutter)是一名数据科学专业人员，拥有帕多瓦大学的数据科学硕士。 在统计分析、机器学习和数据工程的坚实基础上，Michal出色地将复杂的数据集转化为可操作的见解。
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Google DeepMind has released Genie 4 as a research preview for trusted testers. The Genie 4 world model generates explorable worlds from text and image prompts in real time. It also generates the soundscape: ambient noise, music and character dialogue. Users move with keyboard controls and steer events with plain-language prompts. The bigger change is architectural. A Gemini model now runs inside the simulation loop as a planner. That pattern is important for anyone building training environments for agents or robots.
TL;DR
- Runs on: Google-hosted only (Project Genie web app, Gemini API early access).
- Performance: Photorealistic worlds with native audio and live text steering.
- Best: Scene consistency for up to 2 minutes, double Genie 3, per TechCrunch’s briefing.
- Worst: Sessions last a few minutes, and objects drift after repeated prompt edits.
What is Genie 4?
Genie 4 is a world model from Google DeepMind that simulates interactive environments frame by frame. It is not a video clip generator. Each frame responds to user input as it arrives.
DeepMind states that the model is natively multimodal. Audio, music and dialogue are generated together with the visuals. It is DeepMind’s first real-time world model to generate audio natively.
It succeeds Genie 3, announced in August 2025. Genie 3 ran at 720p and 24 frames per second, with visual memory reaching back 1 minute.
How does Genie 4 use Gemini?
Genie 4 borrows from 2 parts of the Gemini family. Gemini Omni anchors the look and behavior of each world. Other Gemini models handle the reasoning that keeps a simulation coherent.
The runtime loop works like this:
- Interpret: When you type a prompt, Gemini adapts it to fit the running scene.
- Plan: Gemini 3.8 Flash breaks a goal into a sequence of steps.
- Verify: It reviews incoming frames to confirm each step succeeded.
- Adapt: If the world shifts or you intervene, it revises the plan.
Between user inputs, Gemini also steers the scene so the world keeps progressing. DeepMind team frames this as an early step toward hybrid world models. In that design, a language model handles structure and narrative, while Genie renders pixels and sound.
What can you do inside a Genie 4 world?
- Steer with text: You can change the weather, move the camera or add a new person or object mid-session.
- Simulate physics and people: DeepMind cites aerodynamics and collisions. It calls human motion the biggest leap, with characters that react to their surroundings.
- Hear the world: Every world carries ambient audio. Characters can also hold conversations that react to your inputs in real time.
- Test robot tasks: In one research demo, Gemini 4 Argon split a checkers task into steps. Genie 4 received each step as a text caption and simulated Apptronik’s Apollo humanoid playing the game.
How does Genie 4 compare with other world models?
DeepMind released no benchmark tables for Genie 4. The comparison below uses only disclosed specs from each project’s own source.
Who can use Genie 4, and when?
Genie 4 is live for trusted testers today. According to DeepMind, it is expected to be available soon to Google AI Ultra subscribers in Project Genie. Early access partners of the Gemini API and Google AI Studio come next.
All Genie 4 video and audio will carry SynthID watermarks. DeepMind states that it ran internal safety evaluations before the preview.
Testers so far span creative industries, journalism, education, gaming and engineering.
Reported uses include:
- Filmmakers running multiple live ‘takes’ for pre-visualization.
- Photojournalists turning a single archival photo into a grounded simulation.
- Game developers testing styles and mechanics before writing engine code.
- Enterprise partners generating zero-to-one simulation scenarios.
What are Genie 4’s limitations?
DeepMind lists several open problems on the Genie 4 model page:
- Visual details and object permanence drift in longer sessions, after complex prompt edits, or during navigation.
- Interaction is limited to a few minutes, not extended sessions.
- Real-world locations are not simulated with perfect accuracy.
- Legible text usually appears only when it is in the input description.
- Real-time audio accuracy and multi-agent interactions remain unsolved.
Key Takeaways
- Genie 4 generates world, ambient audio and dialogue together, in real time.
- Gemini 3.8 Flash plans, checks frames and replans inside the loop.
- No parameters, resolution, frame rate or benchmarks were disclosed.
- Access starts with trusted testers, then AI Ultra and Gemini API partners.
- Drift and short sessions remain the main practical limits.
Check out the Genie 4 announcement, the Genie 4 model page and the Project Genie waitlist. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.
Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us
Michal Sutter is a data science professional with a Master of Science in Data Science from the University of Padova. With a solid foundation in statistical analysis, machine learning, and data engineering, Michal excels at transforming complex datasets into actionable insights.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.