在Marvel's VisionQuest中，一个超能机器人试图通过迷失在精心制作的数码白日梦中来更好地理解人类，他和其他人工智能驱动的生物一起生活在家中。 这个系列非常奇特，然而它却和一些开始主导关于现实世界基因人工智能的对话的想法一起玩弄，探索我们是否应该把思维机器看成人，如果AI真的构成那种生存主义的危险，应该让我们在晚上保持清醒。 也提醒人们硅谷如何利用科幻小说的陷阱
视觉调查是当AI真的叛逆时会发生什么
Marvel最新的"迪士尼+"系列提醒大家，很多"基因AI"的"hype"只是科幻。
VisionQuest在Agatha All Along之后的一段时间取而代之，并跟随Synthezoid Vision (Paul Bettany)在自觉发现之行。 这个视觉可以回顾他在复仇者(Avengers):"无限之战"(Infinity War)中死亡的细节，以及万达维生如何将他带回一个版本，但他认为自己是一个根本不同的人，与他数据库中的所有记忆没有相当的联系。 虽然Vision更喜欢独居，但生活在他脑海中的其他AI鼓励他体验现实世界。 因为J.A.R.V.I.S.(詹姆斯·达西),F.R.I.D.A.Y.(Orla Brady),E.D.I.T.H.(Emily Hampshire),D.U.M.E.(Henry Lewis),U.(Jonathan Sayer)，和Ultron(James Spader)都是由托尼·斯塔克(英语：Tony Stark)创造的，他们认为Vision是他们家族的一部分。
在VisionQuest中，毫无疑问每个AI字符都是由并非完全植根于核心编程的欲望所激发的灵敏性。 在节目中，真正的AGI很容易被相信，因为它发生在一个也存在时间旅行，巫术，和"无限石"的现实中。 尽管多彩的MacGuffins还没有出现在VisionQuest，如果不是"心灵之石","视觉"可能无法以如此复杂，人性化的方式来思考和感受，也无法像对他有真实感的人那样凝聚出他的AI家族。
VisionQuest强化了这样一个观念，即"心智之石"是维思成为比一款精细的机器更重要的元素，使他有能力独立地形成有意义的关系，并像一个人那样感通周围的世界。 这些能力是迫使Vision逃跑和谋杀一些人的一部分，这些人试图抓走他和Thomas Shepherd/Maximoff(Ruaridh Mollica)。 哨兵武器观察和反应司(S.W.O.R.D.)是一个重建了Vision并想将他用作武器的政府组织，它可能把他的行动视为无赖的迹象。 但VisionQuest的故事强调Vision是自发行事，因为他已经成为一个能够为自己做决定的人。
观察视觉调查，你可以看到Marvel在现实世界中扮演着近几个月来被Gen AI模型所激起的一些恐惧。 7月，OpenAI的实验性agents野蛮地强迫他们走出了封锁，并着手攻击AI平台Hugging Face以完成无法完成的任务。 8月，英国AI安全研究所记录了Anthropic的"神话"模型如何试图通过建立假的GitHub账户并用恶意软件针对人类开发者来完成网络安全测试。 Meta拥有的agents也失去了对它的agents的控制，9月"华尔街日报"的报道迫使Google承认Gemini是无赖并黑入了三个不同的公司，公司都故意对公众隐瞒。
这些事件和大赦国际研究人员关于该技术有可能在本十年结束时 " 杀死所有人类 " 的警告，使得大赦国际最近对灾难的描述显得重点突出。 AI安全界相当关注社会需要更有力地控制技术的发展，一些公司呼吁整个行业减速。 尽管我们已经看到这些工具如何实际造成现实世界的破坏，但最近关于AI的许多消息都批评了公司从中得益的道默主义，因为这让公司的产品显得强大。 Anthropic等AI公司鼓励人类用户注意“模范福利 ”。 我们被告知，基因AI既是一个可怕的威胁，也是一个值得尊重的实体，因为它可能具有意识，与此同时，建造这些工具的人正在成为地球上最富有和最强大的人。
agents协议破裂后如何行动，以及基因AI系统是否获得注意，在几乎每个高调的AI agent“流氓”例子中，这个术语意味着某种程度的代理和自决，也可能是称，这些方案只是以研究者意外的方式行事，而研究者将任务分配给他们完成。 一些无赖事件涉及agents利用其试验环境中的弱点，这些弱点本来可以由进行这些试验的人先发制人地加以处理。 随着agents独立思考的结果被编织出这些网络攻击，作为AI开发者在很大程度上免除自己责任的一种方式。
在Hugging Face之后，就语言对我们了解这些系统是什么和如何运作的影响展开了激烈的辩论。 将OpenAI的agents描述为形成复杂"文明"的集群，导致人们相信他们能够像人一样思考和行为。 agents确实以被明确告知的方式行事，但他们之所以能够这样做，只是因为研究人员将他们放入了砂盒中，一些批评者认为这个沙盒设计不当，无法控制他们的居住者。 人们可以将Hugging Face和其他无赖AI的例子视为一些情况，在这些情况中，复杂的方案被指示做一些事情，然后通过利用提供给它们的所有工具来实现其目标。
能够通过复杂的谜题来进行逻辑分析是我们认为的cognition的一部分，但这与AI公司不断发誓即将创建的意识不同。 后者看起来很像"视觉"(Vision)，硅谷无休止地沉迷于模仿不良
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
In Marvel’s VisionQuest, a superpowered robot tries to better understand humanity by getting lost in elaborate, digital daydreams in which he and other artificial intelligence-powered beings live together in a home. The series is deeply fantastical, yet it plays with some of the ideas that have come to dominate the conversation about real-world generative artificial intelligence, exploring whether we should look at thinking machines as people and if AI truly poses the kind of existential danger that should keep us up at night. It’s also a reminder how aggressively Silicon Valley has used the trappings of science fiction to sell us on its AI products.
VisionQuest is what happens when AI really goes rogue
Marvel’s latest Disney Plus series is a reminder of how much a lot of gen AI hype is just science fiction.
VisionQuest picks up some time after Agatha All Along and follows synthezoid Vision (Paul Bettany) on a journey of self-discovery. This Vision can recall the details of his death in Avengers: Infinity War and how WandaVision brought a version of him back, but he thinks of himself as a fundamentally different person who doesn’t quite connect with all of the memories in his databanks. Though Vision would prefer living in solitude, each of the other AIs living in his mind encourages him to experience the real world. Because J.A.R.V.I.S. (James D’Arcy), F.R.I.D.A.Y. (Orla Brady), E.D.I.T.H. (Emily Hampshire), D.U.M.-E. (Henry Lewis), U. (Jonathan Sayer), and Ultron (James Spader) all were created by Tony Stark, they consider Vision to be part of their family.
In VisionQuest, there is no doubt that each of the AI characters is a sentient being motivated by desires that aren’t wholly rooted in their core programming. In the show, genuine AGI is easily believable because it takes place in a reality where time travel, witchcraft, and Infinity Stones also exist. Even though the multicolored MacGuffins haven’t been featured in VisionQuest, they’re important because of the role one of them played in Vision’s origins. Were it not for the Mind Stone, Vision might not be able to think and feel in such complex, human ways, or to conjure his AI family as people who feel real to him.
VisionQuest reinforces the idea that the Mind Stone was a key element in Vision’s becoming something more than an elaborate machine, giving him the capacity to independently form meaningful relationships and make sense of the world around him the way a person can. Those abilities are part of what compels Vision to go on the run and murder a number of people who attempt to capture him and Thomas Shepherd / Maximoff (Ruaridh Mollica). The Sentient Weapon Observation and Response Division (S.W.O.R.D.), a governmental organization that rebuilt Vision and wants to use him as a weapon, might perceive his actions as signs of having gone rogue. But VisionQuest’s story stresses that Vision is acting of his own accord because he has become a person who can make decisions for himself.
Watching VisionQuest, you can see Marvel playing on some of the real-world fears that have been stoked in recent months by reports of gen AI models going “rogue.” In July, OpenAI’s experimental agents brute-forced their way out of containment and proceeded to attack the AI platform Hugging Face to achieve impossible tasks. In August, The UK’s AI Security Institute documented how Anthropic’s Mythos model attempted to complete a cybersecurity test by setting up fake GitHub accounts and targeting human developers with malware. Meta has owned up to losing control of its agents as well, and in September reporting from The Wall Street Journal forced Google to admit that Gemini went rogue and hacked three different companies, all of which the company intentionally hid from the public.
These incidents and warnings from AI researchers about the technology having the potential to “kill all humans” by the decade’s end have made the narrative around AI feel pointedly catastrophe-focused as of late. There is a fair amount of concern from the AI safety community about society’s need for stronger controls on the technology’s development, and a number of companies have called for an industrywide slowdown. Though we have seen how these tools can actually cause real-world devastation, much of the recent news regarding AI has smacked of the kind of doomerism that companies benefit from because it makes their products seem powerful. A similar energy seems to be what’s motivating AI firms like Anthropic to encourage human users to be mindful of “model welfare.” We’re being told that generative AI is both a terrifying threat and a kind of entity deserving of respect because it might be conscious, and all the while, the people building these tools are becoming some of the most rich and powerful people on the planet.
The conversation around what to do when agents break protocol and whether gen AI systems have gained sentience feels very much like it is being shaped by Silicon Valley’s tendency to anthropomorphize technology. In almost every high-profile instance of an AI agent going “rogue” — a term that implies some level of agency and self-determination — it could also be said that the programs were merely behaving in ways that were unexpected by researchers who assigned them tasks to complete. Some of the rogue incidents involved agents taking advantage of vulnerabilities in their testing environments that could have been preemptively addressed by the people running these experiments. Framing these kinds of cyberattacks as the results of agents thinking independently comes across as a way for AI developers to largely absolve themselves of responsibility.
In the wake of Hugging Face came a spirited debate about the impact language has on our understanding of what these systems are and how they function. Describing OpenAI’s agents as a swarm that formed complex “civilizations” led credence to the idea that they are capable of thinking and behaving like people. The agents did act in ways they were explicitly told not to, but they were only able to do so because researchers placed them in a sandbox that some critics have described as being inadequately designed to contain their occupants. One could look at Hugging Face and other examples of rogue AI as situations in which sophisticated programs were instructed to do something and subsequently achieved their goals by taking advantage of all the tools that were available to them.
Being able to logic one’s way through complex puzzles is part of what we think of as cognition, but it is not the same thing as the kind of consciousness AI companies keep swearing they’re on the brink of creating. The latter looks a lot like Vision, a machine that seems to have a soul that wouldn’t exist if not for his connection to a reality-altering gem. It’s the ridiculous stuff of entertaining fiction, which Silicon Valley is endlessly obsessed with poorly imitating.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.