混合的基础设施决定将AI成本和控制作为重点

混合的基础设施决定将AI成本和控制作为重点

企业人工智能正进入一个成本意识的阶段，混合基础设施就是进行计算的地方。 随着推论支出的攀升，商业领袖们正在权衡模型运行的地点，他们使用的模型以及他们有多少数据愿意交给别人。

这些费用方面的考虑正在改变各行业的购买决定，包括金融机构试图将分散的数据转化为实时行动。 据戴尔称，6500多家企业采用了带有Nvidia更新的戴尔AI工厂。 客户要求的改变，根据戴尔销售高级副总裁Kyle Dufresne(图片)的说法。

近三个月来我们看到80%的象征来自前沿模型，三个月后，世界上80%的代币都是由开放型号产生的，"Dufresne 称。 “为什么？因为成本。 每个人都在谈论象征性漫画。”

Dufresne在Dell Technologies New York研讨会上，在SiliconANGLE Media的直播工作室CUBE独家播出时，他们讨论了代币学，混合基础设施以及戴尔如何帮助客户计划AI投资。 (* 以下披露。 )

推论成本将混合基础设施推向边缘

推论现在增长速度快于训练，不过根据杜弗雷斯内的说法，两者都在迅速扩张。 这种转变正在改变AI工作发生的地方，戴尔看到推论运行在数据创建的地方——在云中，在数据中心和外出到PC.

“我们看到企业主说：‘我的天啊，我们如何在不影响创新的情况下降低这些成本？” “我们发现这发生在整个连续体之间

经济学还提出了关于控制的战略问题。 Dufresne解释说，公司必须决定是否将其数据外包和加以区分，现在它们正在根据工作量的多少、它们使用哪些模型以及数据的位置对AI进行定价。 Dell将其最新的AI Factory设定为Nvidia更新，围绕帮助客户获得他们控制的基础设施的结果。

“我们看到世界上每一个实施这些结构的[首席财务官]都说，`高什，我的象征性费用正在爆炸'。 “`我们如何驱动成本？'”

供应是分类账的另一面。 Dufresne估计，内存价格正在推动科技成本上升，戴尔正以协作规划的方式作出反应，引导客户转向更方便使用的组件，并分享未来成本增长的先期可见度。 许多客户发现他们的资本成本低于组件通胀，因此他们更早购买。

不仅能提供科技，“但也可以与客户分享未来会发生什么

SiliconANGLE及CUBE报导纽约戴尔科技研讨会：

(* 披露：CUBE是戴尔技术纽约专题讨论会的付费媒体伙伴。) CUBE活动报道的发起人Dell或其他赞助者对CUBE或SiliconANGLE上的内容都没有编辑控制。 ).

照片：SiliconANGLE

SiliconANGLE联合创始人John Furrier的留言：

支持我们的使命，通过与CUBE社区接触，保持内容的开放和自由。 加入CUBE的校友信托网络，其中技术领导者相互连接，分享情报并创造机会。

- 15M+观看CUBE视频，为跨越AI、云、网络安全等的对话提供动力

- 11.4k+CUBE校友——通过一个独特的信任网络，与11,400多位技术和企业领袖建立联系，塑造未来

你是AWS客户吗？在财务上支持SiliconANGLE，从我们的市场门户页面和链接购买您的AWS服务：https://siliconangle.com/aws-marketplace/

关于 SiliconANGLE 媒体

SiliconANGLE Media由技术视觉家John Furrier和Dave Vellante所创立，构建了产业领先数字媒体品牌的动态生态系统，达到了1500+百万精英技术专业人士。 我们的新专有CUBE AI Video Cloud正在观众互动中突破地步

本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。

Hybrid infrastructure decisions put AI costs and control in focus

Enterprise artificial intelligence is entering a cost-conscious phase, and hybrid infrastructure is where that reckoning plays out. As inference spending climbs, business leaders are weighing where models run, which models they use and how much of their data they are willing to hand to someone else.

Those cost considerations are reshaping buying decisions across industries, including among financial institutions trying to turn siloed data into real-time action. More than 6,500 enterprises have adopted the Dell AI Factory with Nvidia updates, according to Dell. A sharp shift in token economics is changing what customers ask for, according to Kyle Dufresne (pictured), senior vice president of sales at Dell.

“It’s incredible to see just over the last three months where we saw 80% of the tokens being generated from frontier models. Three months later, 80% of the tokens in the world are being generated by open models,” Dufresne said. “Why? Because of cost. And everybody talks about tokenomics.”

Dufresne spoke with theCUBE Research’s Dave Vellante at the Dell Technologies New York Symposium, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed tokenomics, hybrid infrastructure and how Dell is helping customers plan AI investments. (* Disclosure below.)

Inference costs push hybrid infrastructure toward the edge

Inference is now growing faster than training, though both are expanding quickly, according to Dufresne. That shift is changing where AI work happens, with Dell seeing inference run wherever data is created — in the cloud, in the data center and out to PCs.

“We’re seeing the business owners saying, ‘Oh my gosh, these costs are getting really high for inferencing. How do we reduce those costs without curbing innovation?'” Dufresne said. “We’re finding it’s happening across that continuum but more and more right out at the far edge.”

The economics also raise a strategic question about control. Companies have to decide whether they want to outsource their data and differentiation, and they are now pricing AI based on where workloads run, which models they use and where their data sits, Dufresne explained. Dell has framed its latest AI Factory with Nvidia updates around helping customers get results on infrastructure they control.

“We’re seeing every single [chief financial officer] in the world that has implemented these structures saying, ‘Gosh, my token costs are exploding,'” he said. “‘How do we drive costs out?'”

Supply is the other side of the ledger. Memory prices are pushing technology costs up rather than down, and about 20% more memory will reach the market next year against roughly 200% more demand, Dufresne estimated. Dell is responding with collaborative planning, steering customers toward more readily available components and sharing advance visibility into upcoming cost increases. Many customers find their cost of capital is lower than component inflation, so they are buying earlier.

“It’s not only just being able to provide the technology,” Dufresne said. “But also to be able to share with customers what’s going to happen in the future so they can make better decisions today on the use of their capital.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the Dell Technologies New York Symposium:

(* Disclosure: TheCUBE is a paid media partner for the Dell Technologies New York Symposium. Neither Dell, the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more

- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network

Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/

About SiliconANGLE Media

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.

Auto-fetched and translated by AI Gem Box. All rights belong to the original author.