英伟达已经调整下一代Vera Rubin人工智能计算平台的部分硬件规格,包括HBM4高带宽显存带宽以及NVLink高速互连带宽。与此前公布或流传的指标相比,新规格有所下降,但横向扩展网络带宽则出现提升。这一变化可能意味着,英伟达正在根据实际量产情况重新平衡芯片性能、供应能力和系统成本。
根据英伟达目前公布的Vera Rubin平台规格,Rubin GPU配备288GB HBM4显存,显存带宽为19.2TB/s。此前,英伟达的技术资料曾给出最高22TB/s的显存带宽指标。两者相比,当前公布的数值低约12.7%。需要注意的是,英伟达此前使用的是“最高可达”指标,因此这既反映了规格数字的变化,也不一定意味着所有产品的实际性能都出现了同等幅度的下降。
HBM4是新一代高带宽显存技术,采用更宽的内存接口,为人工智能模型训练和推理提供更高的数据吞吐能力。随着模型规模不断扩大,GPU不仅需要更强的计算能力,还必须持续获得大量模型参数和中间数据。如果显存带宽不足,即使计算单元拥有很高的理论算力,也可能因等待数据而无法充分发挥性能。
Rubin平台此前追求的高显存带宽,也给HBM4供应链带来了较高的技术要求。显存制造商需要在较高的数据传输速率下,同时满足功耗、散热、信号完整性和长期可靠性要求。带宽指标越高,设计验证与量产过程面临的挑战通常也越大。
如果英伟达降低显存带宽要求,符合产品标准的HBM4芯片范围可能随之扩大,供应商也有机会提高合格产品的产出比例。这并不意味着显存制造商必须重新设计整套产品,而是可能让部分无法达到此前最高性能目标、但仍满足新要求的产品进入供应体系,从而改善整体供货能力。
除了显存带宽,英伟达还调整了Vera Rubin超级芯片的NVLink互连规格。根据目前的产品资料,Vera Rubin超级芯片的NVLink带宽从此前的7.2TB/s调整为6TB/s,降幅约16.7%。NVLink是英伟达用于GPU之间高速通信的互连技术,对于多GPU系统中的数据交换、模型并行训练以及复杂人工智能推理任务具有重要作用。
在大型人工智能集群中,GPU之间需要频繁交换梯度、激活值以及其他中间数据。对于采用专家混合架构的大型模型而言,不同计算单元之间的通信尤其重要。因此,降低NVLink带宽指标可能影响某些通信密集型任务的性能,但最终影响程度仍取决于模型架构、软件调度方式以及实际负载,不能简单地按照带宽下降比例推算整体算力损失。
与此同时,英伟达提高了部分横向扩展网络的带宽指标。现有资料显示,Vera Rubin超级芯片的横向扩展网络带宽从此前的0.8TB/s提高至0.9TB/s。这类网络主要用于连接不同计算节点,使数据中心能够将大量GPU组织成统一的计算集群。提高网络带宽有助于改善节点之间的数据传输能力,尤其是在计算任务需要跨服务器协同完成时。
这种一降一升的调整,体现了人工智能计算平台设计中的权衡关系:GPU内部及机柜内的通信能力固然重要,但随着集群规模扩大,跨节点通信也可能成为限制整体性能的因素。英伟达可能正在根据实际应用需求,重新分配系统设计中的性能预算。
不过,规格变化本身并不能证明英伟达已经确认存在显存短缺,也不能单独证明降低指标就是为了提高产量。相关解释仍需要结合供应商量产进度、产品认证情况以及英伟达后续披露的信息进行判断。
对于HBM4供应链而言,规格调整可能改变供应商之间的竞争重点。此前,制造商需要争取达到更高的数据传输速度;如果英伟达降低量产产品的带宽要求,竞争可能更加集中于良率、供货规模、功耗、稳定性和成本。能够大规模交付合格产品的供应商,可能因此获得更多机会。
从整个平台来看,Vera Rubin并非单纯依靠显存带宽决定性能。GPU计算能力、显存容量、芯片间互连、网络架构以及软件优化共同决定了系统表现。英伟达官方公布的Vera Rubin NVL72机柜配置包含72颗Rubin GPU,并通过第六代NVLink连接多个GPU,以支持大规模人工智能训练和推理任务。
因此,即使部分硬件指标低于早期目标,Vera Rubin仍可能凭借计算架构、显存容量和系统级优化取得较高性能。真正值得关注的是,英伟达能否在规格调整后按计划扩大出货规模,以及实际运行中的模型训练和推理性能是否符合客户预期。
本文由 AI宝库自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Young Weida has adapted some of the hardware specifications of the next generation Vera Rubin's artificial intelligence computing platform, including HBM4 high bandwidth VRAM bandwidth and NVLink high-speed bandwidth. The new specifications have decreased compared to previously published or circulated indicators, but the horizontal extension of network bandwidth has increased. This change may mean that British Wida is rebalancing chip performance, supply capacity and system costs with actual production.
Rubin GPU is equipped with 288GB HBM4Z82Z and VRAM bandwidth of 19.2TB/s, according to the specifications of the Vera Rubin platform currently published by Weida. Previously, technical information from In Weida had given VRAM bandwidth indicators up to 22TB/s. Compared to the two, the currently published value is about 12.7 per cent lower. It is important to note that Weeda had previously used the “highest achievable” indicator, so this reflects both a change in the number of specifications and does not necessarily mean an equivalent decline in the performance of all products.
HBM4 is a new generation of high-bandwidth VRAM technology that uses a wider memory interface to provide a higher data-admission capability for artificial intelligence model training and reasoning. As the size of the model expands, the GPU needs not only greater computing capacity, but also continued access to a large number of model parameters and intermediate data. If VRAM bandwidth is insufficient, even if the computing unit has a high theoretical strength, it may be unable to perform fully because it awaits data.
The high VRAM bandwidth previously sought by the Rubin platform has also brought higher technical requirements to the HBM4 supply chain. VRAM manufacturers need to meet the requirements of power consumption, heat dispersion, signal integrity and long-term reliability at higher data transmission rates. The higher the bandwidth indicator, the greater the challenges in the design validation and volume process.
If Young Weida lowers the VRAM bandwidth requirements, the scope of HBM4 chips that meet product standards may be expanded, and suppliers may have the opportunity to increase the proportion of output of eligible products. This does not mean that VRAM manufacturers have to re-engineer the product package, but rather may improve overall supply capacity by allowing some products that were unable to meet their previous maximum performance objectives but still meet new requirements to enter the supply system.
In addition to the VRAM bandwidth, the NVLink interconnectivity specification of the Vera Rubin Superchip was adjusted by In Weida. According to current product information, the NVLink bandwidth of the Vera Rubin Superchip was adjusted from its previous 7.2TB/s to 6TB/s, a decrease of about 16.7 per cent. NVLink is an interconnective technology for high-speed communications between GPUs in British Weidar and plays an important role in data exchange in multi-GPU systems, in parallel training in models and in complex artificial intelligence reasoning missions.
In large artificial intelligence clusters, frequent exchange of gradients, activation values and other intermediate data is required between GPUs. Communication between different computing units is particularly important for large-scale models using a hybrid structure of experts. Thus, the reduction of the NVLink bandwidth indicator may affect the performance of some communications-intensive missions, but the ultimate extent of the impact still depends on the model structure, the way the software is deployed and the actual load, and the overall loss of capacity cannot simply be calculated as a percentage of the decrease in bandwidth.
At the same time, Weida has raised the bandwidth indicator for a partial horizontal extension of the network. Available information indicates that the horizontal extension network bandwidth of the Vera Rubin Superchip increased from the previous 0.8 TB/s to 0.9 TB/s. Such networks are used primarily to connect different computational nodes, enabling data centres to organize large numbers of GPUs into a unified computing cluster. Increased network bandwidth will help improve data transfer capabilities between nodes, especially when computing tasks require inter-server teamwork.
This one-to-one-liter adjustment reflects the trade-off in the design of artificially intelligent computing platforms: While communication capacity within the GPU and in the cabinet is important, cross-nodal communications can also be a limiting factor to overall performance as clusters expand. Weeda may be reallocating performance budgets in the design of the system based on actual application needs.
However, the change in specifications does not in itself prove that Young Wida has identified a shortage of VRAM, nor does it prove alone that the lower target was intended to increase production. The explanation still needs to be judged in the light of the progress of the vendor ' s production, the certification of the product and the subsequent disclosure of information by British Wida.
For the HBM4 supply chain, specification adjustments may change the focus of competition among suppliers. Previously, manufacturers had to strive for a higher rate of data transmission; competition might be more concentrated on good rates, supply size, utility, stability and cost if British Wida reduced bandwidth requirements for mass products. Suppliers capable of delivering qualified products on a large scale may thus be given more opportunities.
Vera Rubin does not rely solely on VRAM bandwidth for decisive energy from the platform as a whole. The system performance is jointly determined by GPU computing capacity, VRAM capacity, chip interconnection, network architecture and software optimization. The official Vera Rubin NVL72 set up 72 Rubin GPUs and connected several GPUs through the sixth generation NVLink to support large-scale artificial intelligence training and reasoning.
Thus, even if part of the hardware indicator falls short of the early target, Vera Rubin may still achieve higher performances through computing architecture, VRAM capacity and system-level optimization. It is a real concern that the planned scale-up of the shipment following the specifications adjustment is possible and that the model training and reasoning performance in practice are in line with client expectations.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.