内存强制 GPU Kubernetes与NVIDIA CUDA 13.4共享。

许多AI的工作量只需要GPU的一小部分。 给每个设备一个完整的设备可以让容量闲置；共享GPU可以让平台团队用他们已经拥有的基础设施承担更多的工作量。 NVIDIA GPU已经支持几种共享方法。 多层GPU(MIG)将一个GPU拆分成硬件同位化实例，对应用程序透明。.

]]>

本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。

Many AI workloads need only a fraction of a GPU. Giving each one an entire device can leave capacity idle; sharing GPUs lets platform teams serve more workloads with the infrastructure they already have. NVIDIA GPUs already support several approaches to sharing. Multi-instance GPU (MIG) splits a GPU into hardware-isolated instances that are transparent to the application…

]]>

Auto-fetched and translated by AI Gem Box. All rights belong to the original author.