一家中国 AI 公司,用英伟达的 GPU、参考硅谷的技术路线,训练出了自己的视频大模型,恐怕没有多少人会感到意外。
但如果反过来呢?
全球领先的 GPU 巨头英伟达研究团队少见地选择了一家中国公司的开源多模态模型,投入人力、时间,开发一个视频生成模型。这就有点意思了。
从创业公司到英伟达,H3 为何被选中?
今年 8 月,MiniMax 开放了多模态模型 H3 的权重。这款模型能统一理解文字、图片、音频、视频等多种类型的素材,并兼顾生成质量、速度和成本。从技术生态角度看,开放模型权重使外部团队能够直接参与后训练、蒸馏和推理优化,拓展了其参与模型研发的方式。开源一个月内,H3 下载量超过 2400 万次,有 300 多个基于它开发的公开衍生模型。
最先被吸引的是视频生成公司。它们的客户大多用视频生成模型做广告、营销素材,在乎生成速度、产品和人物的一致性。技术演示再绚烂,到了商业生产现场,客户关心的往往是更现实的问题:商品包装上的字会不会变形?同一个角色换了镜头还能不能保持原样?修改一段广告,是否需要重新生成整条视频?如果要批量制作上千条短视频,时间和成本能否承受?这些问题决定了 AI 视频究竟是一项令人惊叹的技术,还是一门真正能够规模化运转的生意。
行业竞争激烈,这些视频生成公司有动力按照客户需求更针对性调整模型。
生成式媒体基础设施公司 fal 从这些需求出发,以 MiniMax H3 为基础训练 H3 Max,并围绕模型优化推理系统,目标是生成速度更快。视频生成公司 Pika 希望更符合平台上的专业创作者的需求,10 月 29 日,它发布基于 H3 后训练的 H3 Flex,压缩了生成步骤。
有些令人意外的是,和这些垂直行业中的公司不同,英伟达正基于 H3 再开发视频生成模型。 10 月下旬,英伟达相关研究团队基于 H3 发布 Open-H3-Regenerate-2K,先用 H3 生成低分辨率的草稿,再通过额外训练的精修模块和三步去噪重生成高分辨率视频。项目保留了 H3 的原始权重。
英伟达极少在多模态模型上投入如此多的资源,但对 H3 进行了系统性开发。
此前,他们推出 StreamRender-H3 流媒体视频渲染方案和快速视频解码器,分别探索交互式生成和解码加速;推理优化项目则在保持 H3 模型权重、提示词及生成配置不变的情况下,改进生成流程。
视频生成公司和英伟达这类全球巨头对模型的应用场景不同,但选择基座模型的标准都很高:既能处理复杂的多模态输入和视频生成任务,也开放权重,允许研究人员在本地运行模型、增加精修模块或改造推理流程。一个模型即便完全开放,如果生成质量不够好、架构难以扩展,或者无法适应新的训练任务,也很难成为继续研发的基础。
符合这一标准的多模态模型并不多,H3 的性能和延展性让它屡被选择。今年 9 月,H3 在 Arena 图生视频榜单中以 1495 分位列第一,累计获得超过 5.7 万次评测投票。
但英伟达的目标可能不止于此。它擅长并敢于在新技术初期投入并培育生态,例子之一是 CUDA :通过资源倾斜和商务手段,让开发者围绕英伟达 GPU 构建应用,形成了高壁垒的软件生态。
多模态模型领域也许是下一个 CUDA 类的机会:围绕 H3 做推理加速和生成应用,让更多视频模型和开发者进入 NVIDIA 技术栈。英伟达看好的不只是视频生成市场,也包括它背后的生态和算力需求。
开源生态中,合作方也是进入更大市场的“节点”
头部企业把视频模型接进生产流程,面对的要求各不相同,同一家企业也会随业务变化提出新需求。模型厂商如果逐一满足这些要求,还要持续维护和更新,成本会不断增加。
视频生成平台 Runway 调研发现,一些企业客户希望直接拥有模型权重,在自己的环境里部署模型,再用自有数据微调。风险投资机构 a16z 对企业 AI 负责人的访谈也提到,控制权和针对具体业务定制是企业选择开放模型的重要原因。它在报告中也指出,企业越来越重视开放模型,不仅是因为价格,还因为它们可以根据自身数据进行微调。
开放权重的模型提供了一种新的解法。开放权重让头部企业有条件把模型放进自己的生产系统。它们可以围绕已有客户需求调整模型,再通过自己的平台、产品和服务将能力交付出去。
这指向的是远超一家公司能服务的广阔市场。这些合作方各自连接着客户、平台和工作流。对 MiniMax 等模型和产品厂商来说,合作方可能成为进入更多行业的节点。当 H3 随合作方的产品进入更多客户和场景,MiniMax 也能持续拓展自身的行业应用,让更多熟悉垂直场景的技术团队参与进来,在 H3 已有能力的基础上进行针对性优化,共同推动视频生成技术在不同领域的落地。
这也是开源生态中特有的商业化方式。MiniMax 可以借助这些作为“节点”的重要公司,通过授权、部署支持或联合开发等方式扩大收入来源。
这是已经被多个行业验证过的商业路径。智能驾驶芯片与算法公司地平线开放 BPU 芯片 IP 和感知算法授权,也提供芯片、工具链、解决方案及联合开发,车企和合作伙伴可以据此构建差异化产品,这不仅扩大了这家公司的“朋友圈”和影响力,也直接支撑了它的商业化。
根据《MiniMax H3 Community License Agreement》,协议在适用地域内授予免版税的有限许可,允许用户按条款使用、修改模型并开发衍生模型;若使用 H3 的商业产品或服务年收入超过 2000 万美元,须事先取得 MiniMax 的书面授权。
随着生态进一步活跃,MiniMax H3 的商业化也正快速发展。
当视频生成从偶尔尝试的创作工具变成企业生产链上的新环节,广告、电商、影视、游戏和教育等直接相关行业和更广阔的领域,会各自催生新的工具与服务。开放权重让 H3 成为这些团队共同改造的底座,也让 MiniMax 有机会沿着合作方的产品进入更多行业。
这呼应了 MiniMax 一直讲的那句使命“Intelligence with Everyone”:AI 的发展不只是少数模型公司持续推出更强的版本,更多开发者、更多公司也会是这场技术创新浪潮的节点,每个人都是新技术的使用者,也是浪潮的推动者。
对一家商业公司来说,更重要的是市场或许会重新评估一个开源模型的商业价值:除了 API 收入,当一个模型能成为企业定制、部署和产品开发的底座,进入更多行业的工作流,带动授权、技术服务和联合开发等收入,它的商业潜力也许比想象中更大。
本文由 AI宝库自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
A Chinese AI company trained its own video, LLM, using the GPU of Inverda and the technology of Silicon Valley. Few people would be surprised.
But what if the other way around?
The world's leading GPU giant, the British Weeda research team, rarely chose an open source multi-modular model for a Chinese company, investing manpower, time, and developing a video-generation model. That's interesting.
From the start-up company to the Inverda, H3. Why was it chosen?
In August this year, Mini Max opened the weight of the multi-mode model H3. The model provides a uniform understanding of the various types of asset, such as text, pictures, audio, video, etc., and balances the quality, speed and cost of generation. From a technical and ecological point of view, the weight of open models has enabled external teams to participate directly in post-training, distillation and reasoning optimization, expanding their participation in model development. Within a month, H3 downloads exceeded 24 million, with over 300 open derivative models based on its development.
The first to be attracted was the video production company. Most of their clients advertise and market asset using video-generated models, caring about the speed of generation, the consistency of products and characters. The technical demonstration was then debunked, and at the commercial production site, the customer was often concerned with a more realistic question: would the word on the packaging of goods be deformed? Can shot be the same character? Would it be necessary to recreate the entire video by modifying an advertisement? If thousands of short videos were to be made in bulk, would time and cost be affordable? These questions determine whether AI video is an amazing technology or a business that can really be scaled up.
The industry is highly competitive, and these video-producing companies have the incentive to adapt the model to the needs of their clients.
Generating media infrastructure companies fal, from these needs, train H3 Max based on MiniMax H3 and optimize the reasoning system around the model, with the goal of faster generation. The Video Generation Company, Pika, wants to be more in line with the needs of professional creators on the platform, and on October 29, publish compressed the production steps based on H3 Flex, a post-H3.
And some of the surprising things are that unlike companies in these vertical industries, we are developing video generation models based on H3. In late October, the British Wedda research team based on H3 publish Open-H3-Regenerate-2K first produced low Z56Z drafts with H3 and then generated high resolution video by fine-tuning modules and three steps of additional training. The item retains the original weight of H3.
Young Wida rarely invests so much resources in multi-modular models, but H3 is systematically developed.
Previously, they launched the StreamRender-H3 Stream Media Video Render and Fast Video Decoding, respectively, to explore interactive generation and code acceleration; the reasoning optimization project improved the generation process while maintaining the H3 model weights, prompt and generation configurations.
Video-generation companies and global giants such as Ingweida differ in their application to models, but the criteria for selecting a base model are very high: they can handle complex multimodular input and video-generation tasks, and open weights, allowing researchers to run models locally, add refined modules or adapt reasoning processes. A model, even if fully open, is difficult to form as a basis for further research and development if it is not of good quality, difficult to expand or unable to adapt to new training tasks.
There are not many multi-modular models that meet this criterion, and H3 performance and extension allow it to be repeatedly selected. In September of this year, H3 ranked first on the Arena image-to-video list at 1,495, with a cumulative number of over 57,000 votes.
But it may be more than that. One example is CUDA, which has the ability and the courage to invest in and nurture ecology in the early stages of new technologies: through resource slantness and commercial means, it has enabled developers to build applications around the GPU, creating high-barrier software ecology.
The multi-modular model area may be the next CUDA type of opportunity: to engage more video models and developers in NVIDIA technology vaults for reasoning acceleration and generation applications around H3. It's not just the video-generation market, it's also the ecological and arithmetical needs behind it.
In the open-source ecology, the partners are also “nodes” into larger markets.
The front-end enterprises have integrated video models into the production process, facing different requirements, and the same enterprise will also present new demands as business changes. Modellers meet these requirements on a case-by-case basis and are expected to maintain and update them on a continuous basis, with increasing costs.
A video-generation platform, Runway, found that some business clients wanted to have the model weight directly, deploy it in their own environment and fine-tune it with their own data. The risk investment agency a16z interviews with business AI directors also mentioned control and business-specific customization as important reasons for the enterprise ' s choice of an open model. It also noted in the report that enterprises were increasingly focusing on open models, not only because of prices, but also because they could fine-tune their own data.
The open weight model provides a new solution. Open power weights make it possible for head enterprises to place models in their own production systems. They can adjust the model around existing client needs and then deliver capacity through their own platforms, products and services.
This points to a vast market far beyond what a company can serve. These partners are linked to their clients, the platform and workflow. For models and producers such as Mini Max, the collaborators could become nodes for entering more industries. When H3 partners move their products into more clients and scenes, MiniMax can continue to expand its own industry applications, involving more technical teams familiar with vertical scenarios, and to achieve targeted optimization based on H3's established capacity to contribute to the location of video generation technologies in different areas.
This is also a way of commercializing uniquely in open-source ecosystems. Mini Max can use these important companies as “nodes” to expand sources of revenue through authorization, deployment support or joint development.
This is a business path that has been validated by many industries. Smart driving chips and algorithms open to BPU IP and sensory algorithms, which also provide chips, tool chains, solutions, and joint development, on which companies and partners can build differentiated products, not only expand the company's “friend circle” and influence, but also directly support its commercialization.
According to the Mini Max H3 Community Limited Agreement, a limited licence free of royalties is granted within the area of application, allowing users to use, modify and develop derivative models by clause; prior written authorization is required for the use of H3 commercial products or services with an annual income exceeding $20 million.
As the ecology becomes more active, the commercialization of Mini Max H3 is also growing rapidly.
When video generation moves from an occasional creative tool to a new link in the enterprise ' s production chain, advertising, electronics, video, games and education, which are directly related industries and broader areas, each generates new tools and services. Open weights make H3 the bottom of these teams and give Mini Max the opportunity to enter more industries along the product of the partner.
This echoes the "Intelligence with Everyone" mission that Mini Max has been saying: "Intelligence with Everyone": "Ai's development is not just a few model companies that continue to produce stronger versions, but more developers and more companies will also be the node of this wave of technological innovation, each being a user of new technologies and a driver of the wave.
For a commercial company, it is more important that the market may reassess the commercial value of an open source model: In addition to API revenues, the commercial potential of a model may be greater than expected when it becomes the base for business customization, deployment and product development, enters more industries and leads to income from workflow, such as authorization, technical services and joint development.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.