跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2 小时前AI 评分31
AI 导读

黄仁勋表示,通过软件或内核优化将AI模型推理速度提升一倍,在需求超过产能的情况下可使AI实验室的营收翻倍。推理营收等于服务token数量乘以单价,更快的内核能在相同GPU、功耗和场地条件下提高每秒token吞吐量。若额外增加的token在当前价格下均能售出,2倍的速度提升即可在零新增资本支出的情况下实现营收翻倍。

正文 · 原文

Jensen Huang says doubling model speed (e.g. with software or kernel optimization) doubles an AI lab’s revenue, which holds only while demand outruns capacity.

Inference revenue is tokens served multiplied by the price of each token.

Faster kernels raise tokens per second on the same GPUs, the same power, and the same building.

If every extra token finds a buyer at today’s price, a 2x speedup does double revenue with zero new capex. https://x.com/wallstengine/status/2115413873348280709/video/1

来源:Rohan Paul · x.com