Yuchen Jin· @Yuchenj_UW · X·· 6 天前AI 评分63
AI 导读
深度求索（DeepSeek）公开了推理集群数据，显示单集群日服务吞吐量达 155 万亿 token，非高峰定价下每 GPU 小时收入为 $38。作者指出，其开源了推理框架 DeepInfer 并在架构中支持多种硬件。
正文 · 原文
“A single cluster currently serves 155 trillion tokens/day, generating $38 in revenue per GPU-hour (at off-peak pricing).”
Huge flex from DeepSeek. Not only did they open-source their inference engine, but they also open-sourced their revenue numbers.
They didn't disclose which GPUs they're using here, but DeepInfer supports both NVIDIA Blackwell and Huawei Ascend.
Even assuming they're renting B300s at $7 per GPU-hour, that's ~82% gross margin.
来源：Yuchen Jin · x.com