跳到正文
NVIDIA Blog· Dion Harris·· 24 天前精选AI 评分68

OpenAI 发布 GPT-6 Astra Ultrafast 模型

How NVIDIA GPUs Help Accelerate OpenAI’s GPT-6 Astra Ultrafast

AI 导读

OpenAI 推出 GPT-6 Astra Ultrafast 模型,该模型运行于 NVIDIA Blackwell GPU 之上,相比 Astra 标准模式 token 生成速度提升最高 8 倍。该版本现已通过 OpenAI API 及部分 ChatGPT Work 和 Codex 用户开放,旨在通过降低延迟优化智能体在编码、测试及工具调用等工作流中的响应效率。

推荐理由

OpenAI 推出基于 NVIDIA Blackwell 架构的 GPT-6 Astra Ultrafast 模型,通过推理优化实现最高 8 倍的生成速度,旨在缩短智能体在编码与工具调用中的循环周期。

正文 · 原文

GPT-6 Astra Ultrafast, running on NVIDIA Blackwell GPUs, is available now in the OpenAI API and to eligible ChatGPT Work and Codex users. 

Accelerated by inference optimizations through OpenAI’s models that tap into the capabilities of the NVIDIA Blackwell architecture, Ultrafast offers up to 8x faster token generation than the Astra Standard mode. For developers, faster generation can shorten coding agents’ edit-test-debug cycles, reduce the time spent generating responses between tool calls and make interactive applications feel more responsive. 

A faster response matters most when it’s repeated across a workflow: an agent writes code, uses a tool, checks the result and decides what to do next. Ultrafast brings Astra’s capabilities into these time-sensitive loops. NVIDIA AI infrastructure helps OpenAI serve more useful model outputs when developers need it. 

“NVIDIA’s deep investment in tooling and documentation has enabled us to make our models exceptionally good at programming Blackwell and Rubin GPUs,” said Philippe Tillet, inference lead at OpenAI. “Astra can turn that knowledge into high-performance kernels that make NVIDIA hardware compelling across the full frontier of latency, throughput and cost. With Astra Ultrafast, that means faster model responses as agents write code, use tools and work through complex tasks.”

Continually Improving Performance

Performance gains don’t stop when a model is deployed. OpenAI is using its own models to help refine the inference software running on NVIDIA GPUs, taking advantage of the platform’s programmability to test and implement improvements. That ongoing work can make model responses faster and deployed infrastructure more productive over time. 

“Our work with NVIDIA is helping us make AI faster and more useful,” said Uday Ruddarraju, chief technology officer of compute at OpenAI. “We used our internal models to optimize inference on NVIDIA GPUs, and NVIDIA’s programmability helped us deliver the acceleration behind Astra Ultrafast.”

A programmable NVIDIA platform allows developers and researchers to reuse infrastructure across training, inference and reinforcement learning as models evolve. That flexibility helps teams repurpose compute resources as demand changes, improving utilization and avoiding overprovision for each workload.

Developers can use GPT-6 Astra Ultrafast through the API today. See the Ultrafast guide for access, pricing and implementation details.

来源:NVIDIA Blog · blogs.nvidia.com