跳到正文
Hacker News-首页· laginimaineb·· 7 天前精选AI 评分77

Maxwell:一款打通代码与硬件的新型代码执行模型

Maxwell: A new kind of model that sits between code and hardware

AI 导读

doubleAI 推出了新型代码执行模型 Maxwell,它能在程序运行时理解并改进代码、推理硬件与数据,并对所有优化进行形式化等效证明。Maxwell 支持 CPU 与 GPU,其实测表现包括将数据处理管线提速 38 倍、AI 推理内核提速 4.25 倍,并使 LTX-2.5 的 4K 视频生成时间缩短近一半。

推荐理由

原文介绍了能在运行时优化二进制代码并提供形式化等价证明的新型模型,读者可以据此了解其在数据管线和推理内核上的性能表现。

正文 · 原文

by doubleAI

Maxwell understands and improves code while it runs, reasoning about hardware and data, not just code. Every improvement is formally proven equivalent to the original code. Read the manifesto 

  • 38×faster data processing pipelines
  • 4.25×faster AI inference kernels

What is a code execution model?

A short animated film, with narration and captions, introducing Maxwell: most code never sees the hardware it runs on or the data it processes. Maxwell watches a program while it runs, rewrites the binary underneath to fit that exact machine and data, and formally proves every improvement equivalent to the original. It runs on CPUs and GPUs, speeding up data pipelines and AI inference kernels.

Featured customer

LTX-2.5 generates 4K video in half the time

LTX built LTX-2.5 for efficiency from day one, compiled end to end, sequence-parallel across GPUs, decoding on a hand-written attention kernel. A pipeline built and optimized by top human experts. Maxwell made their 4K generation nearly twice as fast.

(opens ltx.io)

  • 1.87×faster 4K video generation
  • 134sper 4K clip on two B200s, down from 250s

Read the story 

Maxwell’s Demonstration

See Maxwell in action optimizing both GPU-based and CPU-based code. Once Maxwell has enough runtime data, it swaps in formally proven optimizations tailored to that exact machine while the program keeps running.

GPU-based speech-to-text using Whisper

Two terminals run the same Python script on the same RTX 4090: 180 transcriptions with Whisper-small from a cold start. Without Maxwell, on the left, it takes 106.23 seconds. With Maxwell, on the right, it completes in 49.82 seconds. Both produce identical transcripts. The recording plays at 4× speed.

CPU-based graph algorithms

Two terminals run the same Python script on the same machine: NetworkX betweenness centrality, 15 runs. Without Maxwell, on the left, it takes 61.44 seconds. With Maxwell, on the right, it completes in 17.50 seconds. Both print identical results. The recording plays at 4× speed.

Research behind Maxwell

  1. Maxwell approaches Speed of Light on Blackwell

    After one day of search, Maxwell beats NVIDIA’s PyTorch baselines on 90% of SOL-ExecBench’s Blackwell kernels.

    (opens on doubleai.com)
  2. doubleAI’s Maxwell: Surpassing Expert-Written Kernels At Scale

    Independently generated and verified a hyper-optimized drop-in version of NVIDIA cuGraph, 3.6× faster on average.

    (opens on doubleai.com)
  3. Blazing Fast pandas Without Changing a Line

    Maxwell completely rewrote pandas’ kernels from scratch, specialized for modern hardware.

    (opens on doubleai.com)

来源:Hacker News-首页 · heymaxwell.ai