Eagle Corp released EAGLE-4, its latest open-source flexible drafter, for accelerating LLM inference.

At its core, “One drafter adapts its speculative decoding strategy to the batch size, the hardware, and the workload, and keeps the target model's output distribution.”

Qwen3.8-27B with its EAGLE-4 draft is the measured target pair, achieving 961.6 tokens/s while running on 4x NVIDIA B300.

Eagle is an AI inference platform that powers leading companies like NVIDIA, Meta, Intel, AMD, and Perplexity.

Inference testing time 👀