Jim Fan 推出了 VFlash,这是一种用于 Physical AI 的视觉模型,通过并行解析视觉世界来实现更快的动作解码。该模型在边缘 GPU 上实现了最高 12 倍的动作解码加速和 5.1 倍的整体机器人推理加速,同时将 3D 轨迹误差降低了最高 61%,目前已开源并公开论文。
该项目通过并行解析视觉世界提升了具身智能的推理速度与精度,为了解端侧机器人规划提供了新的技术路径。
The era of System One Vision Model is here! Introducing VFlash: parsing the visual world in parallel at unmatched speeds for Physical AI.
Most embodied prediction tasks like object localization, robot trajectory planning, and dense 3D motion are fixed-length float vectors. For example, a bounding box is always 6 tokens, a 10-waypoint robot arm trajectory is 54: we know these beforehand. Instead of decoding one token at a time, we can output the entire geometric shape in one go.
VFlash enables up to 12x faster action decoding and a 5.1x overall robot inference speedup on edge GPUs like the Jetson Thor and DGX Spark. What’s surprising is that it ends up even more accurate than the VLM backbone, with up to 61% lower 3D trajectory error. The intuition is that VFlash avoids the cascading errors of autoregressive decoding, where every coordinate is written in ink and every later point loses the chance to backspace.
Everything that moves will be autonomous, and everything autonomous will need to think on its own chip. The next inference revolution is physical reasoning at the speed of reflex.
And as always, it’s open paper, open source! Link in thread:
来源:Jim Fan · x.com