The call-a-model pattern that made LLMs easy to build on is reaching physical robots.

Until now, getting a robot model working on your own arm meant collecting data and training for each task. PokeBot’s RoboAPI lets owners of 5 supported arms skip that and send typed commands instead.

It’s an API for robot arms, much like an LLM API for text: the arm’s camera image goes to PokeBot’s servers, and Poke-Aurora sends back movements the arm executes at 30Hz.

This is a great progress towards zero-shot robotics, the instruction is the only thing that changes between tasks.

https://x.com/PokeBot_Global/status/2115864192402256335/video/1