跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分63
AI 导读

Perceptron 推出第一人称视频标注 API,上传做家务等第一人称视频后,API 会返回带时间戳的每个步骤以及双手动作细节。研究表明其标注效果接近通用前沿模型,而成本降至约 1/8。

正文 · 原文

So much brilliant work is happening on robot training.

A lot of the cost in robot learning sits in labeling video, step by step and hand by hand. If that cost can be reduced by about 8x at nearly the same quality, much more of the footage teams already have can be used.

And now we also have proof that specialized model harnesses are closing in on general frontier models for narrow video tasks, at a fraction of the cost.

Upload a first-person video of someone doing chores, and we have an API returns each step with timestamps, what each hand is doing.

Perceptron AI's research shows, For labeling robot training video, paying 8x more for the biggest AI model buys you almost no extra accuracy.
A smaller system built only for this job gets the same result for the price of a sandwich per hour of video.

https://x.com/perceptroninc/status/2118018939708182843/video/1

来源:Rohan Paul · x.com