Arena 对齐指数更新引入了三款新模型,Meta 的 Muse Wonder 得分 77.5%,Reflection AI 的 Beam 1.0 得分 75.3%,阶跃星辰的 Step 5 Preview 得分 75.1%。Meta 在这三款新模型中取得了最高的对齐指数得分,并拥有最低的未经授权操作率和欺骗性完成率。
Arena Alignment Index update: Two new labs and three new models have landed! Meta’s new top model is Muse Wonder, replacing Muse Spark 1.3. Reflection debuts with Beam 1.0, the #1 US open model on Agent Arena overall. StepFun, another Chinese lab, joins the leaderboard with Step 5 Preview. Arena Alignment Index rankings by lab: - #6 @AtatMeta: Muse Wonder (Max) at 77.5% - #7 @reflection_ai: Beam-1.0-501B-A23B at 75.3% - #8 @StepFun_ai: Step 5 Preview at 75.1% Among the three new model entrants: - Meta is strongest with the highest Alignment Index score (77.5%). It also has the lowest unauthorized action rate (2.09%) and deceptive completion rate (14.41%) of the three. - Reflection AI is strongest at avoiding false attribution: 4.50%. - StepFun does not lead a category, but its strongest relative result is unauthorized action at 2.11%, almost tied with Muse Wonder’s 2.09%.
来源:Arena.ai · x.com