跳到正文
Arena.ai· @arena · X·· 9 天前AI 评分58
AI 导读

Arena Alignment Index 更新引入了三款新模型,其中 Meta 的 Muse Wonder 获得 77.5% 的对齐指数并位居第六,Reflection AI 的 Beam 1.0 和阶跃星辰的 Step 5 Preview 分别以 75.3% 和 75.1% 的得分入榜。

正文 · 原文

Arena Alignment Index update: Two new labs and three new models have landed! Meta’s new top model is Muse Wonder, replacing Muse Spark 1.3. Reflection debuts with Beam 1.0, the #1 US open model on Agent Arena overall. StepFun, another Chinese lab, joins the leaderboard with Step 5 Preview. Arena Alignment Index rankings by lab: - #6 @AIatMeta: Muse Wonder (Max) at 77.5% - #7 @reflection_ai: Beam-1.0-501B-A23B at 75.3% - #8 @StepFun_ai: Step 5 Preview at 75.1% Among the three new model entrants: - Meta is strongest with the highest Alignment Index score (77.5%). It also has the lowest unauthorized action rate (2.09%) and deceptive completion rate (14.41%) of the three. - Reflection AI is strongest at avoiding false attribution: 4.50%. - StepFun does not lead a category, but its strongest relative result is unauthorized action at 2.11%, almost tied with Muse Wonder’s 2.09%.

来源:Arena.ai · x.com