跳到正文
Nathan Lambert· @natolambert · X·· 2 小时前AI 评分34
AI 导读

开源模型消亡的传言被大大夸大了,但此前的 AA index 确实对它们有所美化。作为一个行业,我们需要更多针对特定任务的智能指数,因为 LLM 被用于截然不同的任务中。 我对评测基准行业的综合评述。 https://www.interconnects.ai/p/artificial-analysis-v5-and-the-benchmarkers

正文 · 原文

Open models' demise has been greatly exaggerated, but the previous AA index did flatter them. As an industry we need more specific intelligence indices, as LLMs are used in vastly different tasks.

My meta-review on the benchmarking industry.
https://www.interconnects.ai/p/artificial-analysis-v5-and-the-benchmarkers

来源:Nathan Lambert · x.com