Artificial Analysis 发布了 Search Index,用于评测搜索 API 在性能、成本和延迟方面的表现。该评测涵盖 1700 个任务及 BrowseComp、DeepSearchQA 和 AA-Omniscience 三个基准,目前 Exa(auto)和 Perplexity(medium)以 80 分的成绩领先。
Search is one of the most important tools for agents, and they search very differently to humans. By the end of the year, agents are expected to search the web far more than humans do
The Artificial Analysis Search Index measures the performance, cost and latency of Search APIs across 1700 tasks and three search-specific benchmarks: BrowseComp, DeepSearchQA and AA-Omniscience using the same base model and harness.
Developers can use the Artificial Analysis Search Index to inform their choices when it comes to what search tool their agent should be using. Now you can see who’s #1 while waiting for the bus. Currently Exa (auto) and Perplexity (medium) lead in performances with their best models scoring 80.
来源:Artificial Analysis · x.com