News
AI Summary
15 Nov 20266 Jumada II 1448 AH
Alma Agent's Performance in FrontierHarness v1.1 Ranking

Alma Agent's Performance in FrontierHarness v1.1 Ranking

Alma, developed by yetone, ranked third in the FrontierHarness v1.1 snapshot on November 11, while the competition was still ongoing. By November 15, Alma dropped to sixth place with a pass rate of 59.7%. The FrontierHarness benchmark evaluated 21 different harness configurations, including Codex CLI and Claude Code, across 62 tasks in various fields. FrontierHarness measures performance across 26,040 scored trials, where Alma achieved a success rate of 72.7% in the initial snapshot, outperforming Claude Code. However, in the final ranking, Alma was 13th in terms of cost per successful task, with a cost of $1.22 per success.

Follow these topics

Sign in to follow the topics that matter to you

Sign in to follow

This summary is generated with AI and receives periodic editorial review. Refer to the original source for full details.

0
0 reading now

Insight Score

Rate to unlock

Sign in to react, rate, and save. Sign In

Key terms in this story

Tools mentioned

The top AI news daily on Telegram, and the week in your inbox.