Bank - internal HR

Internal IT & ops support: Leave requests, benefits enrollment, payroll inquiries, remote work arrangements, resignations.

100Test cases available OTS
22Agent tools

Domain agentic intelligence index

We test models on private, non-contaminated tasks.
Here's what we found.

Composite pass^5 score (%)
Last updated: June 17
Composite pass^5 score (%)
Last updated: June 17

Composite pass^5 score across Tool use evaluations (higher is better).
Error bars show 95% confidence intervals.

Scaling curves

K = 1…5 runs

pass^k — Consistency

% tasks passed in every one of k runs.

0%9%18%26%35%k=1k=2k=3k=4k=5
GPT-5.4
Sonnet 4.6
Gemini 3 Flash
Minimax
Kimi K2.5
0%9%18%26%35%k=1k=2k=3k=4k=5
GPT-5.4
Sonnet 4.6
Gemini 3 Flash
Minimax
Kimi K2.5

Task difficulty distribution

Tasks bucketed by aggregate success rate

Buckets show difficulty tiers based on aggregate of models results on the benchmarking subset.

100%

0 of 129 tasks (0%)

0

75%+

0 of 129 tasks (0%)

0

50%+

25 of 129 tasks (19%)

25

25%+

92 of 129 tasks (71%)

92

0%

12 of 129 tasks (9%)

12

Example task

User Request

Correct Agent Solution

What Is Tested

Trusted by Leading AI Teams

Bank - internal HR dataset available for purchase