Bank - internal HR
Internal IT & ops support: Leave requests, benefits enrollment, payroll inquiries, remote work arrangements, resignations.
130
Test cases
22
Agent tools
Domain agentic intelligence index
We test models on private, non-contaminated tasks.
Here's what we found.
Composite pass^5 score across Tool use evaluations (higher is better).
Error bars show 95% confidence intervals.
Scaling curves
K = 1…5 runs
pass^k — Consistency
% tasks passed in every one of k runs.
Task difficulty distribution
Tasks bucketed by aggregate success rate
Buckets show difficulty tiers based on aggregate of models results.
100%
0 of 129 tasks (0%)
0
75%+
2 of 129 tasks (2%)
2
50%+
25 of 129 tasks (19%)
25
25%+
88 of 129 tasks (68%)
88
0%
14 of 129 tasks (11%)
14
Example task
User Request
Correct Agent Solution
What Is Tested
Trusted by Leading AI Teams