Control tasks
This indicator shows the average ratio of control tasks to other tasks within per task suites. A large percentage of control tasks lets you improve the quality but, at the same time, it may make labeling more expensive.
How to calculate
where:
-
is the percentage of control tasks.
-
is the number of control tasks.
-
is the total number of tasks.
The indicator estimation criteria depends on the pool type.
Pool with general tasks
Exam pools
-
A good indicator is
30%
. -
A low indicator is
< 30%
.
-
A good indicator is
100%
. -
A low indicator is
> 90%
.