Results

Once the pool is finished, it's time to check the results.

Subscribe to Toloka News

Monitor statistics

Remember to check project statistics and pool statistics and track metrics like time spent, budget, and quality. Analyze which aspects you could improve.

Download the results

There are two ways to aggregate results in the Toloka interface.

Aggregation using the Dawid-Skene method:
This type of aggregation works well if the task overlap was >1 and multiple responses can be compared with each other. In the pool, click Download results -> Dawid-Skene aggregation model. You can monitor the process and download the finished file on the page with the list of operations. Each response is listed with a percentage based on the confidence.
Aggregation by skill:
Aggregates responses based on the level of trust in the Toloker, which is indicated by the skill value. This works well if the pool used dynamic overlap, or if you set up a skill that measures the quality of responses and the output fields have a limited set of possible values.

You can also use other aggregation methods. To learn more, see our page about aggregation methods.