Receiving responses

You can download Tolokers' responses in a file as tasks are completed.

If tasks were distributed with an overlap of more than 2, run aggregation. Toloka will process all Tolokers' responses for the task and form the resulting response.

Getting the file with responses

In the interface
Via Toloka API

To get a file with Tolokers' responses, click the Download results button on the pool page.

Alert

The responses submitted by the banned Toloker before the ban will be taken into account and paid for. To exclude their responses from the results and aggregations, select the option Exclude assignments from banned users. It will delete the responses from users who were banned at the moment of downloading the results, not when the pool was labeled.

The fields in the file with responses:

  • INPUT:<name of the input data field> — Input data for tasks.

  • OUTPUT:<name of the output data field> — The Tolokers' responses. For training tasks, the field includes first attempted answers.

  • GOLDEN:<name of the output data field> — Responses for control tasks.

  • HINT:text — Hints for training tasks.

  • Information about the task completion (the same for all tasks on the page):

    • ASSIGNMENT:link — Link for viewing the task suite.

    • ASSIGNMENT:assignment_id — ID of the assigned task suite.

    • ASSIGNMENT:worker_id — ID of the Toloker who completed the task.

    • ASSIGNMENT:started — Date and time the task suite was assigned.

    • ASSIGNMENT:status — Task status: SUBMITTED — completed, APPROVED — accepted, REJECTED — declined.

A sample file:

Getting files

If the Tolokers were asked to upload files, the file with responses will contain IDs of the files received from Tolokers.

In the interface
Via Toloka API

To download files on your computer, click the button on the pool page.

You can download all files in the pool in one archive up to 4 GB in size. If the archive is too large (more than 4 GB), use the following tips:

  • Select a single status or pick a smaller time range.

    For example, if you need to review assignments, only download the submitted assignments rather than the accepted or rejected ones.

    If the file still exceeds the permitted size, pick a smaller time range and download the archives in several batches. The time range can be reduced to 1 day.

  • On the pool page, click Review assignments (or View assignments if they have already been accepted) to go to the page with the Tolokers' responses. Each string contains the Toloker's response to one task suite.

    Select the responses you need and click . Download the archives in several batches. You can select and download no more than 100 responses at a time.

  • Use the Toloka API to download files with responses.

See also

For developers

Troubleshooting

Can I ask a Toloker to redo the task if they made mistakes in it?
Can I fix something in a completed task myself?
How do I send an assignment back to the Toloker for revision?
Can I disable tasks for Tolokers who do a poor job on tasks?
What should I do if I want to accept a completed task but the pool is already archived or the Toloker wrote to me after the allowed time?
What should I do if I rejected a task for a reason that isn't specified in the instructions?
Can I reject part of the task responses on the page and accept part of them?
How can I notify the Toloker of changes in the instructions?
How can I increase the project's rating?
Low rating for “Will you take similar tasks in the future”
Low rating for “Clarity of instructions”
Low rating for “Task interface usability”
Low rating for “Communication with the requester”
Why do I get blank spaces inside my TSV file?
What is the result of processing an empty text field?
The results include the responses of Tolokers who I banned
Can I get the exact start and end time from the Toloker with the results of the task?
Contact support

Last updated: August 3, 2023

Introduction
Getting started
Important tips
Useful recommendations
Working with Toloka
Projects
Pools
Tasks
Results
Project analysis
Toloka settings
Task interface
Template Builder
HTML/CSS/JS editor
Help and support
FAQTroubleshootingSupportGlossary