Tolokers
Tip
If you are looking for the answer to a specific question, use Ctrl+F to search the page (Cmd+F on MacOS).
Data about Tolokers
You can view information about Tolokers of your tasks on the Tolokers page. To view information about a Toloker, select their ID. The requester can access the following data in the Toloker profile: country and city, age, education, language skills. On the Metainformation tab, you can find the versions of the browser and operating system, the User-agent type, region detected by IP, and other Toloker parameters. To select the Tolokers for your pool based on their profile, device, geo location, and other parameters, use filters.
It's the Toloker's responsibility to provide the information in the profile during registration. We don't request identity documents for registering in Toloka. If a profile seems suspicious to us, we ask the owner to confirm the information.
No, only the requester can see the Toloker ID.
The requester can't see the full details about specific Tolokers. For example, the requester can't see their date of birth, gender, last name, or first name. However, filters by date of birth and gender are available to the requester in the pool settings. You can use them to select a group of Tolokers without accessing the details about specific Tolokers. This decreases the risk of Toloker de-anonymization.
The pool shows the total number of Tolokers that completed at least one assignment. A training skill can be lost over time if you set repeated training in the pool settings. This setting allows a Toloker to pass the training again after a certain period if the Toloker didn't complete any tasks in associated pools or if there was a large time gap between completing tasks (for example, because of the ban). The training skill displays the Tolokers who either recently completed training, or regularly complete your tasks so that the skill doesn't expire.
Rewards
You can increase the basic task price for Tolokers that have a higher skill. To do this, set up Dynamic pricing. If you want to motivate high-quality Tolokers regardless of their skill, use rewards. In your task instructions, specify the amount and conditions for the Toloker rewards.
To view your expenses that involve rewards, go to your profile and open the Spent tab.
Cheaters
You can deny access to the pool if the Toloker's responses are too fast, if they don't match the majority vote, or if the Toloker makes too many mistakes in control tasks. Tasks completed by such Tolokers can be given to other Tolokers.
No. After sending a task, the Toloker can't make any changes to it. You can add tasks that were completed incorrectly to a new pool.
No, you can't fix anything in the task itself. However, you can do this manually in the results file.
Fraudulent Tolokers aren't banned before the majority vote is known. That's why we recommend that you have new Tolokers complete training or a test. Then you can select the Tolokers that successfully completed the training to do your tasks.
If the Toloker was already paid for the tasks, you can't cancel the payment.
During the training, Tolokers follow the task instructions and practice completing your tasks. Based on the training results, the requester can select Tolokers who did well enough to get access to the main pool. However, the mere fact that the Toloker completes your training pool successfully does not guarantee that they will continue to demonstrate high-quality performance. Tolokers who did well on the training but had inadequate results in the general task might have obtained correct training responses from other people.
In addition to the training, be sure to set up quality control rules in your main pools. This lets you control the quality throughout the task completion process. If the task requires that users send free-format responses or data files, use manual review to pay for them only after reviewing the responses.
The results show the responses of all users, including those who are banned. To exclude their responses from the results, select the option Exclude assignments by banned users. It will delete the responses from users who were banned at the moment the results were downloaded, not when the pool was labeled.
You can't automatically reject the responses of a banned Toloker.
But you can do it yourself if you want. When downloading the results, select the option Exclude assignments by banned users to delete the responses of Tolokers who were banned at the moment of downloading. You can also forward all the assignments from banned users to other Tolokers using the Re-completion of assignments from banned users rule.
Unfortunately, this Toloker has violated the Toloker agreement and will no longer be able to complete tasks. You can find new Tolokers or customize filters so that they better match the project requirements.