Tolokers

  1. Data about Tolokers
  2. Rewards
  3. Cheaters
Tip. If you are looking for the answer to a specific question, use Ctrl+F to search the page (Cmd+F on MacOS).

Data about Tolokers

How do I view information about Tolokers?

You can view information about Tolokers of your tasks on the Tolokers page. To view information about a Toloker, select their ID. The requester can access the following data in the Toloker profile: country and city, age, education, language skills. On the Metainformation tab, you can find the versions of the browser and operating system, the User-agent type, region detected by IP, and other Toloker parameters. To select the Tolokers for your pool based on their profile, device, geo location, and other parameters, use filters.

Do you verify the information entered by the Toloker in the profile?

It's the Toloker's responsibility to provide the information in the profile during registration. We don't request identity documents for registering in Toloka. If a profile seems suspicious to us, we ask the owner to confirm the information.

Do Tolokers know their ID?

No, only the requester can see the Toloker ID.

Why can I filter Tolokers by gender in the pool settings, if gender isn't shown in the profile?

The requester can't see the full details about specific Tolokers. For example, the requester can't see their date of birth, gender, last name, or first name. However, filters by date of birth and gender are available to the requester in the pool settings. You can use them to select a group of Tolokers without accessing the details about specific Tolokers. This decreases the risk of Toloker de-anonymization.

More than 500 Tolokers passed the training, but the training skill shows only 30.

The pool shows the total number of Tolokers that completed at least one assignment. A training skill can be lost over time if you set repeated training in the pool settings. This setting allows a Toloker to pass the training again after a certain period if the Toloker didn't complete any tasks in associated pools or if there was a large time gap between completing tasks (for example, because of the ban). The training skill displays the Tolokers who either recently completed training, or regularly complete your tasks so that the skill doesn't expire.

Other questions

Rewards

How do I reward Tolokers in addition to the basic task price?

You can increase the basic task price for Tolokers that have a higher skill. To do this, set up Dynamic pricing. If you want to motivate high-quality Tolokers regardless of their skill, use rewards. In your task instructions, specify the amount and conditions for the Toloker rewards.

How can I view statistics on paid rewards?

To view your expenses that involve rewards, go to your profile and open the Expenses tab.

Other questions

Cheaters

Can I disable tasks for Tolokers who do a poor job on tasks?

You can deny access to the pool if the Toloker's responses are too fast, if they don't match the majority vote, or if the Toloker makes too many mistakes in control tasks. Tasks completed by such Tolokers can be given to other Tolokers.

Can I ask a Toloker to redo the task if they made mistakes in it?

No. After sending a task, the Toloker can't make any changes to it. You can add tasks that were completed incorrectly to a new pool.

Can I fix something in a completed task myself?

No, you can't fix anything in the task itself. However, you can do this manually in the results file.

Fraudulent Tolokers submit assignments with empty response fields. Are they going to be banned before the responses of other Tolokers are known?

Fraudulent Tolokers aren't banned before the majority vote is known. That's why we recommend that you have new Tolokers complete training or a test. Then you can select the Tolokers that successfully completed the training to do your tasks.

Are the cheaters who were banned for incorrect responses paid anyway?

If the Toloker was already paid for the tasks, you can't cancel the payment.

Tolokers completed the training successfully, but have poor results in the general task

During the training, Tolokers follow the task instructions and practice completing your tasks. Based on the training results, the requester can select Tolokers who did well enough to get access to the main pool. However, the mere fact that the Toloker completes your training pool successfully does not guarantee that they will continue to demonstrate high-quality performance. Tolokers who did well on the training but had inadequate results in the general task might have obtained correct training responses from other people.

In addition to the training, be sure to set up quality control rules in your main pools. This lets you control the quality throughout the task completion process. If the task requires that users send free-format responses or data files, use non-automatic acceptance to pay for them only after reviewing the responses.

The results include the responses of users who I banned

The results show the responses of all users, including those who are banned. To exclude their responses from the results, select the option Exclude assignments by banned users. It will delete the responses from users who were banned at the moment the results were downloaded, not when the pool was labeled.

How can I ban a user and reject all their responses?

You can't automatically reject the responses of a banned Toloker.

But you can do it yourself if you want. When downloading the results, select the option Exclude assignments by banned users to delete the responses of Tolokers who were banned at the moment of downloading. You can also forward all the assignments from banned users to other Tolokers using the Re-completion of assignments from banned users rule.

My project has a trusted user who was banned by the system

Unfortunately, this Toloker has violated the user agreement and will no longer be able to complete tasks. You can find new Tolokers or customize filters so that they better match the project requirements.