Performers

  1. Data about performers
  2. Rewards
  3. Cheaters
Tip. If you are looking for the answer to a specific question, use Ctrl+F to search the page (Cmd+F on MacOS).

Data about performers

How do I view information about performers?

You can view information about performers of your tasks on the Users page. To view information about a performer, select their ID. The requester can access the following data in the performer profile: country and city, age, education, language skills, rating. On the Metainformation tab, you can find the versions of the browser and operating system, the User-agent type, region detected by IP, and other performer parameters. To select the performers for your pool based on their profile, device, geo location, and other parameters, use filters.

Do you verify the information entered by the performer in the profile?

It's the performer's responsibility to provide the information in the profile during registration. We don't request identity documents for registering in Toloka. If a profile seems suspicious to us, we ask the owner to confirm the information.

Do performers know their ID?

No, only the requester can see the performer ID.

Why can I filter performers by gender in the pool settings, if gender isn't shown in the profile?

The requester can't see the full details about specific performers. For example, the requester can't see their date of birth, gender, last name, or first name. However, filters by date of birth and gender are available to the requester in the pool settings. You can use them to select a group of performers without accessing the details about specific performers. This decreases the risk of performer de-anonymization.

More than 500 performers passed the training, but the training skill shows only 30.

The pool shows the total number of performers that completed at least one assignment. A training skill can be lost over time if you set repeated training in the pool settings. This setting allows a performer to pass the training again after a certain period if the performer didn't complete any tasks in associated pools or if there was a large time gap between completing tasks (for example, because of the ban). The training skill displays the performers who either recently completed training, or regularly complete your tasks so that the skill doesn't expire.

Other questions

Rewards

How do I reward performers in addition to the basic task price?

You can increase the basic task price for performers that have a higher skill. To do this, set up Dynamic pricing. If you want to motivate high-quality performers regardless of their skill, use rewards. In your task instructions, specify the amount and conditions for the performer rewards.

How can I view statistics on paid rewards?

To view your expenses that involve rewards, go to your profile and open the Expenses tab.

Other questions

Cheaters

Can I disable tasks for performers who do a poor job on tasks?

You can deny access to the pool if the performer's responses are too fast, if they don't match the majority vote, or if the performer makes too many mistakes in control tasks. Tasks completed by such performers can be given to other performers.

Can I ask a performer to redo the task if they made mistakes in it?

No. After sending a task, the performer can't make any changes to it. You can add tasks that were completed incorrectly to a new pool.

Can I fix something in a completed task myself?

No, you can't fix anything in the task itself. However, you can do this manually in the results file.

Fraudulent performers submit assignments with empty response fields. Are they going to be banned before the responses of other performers are known?

Fraudulent performers aren't banned before the majority vote is known. That's why we recommend that you have new performers complete training or a test. Then you can select the users that successfully completed the training to do your tasks.

Are the cheaters who were banned for incorrect responses paid anyway?

If the user was already paid for the tasks, you can't cancel the payment.

Performers completed the training successfully, but have poor results in the main task

During the training, performers follow the task instructions and practice completing your tasks. Based on the training results, the requester can select performers who did well enough to get access to the main pool. However, the mere fact that the performer completes your training pool successfully does not guarantee that they will continue to demonstrate high-quality performance. Performers who did well on the training but had inadequate results in the main task might have obtained correct training responses from other people.

In addition to the training, be sure to set up quality control rules in your main pools. This lets you control the quality throughout the task completion process. If the task requires that users send free-format responses or data files, use non-automatic acceptance to pay for them only after reviewing the responses.

The results include the responses of users who I banned

The results show the responses of all users, including those who are banned. To exclude their responses from the results, select the option Exclude assignments by banned users. It will delete the responses from users who were banned at the moment the results were downloaded, not when the pool was labeled.

How can I ban a user and reject all their responses?

You can't automatically reject the responses of a banned performer.

But you can do it yourself if you want. When downloading the results, select the option Exclude assignments by banned users to delete the responses of performers who were banned at the moment of downloading. You can also forward all the assignments from banned users to other performers using the Re-completion of assignments from banned users rule.

My project has a trusted performer who was banned by the system

Unfortunately, this performer has violated the user agreement and will no longer be able to complete tasks. You can find new performers or customize filters so that they better match the project requirements.

Other questions