Ban

  1. How to ban a Toloker
  2. Banning on the platform
  3. Troubleshooting

Tolokers can be banned in two ways:

  1. By the requester.
  2. By the platform.

How to ban a Toloker

You can block a Toloker's access to one or more projects. This lets you control manually which Tolokers will complete tasks. For example, you can choose all Tolokers with a skill value lower than N and block their access to tasks. You can also unblock access.

To block access to tasks for a single Toloker:

  1. Select a Toloker on the Tolokers page.

  2. Click Actions → Ban, then fill in the fields:

    Field

    Overview

    Ban type

    Where to apply the ban:

    • In all my projects — All projects.

    • In the project — A single project (choose one from the list).

    Ban expires

    Set when to lift the ban.

    We recommend blocking access temporarily in order to maintain the desired number of Tolokers for completing tasks.

    Reason

    The reason for banning (only seen by the requester).

    Field

    Overview

    Ban type

    Where to apply the ban:

    • In all my projects — All projects.

    • In the project — A single project (choose one from the list).

    Ban expires

    Set when to lift the ban.

    We recommend blocking access temporarily in order to maintain the desired number of Tolokers for completing tasks.

    Reason

    The reason for banning (only seen by the requester).

To block access to tasks for multiple Tolokers:

  1. Select Tolokers by using the filters on the Tolokers page or upload a TSV file:

    <annotator id 1>
<annotator id 2>
...
<annotator id n>
    Copied to clipboard

  2. Click Ban, then fill in the fields (see the table above).

You can view information about access to tasks on the Toloker's page (on the Tolokers page, go to the Bans tab). To unblock access to tasks, hover over the ban line and click .

Attention. The assignments submitted by banned Tolokers will be taken into account if they are not rejected manually using assignment review They can be reassigned by setting up the Recompletion of assignments from banned users rule.

Banning on the platform

Toloka has a special antifraud algorithm for banning dishonest Tolokers. It monitors user behavior and blocks suspicious accounts.

The main reasons for banning:

  1. Disclosure of confidential information.
  2. Using scripts and bots or any form of cheating.
  3. Poor response quality.
  4. Providing false data during registration.
  5. Frequently skipping captchas or entering them incorrectly.
  6. Using multiple accounts.
Note.

If a Toloker's behavior seems suspicious, write to support. We'll conduct an additional review. If the Toloker is violating the user agreement, they'll be blocked in the system and will no longer be able to complete tasks.

You can also ban this Toloker from your project.

Troubleshooting

My project has a trusted Toloker who was banned by the system

Unfortunately, this Toloker has violated the user agreement and will no longer be able to complete tasks. You can find new Tolokers or customize filters so that they better match the project requirements.

Can I disable tasks for Tolokers who do a poor job on tasks?

You can deny access to the pool if the Toloker's responses are too fast, if they don't match the majority vote, or if the Toloker makes too many mistakes in control tasks. Tasks completed by such Tolokers can be given to other Tolokers.

Can I ask a Toloker to redo the task if they made mistakes in it?

No. After sending a task, the Toloker can't make any changes to it. You can add tasks that were completed incorrectly to a new pool.

Can I fix something in a completed task myself?

No, you can't fix anything in the task itself. However, you can do this manually in the results file.

Fraudulent Tolokers submit assignments with empty response fields. Are they going to be banned before the responses of other Tolokers are known?

Fraudulent Tolokers aren't banned before the majority vote is known. That's why we recommend that you have new Tolokers complete training or a test. Then you can select the Tolokers that successfully completed the training to do your tasks.

Are the cheaters who were banned for incorrect responses paid anyway?

If the Toloker was already paid for the tasks, you can't cancel the payment.

Tolokers completed the training successfully, but have poor results in the general task

During the training, Tolokers follow the task instructions and practice completing your tasks. Based on the training results, the requester can select Tolokers who did well enough to get access to the main pool. However, the mere fact that the Toloker completes your training pool successfully does not guarantee that they will continue to demonstrate high-quality performance. Tolokers who did well on the training but had inadequate results in the general task might have obtained correct training responses from other people.

In addition to the training, be sure to set up quality control rules in your main pools. This lets you control the quality throughout the task completion process. If the task requires that users send free-format responses or data files, use non-automatic acceptance to pay for them only after reviewing the responses.

The results include the responses of users who I banned

The results show the responses of all users, including those who are banned. To exclude their responses from the results, select the option Exclude assignments by banned users. It will delete the responses from users who were banned at the moment the results were downloaded, not when the pool was labeled.

How can I ban a user and reject all their responses?

You can't automatically reject the responses of a banned Toloker.

But you can do it yourself if you want. When downloading the results, select the option Exclude assignments by banned users to delete the responses of Tolokers who were banned at the moment of downloading. You can also forward all the assignments from banned users to other Tolokers using the Re-completion of assignments from banned users rule.