All questions on one page

If you aren't using Toloka yet and need advice

Ask a question

If you have a problem working with Toloka

In the section contents, select the stage where you encountered the problem and find the appropriate solution in the list. If not found, select the last item Other questions, fill out the form and wait for a response from the support team.

Registration and getting started

I can't complete registration as an “individual requester”. I'm not getting an SMS code.
  1. Check the number you entered. You might have mistyped it.
  2. Check the number in Yandex ID. It must be set as your main number. If a different number is specified in Yandex ID, an SMS code will be sent to that number.

You can also use the recommendations in Yandex ID Help. If this doesn't help, contact support.

How do I change my account type from “Requester” to “Toloker”?

You can't change the account type from “Requester” to “Toloker”.

If you want to complete tasks, you need to register in Toloka once again, with a different username, but as a Toloker.

To create a Toloker account:
  1. Log out of your requester account.
  2. Go to the Toloka home page.
  3. Click Join.
  4. Follow the system instructions.
Note. You can use the same phone number to create a new account. For a step-by-step description of the registration process, see Registration and login.
The phone number belongs to another user

If you see this warning, make sure you entered the phone number correctly.

Please note that you can only have one requester account per phone number (see the User Agreement).

If your Yandex ID is linked to the wrong number, change it. For more information about linking a phone number, see Yandex ID Help.

If you don't remember your credentials in Toloka, use Restoring access.

If you deleted your Toloka account, create a new Yandex ID and register in Toloka.

How do I change the phone number in my account?

To change your phone number, go to Yandex ID and change your main number.

Note. If you don't have access to the old number, it takes a month to replace it. For more information about changing the phone number, see Yandex ID Help.

Other questions

Sandbox

How do I work with the Sandbox?

Register as a requester in the sandbox.

Register as a Toloker using another account.

In your requester account, add your Toloker account to your trusted list.

Create and run a task. It will appear in the list of tasks for your trusted users. For more information, see Help.

Why don't I see my task in the Sandbox?

Make sure that:

  1. The pool is started.
  2. The user is added as a trusted user.
  3. The trusted user is registered in the sandbox as a Toloker.
  4. The trusted user didn't use social networks when registering.
  5. Your trusted Toloker matches the filters you set.
How do I see my pool through the eyes of a Toloker?

To test your task, add yourself as a trusted Toloker in the Sandbox. To do this, on the Users page, click Add trusted users. Enter the username for the Toloker's account (case-sensitive).

What do I do if an error occurs on the server when I try to export a project from the Sandbox?
Try exporting the project without pools.
Select an exported project and don't select pools in the window that opens.
Click Export.
If the error persists, refresh the token.
Go to Yandex ID.
Under Sign in and device history, click Log out from all devices.
Request new tokens in the Sandbox and main environment.
Update the token in the Sandbox Profile .
How do I check my project in the mobile version of Toloka?

To do this, you will need a Sandbox version of the Toloka app. Write to support to get it.

Will a copy of the project exported from the Sandbox be updated in the main version if I edit the original?

You won't be able to update a previously exported project. If you clone a project from the sandbox again, its current copy is added. The old project doesn't change.

Why isn't anything happening when a test Toloker clicks Submit in the sandbox?

Use your requester account to preview the pool and check whether it's possible to submit a task. If this fails, most likely there is an error in your project.

How do I move control tasks from the Sandbox to the main pool?

The tasks themselves are not exported, only the project configuration and the settings of the selected pool. You can download the completed tasks from the pool in the Sandbox and import them to the exported pool.

To download only the control tasks (if you completed them in the interface), go to Mark up, then click Control tasks and Download.

Is it possible to use the same account for the Sandbox and the public Toloka version?

No, you need a separate account for each version of Toloka. To create a task in the Sandbox, register in it as a requester. To complete your own task, register another account for yourself as a Toloker.

I can't add a trusted user.

Possible reasons:

  • The user isn't registered in the sandbox. The account you registered in the Toloka production version won't work. Make sure you have specified the correct Toloker's account as a trusted one.
  • The Toloker's account is authorized via social networks. Register a new user in Yandex.

Other questions

Setting up a customizable project

Instructions

How do I show my instructions to the Toloker inside the task so that they don't need to open or close it?
There are three options:
  • Put your instructions inside the task, but make sure that it doesn't clutter the interface.
  • Use a side window for your instructions so that the user can quickly expand or collapse them.
  • Hide the instructions in an expandable section or add hints for the individual interface elements.
For best results, we recommend that you pre-select the Tolokers that meet your requirements and set up the quality control rules.
Can I add a video player or audio player to my instructions?
No, but you can add links to them.
Some tags disappear after I save the instructions.
You can't use unsupported tags because they are deleted when you save the project. List of supported tags.
How do I create different instructions for the training pool and main pools?
By default, the project instructions are displayed in the training pool. To use separate instructions for the training pool, deselect Use project instructions. Don't forget to update the training instructions if you change something in the general task instructions.
What do I do if the radio button attributes are displayed correctly in the preview, but disappear after saving?

If the tags or attributes disappear after you save the instructions (for example, checked="true"), it means that they are not supported. For the full list of tags that can be used in the instructions, see the Guide.

Other questions

Configuring the task interface

How do I make an image expand to its maximum size on click?

To the component that inserts the image, add the parameters: real-size=true and screenshot=true.

How do I create a shortcut for adding a polygon in "image-annotation"?
To create a shortcut, add the following action to the "onKey" method:
onKey: function(key) {
          var el = this.getDOMElement().querySelector(".image-annotation-editor__shape-polygon");

          if (key === 'D') {
          el.click();
          el.classList.add('image-annotation-editor__shape_active')
          }
Copied to clipboard

If you need to further modify the area-selection editor, use this library.

How do I enable loading audio files in preview mode?

You can't check loading of audio files in the preview mode, but you can do it in the sandbox if you do your task. To do this, register in the sandbox as a Toloker and add the Toloker username to your trusted list on the Users page. For more information, see this post.

My Tolokers can't upload a file with the assignment

If none of the Tolokers can submit the assignment, the most likely reason is JS validation. Run JS validation again.

Export your project to the sandbox and try to complete the task in the sandbox yourself.

How do I check the task display in the mobile Toloka app?

To check the task's look-and-feel on the mobile phone screen, enable the emulation mode in Chrome or Safari and edit the CSS block.

You can also use the mobile version of the sandbox. Write to support to get access to it.

How do I use different numbers of response options for different questions?
Use concatenation, for example:
{{field type="checkbox" name=(concat "result." @index ) label=(concat "checkbox –
          " @index) size="L"}}
Copied to clipboard
Why is the iframe content not displayed when I add the input and output data to the HTML interface in the preview mode?

Try to disable extensions in your browser. They might block iframe loading.

How do I add the text from an input variable to a checkbox label?

To pass a label in the input data, enter the input field name into the label.

For example, if you have the asd input field with the string type, the component would look like: {{field type="checkbox" name="like" label=asd hotkey="q"}}.

If you want to pass different label values in different tasks or the number of checkboxes may differ, use concatenation.

How do I hide expandable text?

You can hide text in an expandable section by using CSS styles, both in the task itself and in the instructions. You can see the sample code here.

How do I pass the value of the input variable to the “Button with click validation”?
Specify the name of the input field where you pass the link, without the brackets:
{{field type="button-clicked" name="ads" label="Click me" href=name_escape
          action=true}}
Copied to clipboard
How can I do it in JS so that if the checkbox is selected, the link is not required, but if the link is inserted, the checkbox is cleared?
  1. See how this is implemented in the Search for information online template.
  2. To solve the second problem, you can add another validation like this:
    if (solution.output_values.url && solution.output_values.check) {return {task_id:
    this.getTask().id,errors: {'url': {code: ''Insert a link or check the box if the site doesn't exist'}}}}
    Copied to clipboard
I selected one checkbox, but all the checkboxes are selected.

The names of the output fields must differ: each checkbox must have its own unique name. For more information about this component, see here.

How do I add assignment validation depending on a checkbox, so that if an object is in the image, it must be selected, otherwise, a checkbox must be selected?

You can use JavaScript to add assignment validation depending on the checkbox. An example is provided in the “Search for information online” template.

How do I insert a calendar?

You can see an example in the comments for this project. The example includes the output data format and libraries to be added.

To add libraries:
  1. Click the “gear button” in project editing mode.
  2. In the field that opens on the left, enter the links and press Enter.
Why doesn't the “Submit” button work in the task?

The issue is probably in the JS block. Try deleting its content, then test the Submit button in the preview mode.

How do I make tasks that have a varying number of response options and different options available?
You can do this using concatenation.
See the sample projects that can help you build an interface:
  • with checkboxes
  • with a dropdown list
  • with radio buttons
If you pass an array of values to the input field, use commas to separate the array elements. A response option will be generated for each of them in the interface. Input/output data for the sample projects are provided in the comments at codepen.io.
How do I deselect a radio button?

You can't deselect a radio button. You can only select another radio button as a different response option.

How do I, depending on the option selected, show a photo and make it mandatory or hide it and make it optional?

In this case, you need to leave the field optional in the output data and set up validation depending on the Toloker response. You can see how this is implemented in the “Text classification” template.

How do I prevent adding photos from the gallery so that when the user clicks the add photo button the camera opens, rather than the gallery/camera choice?

Add sources="CAMERA" to the attributes of the image loading component. This disables adding photos from the gallery.

How do I run setSolution validation in "OnRender"?
Try to add a condition to check for the second progress bar:
setSolution: function(solution) {
var secondScale = this.getDOMElement().querySelector('.second-scale');

if(secondScale) {
secondScale.style.display = solution.output_values.grammar === 'no' ? 'block' : 'none';
}

TolokaHandlebarsTask.prototype.setSolution.call(this, solution);
}, 
Copied to clipboard
How do I implement selection of 3 different areas in an image?

You can create a selection and drop-down list with category selection. See how it is implemented on this page (Dropdown list tab).

How do I use the Vue markup without the basic TolokaHadlebarsTask object?

Learn more about the template's JS extension here.

To avoid conflict between the Vue markup and the Handlebars syntax, disable the "toloka-handlebars-templates" library and inherit from the Task/TaskSuite classes.

In the “Side-by-side image comparison” template, where do I specify a proxy for the task interface to create a task with three image options?

The “Side-by-side image comparison” template uses a component rather than an HTML tag. This means that you should enclose your proxy in curly brackets like this example: {{img src=(proxy image)}}.

How do I change the task background from the standard white color to a different color?
Use CSS to specify the color for the .task or .task-suite element. For example, to use a black background:
.task-suite {
background-color: #000000;
}
.task {
background-color: #000000;
}
Copied to clipboard
You can also assign a class to the interface block with the image and set the background for this block only.
How do I validate the data entered by the user in the Toloka interface?

You can check the link format using regular expressions. To do this, add the link validation JavaScript code with regexp to the task template.

For example: var regexp = /^(https://www.myurl.com/).{4,200}$/.

You can also add a regular expression to the input field with the string type in the output data. Make the field mandatory. Then add the Text input field field in the task interface (in the HTML block) and specify the field name in the name attribute:
{{field type="textarea" name="input" width="270px" rows=5}} 
Copied to clipboard
How do I add assignment validation depending on a checkbox?

You can use JavaScript to add assignment validation depending on a checkbox. An example is provided in the “Search for information online” template.

How do I enter a list of words line-by-line, display an element for each of them, and save the result to the output array?

Pass an array of strings as the input field. For example, as shown in the screenshot:

In HTML, use a special handlebar to iterate over this field. The code structure will look like this:
{{#each words}}
{{field type="radio" name="result" value=this label=this}}
{{/each}}
Copied to clipboard
How do I use sliders as interface elements for selecting parameter values?
In the HTML code of the template, enter the following:
<input type=""range"" list=""rng"" class=""res""> and include the following in onRender in your JS:
onRender: function() {
// Generated DOM element for the task (available via #getDOMElement())
//Adding auxiliary variables
var $root = $(this.getDOMElement());
var _this = this;
var solution = TolokaHandlebarsTask.prototype.getSolution.apply(this, arguments);

$root.on('change', '.res', function(){
var range_result = $(this).val()
_this.setSolutionOutputValue('result', range_result);

return solution;
})

}
Copied to clipboard
How can I expand the window with HTML/CSS/JS code in the online task editor?

You can't expand the HTML window. To expand the JS and CSS fields, click any area within the field.

How do I use the input data as a variable in the HTML block?

Enclose the input field in double curly brackets {{text}}.

How do I display formatted text from input data in the task?

Enclose the input field in triple curly brackets {{{input_field}}}.

For more information about using the component, see the Requester's guide.

Can I use my own JS to build an interface in Toloka?
You don't have to use our components for task interfaces. Feel free to create a custom design for your tasks. To do this, delete the library from the project template:
  • Click the “gear button” to open the settings.
  • Delete $TOLOKA_ASSETS/js/toloka-handlebars-templates.js.
See the Requester's guide for descriptions of the structure of classes and how they work.
How do I use a variable number of inputs in HTML to be determined by the user?

To change the number of output fields dynamically, use the recommendations from this page.

Are you going to implement an HTML/JS prettifier in the project design?

We didn't intend this window for any sophisticated development. Usually, the content is prepared in a third-party prettified editor, and the resulting code is pasted to the window prior to the update.

However, in the context of TolokaHandlebars editability, there are no differences between our window and a third-party editor.

How do I display the text in the input field as in the source (with the HTML tags)?

To display the text in the input field with HTML tags, use the <pre> tag. For example:<pre>{{text}}</pre>.

In this case, the text is rendered as is, in one scrollable line. To remove the scroll and avoid stretching the task card, add the following CSS to the block:
.task {
  max-width: 800px;
}

pre {
  white-space: pre-wrap;
}
Copied to clipboard
What should the Toloker do if there is no selectable object in the image in an area selection task?
There are four options:
  • Decompose the task: First select images with the items you need, then select areas in them.
  • Select an arbitrary area in the image. For example, put a square in the upper-right corner.

    Mention this in your instructions for reviewers.

  • Ask the Toloker to skip the task and report it in a personal message. Messages are reviewed by the requester. If the selectable object is missing, the task is deleted from the pool (by resetting the overlap).
  • Add the “No object” checkbox to the interface and make sure that your JS checks that either the object is selected or the checkbox is selected.

    For control purposes, add information about the value of this checkbox to the task interface.

How do I make a voice recording of a text in a single audio file, but use about 1000 people to record it?

You need to break down your task for Toloka. If you have a 30-minute task intended for one person and containing all the phrases, the best approach is to divide it into individual phrases, which you can give to different Tolokers. The template for voice recording tasks doesn't require that the user installs a separate voice recorder app.

Refer to our step-by-step guide for creating a voice recording task.

In the input data, you can pass the phrase for the Toloker to record ("enable navigation"), and the speech speed (normal speed). This is the data you need to save in the TSV file. See the Guide to learn about creating a TSV file and its structure.

The preview contains 4 tasks per suite by default. You can specify the number of tasks for your project when you upload the task file. Learn more about the preview.

For example, if you want one person to say the same phrase 10 times, create 10 tasks in a suite. The cost is specified per task suite. To define how many people should say a particular phrase, use the overlap in the pool. By the way, don't forget to set up filters in your pool. This way you can select only the Tolokers who speak a certain language and use mobile devices: client = mobile Toloka.

You can delegate review of the voice recordings to other Tolokers by creating a separate project. Find brief instructions on how to do this here.

Other questions

Input and output data

How do I insert a function that is called by an image click in my task?

You can find an example of the task template for selecting image groups at this link. The input and output data, as well as a fragment of the instructions, are in the comments to the project.

How do I add a mask for the input field, like dd.mm.yyyy for the date field or numbers only (10 or 12) for INN (Taxpayer Identification Number)?

To validate the input data format, you can use the output field type, specifying the acceptable or minimum/maximum values. For example, create an output field for the taxpayer number with the “string” type and enter its minimum and maximum length (like 10 and 12). To use a more sophisticated validation in the template, use RegExp.

To enter a date, you can add a calendar to the task interface. See an example of a calendar.

Do I need to convert all the images in the task to the same size or can they be different?
You can use different image sizes.
If a project's output data may include any number from 1 to 999999, can I specify a range?

You can't use a range as a fixed value.

Other questions

Pool settings

Filters

Can I select Tolokers from a specific city of residence or is the only option “Region by IP”?

Yes, you can do that. In the filters, select Profile → City. Please note that the profile data is entered by the user when they register in Toloka. We recommended that you use the filters Region by phone number and Region by IP.

Can I use a skill beyond a particular pool or project and apply it to other projects as well?

Yes, of course — you can use the same skill for different projects. But most often, a skill is intended for a specific project. If the Toloker completes a certain task well, this doesn't mean that they will complete other ones successfully. Another disadvantage is that if you filter by skills that were set long ago, you will artificially limit the number of available Tolokers.

I want to calculate a skill based on performance in multiple projects. Is that possible? If it is, can I use “Aggregation by skill”?

If you mean multiple different projects, you can't do that.

You can merge all the projects into one and use History size in the quality control rules. See examples in the Control tasks post.

You can use Aggregation by skill, but you'll need to list all the possible values, which is probably not the best choice. Perhaps you'll find another method of aggregation helpful.

I created a project and a pool, but the Next button doesn't work or the preview shows a blank screen.
Toloka lets you know that something is wrong with the project. The blank screen often appears when there are errors in the task interface, including the JavaScript code. The Next button may be disabled if the output specification lacks some field or contains invalid values, or if, for example, you configured validation for a nonexistent field in JavaScript.
Are there any easy ways to assign a certain user a skill in Toloka, even if the user didn't do any tasks (like I can do in the Sandbox)?

In the main Toloka version, you can only assign a skill to users who have completed at least one of your tasks. There is no option to assign a skill to an arbitrary user. To limit the audience of users who will see your project, use filters. For example, specify the city, date of birth, gender, or some other parameters of your target Tolokers.

Can I somehow limit the number of users that can take tasks from the pool at the same time?

Tasks from an open pool are available to every user that matches your pool filters. You can restrict access, like by using a skill.

The Tolokers completed training for the first pool and got the skill. A week later, we cloned the pool, but all the users lost their skill. Which parameter affects skill expiration? Do all the Tolokers need to complete the training again?
The validity period of the training skills is controlled by the Retry after parameter. The skill is deleted after a period specified in days in the Retry after field, if the Toloker:
  • Has a skill value lower than the one specified in the Level required field.
  • Didn't complete any tasks linked to training during this period.

Your users will need to be trained again.

Why is my project not available in the mobile version of Toloka?

Tasks in pools are automatically available in the web version of Toloka and the mobile app. Check the pool settings. You might have the Client = Toloka web version filter on.

Can I add an arbitrary user as a Toloker?

If the user mismatches your preset filter, they can't see the task. You can only remove the restricting filter from the pool. You can test the task in the Sandbox by adding the desired user to your trusted list.

Can I set up a task to display it to users with certain demographic and geo parameters? For example, “Moscow only, 30-45 years old”.

You can do that. To select Tolokers for the pool, use filters.

How do I make the task available not only from desktops, but also from mobile devices?

Tasks in pools are automatically available in the web version of Toloka and the mobile app. Check the pool settings. You might have the Client = Mobile Toloka filter on.

Can I select specific Tolokers for my tasks because I liked their results in my previous pools?

You can assign a skill to these people based on their performance in the previous pools. Use this skill as a filter in the new pool.

How do I set up a filter so that the pool is available to users who don't have a specific skill (like a “spammer”)?

Specify this skill as a filter, but leave the value field empty (this is equivalent to absence of the skill).

How can I raise the skill value for a user, if they already have the skill?

If the user already has a given skill, you can't add the same skill to them from the task review interface. You can open the user's profile and edit the skill value.

Can Toloka users see that they were assigned a skill?

If it's a public or training skill, they see it and they get a message about it.

Can I show a skill in the task interface?

There is no such option. If the skill is public, the Toloker sees it in their profile.

Why can't I find the Toloker's gender in the user data, although I can filter people by this attribute in the pool settings?

Requesters can't see the full details about specific Tolokers. So you can't see information like the date of birth, gender, last name, or first name. However, you can use filters by date of birth and gender (in the pool settings). This way you can select a group of Tolokers without accessing the personal information of individual Tolokers. This decreases the risk of user de-anonymization.

How do I automatically assign skills based on user responses to my questions?
You can do that using the Control tasks rule.
  1. Upload the task file using Smart mixing.
  2. Specify student as the correct answer to the question. Don't take other questions into account (leave the fields empty or unselected).
  3. Add the Control tasks rule to the pool: if the percentage of correct control answers = 100, then set the skill value Student = 1.
See the screenshot

Other questions

Quality control

How do I set quality control in a pool correctly?

The settings for quality control rules depend on the type of tasks. General recommendations:

  • Always use one or more ways to control quality of answers.

  • Counting fast responses makes sense for most tasks.

  • If the user has to choose between options (for example, by selecting checkboxes), check the answers using majority vote or control tasks.

  • If the user has to provide a response as a text or link or upload a photo, the best way to control quality is by reviewing assignments. You can outsource task acceptance to Tolokers. Create a task with a question (for example, “Is this phrase translated correctly?”) and possible responses (for example, “yes”/“no”). Set up overlap and majority vote check.

  • If a task is more like an opinion poll (for example, choosing nice pictures from a set), majority vote is not a good way to control quality. Make