Create a project

If you already have a project and you want to create an identical one, clone the existing project. If not, create a new project.

New project

The project defines what the task will look like for a Toloker.

To get better results, make tasks as simple as possible and divide complex tasks into several projects.

Tip. You can first create and test your project for free in the sandbox and then move it to the Toloka production version.

To create a project, follow the instructions:

In the interface:
  1. Choose a template:

    1. Click the Create project button on the Projects page.

    2. Choose a template. The template contains pre-configured input and output data fields and the task interface, which you can edit.

      If there is no suitable template, choose an empty template.

  2. Provide general information:

    1. Enter the Name and Description. Tolokers will see this in the task list.

    2. Optionally add a Private comment.
  3. Edit the task interface:

    Template Builder
    HTML/JS/CSS editor
    1. Click Show specifications to see the input and output data fields.

      Input data fields are created from the code on the Example of input data tab.

      The output data fields depend on the components that use data.output and values supported by it.

      Learn more about input and output data fields in the Template Builder Help.

    2. Specify the settings for field task display if you use one of the field task templates.

    1. Add fields for input and output data in the Data specification block.

    2. Specify the settings for field task display if you use one of the field task templates.

  4. Write guidelines for Tolokers.

    You can prepare instructions in HTML format, then copy and paste into the editor. Click <> to switch to HTML mode.

  5. Optionally, add translations to other languages.
    1. Select the source language and the target languages.
    2. Fill in the fields in the table.
    3. Click Finish.

After creating the project, add a task pool to it. You can also set up quality control in the project.

Cloning a project

You can view the list of created projects on the Projects page. Open the project page to view the list of pools, project rating, and project statistics.

To clone a project, click in the list of projects or select Project actions → Clone on the project page.

Attention. Quality control in the project is not cloned.

If you need to change the project settings, open edit mode.

Troubleshooting

General task settings
I have a complex task. How do I break it down to get high-quality results?

If your task contains many objects of different types, you should break it down. For example, you can ask users to select numbers in the first project, doorways and windows in the second project, walls in the third project, and plumbing in the fourth project.

The simpler the task, the cheaper it is and the better the quality of the final result. Set the cost of labeling a single class of objects in photos at about $0.01.

Use the Object selection in an image template. You can open this template in the editor and add a drop-down list for labeling the selected object. See how to do this in the editor description (Dropdown list tab).

How do I add response validation depending on a checkbox?

You can use JavaScript to add assignment validation depending on a checkbox. An example is provided in the “Search for information online” template.

How many tasks should be in a suite?

The number of tasks depends on how difficult and time-consuming the tasks are. Keep the size reasonably small. Large task suites are unpopular, partly because they are inconvenient for Tolokers (for example, if the internet connection is unstable).

Setting up tasks with images
What template do I select so that Tolokers label only irrelevant products in the output?

You can create such an assignment based on the classification template. Show a product image and ask the question: "Does the product match the query?" Add two radio buttons for responses: “Yes” and “No”.

How do I label elements on web pages?
Generate the screenshots of pages and manually label areas using the “Object selection in an image” template.
How do I create a task for selecting objects in images?
We recommend that you break down your object selection project into three projects in Toloka:
  1. Sorting images containing an object.
    1. Create a task using the “Image classification” template.
    2. Sort the images containing the object you are looking for.
    3. Show the image to the Toloker and ask if the object is in the image. Response options: Yes/No.
  2. Selecting objects in images.
    1. Select the object in the images you obtained after the previous pro