Toloka documentation

Getting started

Select the problem to solve, fill out an application form for creating a project, and upload your data: the service will configure the project for you, create a task interface, and find performers. All you have to do is run your project and get the labeling results.

Choose a bespoke solution

  1. Open the page with examples of tasks that are available in Toloka.
  2. Choose a solution that fits your task.

Fill out a form

Once you choose a bespoke solution, you need to fill out a form. In the form, you'll be requested any information that is necessary to create a project: its name, instructions, sample tasks, and so on.

It will take about 30 minutes to fill out the form. To make sure you get good results, fill out the application form carefully.

Once you fill out the form, you'll see your project on the Bespoke tab in the Pending status. You don't have to wait until it's moderated and can immediately start uploading task items.

Task items

A task item is a labeling unit – in other words, data uploaded to a batch. The batch consists of task items, and the project consists of batches.

Upload task items

Note

Before uploading task items to a batch, you need to upload them to photo hosting or cloud storage. Learn more in the Where to store data section.

Your items are uploaded to a batch. A batch is a set of data for labeling that you'll assign to performers at a time. You'll get labeling results separately for each batch, too.

  1. Select your project on the Bespoke tab.

  2. Click Create batch.

  3. Enter a name for the batch.

  4. Upload task items in one of the following ways:

    • Upload a ready-made TSV file.

    • Enter the data in text format.

      Each line with data is a task item. You can later view each item's status.

  5. Click Create batch again. Done! You created a batch.

Send the data for labeling

  1. Wait until the project passes moderation: its status will change to Active.
  2. Send the batch for labeling by clicking Launch.

Are there any errors?

If there are errors in the project, its status changes to Rejected. No worries:

  1. Go to the rejected project.
  2. Click Show errors. Read the error description.
  3. Click Clone project to create a duplicate for editing and fix the errors in it.

Tip

If you need help with setting up your project, contact us.

What's next

Download the labeling results.

Upload more items to the batch or create a new one.

Troubleshooting

I didn't find a suitable bespoke solution

If you can't find a solution that fits your goals, contact us.