Sandbox

  1. How to run a project in the sandbox
  2. How to complete tasks
  3. How to move a task to the production version of Toloka
  4. Troubleshooting

The Sandbox is a testing environment for Toloka. This is where you can test your project settings as a performer before moving them to the Toloka production version and running the project for real performers. This helps you avoid making mistakes and spending money on a task that isn't working right.

Restriction. Note that you can only move project and pool settings. You can't move tasks and responses to them. The project's quality control settings can't be moved, either.

How to run a project in the sandbox

  1. Register in the sandbox as a requester. To do this, follow the link.

    Tip. To avoid confusion, use the same Yandex ID that you used in the Toloka production version to register as a requester.
  2. Configure and launch your project:

How to complete tasks

To complete your tasks in the sandbox:

  1. Register in the sandbox as a performer (see the instructions in the user documentation ).
    Attention. Authorization via social media isn't allowed, so you need to register a new user in Yandex.

  2. Log in to the sandbox using the requester account.

  3. Open the Users page and click Add trusted users.

  4. Click Add user and enter the case-sensitive username of the created performer.

    Only trusted users can access your tasks.

    The number of trusted performers required for testing depends on the overlap settings.

    To test your project in the Sandbox, set overlap 1. If you increase the overlap, you will need to register more performers and add trusted user accounts.

    When exporting a project to the live Toloka version you can specify the necessary overlap, in accordance with your project goals.

  5. Log in to the sandbox using the performer account and test your tasks. Make sure that the buttons and response validation are set up correctly, and assess how long it takes to complete the tasks. Make sure that the performer selection and quality control work.

How to move a task to the production version of Toloka

To move tasks from the sandbox to the production version:

  1. Link the sandbox and production version's accounts:

    1. Open the External Services Integration tab in the production version on the profile page and copy the OAuth token.

    2. Open the same tab in the sandbox on the profile page and paste the copied token into the Production OAuth token field.

  2. Go to the project page in the sandbox and click Project actions → Export.

  3. Choose the pools to export and click Export.

    If to the pool has linked training, it is exported automatically.

Troubleshooting

How do I work with the Sandbox?

Register as a requester in the sandbox.

Register as a performer using another account.

In your requester account, add your performer account to your trusted list.

Create and run a task. It will appear in the list of tasks for your trusted users. For more information, see Help.

How do I see my pool through the eyes of a performer?

To test your task, add yourself as a trusted performer in the Sandbox. To do this, on the Users page, click Add trusted users. Enter the username for the performer's account (case-sensitive).

Is it possible to use the same account for the Sandbox and the public Toloka version?

No, you need a separate account for each version of Toloka. To create a task in the Sandbox, register in it as a requester. To complete your own task, register another account for yourself as a performer.

What do I do if an error occurs on the server when I try to export a project from the Sandbox?
Try exporting the project without pools.
Select an exported project and don't select pools in the window that opens.
Click Export.
If the error persists, refresh the token.
Go to Yandex ID.
Under Sign in and device history, click Log out from all devices.
Request new tokens in the Sandbox and main environment.
Update the token in the Sandbox Profile .
How do I check my project in the mobile version of Toloka?

To do this, you will need a Sandbox version of the Toloka app. Write to support to get it.

Will a copy of the project exported from the Sandbox be updated in the main version if I edit the original?

You won't be able to update a previously exported project. If you clone a project from the sandbox again, its current copy is added. The old project doesn't change.

Can I add a user with an insufficient rating to my performers?

The user can't see the task if they don't match the filter or rating. You can remove the blocking filter from the pool. To test your task, add yourself as a trusted performer in the Sandbox.

Why isn't anything happening when a test performer clicks Submit in the sandbox?

Use your requester account to preview the pool and check whether it's possible to submit a task. If this fails, most likely there is an error in your project.

How do I move control tasks from the Sandbox to the main pool?

The tasks themselves are not exported, only the project configuration and the settings of the selected pool. You can download the completed tasks from the pool in the Sandbox and import them to the exported pool.

To download only the control tasks (if you completed them in the interface), go to Mark up, then click Control tasks and Download.

Why don't I see my task in the Sandbox?

Make sure that:

  1. The pool is started.
  2. The user is added as a trusted user.
  3. The trusted user is registered in the sandbox as a performer.
  4. The trusted user didn't use social networks when registering.
  5. Your trusted performer matches the filters you set.
I can't add a trusted user.

Possible reasons:

  • The user isn't registered in the sandbox. The account you registered in the Toloka production version won't work. Make sure you have specified the correct performer's account as a trusted one.
  • The performer's account is authorized via social networks. Register a new user in Yandex.
What overlap should I set?

Overlap defines how many performers complete the same pool task.

The best overlap is an overlap that provides satisfying quality of results. For most tasks that are not reviewed, overlap from “3” to “5” is enough. If the tasks are simple, overlap of “3” is likely to be enough. For tasks that are reviewed, set overlap to “1”.

Can I change overlap after the pool is started?

Yes. Open edit mode for the pool and set a new overlap value. You don't need to restart the pool. Updating the settings is usually fast, but if there are many tasks, it may take several minutes.