The Sandbox is a testing environment for Toloka. This is where you can test your project settings as a Toloker before moving them to the Toloka production version and running the project for real Tolokers. This helps you avoid making mistakes and spending money on a task that isn't working right.
Starting March 2023, new clients get access to Toloka sandbox upon request.
Please contact our support team describing the projects you plan to use the sandbox for, types of tasks you plan to upload, the approximate number of trusted Tolokers who are going to complete tasks for you there, and other details.
Make sure the projects you plan to use in the sandbox meet the usage rules.
The sandbox is intended for testing tasks with small batches of data. Labeling an entire dataset is considered unfair usage of the service, unless you have a special agreement with us.
The sandbox limits the number of trusted Tolokers and submitted tasks for testing your project. Limits are set by Toloka admins.
If you need a private data labeling environment for your own team, request the in-house data labeling option.
Once you have access to the sandbox approved, follow the steps below to run a project there.
Register in the sandbox as a requester.
To avoid confusion, use the same Yandex ID that you used in the Toloka production version to register as a requester.
Configure and launch your project:
A list of instructions is provided in Tutorials for popular tasks.
General instructions in the Starting and tuning a project section.
To complete your tasks in the sandbox:
Register as a Toloker (see the instructions in the user documentation).
Authorization via social media isn't allowed, so you need to register a new user in Yandex.
Log in to the Sandbox using the requester account.
Open the Tolokers page and click Add trusted Tolokers.
Click Add Toloker and enter the case-sensitive username of the created Toloker.
Only trusted Tolokers can access your tasks.
The number of trusted Tolokers required for testing depends on the overlap settings.
To test your project in the Sandbox, set overlap 1. If you increase the overlap, you will need to register more Tolokers and add trusted accounts.
When exporting a project to the production version of Toloka, you can specify the necessary overlap in accordance with your project goals.
Log in to the sandbox using the Toloker account and test your tasks. Make sure that the buttons and response validation are set up correctly, and assess how long it takes to complete the tasks. Make sure that the Toloker selection and quality control work.
Note that you can move only project and pool settings. You can't move tasks and responses to them. The project's quality control settings can't be moved, either.
To move tasks from the sandbox to the production version:
Link the sandbox and production version accounts:
Go to the project page in the sandbox and click → Export.
Choose the pools to export and click Export.
If the pool has linked training, it is exported automatically.