Toloka updates: more presets, mobile preview, better task loading, and test data

Toloka Team
by Toloka Team
Image

Subscribe to Toloka News

Subscribe to Toloka News

Get more out of Toloka with our latest updates! Our growing collection of project presets now includes audio classification and third-party surveys. You also get expanded options for uploading tasks, a mobile preview to test your tasks, and sample datasets for playing in the sandbox. Dive in!

New presets: Audio classification and Survey on third-party platform

Two more project presets join the collection. If you have audio data or use a survey platform, setting up a project will be a snap.

Audio classification

Our new preset includes a template for classifying audio recordings. Evaluate the sound quality in audio files or label audio samples to detect emotion. Get annotated audio data for training voice assistants and other speech-related projects.

Image

Survey on third-party platform

With the Survey on third-party platform preset, you can now use any survey platform with our global crowd of Tolokers. Create a survey on your favorite platform, add a link to it in the Toloka task interface, and access our diverse audience of respondents around the world.

Image

You can choose the demographics of the respondents — location, gender, age, and education. You will need to include a completion code at the end of the questionnaire. Tolokers will add it to the task to show they have completed the survey, and you will use it to accept or reject assignments.

Other survey presets available:

  1. Short / Medium / Long survey in Qualtrics. A boxed solution for running surveys in Qualtrics.
  2. Survey with Toloka template (previously called Customer survey). Surveys can be completed directly in the task interface. Perfect for short polls or if you need a broader range of filters, like average income or relationship status.

All presets are already configured and include a template for the task interface as well as a set of instructions for Tolokers.

Task interface mobile preview

Most Tolokers perform tasks on mobile devices, so you need to make sure your tasks are mobile-friendly. To make this easier for you, we added mobile preview.

You can now see how your tasks will look on Tolokers' devices and decide what changes, if any, to make before publishing them. The preview of the task interface is available on both the project and pool pages.

Image

Improved task loading

Previously, you could only upload tasks in TSV format. We've added XLSX and JSON support so that you're not limited to a single format.

We've also made it easier for you to distribute tasks across pages. You can preview what the task suite looks like for Tolokers with different page layouts, then choose the optimal number of tasks per page. Remember that the price and timeframe are per task suite (not per item on the page). Preview task pages to make sure you get the best results while also paying Tolokers fairly and giving them enough time to complete the tasks on each page.

Image

Popular presets now have test datasets. Use them when you need sample data for sandbox experiments, sample pool and project setups, and overall platform testing.

Image

Test datasets are available in the following presets:

  • Product search relevance
  • Image classification
  • Object recognition and area selection
  • Text classification

Whether you’re new to Toloka or just haven’t logged in lately, you’ll want to check out the new features. If you don’t have any data on hand, feel free to use one of our test datasets to play around. Reach out if you need anything — we're always ready to help.

Get started

Your Toloka team

Article written by:
Toloka Team
Toloka Team
Updated: 

Recent articles

Have a data labeling project?

Take advantage of Toloka technologies. Chat with our expert to learn how to get reliable training data for machine learning at any scale.
Fractal

More about Toloka

  • Our mission is to empower businesses with high quality data to develop AI products that are safe, responsible and trustworthy.
  • Toloka is a European company. Our global headquarters is located in Amsterdam. In addition to the Netherlands, Toloka has offices in the US, Israel, Switzerland, and Serbia. We provide data for Generative AI development.
  • We are the trusted data partner for all stages of AI development–from training to evaluation. Toloka has over a decade of experience supporting clients with its unique methodology and optimal combination of machine learning technology and human expertise. Toloka offers high quality expert data for training models at scale.
  • The Toloka team has supported clients with high-quality data and exceptional service for over 10 years.
  • Toloka ensures the quality and accuracy of collected data through rigorous quality assurance measures–including multiple checks and verifications–to provide our clients with data that is reliable and accurate. Our unique quality control methodology includes built-in post-verification, dynamic overlaps, cross-validation, and golden sets.
  • Toloka has developed a state-of-the-art technology platform for data labeling and has over 10 years of managing human efforts, ensuring operational excellence at scale. Now, Toloka collaborates with data workers from 100+ countries speaking 40+ languages across 20+ knowledge domains and 120+ subdomains.
  • Toloka provides high-quality data for each stage of large language model (LLM) and generative AI (GenAI) development as a managed service. We offer data for fine-tuning, RLHF, and evaluation. Toloka handles a diverse range of projects and tasks of any data type—text, image, audio, and video—showcasing our versatility and ability to cater to various client needs.
  • Toloka addresses ML training data production needs for companies of various sizes and industries– from big tech giants to startups. Our experts cover over 20 knowledge domains and 120 subdomains, enabling us to serve every industry, including complex fields such as medicine and law. Many successful projects have demonstrated Toloka's expertise in delivering high-quality data to clients. Learn more about the use cases we feature on our customer case studies page.