Reviewing Performers' Responses: Manual and Automatic Methods

There are two ways to accept tasks completed by performers in Toloka: automatic acceptance and non-automatic acceptance. Let's look at how these methods differ, which types of tasks they work best on, and how to review tasks with non-automatic acceptance quickly and efficiently.

Apr 15th 2021
Toloka Gets a New Look: The Story Behind Our Rebranding

Toloka went through some massive changes this week. We launched a full-scale rebrand and revealed a new logo and brand identity. Our sites and products now have a more refined, crisp look that we hope you’re enjoying as much as we are. Keep reading to find out how we went from our old daisy logo to a dandelion that’s also a bouquet of popsicles.

Apr 8th 2021
6 Papers Not To Miss from NeurIPS

Neural Information Processing Systems is an annual conference that featured more than 2,000 papers when it was last held in December 2020. We have chosen six papers from the conference as essential reading in crowd science and shared our perspective on trends in crowdsourcing research.

Mar 31st 2021
Searching for Missing People with Toloka

Toloka has teamed up with Liza Alert, a volunteer search-and-rescue organization, to look for missing people in drone images. As part of the process, Tolokers can check aerial images for signs of people to boost searches in progress.

Mar 25th 2021
Toloka Kit: a Python Library for Your Labeling Projects

Scale your data labeling projects with Toloka Kit – an open-source Python library from Toloka! A great tool for ML engineers and data scientists who want to have more flexibility when building labeling pipelines.

Mar 18th 2021
Practical Crowdsourcing: New Online Course on Coursera

The first online course on practical crowdsourcing for data labeling is now available on Coursera!

Mar 16th 2021
Introducing: Toloker Stories

Our users have a fascinating mix of backgrounds, languages, occupations, hobbies and interests, but there is one thing they all share: Toloka fits into their lifestyle. In this post we’ll introduce you to three Tolokers from India, Brazil, and Russia.

Mar 15th 2021
Toloka Digest: New Templates, Python Library and Crowd Science Events

Here at Toloka, 2021 is off to a roaring start! In this post we’ll get you up to speed on everything that’s been going on: updates we’ve made in Toloka, events we’ve participated in, and more.

Mar 11th 2021
Template Builder in Toloka: Accelerate Projects from All Angles

To make it easier and faster to launch projects in Toloka, we developed a new tool called Template Builder. You don't need any programming skills to design projects here. Template Builder is a convenient interface editor in JSON format with everything you need.

Mar 5th 2021
Principled Design for Crowdsourcing

In this post, we cover a recent talk by Ivan Stelmakh, who presented his research with Nihar Shah and Aarti Singh on the importance of principled design of human decision-making systems.

Mar 3rd 2021
Tolokers: Portrait of a Crowd

We ran a survey to learn more about the Toloka community and gathered responses from over 500,000 Tolokers. Here's what we discovered.

Feb 25th 2021
Guidelines for Effective Interfaces

The clarity and quality of the interface can affect how many people will respond to a given task, and how quickly and effectively they will complete it. In this post we have compiled a set of guidelines for effective interfaces.

Jan 28th 2021
The Technology Behind Self-driving Cars

In this post we'll talk about how the self-driving cars learn to see the world around them — what kind of data is collected, how it is processed, what algorithms are used, and the role Toloka plays.

Jan 26th 2021
Training Persona-driven Chatbots with Toloka

Most chatbots aren’t that good at actually chatting and making small talk, but Toloka can help fix that. In this post, we'll tell you how.

Jan 24th 2021
DeepHD Technology: Improving Video Quality with Computer Vision

In this post we’ll share how the DeepHD technology was developed, and how Toloka users helped with the process along the way.

Jan 20th 2021
Toloka Field Surveys Help Yandex.Fuel

Yandex.Fuel is growing fast, even more in outlying areas than in major cities. To find out how effective their gas station branding campaign is, Yandex.Fuel turned to Toloka.

Jan 18th 2021
Social Media Monitoring with Toloka

Large companies are mentioned in social media thousands times a day. They need a tool to automate mention filtering. In this article we'll share how Toloka helps Yandex to analyze mentions and find only ones that need a quick response.

Jan 16th 2021
Using the Crowd to Optimize Yandex.Taxi Quality Control

Toloka helps Yandex.Taxi to provide vehicle photo check to assess its external and internal condition. The purpose of this check is to decide whether the driver should be allowed to take orders

Dec 21st 2020
Toloka Helps Train a Self-driving Car to Detect Surrounding Objects

Yandex uses Toloka to label tens of thousands images needed to train neural network to distinguish surrounding objects in the cities of Russia.

Dec 10th 2020
Rating the Quality of Search Results with Toloka

Ozon uses Toloka to evaluate the quality of the new search engine, to determine the most effective ranking model and to improve the quality of the search algorithm using machine learning.

Dec 3rd 2020
New Metric: Markup Consistency in a Dataset

In this post, we'll share our insights on quality control in Toloka. To gauge the overall quality of the markup, we propose using post-hoc rating probability. We'll be calling this metric consistency.

Nov 23rd 2020
What Is a Crowd Manager and Why Do They Have the Potential to Become Essential Employees?

What is a crowd manager? The direct meaning «someone managing the crowd» accurately reflects the essence. This is an individual who meets business needs by assigning tasks to a large number of performers in a crowdsourcing system.

Nov 16th 2020

Toloka News

Receive information about platform updates, training materials, and other news.
Cookie files
Yandex uses cookies to personalize its services. By continuing to use this site, you agree to this cookie usage. You can learn more about cookies and how your data is processed in the Privacy Policy.
Thu Apr 15 2021 17:01:39 GMT+0300 (Moscow Standard Time)