Toloka — Data labeling platform
Toloka — Data labeling platform
Sign in
Sign in
Sign in
Toloka — Data labeling platform

Data Labeling 
for Natural Language Processing

Extract information from natural language data and take full control of your training data. Power your NLP algorithm with datasets of any size.
Start now
Talk to us
Top-quality data
Collect and annotate training data that meets and exceeds industry quality standards thanks to multiple quality control methods and mechanisms available in Toloka.
Scalable projects
Have any amounts of image, text, speech, audio or video data collected and labeled for you by millions of skilled Toloka users across the globe.
Cost-efficiency
Save time and money with this purpose-built platform for handling large-scale data collection and annotation projects, on demand 24/7, at your own price and within your timeframe.
Free, powerful API
Build scalable and fully automated human-in-the-loop machine learning pipelines with a powerful open API and Python library for easy integration.

Annotations we support

With Toloka, you can control data labeling accuracy to build a predictable pipeline of high-quality training data that impacts your NLP algorithms. Our platform supports annotation for named entity recognition, sentiment analysis, speech recognition, text and intent classification, text recognition, and more.

Use the Toloka crowd to evaluate the performance of your search engine and discover which ranking model works best. Collect data for improving your search relevance algorithm.

Read Case Study

Price for 1000 tasks: $18. Turnaround time: 4 hours.*

Use cases:
  • E-commerce 
  • Cataloging and Recommendations

    • Ask Tolokers to classify or categorize entire texts with predefined category tags.

    Price for 1000 tasks: $18.Turnaround time: 2 hours.*

    Use cases:
  • E-commerce
  • Cataloging and Recommendations
  • Content moderation
  • Optimize chatbots, web pages, social media

    • Use Toloka to label texts with sentiment categories for any purpose, from understanding customer reviews to spam filtering.

    Price for 1000 tasks: $4.5. Turnaround time: 1 hour.*

    Use cases:
  • Spam detection
  • Email filtering
  • Analyzing customer reviews

    • Ask Tolokers to categorize user queries into relevant predefined intents. Use labeled data to train your chatbot, voice assistant, or any other conversational agent to better understand your users.

    Price for 100 tasks: $6. Turnaround time: 1 hour.*

    Use cases:
  • Chatbot
  • Voice assistant
  • Conversational agent

    • Create a collection of utterances that typically occur in conversations, based on instructions or scenarios that you provide for our Tolokers.

    Price for 100 tasks: $12.Turnaround time: 4 hours.*

    Use cases:
  • Chatbot
  • Voice assistant
  • Conversational agent

    • Use our skilled Tolokers to identify parts of text, classify proper nouns, or label any other entities.

    Price for 1000 tasks: $18. Turnaround time: 1 hour.*

    Use cases:
  • Named entity recognition (NER)

    • Get recorded speech samples from Tolokers according to your instructions and use them to create or fine-tune a voice interface.

    Use cases:
  • TTS (Text-to-Speech) and speech synthesis technologies

    • Ask Tolokers to transcribe audio files or check existing transcriptions for accuracy.

    Use cases:
  • Speech recognition model
  • Chatbot

    • Use Toloka to detect emotion, categorize topics, or identify events in audio samples or conversations to improve your model.

    Use cases:
  • Speech recognition model
  • Chatbot

    • Ask Tolokers to transcribe text in PDF files. Use labeled data to train your text recognition algorithms to better identify specific parts of scanned documents, or validate and fine-tune the output of your own OCR models.

    Use cases:
  • Document Processing
  • Transcription
  • Optical Character Recognition (OCR)
    • * Approximate cost. Not a public offer. Price and turnaround time for tasks are set by the requester and depend on the type of task, input data, and other factors.
    Crowdsourcing means unlimited resources
    Data collection and labeling processes place high demands on the time, skills and expertise of a large number of people. Toloka gives you access to an unlimited crowdforce available 24/7 across the globe, plus intelligent tools and quality control methodologies for transparent and scalable workflows.
    Real-time insights
    Track your projects with real-time statistics on progress, spending, quality, time spent on tasks and active users involved. Leverage detailed analytics to fine-tune as necessary and make timely decisions to optimize speed, quality and budget.

    Success stories

    Alexey Hahunov, founder and CTO of Dbrain, IT company and Y Combinator alumnus:
    "Toloka helped us tackle the challenge of recognizing handwritten text in documents. We send anonymous text fragments to Toloka, where qualified performers rewrite the text and send the results back to the Dbrain system for further AI training. This meant we were able to resolve even the most difficult recognition cases for our customers."


    Konstantin Simonchik, science director and co-founder of ID R&D:
    "Using Toloka, we collected the world's largest database of 200,000 unique photos and videos to secure biometric systems against hackers and train neural networks to distinguish real faces from fakes. We chose Toloka because of the user-friendly interface, active performers and optimal quality for the price."


    Dmitry Akimov, VisionLabs data engineer:
    "Toloka is an excellent tool for data processing. We use it to collect and annotate thousands of images and videos every month in order to improve the performance of our algorithms. We chose Toloka because of the fast turnaround time and the active participation of performers."


    Mikhail Burtsev, head of the DeepPavlov.ai laboratory for neural networks and deep learning at Moscow Institute of Physics and Technology:
    "Modern machine learning technologies are not possible without a large volume of training examples. A computer can't master a natural language unless a person „explains“ how to use it correctly. Toloka allows the conversational AI systems that we develop at MIPT to communicate with a large group of people and grow smarter."


    Angelina Galkevich, Analyst Tinkoff:
    "We use Toloka to annotate data for speech synthesis and recognition Toloka performers have already processed tens of thousands of tasks with audio files for us, and we have successfully used the results to train our models. We like the price, the fast turnaround, and the super fast feedback. It allows us to quickly test different markup methods and hypotheses, and then choose the optimal approach."


    Anton Slesarev, head of Technologies in the self-driving cars division at Yandex:

    "Toloka is the first place we go to prepare data for AI. To train the neural network, we need tens of thousands of annotated images. You can buy them for $4 each, or you can have images marked up in Toloka 10 times cheaper and get datasets that are ready to use for training algorithms. We use these datasets for developing self-driving vehicle technology."


    Yandex.Maps Team:
    "Our service tracks outdated information on Yandex.Maps. We update business hours, add new businesses, and remove any that have closed. Toloka users perform our tasks in their neighborhoods, like taking photos of business signs with operating hours. Every month we distribute 15 million tasks like this to 50,000 performers — this is the only way we can keep the huge Yandex.Maps database up to date."


    Alexey Hahunov, founder and CTO of Dbrain, IT company and Y Combinator alumnus:
    "Toloka helped us tackle the challenge of recognizing handwritten text in documents. We send anonymous text fragments to Toloka, where qualified performers rewrite the text and send the results back to the Dbrain system for further AI training. This meant we were able to resolve even the most difficult recognition cases for our customers."


    Konstantin Simonchik, science director and co-founder of ID R&D:
    "Using Toloka, we collected the world's largest database of 200,000 unique photos and videos to secure biometric systems against hackers and train neural networks to distinguish real faces from fakes. We chose Toloka because of the user-friendly interface, active performers and optimal quality for the price."


    Dmitry Akimov, VisionLabs data engineer:
    "Toloka is an excellent tool for data processing. We use it to collect and annotate thousands of images and videos every month in order to improve the performance of our algorithms. We chose Toloka because of the fast turnaround time and the active participation of performers."


    Mikhail Burtsev, head of the DeepPavlov.ai laboratory for neural networks and deep learning at Moscow Institute of Physics and Technology:
    "Modern machine learning technologies are not possible without a large volume of training examples. A computer can't master a natural language unless a person „explains“ how to use it correctly. Toloka allows the conversational AI systems that we develop at MIPT to communicate with a large group of people and grow smarter."


    Angelina Galkevich, Analyst Tinkoff:
    "We use Toloka to annotate data for speech synthesis and recognition Toloka performers have already processed tens of thousands of tasks with audio files for us, and we have successfully used the results to train our models. We like the price, the fast turnaround, and the super fast feedback. It allows us to quickly test different markup methods and hypotheses, and then choose the optimal approach."


    Anton Slesarev, head of Technologies in the self-driving cars division at Yandex:

    "Toloka is the first place we go to prepare data for AI. To train the neural network, we need tens of thousands of annotated images. You can buy them for $4 each, or you can have images marked up in Toloka 10 times cheaper and get datasets that are ready to use for training algorithms. We use these datasets for developing self-driving vehicle technology."


    Yandex.Maps Team:
    "Our service tracks outdated information on Yandex.Maps. We update business hours, add new businesses, and remove any that have closed. Toloka users perform our tasks in their neighborhoods, like taking photos of business signs with operating hours. Every month we distribute 15 million tasks like this to 50,000 performers — this is the only way we can keep the huge Yandex.Maps database up to date."


    Get started now
    Take advantage of Toloka technologies. 
    Millions of Tolokers are available for your projects 24/7.
    Start now
    Talk to us
    Cookie files
    Yandex uses cookies to personalize its services. By continuing to use this site, you agree to this cookie usage. You can learn more about cookies and how your data is processed in the Privacy Policy.
    Fri Jun 04 2021 14:11:56 GMT+0300 (Moscow Standard Time)