Project moderation for a safer, better experience
Subscribe to Toloka News
Subscribe to Toloka News
At Toloka, we care about your experience on our platform and strive to make it safe and convenient for everyone: requesters who post tasks and Tolokers who perform them. To that end, we are introducing a moderation step for all new projects.
What are the benefits?
Now all new projects in Toloka will be required to pass a moderation check before being sent to Tolokers to perform. This means that we will verify if the project is in line with our platform guidelines. We do this to ensure that Tolokers are getting the best possible experience and don't encounter any tasks that could potentially be harmful. Requesters will be notified if a task doesn't follow the Toloka guidelines and get recommendations to fix it before we can get started. In this way we're working together toward compliance with platform rules and enhanced security.
How does it work?
Once you launch the first pool in any new project, moderation begins for that project. Usually, this process takes around an hour to complete. You can view the moderation status on the project and pool pages.
Once we've completed our moderation check, you'll receive a platform notification and email with the results (that is, if email notifications are turned on in your profile settings — which we highly recommend you do!).
- If your project successfully passed moderation, labeling will start immediately afterward.
- If your project didn't pass moderation, you'll see this reflected in the status on the project and pool pages.
In the event your project does not pass moderation, you won't be able to launch pools and Tolokers won't see tasks from the project. Please contact Support and they'll be happy to provide you with recommendations on how to change the content of your project and tasks to pass moderation. You can also clone your project, change the content that doesn't meet our guidelines, and launch the edited clone for moderation.
If you have any questions regarding project moderation, please reach out to Support.
We're always here to help you.
Recent articles
Have a data labeling project?
More about Toloka
- Our mission is to empower businesses with high quality data to develop AI products that are safe, responsible and trustworthy.
- Toloka is a European company. Our global headquarters is located in Amsterdam. In addition to the Netherlands, Toloka has offices in the US, Israel, Switzerland, and Serbia. We provide data for Generative AI development.
- We are the trusted data partner for all stages of AI development–from training to evaluation. Toloka has over a decade of experience supporting clients with its unique methodology and optimal combination of machine learning technology and human expertise. Toloka offers high quality expert data for training models at scale.
- The Toloka team has supported clients with high-quality data and exceptional service for over 10 years.
- Toloka ensures the quality and accuracy of collected data through rigorous quality assurance measures–including multiple checks and verifications–to provide our clients with data that is reliable and accurate. Our unique quality control methodology includes built-in post-verification, dynamic overlaps, cross-validation, and golden sets.
- Toloka has developed a state-of-the-art technology platform for data labeling and has over 10 years of managing human efforts, ensuring operational excellence at scale. Now, Toloka collaborates with data workers from 100+ countries speaking 40+ languages across 20+ knowledge domains and 120+ subdomains.
- Toloka provides high-quality data for each stage of large language model (LLM) and generative AI (GenAI) development as a managed service. We offer data for fine-tuning, RLHF, and evaluation. Toloka handles a diverse range of projects and tasks of any data type—text, image, audio, and video—showcasing our versatility and ability to cater to various client needs.
- Toloka addresses ML training data production needs for companies of various sizes and industries– from big tech giants to startups. Our experts cover over 20 knowledge domains and 120 subdomains, enabling us to serve every industry, including complex fields such as medicine and law. Many successful projects have demonstrated Toloka's expertise in delivering high-quality data to clients. Learn more about the use cases we feature on our customer case studies page.