Toloka logo
Get free demo
Sign in
Fractal

Education Partnerships

Education, collaboration, and support for those working with data.

Why we share our crowdsourcing methodology

At Toloka Academy, we believe that working with the crowd is an essential skill. Our goal is to resolve the bottleneck that data constitutes today and thus spur dramatic innovation and progress both in research and in industry. We want to reach as many people as possible, which is why we are committed to empowering educators with our tools and methodology that’s based on years of research and unique industry expertise. We want teachers, tutors, professors, and lecturers to apply crowdsourcing in an academic context and teach this important skill to others.

Unique Crowd
Science expertise

Our methodology is based on 5 years of research and unique industry expertise. Our lecturers are experts in crowdsourcing, and they regularly participate in conferences around the globe sharing the knowledge that Toloka has accumulated over the years.

Image

Conferences we have taken part in:

Past conference

Crowd Science Workshop at CHI '22

This workshop explores how a reimagined perspective on crowdsourcing platforms could provide a more equitable, fair, and rewarding experience.

Apr 30, 2022
Past conference

VLDB 2021 CROWD SCIENCE WORKSHOP

This workshop focuses on the best practices for efficient and trustworthy crowdsourcing.

Aug 20, 2021
Image
Image
Image

Hosts:

Image
Michael Bernstein
Image
Wuraola Oyewusi
Image
Ujwal Gadiraju
Past conference

High-Quality Data Labeling at Scale with Toloka

This ICML 2021 workshop by Toloka aims to provide a comprehensive picture of how crowdsourcing can be applied to real life AI production.

Jul 18, 2021
Image
Image
Image
+3

Hosts:

Image
Olga Megorskaya
Image
Omar Alonso
Image
Saiph Savage
Image
Daria Baidakova
Image
Dmitry Ustalov
Image
Oleg Pavlov
Past conference

Improving Web Ranking with Human-in-the-Loop: Methodology, Scalability, Evaluation

Apr 13, 2021
Image
Image
Image
+1

Hosts:

Image
Alexey Drutsa
Image
Dmitry Ustalov
Image
Daria Baidakova
Image
Nikita Popov
Past conference

NeurIPS '20 Crowd Science Workshop

We discussed key issues in preparing labeled data for machine learning, with a focus on remoteness, fairness, and mechanisms in the context of crowdsourcing for data collection and labeling.

Dec 11, 2020
Past conference

CVPR '20

We presented a data processing pipeline used for training self-driving cars. Participants gained practical experience launching an annotation project in Toloka.

Jun 15, 2020
Past conference

SIGMOD '20

We explored the practical aspects of how crowdsourcing can be applied to information retrieval. Participants learnt how to create a dataset with relevant products.

Jun 14, 2020
Past conference

WSDM '20

We explored the practice of efficient data collection via crowdsourcing: aggregation, incremental relabeling, and pricing.

Feb 3, 2020
Past conference

KDD '19

We introduced data labeling via public crowdsourcing marketplaces and will presented the key components of efficient label collection.

Aug 8, 2019

Collaboration with educators

We believe that it is essential to support those who educate.
That's why we have accumulated all we have to offer in one place.
To see what we have for educators, go to Learn More.

#faculty

Collaboration with educatorsLearn more
Image
Image

Instructor toolkit

We designed a basic set of learning materials you can use as part of your course. They cover various aspects of crowdsourcing and can be adjusted to your needs.

Education Pricing PlanLearn more

Education Pricing Plan

Our special offer for students, faculty members, and researchers
gives you the opportunity to collect and label data with zero
commission. Apply now and tell your colleagues and students
about this pricing plan.

#students #faculty #researchers

Education Pricing PlanLearn more
Image

Our success stories

Saiph Savage, Director, Civic A.I. Lab Northeastern University & UNAM

With the help of Toloka, we are creating technology that is empowering workers while also ensuring quality labor for the projects of academics and industry actors. Our collaborative research led us to be recognized by UNESCO as one of the 100 most impactful projects in AI. Working with Toloka has also empowered us to give crowdsourcing mini-courses at Northeastern University and the Universidad Nacional Autonoma de Mexico (UNAM).

Courses at 5 top Swiss Universities,
Tel-Aviv University & Y-Data

In 2021, Toloka Academy organized a course for CUSO which unites 5 top Swiss universities: University of Freiburg, University of Geneve, UNIL (University of Lausanne), UNINE (University of Neuchatel) and University of Bern. It was a 3-week course for PhD students and it was centered around the crowdsourcing methodology and techniques that ensure top-quality data. By the end of the course, the participants created projects based on their academic interest.

Sponsorship of projects run by students on the TU Delft (Netherlands) crowdsourcing course

A lot of educators come across serious issues with data sets and projects for their courses. This is why we decided to sponsor their students’ projects. Our cooperation started with a hands-on tutorial, during which we demonstrated some real cases. Then participants of the Crowd Computing Course were given an opportunity to collect and label data on Toloka free of charge. As a result, they presented several brilliant group projects.

Materials used in the “Global UX” course at Northeastern University, USA

We provide educators with learning materials that can be easily included in a course or used independently. For example, our materials are used in the Global UX course at Northeastern University. When we share our materials and expertise with faculty members, we also teach them how to apply all of that in the most efficient way.

Project sponsorship for courses

We believe that practice is an essential part of education. That’s why we are willing to sponsor your students' projects as part of your course. Contact us to discuss this opportunity in more detail.

Contact us
Fractal