Crowd-kit is a Python library that implements most standard crowdsourcing algorithms. It consists of various methods for aggregating performers’ answers, metrics to estimate answer and performer quality, and quality control techniques. The library has an easy-to-use scikit-learn-like interface and operates with Pandas data frames.
Our course at the Conférence universitaire de Suisse occidentale introduces crowdsourcing as a practical methodology and helps participants master the essential steps and techniques to ensure top-quality data.
7th - 25th June 2021
Online Y-DATA Community Course
Together with Y-DATA in Tel Aviv, we created a 6-week community course taught by field experts. Students are exposed to both theory and practice, and apply their new knowledge in 5 full-cycle hands-on projects.
21st April - 26th May 2021
Tutorial at the Academic Fringe Festival
We introduce data labeling via public crowdsourcing marketplaces and present the key techniques for efficiently collecting labeled data. In the practice session, participants launch their own labeling project.
April 8th, 2021
Hands-On Tutorial for King Saud University
In this tutorial we share our unique industry experience in achieving efficient natural language annotation with crowdsourcing. In the practice session, participants launch their own labeling project.