Overcoming scaling challenges for complex systems with Toloka

Toloka's crowdsourcing platform unites the individual efforts of millions of people around the world to label and process data for clients. The results are used in machine learning, research, software testing, technical support, content moderation, and other tasks.

Toloka's backend is a complex service for managing a huge "computing cluster", where people performing tasks act as nodes.

Artem will describe how we work out the problem of managing the "cluster" using the mechanism responsible for creating a list of available tasks for each Toloker (crowd worker).

He'll share three stories about developing various parts of the system. You'll also hear about the challenges we faced while scaling and how we solved them.

When & where

DeveloperWeek is the largest developer conference & event series including the DeveloperWeek Conference & Expo, 1,000+ attendee hackathon, 800+ attendee tech hiring expo, and a series of workshops, technical talks, and keynotes.
You can find more info on the official website.

Dates:
Feb 15 – 17, 2023: Oakland Convention Center, 550 10th St, Oakland, CA 94607, United States (live event)
Feb 21 – 23, 2023: DeveloperWeek will be hosted virtually on the Hopin Platform (online)