Our talk

September 24, Wednesday 12:30-13:00 - How Agents Will Transform Data Production.

The shift from classical ML to autonomous agents is fundamentally changing how we create training data. While traditional ML used fixed datasets with human labels, agents need entirely new data approaches supporting variable inputs, outputs, and complex interactions.
This talk explores how agents are revolutionizing data production through taxonomy development, synthetic data generation blending AI with human expertise, and realistic environment creation. Drawing from Toloka's experience with 200k+ contributors and leading AI institutions, we'll show how human-AI collaboration is evolving for agent development.
Key insights include why agents need different evaluation frameworks than traditional models, the critical role of red teaming in agent data pipelines, and practical strategies for scaling high-quality, safety-aligned datasets. We'll share real examples of organizations successfully navigating this transformation as agents become increasingly autonomous.

Link to the conference