About conference

Ai4 2023 is industry’s most impactful AI event. By gathering leaders of enterprise from across industry, government organizations, disruptive startups, investors, research labs, academia, associations, open source projects, media and analysts, AI4 is creating the largest and most influential arena for idea-sharing, AI-related commerce, and technological progress. The mission at Ai4 is to help provide a common framework for what AI means to both enterprise and the future of our globe as we transition into a new era of responsible human-machine collaboration.

Come visit us at BOOTH #315
Link to the conference

Our talk

August, 12, Friday 15:50 - How Agents Will Transform Data Production in AI

The shift from classical ML to autonomous agents is fundamentally changing how we create training data. While traditional ML used fixed datasets with human labels, agents need entirely new data approaches supporting variable inputs, outputs, and complex interactions.
This talk explores how agents are revolutionizing data production through taxonomy development, synthetic data generation blending AI with human expertise, and realistic environment creation. Drawing from Toloka's experience with 200k+ contributors and leading AI institutions, we'll show how human-AI collaboration is evolving for agent development.
Key insights include why agents need different evaluation frameworks than traditional models, the critical role of red teaming in agent data pipelines, and practical strategies for scaling high-quality, safety-aligned datasets. We'll share real examples of organizations successfully navigating this transformation as agents become increasingly autonomous.