Mindrift: Elevating the standard of data for GenAI

GenAI progress now depends on sophisticated data for training and evaluating models, and high-value data is in short supply. To save on data production costs, general human knowledge can be replicated by LLMs to produce synthetic data for these purposes. But synthetic data inherits biases and shows limitations when it comes to specialized knowledge. 

There isn’t a full substitute for human-generated data when fairness, accountability, and safety are a priority. GenAI development still demands unique data contributed by human experts. As AI models become more specialized, the demand for human-generated data is shifting to niche domains where general knowledge is insufficient, paving the way for a new role: the AI Tutor.

At Toloka, we recruit AI Tutors to craft custom datasets for AI post-training. These professionals are experienced writers, editors, and experts in highly specialized fields, from coding to law to linguistics. The strong skillsets and deep expertise of our AI Tutors are instrumental in refining outputs, mitigating bias, and ensuring models align with ethical and regulatory standards.

Introducing Mindrift

To meet the industry's growing demand for specialized talent and domain-specific knowledge, last year we launched the Mindrift platform, a hub for data production where part-time AI Tutors can contribute to datasets for AI projects focused on their areas of expertise. Leveraging over a decade of experience in building world-class crowdsourcing platforms for AI training, we have refined our data production technology to deliver a seamless and enriching experience for AI Tutors.

Mindrift is a scalable, end-to-end solution for creating custom datasets from scratch.  The platform integrates seamlessly with Toloka to provide clients with curated data crafted by highly educated professionals. Expert knowledge is integrated into data production pipelines that ensure high-quality outputs, supporting critical processes such as supervised fine-tuning, reinforcement learning with human feedback, model evaluation, and red-teaming.

Opportunities for AI Tutors

Mindrift’s global reach fosters diversity in datasets while empowering individuals worldwide. We source data from a diverse range of contributors across geographies, cultures, and languages. 

For many, this represents an opportunity to apply their expertise in a dynamic and cutting-edge field while earning extra income. Whether navigating a career break or adding a side project, AI Tutors join Mindrift for the flexible and challenging opportunity to do something new.

Mindrift has provided me with the most interesting, challenging and flexible work I've ever done. Looking back on my year-long journey, I see only good things on the horizon. It's exciting to know I'm making a difference in the future of AI. – Lisa, AI Tutor 

Freelancing has always been a rollercoaster, but the ride is much smoother now that I can precisely pick my hours and don't rely on project managers or clients. I'm grateful for the flexible earning ability I have now, and I hope that my story encourages others interested in this type of work to reach out and see how they can get started – Christopher, Editor

Ensuring quality

As we leverage human intelligence to shape AI, we hold AI Tutors to high standards for data quality. 

• Our robust security system is designed to detect and prevent fraud, guarding the integrity of the datasets we produce.

• We work to ensure quality at every stage of data production, with ongoing quality checks platform-wide. 

• We develop tailored quality workflows for each project based on client requirements.

• AI Tutors are individually vetted and their performance is tracked.

• AI Tutors are supported with smooth onboarding, targeted training, and ongoing collaboration to continually boost quality. 

The journey of an AI Tutor on the Mindrift platform

Before joining Mindrift, applicants complete testing to demonstrate in-depth knowledge of their field. This process includes both writing tests and domain-specific tests.

Each project on the Mindrift platform has its own onboarding process, including a training course and exams, to help AI Tutors master the project requirements before they start taking tasks. We monitor the pass rates and regularly review the onboarding materials to calibrate the tests and make onboarding as smooth as possible. 

Every expert is additionally reviewed during active participation on a project. A portion of their work is vetted and measured with quality metrics. If quality drops, we suspend the expert’s access to the project while we review their tasks and offer mentoring to resolve issues.  

Quality Assurance specialists are assigned to the project teams to ensure that completed tasks meet project guidelines. These experts have the highest qualifications in their field and in-depth knowledge of project requirements, so their job is to review tasks with a sharp eye and provide constructive feedback to AI Tutors.

Prioritizing the AI Tutor experience

Our top priority is to attract the best talent to Mindrift and keep AI Tutors coming back for more projects that match their skills and interests. We focus on giving our experts the best possible experience and producing the best possible data.

• Competitive pay and convenient payment systems, with flexibility in time commitments, and the freedom to opt out of tasks.

• A technological platform with co-pilots to automate routine tasks for AI Tutors, increasing productivity by 45% and eliminating repetitive workloads, preventing burnout among our experts.

• A supportive environment focused on collaboration and community. AI Tutors use our Discord community to get quick support, communicate with peers, and stay updated on the latest platform developments. Experts can share knowledge and insights to generate better content and accelerate professional growth.

Mindrift is about collaboration and growth. The Discord community allows for focused chats, organized teams, and a platform for asking questions. It's a supportive environment where I can engage with other AI Tutors and learn from my mistakes. – Lance, AI Tutor

With the launch of Mindrift, we are not just building datasets for GenAI models—we are creating opportunities, advancing technology, and empowering individuals to shape the future of AI. 

Combining synthetic and real-world data leads to more reliable AI systems, and this is where Toloka excels. Do you need expert knowledge to improve your LLM? Reach out to us. We have experts in more than 20 domains, including STEM, coding, law, finance, automotive, ESG, medicine, manufacturing, civil engineering, linguistics, and more.