Ask The Crowd is the exciting new UX tool powered by Toloka

Toloka Team
by Toloka Team
Image

Subscribe to Toloka News

Subscribe to Toloka News

Fact: when you’re really good at websites and you’ve spent 100 hours building one, you might lose touch with how an ordinary user would see it for the first time. That’s why it’s crucial to test things on real people. Usability testing can be incredibly elaborate, involving dedicated laboratories, screen recordings and eye tracking rigs.

But what if you need an answer within the next five minutes?

The team at Ask The Crowd developed an elegant solution that integrates Toloka. With their new app, getting feedback is like turning on a tap.

So how does it work? It’s simple.

Let’s follow along step by step.

  • You submit questions via the website
  • Ask The Crowd sends these questions to the Toloka API
  • Tolokers answer the questions
  • Toloka sends the answers back in JSON format
  • Ask The Crowd turns the JSON data into something nice and pretty
  • You sort and tag these answers with an easy interface
  • Your results are ready

It’s all done in a matter of minutes.

Let’s see it in action

Imagine you sell electronic devices and you need an icon for drones.

Image

We don’t yet have a single, widely recognized symbol for that. There are many options.

Image

So which is most clearly a drone?

There are two ways to use this platform. You can ask a survey, where respondents select from multiple choices. Or you can ask a single question, where they type their answer. This time, we don’t really want to offer multiple choices, because it gives a big hint as to the right answer. It would be much better to see what they come up with on their own.

Instead, let’s ask a single question for each icon.

Submit your questions and icons. Then go and make a tea or coffee — or sing nearly all of Bohemian Rhapsody. Five minutes — that’s how long it takes to get the results.

Sorting the answers

You might be surprised how many ways folks identify something as a drone. They can write “drone” or “a drone” or “quadcopter with camera”. It might even be a “dron” or “dronne”.

Ask The Crowd lets you tag all these answers with an A, B or C.

In this example, we can use “A” for a drone and “B” for anything else. In just five minutes, we learned which of these icons was most recognized as a drone, and which was least.

Toloka and the power of the crowd

Toloka can help in almost any scenario, whenever you need actual humans to answer a question. We even used it to test our new logo.

Integrating Toloka can be a straightforward way to provide a useful service to a particular audience. For Ask The Crowd, all it really took was a web interface connected to the Toloka API.

Toloka gives you access to a crowd that’s always on call, around the clock, that scales as you need it and can get things done in minutes. Use the power of the crowd to bring an MVP to market fast, and to validate new ideas even faster.

Article written by:
Toloka Team
Toloka Team
Updated: 

Recent articles

Have a data labeling project?

Take advantage of Toloka technologies. Chat with our expert to learn how to get reliable training data for machine learning at any scale.
Fractal

More about Toloka

  • Our mission is to empower businesses with high quality data to develop AI products that are safe, responsible and trustworthy.
  • Toloka is a European company. Our global headquarters is located in Amsterdam. In addition to the Netherlands, Toloka has offices in the US, Israel, Switzerland, and Serbia. We provide data for Generative AI development.
  • We are the trusted data partner for all stages of AI development–from training to evaluation. Toloka has over a decade of experience supporting clients with its unique methodology and optimal combination of machine learning technology and human expertise. Toloka offers high quality expert data for training models at scale.
  • The Toloka team has supported clients with high-quality data and exceptional service for over 10 years.
  • Toloka ensures the quality and accuracy of collected data through rigorous quality assurance measures–including multiple checks and verifications–to provide our clients with data that is reliable and accurate. Our unique quality control methodology includes built-in post-verification, dynamic overlaps, cross-validation, and golden sets.
  • Toloka has developed a state-of-the-art technology platform for data labeling and has over 10 years of managing human efforts, ensuring operational excellence at scale. Now, Toloka collaborates with data workers from 100+ countries speaking 40+ languages across 20+ knowledge domains and 120+ subdomains.
  • Toloka provides high-quality data for each stage of large language model (LLM) and generative AI (GenAI) development as a managed service. We offer data for fine-tuning, RLHF, and evaluation. Toloka handles a diverse range of projects and tasks of any data type—text, image, audio, and video—showcasing our versatility and ability to cater to various client needs.
  • Toloka addresses ML training data production needs for companies of various sizes and industries– from big tech giants to startups. Our experts cover over 20 knowledge domains and 120 subdomains, enabling us to serve every industry, including complex fields such as medicine and law. Many successful projects have demonstrated Toloka's expertise in delivering high-quality data to clients. Learn more about the use cases we feature on our customer case studies page.