Running research on white college students is not cool anymore — but neither is running it on the so-called WEIRD samples. If you want your results to be generalizable, your research to be truly unbiased, you need more than American samples.
For years, Toloka has served the global computer science and machine learning community, driving and unbiased data generation for AI. This year, Toloka is proud to offer its perks to social scientists.
Toloka boasts over 245,000 diverse performers in 202 world countries. Psychology researchers now have access to . They were responsibly selected with regards to number of active users and local federal minimum wages.
Pakistan, Brazil, India, Philippines, Algeria, Kenya, Nigeria, Kazakhstan, Egypt, Colombia, Bangladesh, Morocco, Viet Nam, South Africa, Venezuela, Uzbekistan, Indonesia, Peru, Argentina, Myanmar, Ghana, Tunisia, Mexico, Saudi Arabia, Nepal, and more
All you need is a survey created in Qualtrics and approved by your institution's IRB. Got it already? Lucky you, the hardest part of the job is done.
The part with Toloka is really easy. Just go ahead and:
This spring, Toloka is giving away 250 small student grants and 25 faculty grants. Get your feet wet with collecting cross-cultural survey data. All we ask for in return is feedback on your user experience. To apply, see our exhibitor booth at MPA or apply right here.Apply for a grant
What we do to protect our global community of Tolokers from exploitation:
The average minimum wage in the countries we feature is $1.04 per hour. Our pre-set survey prices are about 1.5 times higher. Even after our (small) platform commissions, Tolokers can still make money that matters to them.
The survey price is based on the approximate survey timing: short, medium, or long. We factor in the minimum wage in the available countries. This is one way we prevent exploitation of disadvantaged communities.
As much as we in academia are used to our submissions being rejected, that's not what our Tolokers signed up for! Once the completion code is submitted, the respondent gets paid. You can still control the quality of your data by introducing smart flow in your Qualtrics survey with embedded attention checks.
Toloka is supported 24/7. Contact us via chat right in the interface, submit a support request, or just email us.
Countries are sorted by the average number of active performers. Some countries on this list have federal minimum wage regulations.
Toloka academic surveys feature pre-set prices that meet or exceed those requirements.
|Algeria, Kenya, Nigeria, Egypt, Morocco, South Africa, Ghana, Tunisia, Cameroon, Zambia, Cote d'Ivoire, Uganda, Ethiopia, Senegal, Benin, Togo, Burkina‐Faso, Madagascar, Tanzania, Zimbabwe, Mozambique, Mali, Botswana, Somali, Congo, Rwanda, Angola, Namibia||Brazil, Colombia, Venezuela, Peru, Argentina, Mexico, Dominican Republic, Ecuador, Jamaica, Costa Rica, Paraguay, Guatemala, Haiti, Panama, Honduras, Uruguay, Nicaragua, El Salvador||Pakistan, India, Philippines, Kazakhstan, Viet Nam, Bangladesh, Uzbekistan, Indonesia, Myanmar, Saudi Arabia, Nepal, Kirghizstan, Sri Lanka, Tadjikistan, Jordan, United Arab Emirates, Malaysia, Turkmenistan, Lebanon, Iraq, Afghanistan, Singapore, Palestine||Moldova, Italy, Azerbaijan, Georgia, Armenia, Sweden, Finland, Austria, Bosnia & Herzegovina|