Toloka documentation
Getting started
How does Toloka work?
Registration
Your first project
Data security
Important tips
What tasks can't be placed in Toloka?
Common mistakes made by requesters
How to save your budget
Sandbox
Tutorials
List of examples
Images
Image classification
Image comparison (Side-by-side)
Object recognition & detection
Object recognition and area selection (example with decomposition)
Overview
Project 1. Does the image contain a specific object?
Project 2. Select an object in the image
Project 3. Are the bounding boxes correct?
Appendix: Complete code for all projects
Video
Video classification
Audio
Audio transcription
Audio classification
Voice recording
Texts
Sentiment analysis and content moderation
Data enrichment
Searching for product characteristics
Product photo search (example with decomposition)
Overview
Project 1. Does the photo contain a certain object?
Project 2. Find a similar item in an online store
Project 3. Does the item found look similar to the original?
Project 4. Which of the found items is most similar to the original?
Appendix: Complete code for all projects
Surveys
Overview
Survey with Toloka template
Survey on third-party platform
Survey based on Qualtrics
Field tasks
Collecting offline data
Price monitoring
Product monitoring
Data collection: Organizations
Monitoring field objects
Customization examples
Overview
Add a button
Attaching files
Add description fields
Add a picture
Add a text field
Add response options
Projects
Steps to follow
Decomposition of the task
Initial project settings
Create a project
Editing a project
Writing instructions
Task interface
Template Builder
Overview
Quick start
Visual editor
Presets
List
Images
Image classification
Image comparison (Side-by-side)
Product search relevance
Object recognition & detection
Text recognition from an image (OCR)
Accessories recommendations
Video
Video classification
Video comparison (Side-by-side)
Texts
Copywriting
Text comparison (Side-by-side)
Text classification
Sentiment analysis & Content moderation
Audio
Audio transcription
Audio comparison (Side-by-side)
Field tasks
Collecting offline data
Data enrichment
Searching for product characteristics
Surveys
Survey
Instructions
List of instructions
Input and output data
Working with data
Read and write
Creating specifications
Clearing the entered values
Audio and video
Playing back audio
Inserting videos
Comparing video clips
Working with text and numbers
Components for working with text
Text formatting
Number input field
Working with pictures
Inserting images
Object selection in an image
Display settings
Task display
Writing direction
Inserting links
Tips and recommendations
Configure keyboard shortcuts
Reviewing assignments automatically
Show hints
Reuse code
Component reference guide
List of components
Layouts
List of layouts
layout.bars
layout.columns
layout.compare
layout.side-by-side
layout.sidebar
Views
List of views
view.action-button
view.alert
view.audio
view.collapse
view.device-frame
view.divider
view.group
view.iframe
view.image
view.labeled-list
view.link
view.link-group
view.list
view.map
view.markdown
view.text
view.video
Fields
List of fields
field.audio
field.button-radio
field.button-radio-group
field.checkbox
field.checkbox-group
field.date
field.email
field.file
field.image-annotation
field.list
field.map
field.media-file
field.number
field.phone-number
field.quiz
field.radio-group
field.select
field.text
field.text-annotation
field.textarea
Conditions
List of conditions
condition.all
condition.any
condition.empty
condition.equals
condition.link-opened
condition.not
condition.played
condition.played-fully
condition.required
condition.same-domain
condition.schema
condition.sub-array
condition.distance
Helpers
List of helpers
helper.concat-arrays
helper.entries2object
helper.if
helper.join
helper.object2entries
helper.replace
helper.search-query
helper.switch
helper.text-transform
helper.transform
helper.translate
helper.proxy
Plugins
List of plugins
plugin.field.image-annotation.hotkeys
plugin.field.text-annotation.hotkeys
plugin.hotkeys
plugin.toloka
plugin.trigger
Data sources
List of data sources
data.location
Actions
List of actions
action.bulk
action.notify
action.open-close
action.open-link
action.play-pause
action.rotate
action.set
action.toggle
Troubleshooting
Support
HTML/CSS/JS editor
Task interface
Adapt a task for mobile devices
HTML
List of components
Handlebars
Expressions and helpers
Additional helpers
Components for solving common problems
String input field
Text input field
String input with suggest list
Radio button
Checkbox
Drop-down list
Button for file upload
Button for image file upload
Button for recording and uploading a video file
Button for recording and uploading an audio file
Button with click validation
Image with area selection
Text segmentation editor
Image
Button
Iframe
Text formatted in HTML
JS
How to use JavaScript extensions
Assignment class
TaskSuite class
Task class
Services for specific purposes
Input and output data
Setting up quality control
Translations
Returning to a previous version of a project
Interim statistics
Pool settings
General information
Creating a pool
Editing a pool
Audience selection
Filters
Pricing
Setting up pricing
Quality control
Overview
Setting up quality control
Quality control rules
How to check Tolokers: quality control rules
List of rules
“Remember values” parameter
Control tasks
Majority vote
Fast responses
Captcha
Skipped assignments
Earnings
Submitted responses
Results of assignment review
Recompletion of assignments from banned users
Processing rejected and accepted assignments
Overlap settings
What is overlap?
Dynamic overlap
Selective majority vote check
Speed/quality balance
Additional settings
Manual review
Archiving a pool
Interim statistics
Tasks
Steps to follow
Creating a file with tasks
Uploading tasks to a pool
How to upload tasks
Ways to group tasks in suites
Checking project
Task markup
Overview
How to edit tasks by yourself
Adding a training (optional)
Adding funds to your account
Starting and stopping a pool
Results
Receiving responses
Reviewing Tolokers' responses
Aggregation of results
Project analysis
Project rating
Project statistics
Pool statistics
Efficiency indicators
Overview
Bans
Communication issues
Control tasks
Control task balance
Project availability
Quality of instructions
Quality of interface
Rejected tasks
Submission rate
Toloka settings
Tolokers
Viewing Tolokers
Rewards
Communication
Ban
Skills
How do I use skills?
Global skills
Creating a skill
Assigning the skill
Using the skill
Editing a skill
Removing a skill
History of skill changes
Profile
Editing the profile
Notifications
About money
About account management
Topping up your account
Promo codes
Refund
Payment documents
Questions and answers
Shared access to the requester's account
Useful recommendations
Data storage
Where to store files
Amazon S3
Azure Blob Storage
Google Cloud Storage
Yandex Object Storage
Tips for designing tasks
Using exams
Using A/B experiments
For developers
REST API
Overview
Toloka API
Overview
Accessing the API
Quick start
Overview
Posting tasks
Receiving responses
Project
Overview
Create a project
Overview
Configuration for Template Builder
Edit a project
Get the list of projects
Get project properties
Archive a project
Pools
Overview
Create a pool
Close a pool for editing
Edit a pool
Open a pool
Close a pool
Move a pool to the archive
Clone a pool
Get the list of pools
Get properties of a pool
Change pool priority
Training
Overview
Create a training pool
Edit a training pool
Open a training
Close a training
Archive a training pool
Clone a training pool
Get a list of training pools
Get training properties
Subscriptions to events
Overview
Create a subscription
Get a subscription
Get a list of subscriptions
Delete a subscription
Notification format
Send a test notification
Event authentication
Toloker selection
Overview
Skills
Overview
Create a skill
Edit a skill
Get the list of skills
Get the skill ID
Set the skill value
Get a list of Tolokers who have skills
Get a Toloker's skill value
Remove a skill for a Toloker
Quality control rules
Overview
Control tasks
Majority vote
Entering captchas
Compensation amount
Skipped assignments
Number of tasks completed
Fast responses
Rejected tasks
Processing rejected and accepted assignments
Recompletion of assignments
Filters
Overview
Filter by profile data
Filter by computed data
Filter by skills
Block access to tasks
Overview
Block access to tasks
Get a list of bans
Get information about a ban
Unblock access
Ways to upload tasks
Tasks
Overview
Create one or multiple tasks
Create multiple tasks
Get the list of tasks
Get a task
Edit a task
Stop assigning a task
Task suites
Overview
Create one or multiple task suites
Create multiple task suites
Get the list of task suites
Get a task suite
Change the task suite overlap
Change task suite priority
Stop assigning a task suite
Tracking operations
Overview
Get the list of operations
Get operation details
Get the operation log
Getting responses
Overview
Get responses
Get response properties
Files in responses
Overview
Get the list of files
Get file metadata
Download file
Aggregated responses
Overview
Aggregate responses in a pool
Aggregate responses to a single task
Get aggregate responses
Checking completed tasks
Rewards
Overview
Issue rewards
Get a list of rewards issued
Get reward properties
Messages for Tolokers
Overview
To send a message
Get a list of message threads
Reply to message thread
Move a message thread
Get user metadata
Account balance
Handling errors
Standard query parameters
Sorting the list of objects
Libraries
Python SDK
Overview
Toloka-Kit
Overview
Getting OAuth token
Quick start
Recipes
Overview
Projects
Create project
Get list of projects
Get project details
Edit project
Archive project
Pools
Create pool
Get list of pools
Get pool details
Open pool
Close pool
Archive pool
Clone pool
Change pool priority
Toloker selection
Set overlap
Filter Tolokers
Use quality control rules
Skills
Get skills
Create skill
Assign skill to Toloker
Edit skill
List Tolokers with skills
Remove skill from Toloker
Tasks and task suites
Group tasks in task suites
Upload tasks
Get list of tasks
Get task details
Change task overlap
Responses
Get list of responses
Accept responses
Reject responses
Aggregate responses in pool
Get list of files in responses
Download attachments
Rewards
Issue rewards to Tolokers
Get list of all rewards issued
Get reward details
Messages
Send messages
Get list of message threads
Reply to thread
Sample project recipe
More usage examples
Reference
toloka.client
TolokaClient
TolokaClient methods
aggregation
aggregate_solutions_by_pool
aggregate_solutions_by_task
find_aggregated_solutions
get_aggregated_solutions
analytics
get_analytics
app
archive_app_project
create_app_batch
patch_app_batch
create_app_item
create_app_items
create_app_project
find_app_batches
find_app_items
find_app_projects
find_apps
get_app
get_app_batch
get_app_batches
get_app_item
get_app_items
get_app_project
get_app_projects
get_apps
start_app_batch
stop_app_batch
resume_app_batch
unarchive_app_project
assignments
accept_assignment
find_assignments
get_assignment
get_assignments
get_assignments_df [pandas]
patch_assignment
reject_assignment
attachments
find_attachments
get_attachment
get_attachments
download_attachment
messages
add_message_thread_to_folders
compose_message_thread
find_message_threads
get_message_threads
reply_message_thread
remove_message_thread_from_folders
operations
get_operation
find_operations
get_operations
get_operation_log
wait_operation
pools
archive_pool
archive_pool_async
clone_pool
clone_pool_async
close_pool
close_pool_async
close_pool_for_update
close_pool_for_update_async
create_pool
find_pools
get_pool
get_pools
open_pool
open_pool_async
patch_pool
update_pool
projects
archive_project
archive_project_async
create_project
clone_project
find_projects
get_project
get_projects
update_project
requester
get_requester
skills
create_skill
find_skills
get_skill
get_skills
update_skill
tasks
create_task
create_tasks
create_tasks_async
find_tasks
get_task
get_tasks
patch_task
patch_task_overlap_or_min
task suites
create_task_suite
create_task_suites
create_task_suites_async
find_task_suites
get_task_suite
get_task_suites
patch_task_suite
patch_task_suite_overlap_or_min
training
archive_training
archive_training_async
clone_training
clone_training_async
close_training
close_training_async
create_training
find_trainings
get_training
get_trainings
open_training
open_training_async
update_training
user bonus
create_user_bonus
create_user_bonuses
create_user_bonuses_async
find_user_bonuses
get_user_bonus
get_user_bonuses
user restrictions
delete_user_restriction
find_user_restrictions
get_user_restriction
get_user_restrictions
set_user_restriction
user skills
delete_user_skill
find_user_skills
get_user_skill
get_user_skills
get_user
set_user_skill
webhook subscription
delete_webhook_subscription
find_webhook_subscriptions
get_webhook_subscription
get_webhook_subscriptions
upsert_webhook_subscriptions
actions
Restriction
RestrictionV2
ChangeOverlap
SetSkill
SetSkillFromOutputField
ApproveAllAssignments
RejectAllAssignments
aggregation
AggregatedSolution
PoolAggregatedSolutionRequest
TaskAggregatedSolutionRequest
WeightedDynamicOverlapTaskAggregatedSolutionRequest
analytics_request
ActiveWorkersByFilterCountPoolAnalytics
ApprovedAssignmentsCountPoolAnalytics
AvgSubmitAssignmentMillisPoolAnalytics
CompletionPercentagePoolAnalytics
EstimatedAssignmentsCountPoolAnalytics
RealTasksCountPoolAnalytics
RejectedAssignmentsCountPoolAnalytics
SkippedAssignmentsCountPoolAnalytics
SpentBudgetPoolAnalytics
SubmittedAssignmentsCountPoolAnalytics
UniqueSubmittersCountPoolAnalytics
UniqueWorkersCountPoolAnalytics
app
App
AppBatch
AppBatchCreateRequest
AppItem
AppItemsCreateRequest
AppProject
assignment
Assignment
AssignmentPatch
GetAssignmentsTsvParameters
attachment
AssignmentAttachment
batch_create_results
TaskBatchCreateResult
TaskSuiteBatchCreateResult
UserBonusBatchCreateResult
WebhookSubscriptionBatchCreateResult
clone_results
CloneResults
collectors
AcceptanceRate
AnswerCount
AssignmentsAssessment
AssignmentSubmitTime
Captcha
GoldenSet
Income
MajorityVote
SkippedInRowAssignments
Training
UsersAssessment
conditions
AcceptedAssignmentsRate
AcceptedAssignmentsCount
AssessmentEvent
AssignmentsAcceptedCount
CorrectAnswersRate
FailRate
FastSubmittedCount
GoldenSetAnswersCount
GoldenSetCorrectAnswersRate
GoldenSetIncorrectAnswersRate
IncomeSumForLast24Hours
IncorrectAnswersRate
NextAssignmentAvailable
PendingAssignmentsCount
PoolAccessRevokedReason
RejectedAssignmentsCount
RejectedAssignmentsRate
SkillId
SkippedInRowCount
StoredResultsCount
SubmittedAssignmentsCount
SuccessRate
TotalAnswersCount
TotalAssignmentsCount
TotalSubmittedCount
error_codes
CommonErrorCodes
InternalErrorCodes
ValidationErrorCodes
exceptions
AccessDeniedApiError
AuthenticationApiError
ConflictStateApiError
DoesNotExistApiError
FailedOperation
IncorrectActionsApiError
InternalApiError
RemoteServiceUnavailableApiError
TooManyRequestsApiError
ValidationApiError
filter
AdultAllowed
Citizenship
City
ClientType
Computed
Country
DateOfBirth
DeviceCategory
Education
Gender
Languages
OSFamily
OSVersion
OSVersionBugfix
OSVersionMajor
OSVersionMinor
Profile
RegionByIp
RegionByPhone
Skill
UserAgentFamily
UserAgentFamily.UserAgentFamily
UserAgentType
UserAgentVersion
UserAgentVersionBugfix
UserAgentVersionMajor
UserAgentVersionMinor
message_thread
MessageThread
Interlocutor
MessageThreadCompose
MessageThreadFolders
MessageThreadReply
operations
AggregatedSolutionOperation
AnalyticsOperation
PoolArchiveOperation
PoolCloneOperation
PoolCloseOperation
PoolOpenOperation
ProjectArchiveOperation
TasksCreateOperation
TaskSuiteCreateBatchOperation
TrainingArchiveOperation
TrainingCloneOperation
TrainingCloseOperation
TrainingOpenOperation
UserBonusCreateBatchOperation
operation_log
OperationLogItem
owner
Owner
pool
Pool
PoolPatchRequest
dynamic_overlap_config
DynamicOverlapConfig
DynamicPricingConfig
mixer_config
MixerConfig
speed_qualitty_balance_config
TopPercentageByQuality
BestConcurrentUsersByQuality
primitives
base
autocast_to_enum
BaseParameters
BaseTolokaObject
infinite_overlap
InfiniteOverlapParametersMixin
retry
TolokaRetry
project
Project
localization
AdditionalLanguage
LocalizationConfig
field_spec
ArrayBooleanSpec
ArrayCoordinatesSpec
ArrayFileSpec
ArrayFloatSpec
ArrayIntegerSpec
ArrayStringSpec
ArrayUrlSpec
BooleanSpec
CoordinatesSpec
FieldType
FileSpec
FloatSpec
IntegerSpec
JsonSpec
StringSpec
UrlSpec
task_spec
TaskSpec
view_spec
ClassicViewSpec
TemplateBuilderViewSpec
quality_control
QualityControl
requester
Requester
search_requests
AggregatedSolutionSortItems
AppBatchSortItems
AppItemSortItems
AppProjectSortItems
AppSortItems
AssignmentSortItems
AttachmentSortItems
MessageThreadSortItems
PoolSortItems
ProjectSortItems
SkillSortItems
TaskSortItems
TaskSuiteSortItems
TrainingSortItems
UserBonusSortItems
UserRestrictionSortItems
UserSkillSortItems
WebhookSubscriptionSortItems
OperationSortItems
AggregatedSolutionSearchRequest
AppBatchSearchRequest
AppItemSearchRequest
AppProjectSearchRequest
AppSearchRequest
AssignmentSearchRequest
AttachmentSearchRequest
MessageThreadSearchRequest
ProjectSearchRequest
PoolSearchRequest
SkillSearchRequest
TaskSearchRequest
TaskSuiteSearchRequest
TrainingSearchRequest
UserBonusSearchRequest
UserRestrictionSearchRequest
UserSkillSearchRequest
WebhookSubscriptionSearchRequest
OperationSearchRequest
search_results
AggregatedSolutionSearchResult
AppBatchSearchResult
AppItemSearchResult
AppProjectSearchResult
AppSearchResult
AssignmentSearchResult
AttachmentSearchResult
MessageThreadSearchResult
PoolSearchResult
ProjectSearchResult
SkillSearchResult
TaskSearchResult
TaskSuiteSearchResult
TrainingSearchResult
UserBonusSearchResult
UserRestrictionSearchResult
UserSkillSearchResult
WebhookSubscriptionSearchResult
OperationSearchResult
skill
Skill
solution
Solution
task
Task
CreateTaskParameters
CreateTaskAsyncParameters
CreateTasksParameters
TaskOverlapPatch
TaskPatch
task_distribution_function
TaskDistributionFunction
task_suite
TaskSuite
TaskSuiteCreateRequestParameters
TaskSuiteOverlapPatch
TaskSuitePatch
template_builder
get_input_and_output
TemplateBuilder
actions
BulkActionV1
NotifyActionV1
OpenCloseActionV1
OpenLinkActionV1
PlayPauseActionV1
RotateActionV1
SetActionV1
ToggleActionV1
base
RefComponent
UnknownComponent
conditions
AllConditionV1
AnyConditionV1
DistanceConditionV1
EmptyConditionV1
EqualsConditionV1
LinkOpenedConditionV1
NotConditionV1
PlayedConditionV1
PlayedFullyConditionV1
RequiredConditionV1
SameDomainConditionV1
SchemaConditionV1
SubArrayConditionV1
data
InputData
InternalData
LocalData
LocationData
OutputData
RelativeData
fields
AudioFieldV1
ButtonRadioFieldV1
ButtonRadioGroupFieldV1
CheckboxFieldV1
CheckboxGroupFieldV1
DateFieldV1
EmailFieldV1
FileFieldV1
ImageAnnotationFieldV1
ListFieldV1
MediaFileFieldV1
NumberFieldV1
PhoneNumberFieldV1
RadioGroupFieldV1
SelectFieldV1
TextAnnotationFieldV1
TextareaFieldV1
TextFieldV1
helpers
ConcatArraysHelperV1
Entries2ObjectHelperV1
IfHelperV1
JoinHelperV1
Object2EntriesHelperV1
ReplaceHelperV1
SearchQueryHelperV1
SwitchHelperV1
TextTransformHelperV1
TransformHelperV1
TranslateHelperV1
YandexDiskProxyHelperV1
layouts
BarsLayoutV1
ColumnsLayoutV1
CompareLayoutV1
SidebarLayoutV1
SideBySideLayoutV1
plugins
HotkeysPluginV1
ImageAnnotationHotkeysPluginV1
TextAnnotationHotkeysPluginV1
TolokaPluginV1
TriggerPluginV1
views
ActionButtonViewV1
AlertViewV1
AudioViewV1
CollapseViewV1
DeviceFrameViewV1
DividerViewV1
GroupViewV1
IframeViewV1
ImageViewV1
LabeledListViewV1
LinkViewV1
LinkGroupViewV1
ListViewV1
MapViewV1
MarkdownViewV1
TextViewV1
VideoViewV1
training
Training
user
User
user_bonus
UserBonus
UserBonusCreateRequestParameters
user_restriction
AllProjectsUserRestriction
DurationUnit
PoolUserRestriction
ProjectUserRestriction
SystemUserRestriction
user_skill
UserSkill
SetUserSkillRequest
webhook_subscription
WebhookSubscription
toloka.async_client
AsyncTolokaClient
AsyncTolokaClient methods
aggregation
aggregate_solutions_by_pool
aggregate_solutions_by_task
find_aggregated_solutions
get_aggregated_solutions
analytics
get_analytics
app
archive_app_project
create_app_batch
patch_app_batch
create_app_item
create_app_items
create_app_project
find_app_batches
find_app_items
find_app_projects
find_apps
get_app
get_app_batch
get_app_batches
get_app_item
get_app_items
get_app_project
get_app_projects
get_apps
start_app_batch
stop_app_batch
resume_app_batch
unarchive_app_project
assignments
accept_assignment
find_assignments
get_assignment
get_assignments
get_assignments_df [pandas]
patch_assignment
reject_assignment
attachments
find_attachments
get_attachment
get_attachments
download_attachment
messages
add_message_thread_to_folders
compose_message_thread
find_message_threads
get_message_threads
reply_message_thread
remove_message_thread_from_folders
operations
get_operation
find_operations
get_operations
get_operation_log
wait_operation
pools
archive_pool
archive_pool_async
clone_pool
clone_pool_async
close_pool
close_pool_async
close_pool_for_update
close_pool_for_update_async
create_pool
find_pools
get_pool
get_pools
open_pool
open_pool_async
patch_pool
update_pool
projects
archive_project
archive_project_async
create_project
clone_project
find_projects
get_project
get_projects
update_project
requester
get_requester
skills
create_skill
find_skills
get_skill
get_skills
update_skill
tasks
create_task
create_tasks
create_tasks_async
find_tasks
get_task
get_tasks
patch_task
patch_task_overlap_or_min
task suites
create_task_suite
create_task_suites
create_task_suites_async
find_task_suites
get_task_suite
get_task_suites
patch_task_suite
patch_task_suite_overlap_or_min
training
archive_training
archive_training_async
clone_training
clone_training_async
close_training
close_training_async
create_training
find_trainings
get_training
get_trainings
open_training
open_training_async
update_training
user bonus
create_user_bonus
create_user_bonuses
create_user_bonuses_async
find_user_bonuses
get_user_bonus
get_user_bonuses
user restrictions
delete_user_restriction
find_user_restrictions
get_user_restriction
get_user_restrictions
set_user_restriction
user skills
delete_user_skill
find_user_skills
get_user_skill
get_user_skills
get_user
set_user_skill
webhook subscription
delete_webhook_subscription
find_webhook_subscriptions
get_webhook_subscription
get_webhook_subscriptions
upsert_webhook_subscriptions
toloka.autoquality [autoquality]
optimizer
AutoQuality
scoring
default_calc_ranks
default_calc_scores
toloka.metrics
collector
MetricCollector
MetricCollector.run
jupyter_dashboard [jupyter-metrics]
Chart
DashBoard
metrics
bind_client
Balance
NewMessageThreads
NewUserBonuses
NewUserSkills
pool_metrics
AssignmentEventsInPool
AssignmentsInPool
BansInPool
PoolCompletedPercentage
SpentBudgetOnPool
TasksInPool
WorkersByFilterOnPool
toloka.streaming
cursor
AssignmentCursor
MessageThreadCursor
TaskCursor
UserBonusCursor
UserRestrictionCursor
UserSkillCursor
event
AssignmentEvent
MessageThreadEvent
TaskEvent
UserBonusEvent
UserRestrictionEvent
UserSkillEvent
observer
AssignmentsObserver
PoolStatusObserver
pipeline
Pipeline
Crowd-Kit
Overview
Reference
Aggregation
Classification
DawidSkene
Overview
fit
fit_predict
fit_predict_proba
OneCoinDawidSkene
Overview
fit
GLAD
Overview
fit
fit_predict
fit_predict_proba
GoldMajorityVote
Overview
fit
fit_predict
fit_predict_proba
predict
predict_proba
MMSR
Overview
fit
fit_predict
fit_predict_score
predict
predict_score
MACE
Overview
fit
fit_predict
fit_predict_proba
MajorityVote
Overview
fit
fit_predict
fit_predict_proba
Wawa
Overview
fit
fit_predict
fit_predict_proba
predict
predict_proba
ZeroBasedSkill
Overview
fit
fit_predict
fit_predict_proba
predict
predict_proba
Embeddings
ClosestToAverage
Overview
fit
fit_predict
fit_predict_scores
HRRASA
Overview
fit
fit_predict
fit_predict_scores
RASA
Overview
fit
fit_predict
fit_predict_scores
Image segmentation
SegmentationEM
Overview
fit
fit_predict
SegmentationMajorityVote
Overview
fit
fit_predict
SegmentationRASA
Overview
fit
fit_predict
Pairwise
BradleyTerry
Overview
fit
fit_predict
NoisyBradleyTerry
Overview
fit
fit_predict
Texts
ROVER
Overview
fit
fit_predict
TextHRRASA
Overview
fit_predict
fit_predict_scores
TextRASA
Overview
fit
fit_predict
fit_predict_scores
TextSummarization
Overview
fit_predict
utils
get_accuracy
get_most_probable_labels
manage_data
normalize_rows
add_skills_to_data
Datasets
get_datasets_list
load_dataset
Metrics
Data
alpha_krippendorff
consistency
uncertainty
Workers
accuracy_on_aggregates
Postprocessing
entropy_threshold
Troubleshooting and support
All questions on one page
Registration and getting started
Sandbox
Setting up a project
Setting up a pool
Adding tasks to a pool
Working with results
Archiving pools and projects
Payments
Tolokers
Questions about presets
Support
Success stories
Glossary
Changelog
Data labeling platform
Support
Find answers to questions
Contact Toloka Customer Care
Find answers to questions
All questions on one page
Join our Slack community
Contact Toloka Customer Care
Was the article helpful?
Yes
No
In this article:
Find answers to questions
Contact Toloka Customer Care