get_accuracy

crowdkit.aggregation.utils.get_accuracy | Source code

get_accuracy(
data: DataFrame,
true_labels: Series,
by: Optional[str] = None
)

Parameters description

ParametersTypeDescription
dataDataFrame

Workers' labeling results. A pandas.DataFrame containing task, worker and label columns.

true_labelsSeries

Tasks' ground truth labels. A pandas.Series indexed by task such that labels.loc[task] is the tasks's ground truth label.

  • Returns:

    workers' skills. A pandas.Series index by workers and holding corresponding worker's skill

  • Return type:

    Series

Last updated: March 31, 2023

Crowd-Kit
Overview
Reference
Aggregation
Datasets
Learning
Metrics
Postprocessing