get_accuracy

crowdkit.aggregation.utils.get_accuracy | Source code

get_accuracy(
    data: DataFrame,
    true_labels: Series,
    by: Optional[str] = None
)

Parameters Description

ParametersTypeDescription
dataDataFrame

Workers' labeling results. A pandas.DataFrame containing task, worker and label columns.

true_labelsSeries

Tasks' ground truth labels. A pandas.Series indexed by task such that labels.loc[task] is the tasks's ground truth label.

  • Returns:

    workers' skills. A pandas.Series index by workers and holding corresponding worker's skill

  • Return type:

    Series

Crowd-Kit
Overview
Reference
Aggregation
Datasets
Learning
Metrics
Postprocessing