get_accuracy

crowdkit.aggregation.utils.get_accuracy | Source code

get_accuracy(
    data: DataFrame,
    true_labels: Series,
    by: Optional[str] = None
)

Parameters Description

Parameters Type Description
data DataFrame

Workers' labeling results. A pandas.DataFrame containing task, worker and label columns.

true_labels Series

Tasks' ground truth labels. A pandas.Series indexed by task such that labels.loc[task] is the tasks's ground truth label.

  • Returns:

    workers' skills. A pandas.Series index by workers and holding corresponding worker's skill

  • Return type:

    Series