crowdkit.metrics.workers.accuracy_on_aggregates.accuracy_on_aggregates | Source code
accuracy_on_aggregates(answers: DataFrame,aggregator: Optional[BaseClassificationAggregator] = ...,aggregates: Optional[Series] = None,by: Optional[str] = None)
Accuracy on aggregates: a fraction of worker's answers that match the aggregated one.
a data frame containing
aggregation algorithm. default: MajorityVote
aggregated answers for provided tasks.
if set, returns accuracies for every worker in provided data frame. Otherwise, returns an average accuracy of all workers.