Wawa

crowdkit.aggregation.classification.wawa.Wawa

Wawa(self)

Worker Agreement with Aggregate

Calculates the considers the likelihood of coincidence of the performers opinion with the majority Based on this, for each task, calculates the sum of the agreement of each label The correct label is the one where the sum of the agreements is greater

Parameters Description

ParametersTypeDescription
labels_Optional[Series]

Tasks labels A pandas.Series indexed by task such that labels.loc[task] is the taskss most likely true label.

skills_Optional[Series]

Performers skills A pandas.Series index by performers and holding corresponding performers skill

probas_Optional[DataFrame]

Tasks label probability distributions A pandas.DataFrame indexed by task such that result.loc[task, label] is the probability of tasks true label to be equal to label. Each probability is between 0 and 1, all tasks probabilities should sum up to 1

ParametersTypeDescription
labels_Optional[Series]

Tasks labels A pandas.Series indexed by task such that labels.loc[task] is the taskss most likely true label.

skills_Optional[Series]

Performers skills A pandas.Series index by performers and holding corresponding performers skill

probas_Optional[DataFrame]

Tasks label probability distributions A pandas.DataFrame indexed by task such that result.loc[task, label] is the probability of tasks true label to be equal to label. Each probability is between 0 and 1, all tasks probabilities should sum up to 1