We will discuss two major challenges in peer evaluation: (1) Fraud, where a group of participants form a coalition, get assigned to evaluate each other, and then give highly positive reviews; (2) Feedback, where opinions given by evaluatees (e.g., authors of papers) about evaluators (e.g., reviewers of papers) are biased by the evaluation given to them (e.g., whether the paper was accepted or rejected). We will propose practical solutions with strong theoretical guarantees, and discuss important and impactful open problems.


Nihar B. Shah
Carnegie Mellon University
Assistant Professor in the Machine Learning and the Computer Science Departments
Don't miss
Mon Aug 02 2021 12:20:30 GMT+0300 (Moscow Standard Time)