Measurement Integrity in Peer Prediction: A Peer Assessment Case Study
Noah Burrell, Grant Schoenebeck · 2023
We propose measurement integrity, a property related to ex post reward fairness, as a novel desideratum for peer prediction mechanisms in many natural applications. Like robustness against strategic reporting, the property that has been the primary focus of the peer prediction literature, measurement integrity is an important consideration for understanding the practical performance of peer prediction mechanisms.