Quality Control in Crowdsourcing Systems: Issues and Directions
Mohammad Allahbakhsh, Boualem Benatallah, Aleksandar Ignjatović, Hamid Reza Motahari‐Nezhad, Elisa Bertino, Schahram Dustdar · IEEE Internet Computing · 2013
As a new distributed computing model, crowdsourcing lets people leverage the crowd's intelligence and wisdom toward solving problems. This article proposes a framework for characterizing various dimensions of quality control in crowdsourcing systems, a critical issue. The authors briefly review existing quality-control approaches, identify open issues, and look to future research directions. In the Web extra, the authors discuss both design-time and runtime approaches in more detail.