Towards Measuring Crowdsourcing Success: An Empirical Study on Effects of External Factors in Online Idea Contest
Thomas Pierre Walter, Andrea Bäck · Alexandria (UniSG) (University of St.Gallen) · 2011
Crowdsourcing campaigns in general and online idea contests in particular have reached popularity in practice and research.Based on the open innovation paradigm, idea marketplace providers like InnoCentive broker ideas between a potentially large-scaled crowd of solvers and seeking firms by hosting idea contests in the web.So far, research has mainly focused on the setup of idea marketplaces, design patterns to define idea contests or motivation factors to spur solvers.Mostly, extrinsic incentives, especially rewards for best ideas, are used to guarantee high amounts and good quality of ideas.In contrast to the predominant qualitative and conceptional research on online idea contests, we attempt an empirical study.We derive external factors, like rewards, contest-duration or market-maturity, to construct a model depicting effects of these factors on the outcome of online idea contests.We use a dataset from Atizo, containing over 25'000 submitted ideas and over 83'000 ratings to evaluate validity of our model.Our findings show that current design elements of online contest may not contribute to the commonly expected effects.One interesting aspect is that using rewards to maximize quality and quantity of ideas creates a conflict of goals as rewards can have perverse effects on the outcome.