On the Organisation of Program Verification Competitions
Marieke Huisman, Vladimir Klebanov, Rosemary Monahan, Vladimir Klebanov, Bernhard Beckert, Armin Biere, Geoff Sutcliffe · University of Twente Research Information · 2012
Abstract. In this paper, we discuss the challenges that have to be addressed when organising program verification competitions. Our focus is on competitions for verification systems where the participants both formalise an informally stated requirement and (typically) provide some guidance for the tool to show it. The paper draws its insights from our experiences with organising a program verification competition at FoVeOOS 2011. We discuss in particular the following aspects: challenge selection, on-site versus online organisation, team composition and judging. We conclude with a list of recommendations for future competition organisers. 1