Crowdsorting Timed Comments about Music: Foundations for a New Crowdsourcing Task
Karthik Yadati, Pavala Shakthi Nathan Chandrasekaran Ayyanathan, Martha Larson · 2014
This paper provides an overview of the Crowdsorting Timed Comments about Music Task, a new task in the area of crowdsourcing for social media offered by the MediaEval 2014 Multimedia Benchmark. Data for this task is a set of Electronic Dance Music (EDM) tracks, collected from on-line music sharing platform Soundcloud. Given a set of noisy labels for segments of Electronic Dance Music (EDM) that were collected on Amazon Mechanical Turk, the task is to predict a single ‘correct ’ label. The labels indicate whether or not a ‘drop ’ occurs in the particular music segment. The larger aim of this task is to contribute to the development of hybrid human/conventional computation techniques to gen-erate accurate labels for social multimedia content. For this reason, participants are also encouraged to predict labels by combining input from the crowd (i.e., human computation) with automatic computation (i.e., processing techniques ap-plied to textual metadata and/or audio signal analysis). 1.