Predicting the Perceived Quality of Web Forum Posts

Markus Weimer, Iryna Gurevych · TUbilio (Technical University of Darmstadt) · 2007

Assessing the quality of user generated content is an important problem of Web 2.0. Currently, most web sites need their users to rate content manually, which is labour intensive and thus happens rarely. The automatic systems in the literature are limited to one kind or domain of discourse. We propose a system to assess the quality of user generated discourse automatically. Our system learns from human ratings by applying SVM classification based on features such as Surface, Lexical, Syntactic, Forum specific and Similarity features. Our system has also shown to be adaptable to different domains of discourse in our experiments on three different web forum data sets. The system outperformed the majority class baseline for all three data sets. Our best performing system configuration achieves an accuracy of 89.1%, which is significantly higher than the baseline of 61.82%.

Read the paper · More papers on PaperTik