Statistical feature extraction for cross-language web content quality assessment

Guanggang Geng, Xiao-Dong Li, Li-Ming Wang, Wei Wang, Shuo Shen · 2011

Web content quality assessment is a typical static ranking problem. Heuristic content and TFIDF features based statistical systems have proven effective for Web content quality assessment. But they are all language dependent features, which are not suitable for cross-language ranking. In this paper, we fuse a series of language-independent features including hostname features, domain registration features, two-layer hyperlink analysis features and third-party Web service features to assess the Web content quality. The experiments on ECML/PKDD 2010 Discovery Challenge cross-language datasets show that the assessment is effective.

Read the paper · More papers on PaperTik