Webpage Genre Identification Using Variable-Length Character n-Grams
Ioannis Kanaris, Efstathios Stamatatos · 2007
An important factor for discriminating between Web pages is their genre (e.g., blogs, personal homepages, e-shops, online newspapers, etc). Web page genre identification has a great potential in information retrieval since users of search engines can combine genre-based and traditional topic-based queries to improve the quality of the results. So far, various features have been proposed to quantify the style of Web pages including word and HTML-tag frequencies. In this paper, we propose a low-level representation for this problem based on character n-grams. Using an existing approach, we produce feature sets of variable-length character n- grams and combine this representation with information about the most frequent HTML-tags. Based on two benchmark corpora, we present Web page genre identification experiments and improve the best reported results in both cases.