Construct the XQuery-based wrapper for extracting web data

Tiezheng Nie, Derong Shen, Ge Yu, Yue Kou, Dan Yang · 2011

Web pages provide a large number of structured data, which are required by many advanced applications. However, existing works lack the compatibility. This paper proposes a web data extraction model which builds an XQuery-based wrapper for extracting data of web pages. We firstly annotate data values with XPATH in XML documents of sample pages. Then we design an algorithm to generate XQuery statements which can extract data form XML documents and output result data with structured or semi-structured format. Since XQuery is a well known standard for operating XML data and is supported by most database systems and applications, our wrapper has high compatibility for most applications. The experimental results demonstrated approach we proposed is feasible for extracting web data which is important for web data integration.

Read the paper · More papers on PaperTik