Research on discovering Deep Web entries based ontopic crawling and ontology
Gang Liu, Kai Liu, Yuanyuan Dang · 2011
Abstract-With the wide application of web database, Web pages are continuously deepened. In order to use Deep Web resources effectively, the Deep Web data need to be integrated on a large scale, and data sources discover is the primary work of Deep Web resources integration. The Deep Web site found efficiently is the key of the Deep Web data Integration. This paper puts forward a kind of Deep Web entry automatic discovery method. In this paper, firstly using the information of specific field Deep Web entry form to establish domain ontology, then web forms can be judged by the process of the topic crawler crawling in the web. If there are forms which are extracted its attributes and calculate the weights from form's attributes and ontology. Download this page when the weights greater than the fixed value. Finally we use test words to examine the already download pages to find out high quality Deep Web entry pages.