An Integrated Set of Web Mining Tools for Research
D Aravind · Zenodo (CERN European Organization for Nuclear Research) · 2018
The evolution of the World Wide Web has brought us enormous and evergrowing amounts of data and information. A large number of data provided by the web, it has become a special area for research. In a sense, the web data mining with its design and implementation provides well bound utilizing information from the web for research. This paper describes th e design and implementation of web data mining research. It gives a method of identifying, extracting, filtering and analyzing data for web resources. It sequentially starts with Information Retrieval (IR), Information Extraction (IE), Generalization, analysis, and Validation. IR will identify web sources by predefined categories with classification. IE will use a hybrid extraction way to select portions from a web page and give data into a database. Generalization will clean data and use database techniques to analyze collected data. Validation uses model-based data extraction to validate the data correctness. This work offers an integrated set of web mining tools that will help advance sophisticated in supporting researcher doing online research.