Web-Text Mining Algorithm and Its Application in Multi-monitoring Point Data Collecting
Yuangan Wang · Research and Exploration in Laboratory · 2013
In the multi-monitoring point system,the effective acquisition and processing of mass data is a key issue to be solved for effective integration of data from the regional servers.In this paper,the extraction algorithm based on Web page list was applied to multi-point data collecting by introducing the principles of Web text mining and data extraction methods,and a corresponding multi-point data collecting system was built.The analysis of the marine data of multi-monitoring point shows that accurate data items have been taken by the extraction algorithm based on Web page list,the problem of nested data records,automatic extraction and Multi-machine cooperation has been solved.The efficiency of data collection has been improved.