Research on Public Opinion Data Collection of Electric Power Information Based on Web Crawler Technology
Wenjie Fan, Wenyu Cheng, Yue Shang, Jing Li · 2023
As network communication becomes an important data foundation for the development and application of electric power. The rapid development of electricity public opinion will cause rapid spread and adverse effects if it is not controlled. Therefore, the collection of power network public opinion data has become an important research content in recent years. This paper uses web crawler technology to construct public opinion topic vectors. The web page similarity is calculated, and the public opinion topic data is crawled to realize the collection of public opinion data. By testing different numbers of web pages, the results show that the method in this paper has the advantages of high average recall rate, high accuracy rate, and less time-consuming data collection. It can effectively improve the efficiency of public opinion collection on the power network.