Design and Implementation of Rapid Information Acquisition and Analysis System
Haiyan Fu, Yu Li, Xuechao Sun · 2019
In the era of big data, extracting valuable information from huge and complicated information has become a difficult issue. The work designed a rapid information acquisition and analysis system for Zhihu Forum. The client of system used the Bootstrap front-end development framework, JavaScript framework Jquery, asynchronous JavaScript and XML Ajax to develop visual interface. The main function of the server was to use the crawler technology to quickly obtain the forum information based on python environment. Moreover, Jieba segmentation was used to segment the text data, and then the generalized word cloud was generated according to the frequency of each word in the text. The proportion of positive affectivity was given by using the third-party tool snowNLP to judge the emotion. Finally, the top ten posts are selected as hot topics for reference by the number of likes. The development and application of the system can improve the information acquisition and analysis of users.