A Data Collection Method based on Topic Weight Hypergraph
Di Wu, Peng Zhang, X. R. Meng, Guo Chen, Junlong Du, Chao Zhang, Lixin Du · 2023
With the rapid development of technologies such as big data and artificial intelligence, the global internet data production speed is increasing. The traditional manual keyword-based retrieval approach is unable to meet the needs of information retrieval. Therefore, it is essential to efficiently and quickly obtain high-value data from massive internet data. In this paper, we propose an automatic data collection method based on the weighted hypergraph of topic words, initiating the retrieval process from a seed keyword search. By iteratively exploring new topic words around the seed keyword, we achieve the collection of topic data.