Natural language semantic corpus construction based on cloud service platform
Suzhen Wang, Qingchuan Zhang, Lu Zhang · 2017
The natural language semantic corpus construction is the key step to implement information exchange in the intelligent cloud-computing environment. This paper makes a detailed analysis of semantic corpus construction technologies, and proposes a new webpage de-duplication algorithm based on TF-IDF and word vector distance. Experimental results show accuracy and efficiency of the proposed method. Our proposal can be used in semantic corpus construction directly; it can improve the efficiency of webpage de-duplication.