A study of duplicate removal technology based on Chinese CQA
Peng Yue · Journal of Suzhou University of Science and Technology · 2014
Based on the semantic knowledge resource of HowNet,a duplicate removal method focusing on the questions from CQA is proposed through computing similarity between sentences.The questions which own a high degree of similarity with others were selected and removed by calculating the semantic similarity between them.In this way,we increased the efficiency of users obtaining needed information and improved user experience.The experiment results on the questions from the URL http://iask.sina.com.cn/ show a good duplicate removal effect.