Computer-aided Off-topic Composition Detection
Qiang Qu, Yahui Zhao, Rongyi Cui · Proceedings of the 2nd International Conference on Culture, Education and Economic Development of Modern Society (ICCESE 2018) · 2018
Aiming at the problem that the lack of accurate and efficient off-topic detection algorithm for the current English composition teaching system in China, an off-topic detection algorithm based on LDA and word2vec was proposed in this paper.The algorithm used LDA to model the documents and trained the model with word2vec, with obtained semantic relation between document's topic and words, calculated the probability weighted sum of each topic and its feature words in the document.Finally, the off-topic compositions were selected by setting reasonable threshold.According to the different F-measures for the different number of topics in the document, the optimum number of topics was determined in the experiment.The experimental results show that the proposed method, with above 89% of F-measure, is more effective than traditional vector space model, and can realize the intelligent processing of off-topic compositions detection, which may be applied effectively in teaching of English composition.