Siamese Network-Based Text Similarity Algorithm Research
Junhong Chen, Kaihui Peng · Journal of Artificial Intelligence Practice · 2024
This paper proposes a text similarity calculation model based on multi-scale convolutional neural networks and attention mechanisms. The model is capable of extracting information at different granularities within the text, enabling it to learn from multiple layers of information and thereby improving the accuracy of the text similarity calculation task. After training, the model can generate sentence vectors suitable for cosine similarity computation, which allows the model to pre-generate vectors for the text in the repository. During actual retrieval, only the sentence vector of the text to be searched is needed to calculate similarity with the pre-generated vectors in the repository.