Matching Varying-Length Texts via Topic-Informed and Decoupled Sentence Embeddings
Xixi Zhou, Chunbin Gu, Xin Jie, Jiajun Bu, Haishuai Wang · 2024
Measuring semantic similarity between texts is a crucial task in natural language processing.While existing semantic text matching focuses on pairs of similar-length sequences, matching texts with non-comparable lengths has broader applications in specific domains, such as comparing professional document summaries and content.Current approaches struggle with text pairs of non-comparable lengths due to truncation issues.To address this, we split texts into natural sentences and decouple sentence representations using supervised contrastive learning (SCL).Meanwhile, we adopt the embedded topic model (ETM) for specific domain data.Our experiments demonstrate the effectiveness of our model, based on decoupled and topicinformed sentence embeddings, in matching texts of significantly different lengths across three well-studied datasets.