Quora Question Pairs using PERT
Shubham Agarwal · 2023
Quora is a simple portal for asking questions and linking with experienced people who may provide thoughtful and well-written responses. With millions of users accessing Quora every day, it is not surprising that many individuals post identical or similar-intent queries. Because of their effective text representations developed through extensive corpus training, pre-trained language models (PLMs) have been employed extensively for resolving natural language processing (NLP) challenges. This study examines the task of Natural Language Understanding (NLU) by examining Quora dataset’s duplicate question identification. We employ PERT, an auto-encoding model similar to BERT that trains on the Permutation Language Model (PerLM). The experiment’s findings demonstrate that PERT can outperform a number of related baseline models.