Natural Language Processing and Natural Language Understanding Techniques for Intelligent Search
Shrishti Shiva, Mohamed A. El-dosuky, Sherif Kamel · International Journal of Computer Applications · 2024
This paper presents an intelligent text retrieval and ranking system leveraging advanced NLP and NLU techniques, including word embeddings and cosine similarity.The system incorporates an LSTM language model to generate document embeddings from preprocessed text documents, facilitating accurate document-query matching.Experimental evaluation demonstrates the system's efficacy, achieving an average accuracy of 0.75 on the test set.The use of cosine similarity further supports the system's ability to rank documents meaningfully.However, potential overfitting concerns necessitate an exploration of regularization techniques to improve generalization.The proposed intelligent system finds practical applications in search engines and recommendation systems, delivering contextually relevant content to users.