A comparison of Kazakh language processing models for improving semantic search results
Айгерим Айтим, Ryskhan Satybaldiyeva · Eastern-European Journal of Enterprise Technologies · 2025
The object of the study is the text classification and semantic search tailored to the unique linguistic features of the Kazakh language. The research addresses the challenge of improving the accuracy, relevance, and efficiency of semantic search. This study focuses on improving semantic search for the Kazakh language by analyzing computational models tailored to its unique linguistic features, such as agglutinative morphology and rich inflectional systems. The research compares traditional rule-based approaches and advanced transformer architectures, including fine-tuned models like RoBERTa, for their ability to handle semantic nuances, contextual relationships, and user intent. The results reveal that fine-tuned transformer models achieved significant advancements, with the RoBERTa model attaining a Precision@10 of 89.4 %, a Mean Reciprocal Rank (MRR) of 85.6 %, and an F1-Score of 88.0 %. Additionally, the semantic search system developed in this study demonstrated a precision of 88.4 %, recall of 87.6 %, and an F1-score of 88.0 % on a domain-specific Kazakh dataset. Key to these improvements were innovations in preprocessing pipelines, including custom tokenization and lemmatization tailored to Kazakh's agglutinative morphology, and the integration of contextual embeddings to resolve issues such as synonymy and homonymy. Computational efficiency was enhanced through resource optimization techniques, enabling the deployment of these advanced models in constrained environments. These findings underscore the potential of tailored transformer models to bridge the gap in semantic search capabilities for underrepresented languages like Kazakh, advancing the inclusivity of natural language processing technologies