Speech Translation From Darija to Classical Arabic: Performance Analysis of Whisper, SeamlessM4T, and S2T Models
Maria Labied, Abdessamad Belangour, Mouad Banane · IEEE Access · 2025
This study evaluates the performance of advanced speech-to-text translation models—Whisper large-v3, SeamlessM4T, and S2T—fine-tuned on the Darija-C corpus to translate Darija speech into Classical Arabic text. Darija, a widely spoken Arabic dialect, presents significant challenges for automated translation due to its linguistic complexity and lack of standardized resources. The fine-tuning process adapted each model to the nuances of Darija speech, aiming to optimize translation quality and linguistic alignment with Classical Arabic. The primary goal of this research is to identify the model achieving the highest BLEU score, which serves as a benchmark for translation accuracy and fluency. Comprehensive experiments highlight the comparative strengths and limitations of these models, with Whisper large-v3 emerging as a strong contender alongside SeamlessM4T and S2T. Results reveal the critical role of fine-tuning in improving the performance of pre-trained models on low-resource dialects. This work contributes to the development of effective speech translation systems for Arabic dialects, offering insights into optimizing model architectures for underrepresented languages and enhancing their practical applicability in real-world scenarios.