Syllable-aware Neural Language Models: A Failure to Beat Character-aware Ones
Zhenisbek Assylbekov, Rustem Takhanov, Bagdat Myrzakhmetov, Jonathan North Washington · 2017
Syllabification does not seem to improve word-level RNN language modeling quality when compared to characterbased segmentation.However, our best syllable-aware language model, achieving performance comparable to the competitive character-aware model, has 18%-33% fewer parameters and is trained 1.2-2.2times faster.