Cross-linguistic analysis of prosodic features for sentence segmentation
James G. Fung, Dilek Zeynep Hakkani-Tür, Mathew Magimai.-Doss, Elizabeth E. Shriberg, Sébastien Cuendet, Nikki Mirghafori · 2007
In this paper, we perform a cross-linguistic study of prosodic features in sentence segmentation by using two different feature selection approaches: a forward search wrapper and feature filtering. Experiments in Arabic, English, and Mandarin show that prosodic features make significant contributions in all three languages. Feature selection results indicate that feature relevancy can vary greatly depending on the target language, and therefore the optimal feature subset varies considerably between languages. We observe patterns in the feature selection and the affinity of the different languages toward certain feature types, which gives us insight into future feature selection and feature design. Index Terms: prosodic features, cross lingual, feature selection, sentence segmentation