Syllable to Word: Relative Collocational Syllable Entropy vs.Transitional Probabilities
Paul Juinn Bing Tan, Phillip Potamites, Paul Juinn Bing Tan, Yao Hui-mei · PONTE International Scientific Researchs Journal · 2016
This article uses the hypothesis that language must balance predictability and informativeness to segment syllable streams into words. It shows that this method works somewhat better and more intuitively than its competing candidate for children's method of achieving word cognition. It further shows that syllable statistics fall within a specified range and argues that borderline cases are either victims of over-fitting or likely candidates for language change.