Manipulation of oral cancer speech using neural articulatory synthesis

Bence Mark Halpern, Teja Rebernik, Thomas B. Tienkamp, R.J.J.H. van Son, Michiel W. M. van den Brekel, Martijn B. Wieling, Max J. H. Witjes, Odette Scharenborg · arXiv (Cornell University) · 2022

We present an articulatory synthesis framework for the synthesis and manipulation of oral cancer speech for clinical decision making and alleviation of patient stress. Objective and subjective evaluations demonstrate that the framework has acceptable naturalness and is worth further investigation. A subsequent subjective vowel and consonant identification experiment showed that the articulatory synthesis system can manipulate the articulatory trajectories so that the synthesised speech reproduces problems present in the ground truth oral cancer speech.

Read the paper · More papers on PaperTik