Tongue `N' Groove: An Ultrasound Based Music Controller

FLORIAN M. VOGT, Graeme McCaig, Ali, Mir A., Sidney Fels · Zenodo (CERN European Organization for Nuclear Research) · 2002

Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.

Read the paper · More papers on PaperTik