Sensor fusion: Towards a fully expressive 3D music control interface

Gabrielle Odowichuk, Shawn Trail, Peter F. Driessen, Wendy Nie, Wyatt H. Page · 2011

This paper describes a study into the realisation of a new method for capturing 3D sound control data. It expands on our established practice with the radiodrum 3D input device by incorporating a computer vision platform that we have developed using the Xbox Kinect motion sensing input device. It also extends our previous work in systemizing a low-cost, open-source 3D gesture sensor system, as a novel method for musically oriented human computer interaction. We discuss in detail the development process and the system performance in different scenarios and outline the future directions of this development.

Read the paper · More papers on PaperTik