Interaction design of gesture control for DMS multi-channel system
Yu Tian Wang, Yuan Lu, Juan‐Juan Cai, Hui Wang, Qin Zhang · 2017
With the development of Artificial Intelligence, gesture recognition technology has been applied in practical schemes. We built up the Dynamic Matrix Sound system (DMS system) which makes an excellent sound field reproduction effect. However, because of the weak controllability of the large-scale system, the application of the DMS system is very limited. In order to control a DMS system by gesture, the Leap Motion is adopted and the Node.js is used to connect the DMS system with client terminal. The real time 3D gesture position data, which is captured by leap motion, will be translated into DMS control instruction and transferred to the DMS system to implement the play, pause and other functions. In order to support a wider range of client hardware, the design is realized by javascript and C++, of which the data communication between them is realized through Node.js. In the design of the system, the whole process is to transfer the communication logic of websocket to the Node.js, so that the communication between the mobile devices and the back-end is more reasonable.