Multimodal Interface Architecture for Unmanned Aerial Vehicle Control
Николай Сергеевич Абрамов, Yulia Emelyanova, Alexander Talalaev, Vitaly Petrovich Fralenko, Михаил Вячеславович Хачумов · Russian Aeronautics · 2022
Abstract We considered an approach to the construction of a combined smart interface for the control system of a quadrocopter-type unmanned aerial vehicle that integrates various methods of information input, processing, and transmission. In this work, the architecture and system of voice and gesture commands of the quadrocopter control system multimodal interface are presented. Training samples were prepared and experimental verification of recognition algorithms using artificial neural networks of deep learning was carried out.