Deep learning-based hand gesture recognition for collaborative robots

Cristina Nuzzi, Simone Pasinetti, Matteo Lancini, Franco Docchio, Giovanna Sansoni · IEEE Instrumentation & Measurement Magazine · 2019

This paper is a first step towards a smart hand gesture recognition set up for Collaborative Robots using a Faster R-CNN Object Detector to find the accurate position of the hands in RGB images. In this work, a gesture is defined as a combination of two hands, where one is an anchor and the other codes the command for the robot. Other spatial requirements are used to improve the performances of the model and filter out the incorrect predictions made by the detector. As a first step, we used only four gestures.

Read the paper · More papers on PaperTik