Gaze Instruction System Used Panoramic Expansion Image of Omnidirectional Camera

Yoichiro Maeda, Kazuki Naruki · 2016

In recent years, many support systems intended for elderly and disabled people have been developed. Among them, the study on the interface utilizing human gaze has been attracting attention. Human vision contains a lot of important information. Some studies that estimate a next action of operator intended to perform by using the visual information have been reported. Also we performed the research that recognizes the human instruction based on the operator's gaze point and controls the locomotion of wheelchair by paying attention to the motion and the characteristics of human eyes. As an example, the visual saliency map model is one of the means using to estimate the intention of the human gaze. This model enables to estimate the place directed human attention from the image. Also, this model has an advantage that uses only the image information. As the research dealing with the visual saliency map model, the study suppressing the changing value of saliency map by the movement of operator's head and the study controlling the weight of saliency map used a human knowledge as a value have been reported. However, there are few applications used the visual saliency map model by the movement of human eyes in real time because it is difficult to adjust it in the conventional studies. In this research, we focus on the combination of visual saliency map and gaze information, and extract a behavioral intention estimation map from the landscape and the movement of human eye. We propose a gaze instruction system using panoramic expansion image for controlling the locomotion of omni-directional wheelchair. In this system, the human intention by various input information is estimated by using fuzzy reasoning. To evaluate the effectiveness of this method, we carried out the comparison experiments for gaze instruction system by using only movement of human eyes.

Read the paper · More papers on PaperTik