Enriching user experience with intuitive interactions and immersive environments
Balakrishnan Prabhakaran · 2009
Will it not be nice if we can walk into a video game and punch the monster - without using any joy stick or remote controllers? Or play a music title by waving your hand towards the computer screen? Intuitive interfaces have been a fascination for young and elderly alike: young - for doing cool things such as a video game interaction, and for the elderly to handle technology as well as to overcome any physical limitation they may have. Researchers have been trying to use video-based and body sensor based technologies for this purpose of understanding human gesture.Providing immersive environments within which humans can interact - among themselves, with other objects, or the computer - is another research area that raise the level of user experience when combined with the above mentioned intuitive human gesture recognition. Researchers have been developing streaming 3D environments and deformable 3D models to meet this goal.In this talk, we discuss the state-of-the-art in the technologies used for video-based and sensor-based human gesture recognition. We dwell on the similarities and differences between the two approaches (vision-based and sensor-based) and talk about the algorithms and techniques that can be employed. We also describe the possibilities for creating immersive environments by looking at techniques for 3D streaming.