Recognising Egocentric Activities from Gaze Regions with Multiple-Voting Bag of Words
Irwandi Hipiny, Walterio W. Mayol-Cuevas · 2012
We present a system that aims to recognize activities from an egocentric perspective where the prime source of information are gradient regions around the wearer’s gaze fixations. Inspired by evidence from Vision research on the analysis of gaze patterns of people doing manual tasks, we assess how well an existing real-time method for region description performs on a dataset of about 200 video sequences recorded from a wearable gaze tracker. We evaluate the use of the traditional bag of words classification approach, however we introduce and evaluate a weighted multiple voting scheme. We model an activity as a record of fixated visual landmarks as the person progresses through the steps. Our method has shown encouraging results on 11 different classes of manual and household activities, with our multiple voting scheme increasing the hit rate by nearly twofold. 1