An Integrated Evaluation of Perception, Interpretation, and Narration
Nicole Maslan, Melissa Roemmele, Andrew S. Gordon · 2015
In this paper, we describe our efforts to create an evaluation tool to aid in the development of artificial intelligence sys-tems that integrate perception, reasoning, and language abil-ities. Based on an early and influential study by social psy-chologists Fritz Heider and Marianne Simmel, we created 100 short movies depicting the motions of two triangles and a circle around a box with a hinged opening. For each mov-ie, we provide quantitative information about each object's trajectory, a formal description of the actions that can be perceived in each object's behavior, a formal interpretation of the social situation that is depicted, and a short English narration of the interpreted events.