Generating Spatial Referring Expressions in Interactive 3D Worlds
Diego dos Santos Silva, Ivandré Paraboni · Spatial Cognition and Computation · 2015
This paper discusses the computational problem of generating referring expressions (REG) in 3D virtual worlds. We propose a REG algorithm that attempts to make adequate choices of spatial relations for the purpose of disambiguation (as opposed to, e.g., determining the localisation of a previously identified object). The decisions made by the algorithm are based on existing computational models of spatial reference, and further refined by the use of domain knowledge obtained from a corpus of instructions in virtual environments. The proposed approach is shown to outperform a number of baseline systems, and provides evidence on how a standard REG approach may be applied to the generation of these descriptions in 3D virtual worlds.