Analytical augmentation of 3D simulation environments
Julia J. Loughran, Marchelle M. Stahl · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 1998
This paper describes an approach for augmenting three- dimensional (3D) virtual environments (VEs) with analytic information and multimedia annotations to enhance training and education applications. Analytic or symbolic information in VEs is presented as bar charts, text, graphical overlays, or with the use of color. Analytic results can be computed and displayed in the VE at run-time or, more likely, while replaying a simulation. These annotations would typically include computations of pre-defined Measures of Performance (MOPs) or Measures of Effectiveness (MOEs) associated with the training or educational goals of the simulation. Multimedia annotations are inserted into the VE by the user and may include: a drawing or whiteboarding capability, enabling participants to insert written text and/or graphics into the two-dimensional (2D) or 3D world; audio comments, and/or video recordings. These annotations can clarify a point, capture teacher feedback, or elaborate on the student's perspective or understanding of the experience. The annotations are captured in the VE either synchronously or asynchronously from the users (students and instructors), during simulation execution or afterward during a replay. When replaying or reviewing the simulation, the embedded annotations can be reviewed by a single user or by multiple users through the use of collaboration technologies. By augmenting 3D virtual environments with analytic and multimedia annotations, the education and training experience may be enhanced. The annotations can offer more effective feedback, enhance understanding, and increase participation. They may also support distance learning by promoting student/teacher interaction without co-location.