Multi-sensory information as an improvement for communication systems efficiency
Francisco P. Lacerda, Eeva Klintfors, Lisa Gustavsson · 2005
The paper addresses the issue of extraction of implicit information conveyed by systematic audio-visual contingencies. A group of adult subjects was tested on a simple inference task provided by short film sequences. The video materials were encoded and submitted to processing by two neural networks (NN) that simulated the results of the adult subjects. The results indicated that the adult subjects were extremely efficient at picking up the underlying information structure and that the NN could also perform acceptably on both classification and generalization tasks.