Sequence recognition by input anticipation
Kagan Tumer, Joydeep Ghosh · 1994
Processing time-dependent information is crucial in a multitude of classification tasks. This paper introduces a new neural network called the anticipation network, which fuses two simple recurrent networks for more efficient feature extraction and classification of spatiotemporal signals. The network has two sets of outputs: the first set classifies the patterns, while the second one trains "anticipation" units whose goal is to predict future inputs. The correlation between these outputs adds constraints to shared hidden nodes, thereby resulting in better feature selection. The ability to anticipate the input sequence is thus used to either classify, generate or complete sequences. Simulation results are provided for a simple frequency detection task, classification of artificial (multidimensional) sonograms, and the detection and classification of real underwater acoustic signals. The results show that anticipation networks not only classify patterns more accurately, but are able to ...