Application of pretrained deep neural networks to large vocabulary speech recognition
Navdeep Jaitly, Patrick Nguyen, Andrew Senior, Vincent Vanhoucke · 2012
The use of Deep Belief Networks (DBN) to pretrain Neural Networks has recently led to a resurgence in the use of Artificial Neural Network- Hidden Markov Model (ANN/HMM) hybrid systems for Automatic Speech Recognition (ASR). In this paper we report results of a DBN-pretrained context-dependent ANN/HMM system trained on two datasets that are much larger than any reported previously with DBN-pretrained ANN/HMM