Improve Multichannel Speech Recognition with Temporal and Spatial Information
Yu Zhang, Pengyuan Zhang, Qingwei Zhao · IEICE Transactions on Information and Systems · 2018
In this letter, we explored the usage of spatio-temporal information in one unified framework to improve the performance of multichannel speech recognition. Generalized cross correlation (GCC) is served as spatial feature compensation, and an attention mechanism across time is embedded within long short-term memory (LSTM) neural networks. Experiments on the AMI meeting corpus show that the proposed method provides a 8.2% relative improvement in word error rate (WER) over the model trained directly on the concatenation of multiple microphone outputs.