WNSA-Net: An Axial-Attention-Based Network for Schizophrenia Detection Using Wideband and Narrowband Spectrograms
Ling T. He, Jia Fu, Yuanyuan Li, Xi Xiong, Jing Zhang · IEEE/ACM Transactions on Audio Speech and Language Processing · 2022
Schizophrenia is a severe mental disease that affects patients' thoughts, feelings, and behaviors. Speech signal has proven to be a biomarker in the early diagnosis of schizophrenia. Previous studies on schizophrenic speech detection are mainly based on manual feature extraction engineering, which requires domain knowledge for researchers and has difficulties extracting effective features. This work proposes an end-to-end architecture, called Axial-attention-based Network using Wideband and Narrowband Spectrograms (WNSA-Net), to detect schizophrenia. Specifically, we adopt both wideband and narrowband spectrograms as inputs to represent speech signals using fine time and frequency structures. Then dilated convolution blocks are employed to capture detailed and long-range information in spectrograms. Axial-attention blocks are introduced to augment the information in feature maps along the time and frequency axes. In addition, we employ a gate mechanism to fuse the output feature maps from all channels. Experimental results on the Schizophrenia dataset and its subdatasets show that schizophrenic patients have difficulties in expressing emotions. To validate the performance of our WNSA-Net, experiments are conducted on Schizophrenia dataset and open-access TORGO database, achieving 97.37% and 98.16% accuracy in detecting schizophrenia and dysarthria, respectively. The results show promise for the proposed method in the diagnosis of disordered speech.