ParalMGC: Multiple Audio Representations for Synthetic Human Speech Attribution
Michael Neri, Anna Ferrarotti, Luca De Luisa, Andrea Salimbeni, Marco Carli · 2022
Deep learning models allow the creation of deepfake synthetic audios which are difficult to distinguish from natural ones. Moreover, recognizing which algorithm generated a given synthetic audio is even more challenging. This challenging task, scarcely explored in the literature, is the focus of this paper. We introduce a deep learning approach to identify which synthesis algorithm produced a generic speech audio. Specifically, the proposed system exploits two parallel branches for processing 2D audio features, i.e., Mel-Frequency and the GammaTone coefficients. The extracted features are concatenated and then refined by two convolutional layers. The performance of the model is evaluated on the 2022 IEEE Signal Processing Cup dataset. Different configurations of the proposed framework involving several audio features and deep learning architectures are discussed. The proposed approach achieves an accuracy of 98.1% on the validation set of the synthetic dataset.