Mel spectrogram based audio forgery detection using CNN
Arda Üstübıoğlu, Beste Üstübioğlu, Güzin Ulutaş · Research Square · 2022
Abstract In this time of technology, digital speech can be created and falsified by a very diverse of hardware and software technologies. Audio Copy-move forgery is an audio forgery technique that goals to create forged audio by hiding undesirable words or repeating wanted words in the identical speech. Therefore, audio authentication has been a necessary requisition. In this study, an effective approach to spectral images based on audio copy-move forgery detection using Convolutional Neural Networks (CNN) with data augmentation is proposed. There are only a few hand-crafted methods conducted for the detection of audio copy-move forgery. None of the existing works on audio copy-move forgery detection has proposed deep feature learning from speech recording with Mel spectrogram. This is the first method to employ deep learning with Mel spectrogram of audio for the detection of audio copy-move forgery. The proposed CNN architecture classifies the suspicious Mel spectrogram images into two classes: original and forged. The proposed CNN system is successfully trained on these Mel spectrogram images feature extraction. The proposed algorithm has been tested on our datasets generated from Arabic Speech Corpus and TIMIT speech database. The results show the effectiveness, robustness to post-processing operations, and high accuracy of the proposed approach compared to other studies.