Bone-Conducted Speech to Air-Conducted Speech Conversion Based on CycleConsistent Adversarial Networks
Qing Pan, Jian Zhou, Teng Fei Gao, Liang Tao · 2020
Compared with traditional Air-Conducted Microphone (ACM) speech, Bone-Conducted Microphone (BCM) speech has the advantage of shielding background noise and helps to improve the communication quality in the strong noise environment. This paper proposes a method that uses Cycle-Consistent Adversarial Networks (CycleGAN) to extend the bandwidth for converting BCM speech to ACM speech based on the analysis of the bandwidth difference. The proposed method learns the mapping relationship between BCM speech and ACM speech without relying on parallel data, and does not require any additional data, modules or alignment process, it also avoids the over smoothing that is easy to appear in many statistical models. The experimental results show that the method can better reconstruct the high-frequency components of BCM speech. Compared with the original speech, it improves the subjective and objective results, and obtains Melspectrum features with higher similarity to the target speech.