Synthesis of Explosion Sounds from Utterance Voice of Onomatopoeia using Transformer
Riki Takizawa, Shigeyuki Hirai · 2023
Sound creators use knowledge, techniques, and experience to create sound effects for media works, ensuring that these sound effects are suitable for different situations and dramatic presentations. This is a challenging task for inexperienced creators and beginners, but it is relatively easy for anyone to imagine desired sounds and express them as onomatopoeic utterances. Therefore, we propose a novel technique to easily create a desired sound effect by synthesizing the sound from voice articulation, rhythm, and intonation. In this research, we focus on explosion sounds, a kind of sound effect that has various representations. The proposed technique uses a Transformer, which trains the conversion from speech to explosion sounds. This paper describes the synthesizer model with Transformer and datasets for training the model and some results in current.