Audio Morphing Using Matrix Decomposition and Optimal Transport
Gerard Roma, Owen Green, Pierre Alexandre Tremblay · Huddersfield Research Portal (University of Huddersfield) · 2020
This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.