SOUNDSPOTTER / REMIX-TV: FAST APPROXIMATE MATCHING FOR AUDIO AND VIDEO PERFORMANCE
Michael A. Casey, Mick Grierson · University of Michigan Library Repository · 2007
SoundSpotter is an open source software system for realtime matching of an audio input stream to a database of continuous audio or video.Among its novel features are real-time control over audio segmentation, feature selection and match radius.The system uses audio input to control selection of output from a database using approximate matching.The low latency methods employed allow a feedback loop between the performer and SoundSpotter, so it can be used as a live electronic musical instrument.We employ approximate matching using nearest neighbor search with variable-length sequences of features.The feature space is controlled by range selection over the feature vector dimensions determining which are left out of similarity calculations.The current implementation is capable of real-time matching in tens of hours of audio or video on current laptop hardware.Finally, we describe a SoundSpotterdriven video editing application called REMIX-TV.