Synesthesia audio-visual interactive-sound and music visualization in virtual reality with orbital observation and navigation
Benjamin Outram · 2016
Music visualization is particularly suited to enjoying music and for new modes of interaction and embodiment in virtual reality. Here I demonstrate several real-time virtual reality sound and music visualization techniques and applications using both music from electronic music producer James Le Roux, and sound from a user's microphone. Additionally, the adoption of an `orbital mode' interaction technique allows unprecedented hands-free user observation and navigation control. Users are able to pause the sound, halting the visualization data so that it can be viewed in freeze-frame from any angle.