Sound Scope Pad: Controlling a VR Concert with Natural Movement
Masatoshi Hamanaka · 2022
We developed Sound Scope Pad, an application that provides an active music listening experience that combines AI, virtual reality, and spatial acoustics. Users can emphasize the sounds of certain performers by turning their head to the left or right or bringing their hands closer to their ears to find and focus on the performer they want to listen to. In the Sound Scope Headphones that we previously built, the user’s head direction was detected by an accelerometer mounted on the arch of the headphones. In Sound Scope Pad, the head direction is detected by combining the angle information detected by the acceleration gyro sensor of a tablet and the angle information of the head recognized from the front camera image of the tablet.