Learning to Listen to Data: Voice Interaction, Sonification, and Narrative
Jordan Wirfs-Brock · 2021
My dissertation explores how to help people learn to listen to data through new voice-first technological capabilities, by combining narrative storytelling and data sonification. For example, what if a voice assistant could help you craft personalized sounds that meaningfully represent your emotions, log them over time, and listen back to those sounds and reflect on your behaviors? Beyond simply helping general audiences engage with data, I hope these kinds of interactions can support people as they develop new capacities to learn and think with data and sound, bringing acts of everyday data interpretation to new audiences and contexts.