Streaming Behaviour: Live Streaming as a Paradigm for Multi-view Analysis of Emotional and Social Signals
Mihalis A. Nicolaou, Charles Ringer · Goldsmiths (University of London) · 2018
We argue that live video game streams constitute an invaluable paradigm towards building multi-view, data-driven models of human behaviour.The interactive setting under which a stream operates is enriched with social signals, conveyed between streamers and viewers via facial expressions, body movement, vocal cues, as well as written language.We consider the data sources involved in a typical broadcast (e.g., camera stream, game footage, text) as dataviews that carry inherent correlations, since they all describe events occurring during a stream.We argue that this unique interactive setting facilitates the joint, multi-view analysis of various heterogeneous data sources involved, in a coherent and self-contained manner.We elaborate on the emergence of social signals in this setting, while discussing close links and potential research directions related to areas such as affective computing, machine learning, computer vision and intelligent game design.