Gaze-music Media Transformation by Similarity of Impression Words
Abdullah Iskandar, Takafumi Nakanishi, Achmad Basuki, Ryotaro Okada, Takashi Kitagawa · 2020
In this paper, we present gaze-music transformation realization method by realizing gaze emotion detection system and interconnecting the detection system and an automatic music media creation system. This method automatically creates a music media contents by a detected emotion from human gaze. When it is possible to realize a system that acquires human gaze data from a camera device, detects emotions from the data, and creates media content in response to those emotions, it will contribute to creative activities corresponding to human emotion. Our method connects a gaze emotion detection system and an automatic music creation system by the similarity of words that represent emotions and impressions. It is possible to compare emotions by comparing the emotions expressed by each different vocabulary using the similarity of words.