Integration of DNN Generated Spontaneous Reactions with a Generic Multimodal Framework for Embodied Conversational Agents
Hung‐Hsuan Huang, Masato Fukuda, Stef van der Struijk, Toyoaki Nishida · 2018
This paper describes the recent extensions of our previously proposed GECA Framework in incorporating the interconnection with GECA original networking library and ZeroMQ message passing library, the connection with Python based DNN developing API, Keras, and a character animator supporting FACS based detailed facial animations and lip-syncing with real-time generated voice tracks.