Attention-Aware Multi-modal RNN for Deception Detection
Shun-Wen Hsiao, Cheng-Yuan Sun · 2022 IEEE International Conference on Big Data (Big Data) · 2022
Nowadays, various video data are springing up. In the field of human-centric video analysis, deception detection becomes a crucial issue to us. Thanks to AI development, automated deception detection has been researched for a while. Nonetheless, the mainstream techniques work as a black box, which is unexplainable. This paper presents an attention mechanism on visual and audio features, which makes the detection interpretable. Besides, we embrace the approach of multi-modal by combining visual, audio, and transcription features as an ensemble model, which can achieve 96% of accuracy.