Edge Computing With Complementary Capsule Networks for Mental State Detection in Underground Mining Industry
Mei Wang, Jiang Wang, Yuancheng Li, Huimin Lu · IEEE Transactions on Industrial Informatics · 2022
Most safety accidents are caused by human factor in underground resource mining industry. This is because the nonuniform lighted and noisy and dangerous environment easily evokes the negative mental state and causes the nonstandard production operation. Aiming at the difficult problem to be solved urgently, this article proposes an edge computing mental state framework of the Internet of Things in the underground mining industry. Moreover, a filtering algorithm using a defined threshold function is developed. Furthermore, an complemented capsule network model is constructed by using two residual modules. Specially, a two-stage mental state fusion algorithm is proposed with electrocardiogram signals and facial expression. Finally, the mental state variation characteristics are explored with the underground illuminating and coloring. Experiments show that the mental state detection accuracy is increased by 2.6%. The higher mental arousal is at the illumination between 320Lxand 330Lx.