MSG-GCN: Multi-Semantic Guided Graph Convolutional Network for Human Overboard Behavior Recognition in Maritime Drone Systems
Ruijie Hang, Guiqing He, Liheng Dong · Drones · 2025
Drones are increasingly being used in maritime engineering for ship maintenance, emergency rescue, and safety monitoring tasks. In these tasks, action recognition is important for human–drone interaction and for detecting abnormal situations such as falls or distress signals. However, the maritime environment is highly challenging, with illumination variations, water spray, and dynamic backgrounds often leading to ambiguity between similar actions. To address this issue, we propose MSG-GCN, a multi-semantic guided graph convolutional network for human action recognition. Specifically, MSG-GCN integrates structured prior semantic information and further introduces a textual–semantic alignment mechanism to improve the consistency and expressiveness of multimodal features. Benefiting from its lightweight hierarchical design, our model offers excellent deployment flexibility, making it well suited for resource-constrained UAV applications. Experimental results on large-scale benchmark datasets, including NTU60, NTU120 and UAV-human, demonstrate that MSG-GCN surpasses state-of-the-art methods in both classification accuracy and computational efficiency.