Differential Enhancement and Commonality Fusion for RGBT Tracking
Yang Jianrong, Enzeng Dong, Jigang Tong, Sen Yang, Zufeng Zhang, Wenyu Li · 2023
Target tracking is a fundamental task and an important part in the field of computer vision. The image information contained in the visible (RGB) modality and thermal infrared (T) modality has differences. RGBT tracking utilizes this difference to fuse the information of the two modalities, fully combining the uniqueness and complementarity of the information of the two modalities. How to maximize the uniqueness of individual modalities in RGBT tracking and how to effectively combine the complementarity of the two modalities is the key issue in RGBT tracking. For the combination of the uniqueness and complementarity of the two modalities, a novel Differential Enhancement and Commonality Fusion Network (DECFNet) is designed in this paper, in which the main components include a feature enhancement module for the visible modality and a feature enhancement module for the thermal infrared modality, as well as a fusion module that effectively fuses the information of both. The results on three RGB T tracking benchmark datasets demonstrate the effectiveness of the proposed method.