Evidence-Based Fusion for Low-Quality RGB-T Semantic Segmentation
Wenli Liang, Xiaolin Zhang, Yuanjian Yang, Caifeng Shan · IEEE Sensors Journal · 2025
In recent years, significant progress has been made in RGB-Thermal (RGB-T) semantic segmentation. However, most methods assume optimal imaging conditions, overlooking real-world challenges, such as sensor noises, blur, extreme weather, or transmission errors. These factors can lead to inconsistent information across RGB and thermal modalities, degrading segmentation performance. To address this, we propose an Evidence-based Fusion Network (EBFNet) to enhance segmentation accuracy for low-quality RGB-T inputs. Concretely, our approach tackles inconsistent modal information by introducing an Evidence-based Consistency Loss, which quantifies and mitigates conflicts between modalities using a Dirichlet distribution to model decision reliability. Building on this, we design a Discrepancy Priority Fusion Module. It fuses RGB and thermal features by prioritizing reliable ones using discrepancy maps. This enhances feature integration, boosting robustness for low-quality inputs. For evaluation, we construct low-quality versions of the MFNet and PST900 datasets by simulating real-world degradations. Extensive experiments on these datasets demonstrate that EBFNet outperforms state-of-the-art methods in low-quality RGB-T semantic segmentation.