Winscaleformer: Diffusion-Attention-Based Single Remote Sensing Image Dehazing
Nan Liu, Yi-Horng Lai, Xiaoping You, Wenqiong Zhang, Jiaen Wang, Haoxin Wu, Xian Yu · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 2025
The Transformer architecture has demonstrated outstanding performance in image dehazing with its global modeling capability. However, it suffers from a quadratic computational complexity bottleneck when processing high-resolution images, leading to the restriction of attention mechanisms to local computations, which fails to effectively capture global dependencies between distant pixels in images. To address these challenges, this paper proposes a novel diffusion attention mechanism that can perform efficient global feature modeling while reducing computational overhead. Specifically, this study adopts a window-based Transformer architecture. First, a sub-block partitioning strategy is implemented within local windows, where homogeneous attention weights are applied to adjacent sub-blocks, enabling window size expansion while maintaining constant computational cost.Then, a Clarity Mixing module is proposed to alleviate the weakening of intra-block information interaction. Simultaneously, Snake-Scan Block Displacement is applied to move and reorganize the image in block units without disrupting image continuity, strengthening information connections between different windows. Additionally, we collected a large-scale non-uniform remote sensing dehazing dataset RSHaze5K for evaluating the dehazing capability of networks on heterogeneous images. Experimental results indicate that this method achieves over 30 dB PSNR on the RSHaze5K dataset, reaching SOTA. Compared to the standard Swin Transformer architecture, our model possesses a larger receptive field without increasing computational cost, offering greater advantages when dealing with high-resolution images.The code and dataset are publicly available athttps://github.com/liunanwangxing/my_Winscaleformer.