Reppoints-Based Multiscale Task Enhancement Network and Sample Assignment Method for Oriented Object Detection
Yibing Li, Zifan Li, Fang Ye, Tao Jiang · IEEE Geoscience and Remote Sensing Letters · 2023
Unlike normal images, remote sensing images (RSI) often contain complex backgrounds and multi-scale targets with arbitrary directions. This makes existing detection methods ineffective. In contrast to the usual rotating frame RSI target detection methods, the Reppoints-based method can learn autonomously to capture target features of arbitrary pose based on the target’s characteristics. Therefore, a new Reppoints-based detector is proposed in this letter to improve the accuracy from multiple perspectives. In order to better expand the receptive fields and obtain finer features, the multi-scale task enhancement Network (MSTEN) preserves the multi-scale receptive fields and multi-scale information through the deformable convolution and the skip connection, while improving the feature extraction capability of the network for targets of arbitrary orientation. At the same time, the network adapts the features to the characteristics of different tasks in order to better suit the needs of the respective tasks. Finally, the dynamic reppoints learning (DRL) is proposed in order to select samples that perform well in both the regression and classification tasks. The experimental results on two challenging datasets, DOTA and HRSC2016, show the effectiveness of our proposed method.