Learning for Feature Matching via Graph Context Attention
Junwen Guo, Guobao Xiao, Zhimin Tang, Shunxing Chen, Shiping Wang, Jiayi Ma · IEEE Transactions on Geoscience and Remote Sensing · 2023
Establishing reliable correspondences via a deep learning network is an important task in remote sensing, photogrammetry and other computer vision fields. It usually requires mining the relationship among correspondences to aggregate both local and global context. However, current methods are insufficient to effectively acquire context information with high reliability. In this paper, we propose a graph context attention based network (called GCA-Net) to capture and leverage abundant contextual information for feature matching. Specifically, we design a graph context attention block which generates multi-path graph contexts and softly fuses them to combine respective advantages. In addition, for building the graph context containing stronger representation ability and outlier resistance ability, we further design a local-global channel mining block to gather context information by focusing on the significant part as well as to mine dependencies among channels of correspondences in both local and global aspects. The proposed GCA-Net is able to effectively infer the probability of correspondences being inliers or outliers and estimate the essential matrix meanwhile. Extensive experimental results for outlier removal and relative pose estimation demonstrate that GCA-Net outperforms the state-of-art methods on both outdoor and indoor datasets (i.e.,YFCC100M and SUN3D). In addition, experiments extended to remote sensing and point cloud scenes also demonstrate the powerful generalization capability of our network.