A Novel Unsupervised Domain Adaption Method for Depth-Guided Semantic Segmentation Using Coarse-to-Fine Alignment
Kieu Dang Nam, Tu Minh Nguyen, Trinh V. Dieu, Muriel Visani, Thi-Oanh Nguyen, Dinh Viet Sang · IEEE Access · 2022
Domain adaptation methods in machine learning deal with the domain shift issue by aligning source and target data representation. This paper proposes a novel domain adaptation method for semantic segmentation that exploits the Fourier transform on chromatic space to improve the quality of style transfer, and generates pseudo-labels for self-training by combining the results from different teachers obtained at different rounds of self-training. Our method also applies class-level adversarial learning to achieve a more fine-grained alignment between the two domains, and a late fusion with a depth-estimation model to improve its segmentation outputs. Experiments show that our method yields superior performance in terms of accuracy compared to other existing state-of-the-art methods.