Multi-Contrast MRI Image Translation via Pathology-Aware Generative Adversarial Networks
Mohamed Hosny Abdallah, M. Rasmy, Muhammad Ali Rushdi · 2023
Multi-contrast magnetic resonance imaging (MRI) sequences reflect different tissue characteristics, and thus such sequences are crucial for clinical and non-clinical applications. However, the acquisition of these MRI sequences is both financially and computationally expensive. In order to alleviate these expenses, cross-modality MRI image translation schemes have been proposed to transform an MRI image of one contrast (or modality) to another. Image translation has been primarily based on deep learning architectures, especially generative adversarial networks (GAN). Most of the GAN-based methods focus on matching voxel values and anatomical structures, irrespective of whether the region is normal or abnormal. In this paper, we present a pathology-aware GAN (Pa-GAN) architecture which exploits MRI contrast images and segmentation masks for pathological areas in order to explicitly differentiate between normal and pathological tissues in the multi-contrast MRI image translation process. This framework leads to the synthesis of MRI images with better anatomical details in the normal & abnormal regions. We employed edge-based, gradient-based, and mean-absolute-error (MAE) loss functions in order to ensure the structural integrity of the synthesized MRI images. Extensive experiments were conducted on the BraTS 2015 dataset for T1-weighted (T1W)-to-T2-weighted (T2W) MRI image translation. The proposed architecture achieved promising qualitative and quantitative results with average structural similarity index (SSIM) and peak signal-to-noise ratio (PSNR) metrics of 0.972 and 34.83 dB, respectively.