Effective deep-learning brain MRI super resolution using simulated training data
Aymen Ayaz, Rien Boonstoppel, Cristian Lorenz, Juergen Weese, Josien P. W. Pluim, Marcel M. Breeuwer · Computers in Biology and Medicine · 2024
In the field of medical imaging, high-resolution (HR) magnetic resonance imaging (MRI) is essential for accurate disease diagnosis and analysis. However, HR imaging is prone to artifacts and is not universally available. Consequently, low-resolution (LR) MRI images are typically acquired. Deep learning (DL)-based super-resolution (SR) techniques can transform LR images into HR quality. However, these techniques require paired HR-LR data for training the SR networks. This research aims to investigate the potential of simulated brain MRI data to train DL-based SR networks. We simulated a large set of anatomically diverse, voxel-aligned, and artifact-free brain MRI data at different resolutions. We utilized this simulated data to train four distinct DL-based SR networks and augment their training. The trained networks were then evaluated using real data from various sources. With our trained networks, we produced 0 . 7 mm SR images from standard 1 mm resolution multi-source T1w brain MRI. Our experimental results demonstrate that the trained networks significantly enhance the sharpness of LR input MR images. For single-source images, the performance of networks trained solely on simulated data is slightly inferior to those trained solely on real data, with an average structural similarity index (SSIM) difference of 0.025. However, networks augmented with simulated data outperform those trained on single-source real data when evaluated across datasets from multiple sources. Paired HR-LR simulated brain MRI data is suitable for training and augmenting diverse brain MRI SR networks. Augmenting the training data with simulated data can enhance the generalizability of the SR networks across real datasets from multiple sources. • Large number of voxel-aligned and artifact-free paired HR-LR T1w brain MRI data is simulated. • Simulated brain MR images are suitable for training and augmenting brain MRI SR network. • Simulated images are useful across diverse SR networks, including GANs, CNNs, residual networks and Unets. • Networks augmented with simulated data performs better across multi-source dataset compared to the networks trained on real data only.