Semantic CMR Synthesis: Generating Coherent Short- and Long-Axis Images with Corresponding Multi-Class Anatomical Labels

Thomas Joyce, Nico Schulthess, Gloria Wolkerstorfer, Stefano Buoso, Sebastian Kozerke · Proceedings on CD-ROM - International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition/Proceedings of the International Society for Magnetic Resonance in Medicine, Scientific Meeting and Exhibition · 2023

We propose to use a combination of the StyleGAN2, ADA and DatasetGAN methods to produce synthetic short- and long-axis view cardiac magnetic resonance (CMR) images accompanied with corresponding 11-class tissue masks. The image generator networks are trained on datasets of approximately 1850 and 5000 unlabelled images, for short- and long-axis images respectively. The segmentation networks are trained on only 30 manually annotated synthetic images in total. We further demonstrate a proof-of-concept method for generating coherent long- and short-axis images of the same synthetic patient.

Read the paper · More papers on PaperTik