Cross-Modal Transfer Learning Methods for Alzheimer's Disease Diagnosis
Pedro Paulo Gomes Pereira, Margarida Silveira · 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) · 2022
In this paper we propose cross-modal transfer learning for Alzheimer's disease detection. We use positron emission tomography (PET) and magnetic resonance imaging (MRI) brain scans from ADNI to train convolutional neural networks (CNNs) on one modality and fine-tune it on the other modality. We start by showing that cross-modal transfer learning approaches outperform CNNs trained from scratch on a single modality. We then show that cross-modal transfer-learning also outperforms multimodal approaches using the same data.