Deep Learning Models Connecting Images and Text: A Primer for Radiologists
Andrew Wu, Merve Kulbay, Phillip M. Cheng, Alexandre Cadrin-Chênevert, Laurent Létourneau‐Guillon, Gabriel Chartrand, Jaron Chong, Emmanuel Montagnon, Ismail Ben Ayed, An Tang · Radiographics · 2025
Multimodal models integrate and interpret multiple types of data such as images, videos, text, and numbers simultaneously. Potential clinical applications of these models include automated captioning of medical images, generation of the preliminary radiology report, and creation of educational images. These advances may enable case prioritization, streamlining of clinical workflows, and improvements in diagnostic accuracy. Published under a CC BY 4.0 license.