One Year On: Assessing Progress of Multimodal Large Language Model Performance on RSNA 2024 Case of the Day Questions
Benjamin Hou, Pritam Mukherjee, Vivek Batheja, Kenneth C. Wang, Ronald M. Summers, Zhiyong Lu · Radiology · 2025
Multimodal large language models have significantly improved in assessing RSNA Case of the Day Questions over the past year, with OpenAI’s latest models outperforming those from Google and Meta; notably, OpenAI o1 had an accuracy comparable to expert radiologists.