Decoding Medical Language Using Optical Character Recognition and Large Language Models
Poonam Chaudhary, Raveesh Yadav, Riya Sharma, Ajay Kumar, Ashish Kumar · 2025
Reading and understanding medical reports are challenges because of a lack of specialized medical knowledge, especially with the increasing use of high-level medical terminology. This obstacle hinders effective communication between healthcare providers and patients, which can lead to misunderstandings and nonoptimal healthcare outcomes. To address this challenge, the authors of this chapter proposes an innovative solution of integrating large language models (LLMs) and optical character recognition (OCR). The OCR technology extracts the texts from medical documents that are input to the LLM module. The text containing complex medical terminology within reports from medical documents is then interpreted and decoded to better understand the medical reports. The authors combined the two technologies together to better understand medical reports and help improve how patients and healthcare providers communicate, leading to better healthcare for everyone.