Eyes for the Elderly
Soham Agarwal, Sanatan Sukhija, Yayati Gupta · 2023
Vision impairment is one of the most prominent health issues in the elderly leading them to face many complications inside their living quarters. This paper proposes an Artificial Intelligence (AI) tool called Eyes for the Elderly which communicates with the target demographic to enable the elderly to locate objects in their vicinity. The textual data derived from the audio is used in parallel with a custom-trained YOLOv5 (You Only Look Once) algorithm. The snapshots from the video feed captured with a low-budget camera are fed into this model. The tool then calculates the IOU (Intersection Over Union) between the bounding boxes of the detected objects thereby locating the objects with respect to each other (e.g. "The phone is on the bed"). The location of the household item is returned as an audio response. This allows the target demographic to make up for their loss of vision to a certain degree. The tool is integrated into a web application built on Flask. The interface enables the visually impaired to quickly and efficiently locate personal belongings in multiple areas inside their homes.