CustomSight: Enhancing LLM-Powered Visual Assistance for Blind Individuals using Goal-Directed Dynamic Filters

Adil Rahman, Rifat Rahman Khan, Jonggi Hong, Stephanie Valencia, Seongkook Heo · 2025

Figure 1: Computer vision-based assistive apps offer unstructured feedback, while LLM-based visual question answering apps require well-framed images, often challenging without sight.CustomSight creates Dynamic Filters to automatically capture goal-relevant images and query the LLM to assist BVI individuals in accessing targeted visual information effectively.

Read the paper · More papers on PaperTik