Digital Assistant for Visually Impaired People
Thuvaraka Thayaparan, Sanjay Jayakumar, Borsatto Fernando, Gobisan Ananthanadarajan, Lakmini Abeywardana, Dharshana Kasthurirathna · 2023
This research paper presents a comprehensive exploration of various components to enhance the capabilities of a digital assistant tailored for visually impaired individuals. The first component explores how various image captioning architectures and Vision Encoder Decoder models can be used for better environmental interaction. The second component concerns with facial expression recognition for better social interaction and the third component is a currency note identification component that aims to aid visually impaired individuals with cash transaction whilst the final component that explores a voice bot aims to improve a voice bot and how to manage accents, speech accuracy and naturality using modern deep learning techniques. By investigating these components, this research advances assistive technology, empowering visually impaired individuals with a conversational digital assistant that enhances environmental interaction, supports social interactions, and aids in currency identification.