A Machine Learning Model for Augmenting the Media Accessibility for the Disabled People
Hari Krishnan Andi, S. Senbagam, Dilip Kumar Sharma, Mayura Vishal Shelke, N. K. Senthil Kumar, Ramesh Chandra Poonia · 2023
In an era characterized by the proliferation of digital media, the need to efficiently use multimedia content has become paramount. This article discusses an innovative technique called “Fast Captioning (FC)” to improve media accessibility, especially for people with disabilities and others with time restrictions. Modern Machine Learning (ML) algorithms are incorporated into the framework, which speeds up video consumption while maintaining content coherence. The procedure includes extracting complex features like Word2Vec embeddings, part-of-speech tags, named entities, and syntactic relationships. Using annotated data, a ML model is trained to forecast semantic similarity scores between words and frames. The predicted scores seamlessly integrate into equations that calculate similarity, thus enhancing content comprehension. Through this all-encompassing approach, the article offers a comprehensive solution that balances the requirements of contemporary media with the accessibility requirements of people with disabilities, producing a more inclusive digital environment. Machine Learning-based Media Augmentation (ML-MA) has achieved the highest accuracy of 96%, and the captioning is accurate.