A Deep Learning-Based Efficient Image Captioning Approach for Hindi Language

Vishal Jayaswal, Rajneesh Rani, Jagdeep Kaur · Advances in systems analysis, software engineering, and high performance computing book series · 2024

The image caption is a statement that simply conveys the contents of an image. The technique of picture captioning requires both digital image processing and natural language processing. Previously, the majority of research was completed in English language for image captioning. But research work for the Hindi language is much less. Hindi is the national language of India, and the fourth most widely spoken language in the world. The vast majority of Indians speak Hindi. This was the main cause behind the choice to develop a Hindi-language picture captioning algorithm. In this chapter, an effective deep learning-based photo captioning model based on encoder-decoder for the Hindi language is proposed. The encoding process utilizes a convolution neural network (CNN), while the decoding process employs a recurrent neural network (RNN) with an attention mechanism. For the implementation, the Hindi version of the Flickr 8k dataset is used and to evaluate the performance of image captioning, BLEU score is used.

Read the paper · More papers on PaperTik