A Survey on Image Encoders and Language Models for Image Captioning

Himanshu Sharma · IOP Conference Series Materials Science and Engineering · 2021

Abstract Generating a natural language explanation for a given image is known as image captioning. An image captioning method aims to determine the significant objects present in an image together with the relationship between these objects. Also, the model has the capability to describe an image by a syntactically and semantically correct sentence. For image encoding, convolutional neural network {CNN] is applied and for producing natural language descriptions for a given image, language models (RNN & LSTM etc.) are employed. In this paper, the image encoders and language models used by the state-of-the-art image captioning models is discussed.

Read the paper · More papers on PaperTik