Rahul Patil at SemEval-2023 Task 1: V-WSD: Visual Word Sense Disambiguation
Rahul Patil, Pinal Patel, C. I. Chandas Patel, M. K. S. Verma · 2023
Semeval 2023 task 1: Visual-WSD, In this paper, we propose an ensemble of two Neural network systems that ranks 10 images given a word and limited textual context.We have used OpenAI CLIP based models for the English language and multilingual text-to-text translation models for Farsi-to-English and Italian-to-English.Additionally, we propose a system that learns from multilingual bert-base embeddings for text and ResNet101 embeddings for the image.Considering all three languages into account this system has achieved the fourth rank.