MM-PoE: Multiple Choice Reasoning via. Process of Elimination using Multi-Modal Models
Sayak Chakrabarty, Souradip Pal · The Journal of Open Source Software · 2025
This paper introduces Multiple Choice Reasoning via.Process of Elimination using Multi-Modal models, also known as Multi-Modal Process of Elimination (MM-PoE), is a method to enhance vision language models' performance on multiple choice visual reasoning tasks by employing a two-step scoring system that first eliminates incorrect options and then predicts from the remaining ones.Our experiments across three question-answering datasets show the method's effectiveness, particularly in visual reasoning tasks.This method addresses one of the key limitations of the paper (Ma & Du, 2023) by extending to tasks involving multi-modalities and also includes experimentation techniques for few-shot settings.