LTRC_IIITH’s 2023 Submission for Prompting Large Language Models as Explainable Metrics Task
Pavan Baswani, Ananya Mukherjee, Manish Shrivastava · 2023
In this report, we share our contribution to the Eval4NLP Shared Task titled "Prompting Large Language Models as Explainable Metrics."We build our prompts with a primary focus on effective prompting strategies, score-aggregation, and explainability for LLMbased metrics.We participated in the track for smaller models by submitting the scores along with their explanations.According to the Kendall correlation scores on the leaderboard, our MT evaluation submission ranks second-best, while our summarization evaluation submission ranks fourth, with only a 0.06 difference from the leading submission.