UHH at AVeriTeC: RAG for Fact-Checking with Real-World Claims
Özge Sevgili, Irina Nikolaevna Nikishina, Seid Muhie Yimam, Martin Semmann, Chris Biemann · 2024
This paper presents UHH's approach developed for the AVeriTeC shared task.The goal of the challenge is to verify given real-world claims with evidences from the Web.In this shared task, we investigate a Retrieval-Augmented Generation (RAG) model, which mainly contains retrieval, generation, and augmentation components.We start with the selection of the top 10k evidences via BM25 scores, and continue with two approaches to retrieve the most similar evidences: (1) to retrieve top 10 evidences through vector similarity, generate questions for them, and rerank them or (2) to generate questions for the claim and retrieve the most similar evidence, again, through vector similarity.After retrieving the top evidences, a Large Language Model (LLM) is prompted using the claim along with either all evidences or individual evidence to predict the label.Our system submission, UHH, using the first approach and individual evidence prompts, ranks 6th out of 23 systems.Refuted Q: What is Nigeria's current estimated population?A: With a population of roughly 200 million people, Nigeria's Supported Supported Supported Q: What is the current population estimate for Nigeria?A: Nigeria's population is projected to reach 262.9 and 401.3 million people in 2030 and 2050, respectively.Refuted Q: What is the current estimated population of Nigeria?A: The population of Nigeria is currently estimated at 198 million, with an annual Supported Q: What is Nigeria's estimated population in comparison to 200 million?A: With over 220 million people, Nigeria is the most populated country in Africa and the sixth in the world.Refuted Q: What is the estimated population of Nigeria?A: Nigeria has a population of 180 million people (seventh largest in the world) and an economy worth more than $500 billion (21st in the world).Refuted Q: Is Nigeria currently the most populous country in Africa?A: Nigeria is the most populous country in Africa and the eighth most populous country in the world, with approximately 162 million people.Supported Q: What was Nigeria's population in 2021?A: -The population of Nigeria in 2021 was 213,401,323, a 2.44% increase from 2020.Supported Q: What was Nigeria's population in 2022?A: -The population of Nigeria in 2022 was 218,541,212, a 2.41% increase from 2021.Supported Q: What was Nigeria's population in 2020?A: Nigeria had a population of 206.14 million people (2020) with an annual population growth rate of 2.5%.