Team Papelo at FEVEROUS: Multi-hop Evidence Pursuit
Christopher D. Malon · 2021
We develop a system for the FEVEROUS fact extraction and verification task that ranks an initial set of potential evidence and then pursues missing evidence in subsequent hops by trying to generate it, with a "next hop prediction module" whose output is matched against page elements in a predicted article.Seeking evidence with the next hop prediction module continues to improve FEVEROUS score for up to seven hops.Label classification is trained on possibly incomplete extracted evidence chains, utilizing hints that facilitate numerical comparison.The system achieves .281FEVEROUS score and .658label accuracy on the development set, and finishes in second place with .259FEVEROUS score and .576label accuracy on the test set.