NA‐Reviewer: Reviewing the context to improve the error accumulation issue for multi‐hop QA
Ruiliu Fu, Han Wang, Jun Zhou, Xuejun Zhang · Electronics Letters · 2021
Abstract The multi‐hop question answering (QA) task requires the machine to answer the question correctly and at the same time provide evidence clues. Some pipeline methods have achieved great results in answer accuracy and interpretability, while a obvious drawback of these pipeline methods is the error accumulation issue. In this letter, we propose a NA‐Reviewer method to improve the error accumulation issue in multi‐hop QA task. It consists of two parts: an NA‐Discriminator and a Reviewer, where the NA‐Discriminator transforms the error accumulation issue into an unanswered discrimination task, and the Reviewer corrects the error by reviewing the context according the error clues. We conducted experiments on the 2WikiMultiHopQA dataset. Compared with the previous state‐of‐the‐art works, the proposed NA‐Reviewer method have increased the F1 value by 4.27 percentage points, and compared to the ablation model without the NA‐Reviewer method, it has increased the F1 value by 9.58 percentage points, which significantly improves the error accumulation issue.