heiDS at ArchEHR-QA 2025: From Fixed-k to Query-dependent-k for Retrieval Augmented Generation

Ashish Pratap Singh Chouhan, Michael Gertz · 2025

This paper presents the approach of our team called heiDS for the ArchEHR-QA 2025 shared task.A pipeline using a retrieval augmented generation (RAG) framework is designed to generate answers that are attributed to clinical evidence from the electronic health records (EHRs) of patients in response to patientspecific questions.We explored various components of a RAG framework, focusing on ranked list truncation (RLT) retrieval strategies and attribution approaches.Instead of using a fixed top-k RLT retrieval strategy, we employ a query-dependent-k retrieval strategy, including the existing surprise and autocut methods and two new methods proposed in this work, autocut* and elbow.The experimental results show the benefits of our strategy in producing factual and relevant answers when compared to a fixed-k.

Read the paper · More papers on PaperTik