A Benchmark Comparison of a Domain-Focused Pipeline with ChatGPT
Chen Zhang, Tingting Zhao, Hakan Saraoğlu, David A. Louton · Journal of Computer Information Systems · 2025
This paper presents a framework for generating domain-specific questions and retrieving answers from a target-domain text corpus. The approach involves fine-tuning a model to deliver concise answers tailored to mutual funds in finance. Using open-source tools and datasets, the proposed pipeline achieves accuracy levels comparable to ChatGPT, while offering key advantages such as customizable domain-specific corpora, reduced training time, and lower costs. Benchmarking results highlight its effectiveness and potential as a cost-efficient alternative for domain-focused question answering.