Domain-Specific Question-Answering Systems: A Case Study of a Carbon Neutrality Knowledge Base
Lei Liu, Yongzhang Zhou, Jianhua Ma, Yuqing Zhang, Luhao He · Sustainability · 2025
Carbon neutrality is a critical global objective in the fight against climate change. As relevant knowledge and technologies advance rapidly, there is an escalating demand for sophisticated intelligent services. While large language models (LLMs) have demonstrated considerable promise in knowledge processing and generation, their application within the domain of carbon neutrality remains in the early stages of exploration. This study develops a carbon neutrality knowledge base (CN Knowledge Base) using the ChatGLM3 model aimed at enhancing question-answering capabilities in areas such as carbon emission monitoring, policy interpretation, and technical optimization. By refining domain-specific corpora and integrating a Retrieval-Augmented Generation (RAG) mechanism, the model’s ability to generate accurate and relevant responses is improved. To evaluate the performance of the proposed system, a comprehensive quantitative comparison is conducted using established evaluation metrics, including BLEU (Bilingual Evaluation Understudy), BERT (Bidirectional Encoder Representations from Transformers), and METEOR (Metric for Evaluation of Translation with Explicit Ordering). The CN Knowledge Base is benchmarked against leading models such as GPT-4, Gemini, and Bing. The results demonstrate that the CN Knowledge Base outperforms other models in METEOR (0.2697) and is comparable to GPT-4o in both BLEU (0.8755) and BERT (0.8260) Scores (GPT-4o: BLEU: 0.8784, BERT: 0.8404). These findings underscore the knowledge base’s strong adaptability and its ability to generate high-quality, domain-specific content. The study suggests that specialized models can overcome the limitations of general-purpose LLMs, particularly in precise terminology and accurate application of domain knowledge. With continued development, such models could significantly enhance digital and intelligent solutions for carbon neutrality and related fields.