Integrating Large Language Model and Mental Model of Others: Studies on Dialogue Communication Based on Implicature
Ayu Iida, Kohei Okuoka, Satoko Fukuda, Takashi Omori, Ryoichi Nakashima, Masahiko Osawa · 2024
Despite the significant development of Large Language Models (LLMs), they struggle with “dialogue communication based on implicature,” which humans handle easily. In this study, we aim to improve the performance of LLMs in this type of dialogue tasks by integrating LLMs with a cognitive model of dialogue. The cognitive model of dialogue comprises beliefs, desires, and intentions, which is defined as the Mental Model of Others (MMO) for predicting or estimating other’s mental states and behaviors. We propose two integration methods: the LLM Embedded in Cognitive Model (LEC) and the Cognitive Model Embedded in LLM (CEL). We examined the performances of our proposed method using the dialogue task, showing that the LEC can respond appropriately in the dialogues with implicatures, which cannot be achieved by conventional LLMs.