Leveraging fine-tuning of large language models for aspect-based sentiment analysis in resource-scarce environments
Jakob Fehle, Udo Kruschwitz, Nils Constantin Hellwig, Christian G. Wolff · Knowledge-Based Systems · 2026
• Our fine-tuned LLM handles resource-scarce scenarios better than previous SOTA approaches. • An instruction-fine-tuned LlaMA 3 8B achieves new SOTA performance for the ACSA and E2E tasks on the Rest-16 dataset and for the ACSA and TASD tasks for GERestaurant. • Few-shot prompting shows promising results, though fine-tuned LLMs typically achieve better results and are more efficient. • For fine-tuning LLMs, concise prompts are usually sufficient if combined with well-optimized hyperparameters. This study explores the use of fine-tuned open source large language models (LLMs) for Aspect-based Sentiment Analysis (ABSA), comparing their performance with state-of-the-art (SOTA) methods on English and German datasets with focus on low-resource scenarios. Results on the four ABSA subtasks Aspect Category Detection (ACD), Aspect Category Sentiment Analysis (ACSA), End-To-End-ABSA (E2E), and Target Aspect Sentiment Detection (TASD) show that fine-tuned LLMs handle limited training data scenarios better than current SOTA approaches, achieving consistent performance across various dataset sizes. Prompt formulation and hyperparameter tuning influence performance, though concise prompts often suffice when combined with effective fine-tuning. To assess generalizability, we conduct an ablation study across multiple languages, domains, and LLM architectures. The findings confirm that performance gains extend beyond the initial setting, supporting the robustness of fine-tuned LLMs over multiple different languages and domains. We establish new SOTA results on the Rest-16 and GERestaurant datasets and highlight the practical viability of fine-tuning LLMs for ABSA applications under limited training material.