AnnoLoom : Augmenting Codebook Generation and Annotation with Large Language Models
Lu Wang, Duncan Lynch, Elham Aghakhani, George Demiris, Karla Washington, Rezvaneh Rezapour, Jina Huh · Proceedings of the Association for Information Science and Technology · 2025
ABSTRACT We introduce AnnoLoom, a tool designed to assist researchers with codebook development, annotation tasks, and evaluation of human vs. AI's annotation results. AnnoLoom contributes to human expert‐AI collaboration and its efficacy in the context of using Large Language Models (LLMs) for research involving text‐based data. We conducted a cognitive walkthrough to iteratively improve the design of AnnoLoom and discussed the future work.