Humans in Empirical Software Engineering Studies: An Experience Report
Bonita Sharif, Niloofar Mansoor · 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · 2022
The use of human validation in software engineering methods, tools, and processes is crucial to understanding how these artifacts actually impact the people using them. In this paper, we report our experiences on two methods of data collection we have used in software engineering empirical studies, namely online questionnaire-based data collection and in-person eye tracking data collection using eye tracking equipment. The design and instrumentation challenges we faced are discussed with possible ways to mitigate them. We conclude with some guidelines and our vision for the future in human-centric studies in software engineering.