Use of eye tracking in instrument construction and/or validity studies: Scoping Review
Francisco Wagner dos Santos Sousa, André Castelo Branco Soares, Francisco Lucas de Lima Fontes, Glauber Cavalcante Oliveira, Luana Savana Nascimento de Sousa Arruda, José Wicto Pereira Borges · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · 2025
Aims to map the evidence on the use of eye tracking in studies on instruments' construction and/or validity. This is a scoping review, based on Joanna Briggs Institute, protocol is registered in the Open Science Framework. Searches were carried out in EMBASE; SCOPUS; Web of Science; MEDLINE/PubMed; CINAHL; LILACS, PsycINFO and gray literature. Eligibility criteria: studies with no time frame or languages, which used eye tracking in the instrument's construction and/or evidence of validity and exclusion: ongoing studies, letters to the editor, abstracts. A total of 26 studies were included in the final sample. Eye tracking was used in a variety of ways to construct and/or validate instruments, with a greater focus on experimental studies, with multiple-choice questionnaires, the item reading process, to check the order and format of questionnaire responses, to evaluate complex questions and improved versions of instruments, response processes, learning styles, asthenopia, cognitive impairment and capacity, discrete choice and instrument reliability, in facial emotion recognition. The main metrics collected were fixation rates and duration, areas of interest, dwell time, GazePlot and Heatmap, saccades and refixation rates; dwell time, GazePlot and Heatmap, saccades and refixation rate. Eye tracking has been used in investigative approaches based on the validity of multiple-choice questionnaires, adapted and applied in exploratory research, the focus of which is to analyze the option order, format, item writing, response style and cognitive evaluations of the participants' response process.