Test-Retest Reliability of the Open Card Sorting Method
Styliani Pampoukidou, Christos Katsanos · 2021
Open card sorting is a popular method for designing information architectures. However, there is a lack of empirical evidence on the validity and reliability of the method. This paper explores the test-retest reliability of open card sorting. To this end, a within-subjects study was conducted. The same participants performed open card sorts twice with a time interval of 15-20 days. Content from three website domains was used: an eshop, a travel and tourism website, and a university website. Results showed that participants provided highly similar groupings and labels between the two card sorts per domain. A high agreement of the produced navigation structures was also found. These findings provide support for the test-retest reliability of open card sorting.