Combining methods to evaluate mobile usability
Elisabeth Lesemann, Natalie Woletz, Sven Koerber · 2007
In this paper, we will discuss the deployment of quantitative and qualitative methods with focus on our special situation as being an external usability consultancy. We will report on two case studies in which we used different approaches to collect quantitative data from a large sample as well as qualitative data from a smaller sub-sample. In a simplified way, user tests in study 1 consisted of two phases, a first to collect quantitative data and a second to collect qualitative data. In study 2, quantitative and qualitative data were collected alternately. Qualitative data collection was skipped by a sub-sample in both studies. We will discuss methodological weaknesses of combined designs and how they can nevertheless be used to yield good results at a reasonable cost in a short amount of time. From our experience, we conclude that the approach used in study 1 proved to be more efficient concerning time and costs. From a methodological viewpoint, we will argue that the approach used in study 1 yielded satisfactory results for quantitative as well as qualitative measurements.