Efficiency and Effectiveness Measures To Help Guide the Business of Software Testing
Jon T. Huber · 1999
paper is based on actual Hewlett Packard work experience. The results of the Process Metrics team will be discussed. The Process Metrics team was part of a special 100 day effort to identify ways to improve the current Software Testing processes, infrastructure, and measurement. The specific focus of the Process Metrics team was to identify and define efficiency and effectiveness metrics for the Boise LaserJet Test Lab. The Process Metrics team consisted of five members who contributed approximately 10-20 hours per week for a three month period. This is a total of approximately 900 engineering hours (15 hours p/week * 5 engineers * 12 weeks). This paper will explain what metrics were chosen and what process was used to select the metrics. This paper will enable other Software Testing organizations to examine their current metrics solution and adjust it to better meet the needs of Software Testing. Introductionrecent years, many Software Testing organizations have often been services funded by Software Development organizations. As a result, the measurements reported by Software Testing organizations have often been tailored to fit the needs of Software Development. Although it is important to measure the quality of the product under development, it is equally important to measure the effectiveness and efficiency of Software Testing itself as an activity - not a service. Specifically, the measurements described in this paper first answers the question of whether Software Testing is doing the (effectiveness). Once there is assurance and quantification of correct testing, metrics should be developed that determine whether or not Software Testing does the thing right (efficiency). By measuring effectiveness and efficiency, a Software Testing organization can better communicate its own importance using factual information. This enables Software Testing organizations to break free from the misconception that Software Testing measurement should concentrate on issues important to the Software Development community.