Basic Attributes Test: Psychometric Equating of a Computer-Based Test
Thomas R. Carretta, Malcolm James Ree · International Journal of Aviation Psychology · 1993
The U.S. Air Force will implement a new pilot candidate selection composite based on scores from a paper-and-pencil multiple aptitude test, a computer-based test, and biographical information. A selection composite score derived from these variables will be used to indicate the probability of success in undergraduate pilot training. The purpose of this study was to equate the experimental and operational computer-based tests. The preimplementation equating was necessary (a) to determine whether the tests measured the same psychological constructs, (b) to compare the score distributions of the two computer-based tests, and (c) to develop equating tables. Equating was required so that scores from operational tests could be used in proposed pilot candidate selection equations developed on the basis of the experimental tests. Experimental and operational tests were administered to 2,034 basic recruits. Analyses were performed at the test-score and composite-score level, and several types of equatings were completed. Adjusted correlations between the experimental and operational computer-based tests were acceptable, demonstrating construct validity. Differences in the shapes of the distributions (i.e., skewness, kurtosis) for several scores on the computer-based tests were observed. Several types of equatings (linear, equipercentile, smoothed equipercentile) were performed to develop conversion tables for use during implementation of the operational tests.