Analyzing Data From A Pilot Test Administration
Fernando Cartwright · 2015
Introduces the analysis of pilot test data using the Item and Test Analysis (IATA) by describing the steps in an analysis of data from a pilot test administration. The stages in the workflow include (1) loading of data, (2) specification of the analysis, (3) item analysis, (4) dimensional analysis, (5) analysis of differential item functioning, and (6) item selection. Scale scores or performance standards remain uncalculated because the distribution of proficiency in the pilot sample will likely not prove representative of the population. For all analysis workflows, IATA produces a number of different results in data table format, allowing for viewing and saving on the final interface of each workflow. For a real pilot test analysis, the results tables and any graphics should provide test developers the information needed to modify the test by selecting, ordering, and adding items to maximize the accuracy and usefulness of the final test form.