Application of Generalizability Theory and Many-facet Rasch Model in Developing a Speaking Test for Prospective Secondary School English Teachers
Haiyan Sun · Wai-yu yu wai-yu jiaoxue · 2011
Taking Generalizability Theory and Many-facet Rasch Model as its theoretical basis,this study investigates the reliability and validity of a trial test results of a speaking test for prospective secondary school English teachers by using GENOVA and FACETS.The results of the GENOVA analysis showed that the dependability of the test would not change much if fewer tasks were included in the test,whereas the reliability of the test would have a significant change if fewer raters were employed.The results of the FACETS analysis revealed that some tasks were misfitting with the model and one rater was not consistent in her marking.These results provide useful complementary information for the improvement of the test content and the rating process.