The Effect of Specific Language Features on the Complexity of Systems for Automated Essay Scoring.
Yoav Cohen, Anat Ben-Simon, Myra Hovav · 2003
This paper focuses on the relationship between different aspects of the linguistic structure of a given language and the complexity of the computer program, whether existing or prospective, that is to be used for the scoring of essays in that language. The first part of the paper discusses common scales used to assess writing products, then briefly describes various methods of Automated Essay Scoring (AES) and reviews several AES programs currently in use. It also presents empirical results attesting to the reliability and validity of these programs, principally with regard to essays written in English. The second part of the paper presents various linguistic features that may vary extensively across languages and examines the ramifications of these features on the complexity of the AES operational system. This analysis is presented chiefly with regard to Hebrew and English, which are used to illustrate the differences that may exist between languages. (Contains 5 tables and 30 references.) (SLD) Reproductions supplied by EDRS are the best that can be made from the original document. (-9) fl) C1 00 U.S. DEPARTMENT OF EDUCATION Office of Educational Research and Improvement EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) is document has been reproduced as received from the person or organization originating it. Minor changes have been made to improve reproduction quality. PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY