Applied Linguistics Advance Access originally published online on September 18, 2009
Applied Linguistics 2009 30(3):435-440; doi:10.1093/applin/amp035
| ||||||||||||||||||||||||||||||||||||||||||||||||
© Oxford University Press 2009
A G-Theory Analysis of Rater Effect in ESL Speaking Assessment
University of Toronto, Canada
| Abstract |
|---|
The current status of English as an international language has come with challenges to the native speaker norms and raised the relevance of localized varieties in language assessment. This preliminary study investigates whether native English-speaking (NS) and non-native English-speaking (NNS) raters differ in their effect on score reliability in ESL speaking assessment. A generalizability theory analysis indicated that, although NS and NNS raters exhibited similar severity patterns across all students, they interacted with the students in different ways. This article also discusses the implications for assessment practice and directions for future research.