You are here
Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants
There is growing interest in using measures of teacher applicant quality to improve hiring decisions, but the statistical properties of such measures are poorly understood. We present evidence on structured ratings solicited from teacher applicants’ references. We find that the reference ratings capture only one underlying dimension of applicant quality, which may indicate a need to broaden the range of questions posed to professional references. Point estimates of inter-rater reliability range between 0.23 and 0.31 and are significantly lower for novice applicants. It is difficult to judge whether these levels of reliability are high or low in the current context given so little evidence on comparable applicant assessment tools.
This paper was published in Economics of Education Review in August 2021 and can be found here.
Keywords: teacher applicants, teacher hiring, inter-rater reliability
Citation: Dan Goldhaber, Cyrus Grout, Malcolm Wolff, Patricia Martinkova (2020). Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants. CALDER Working Paper No. 237-0620
You May Also Be Interested In
The Impact of a $10,000 Bonus on Special Education Teacher Shortages in Hawai‘i
Roddy Theobald, Zeyu Xu, Allison Gilmour, Lisa Lachlan-Hache, Liz Bettini, Nathan Jones
The Long and Winding Road: Mapping the College and Employment Pathways to Teacher Education Program Completion in Washington State
Dan Goldhaber, John Krieg, Stephanie Liddle, Roddy Theobald
The Effects of Comprehensive Educator Evaluation and Pay Reform on Achievement
Eric Hanushek, Jin Luo, Andrew Morgan, Minh Nguyen, Ben Ost, Steven Rivkin, Ayman Shakeel