You are here
Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants
There is growing interest in using measures of teacher applicant quality to improve hiring decisions, but the statistical properties of such measures are poorly understood. We present evidence on structured ratings solicited from teacher applicants’ references. We find that the reference ratings capture only one underlying dimension of applicant quality, which may indicate a need to broaden the range of questions posed to professional references. Point estimates of inter-rater reliability range between 0.23 and 0.31 and are significantly lower for novice applicants. It is difficult to judge whether these levels of reliability are high or low in the current context given so little evidence on comparable applicant assessment tools.
This paper was published in Economics of Education Review in August 2021 and can be found here.
Keywords: teacher applicants, teacher hiring, inter-rater reliability
Citation: Dan Goldhaber, Cyrus Grout, Malcolm Wolff, Patricia Martinkova (2020). Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants. CALDER Working Paper No. 237-0620
You May Also Be Interested In
School District Staffing Challenges in a Rapidly Recovering Economy
Dan Goldhaber, Trevor Gratz
Lost to the System? A Descriptive Exploration of Where Teacher Candidates Find Employment and How Much They Earn
Dan Goldhaber, John Krieg, Roddy Theobald, Stephanie Liddle
Front End to Back End: Teacher Preparation, Workforce Entry, and Attrition
Dan Goldhaber, John Krieg, Roddy Theobald, Marcelle Goggins