You are here
Combining Multiple Performance Measures: Do Common Approaches Undermine Districts’ Personnel Evaluation Systems?
Teacher and principal evaluation systems now emerging in response to federal, state and/or local policy initiatives typically require that a component of teacher evaluation be based on multiple performance metrics, which must be combined to produce summative ratings of teacher effectiveness. Districts have utilized three common approaches to combine these multiple performance measures, all of which introduce bias and/or additional prediction error that was not present in the performance measures originally. This paper investigates whether the bias and error introduced by these approaches erodes the ability of evaluation systems to reliably identify high- and low-performing teachers. The analysis compares the expected differences in long-term teacher value-added among teachers identified as high- or low-performing under these three approaches, using simulated data based on estimated inter-correlations and reliability of measures in the Gates Foundation’s Measures of Effective Teaching project. Based on the results of our simulation exercise presented here, we conclude these approaches can undermine the evaluation system’s objectives in some contexts. Depending on the way these performance measures are actually combined to categorize teacher performance, the additional error and bias can be large enough to undermine the district’s objectives.
Keywords: Teacher Evaluation, Teacher Effectiveness, Principals
Citation: Michael Hansen, Mariann Lemke, Nicholas Sorensen (2014). Combining Multiple Performance Measures: Do Common Approaches Undermine Districts’ Personnel Evaluation Systems?. CALDER Working Paper No. 118
You May Also Be Interested In
How Did It Get This Way? Disentangling the Sources of Teacher Quality Gaps Across Two States
Dan Goldhaber, Vanessa Quince , Roddy Theobald
Accounting for Student Disadvantage in Value-Added Models (Update)
Eric Parsons, Cory Koedel, Li Tan
An Exploration of Sources of Variation in Teacher Evaluation Ratings across Classrooms, Schools, and Districts
James Cowan , Dan Goldhaber, Roddy Theobald