You are here
Education Level
K-12
Full Abstract
We compare teacher preparation programs in Missouri based on the effectiveness of their graduates in the classroom. The differences in effectiveness between teachers from different preparation programs are very small. In fact, virtually all of the variation in teacher effectiveness comes from within-program differences between teachers. Prior research has overstated differences in teacher performance across preparation programs for several reasons, most notably because some sampling variability in the data has been incorrectly attributed to the preparation programs.
Citation: Cory Koedel, Eric Parsons, Michael Podgursky, Mark Ehlert (2012). Teacher Preparation Programs and Teacher Quality: Are There Real Differences Across Programs. CALDER Working Paper No. 79
Full Abstract
During the late 1990's public pension funds across the United States accrued large actuarial surpluses. The seemingly flush conditions of the pension funds led legislators in most states to substantially improve retirement benefits for public workers, including teachers. In this study we examine the benefit enhancements to the teacher pension system in Missouri. These enhancements resulted in large windfall gains for teachers who were close to retirement when the legislation was enacted. By contrast, novice teachers and teachers who had not yet entered the labor force, were made worse off. The reason is that front-end contribution rates have been raised for current teachers to offset past liabilities accrued from the enhancements. Other things equal, the teaching profession in Missouri is now less appealing for young teachers than it was before the pension enhancements were enacted.
Citation: Cory Koedel, Shawn Ni, Michael Podgursky (2012). Who Benefits from Pension Enhancements?. CALDER Working Paper No. 76
Full Abstract
Redistributing highly effective teachers from low- to high-need schools is an education policy tool that is at the center of several major current policy initiatives. The underlying assumption is that teacher productivity is portable across different schools settings. Using elementary and secondary school data from North Carolina and Florida, this paper investigates the validity of this assumption. Among teachers who switched between schools with substantially different poverty levels or academic performance levels, we find no change in those teachers’ measured effectiveness before and after a school change. This pattern holds regardless of the direction of the school change. We also find that high-performing teachers’ value-added dropped and low-performing teachers’ value-added gained in the post-move years, primarily as a result of regression to the within-teacher mean and unrelated to school setting changes. Despite such shrinkages, high-performing teachers in the pre-move years still outperformed low-performing teachers after moving to schools with different settings.
Citation: Zeyu Xu, Umut Özek, Matthew Corritore (2012). Portability of Teacher Effectiveness Across Schools. CALDER Working Paper No. 77
Full Abstract
In this paper we report on work estimating the stability of value-added estimates of teacher effects, an important area of investigation given public interest in workforce policies that implicitly assume effectiveness is a stable attribute within teachers. The results strongly reject the hypothesis that teacher performance is completely stable within teachers over long periods of time, but estimates suggest that a component of performance appears to persist within teachers, even over a ten-year panel. We also find that little of the changes in teacher effectiveness estimates within teachers can be explained by observable characteristics.
Citation: Dan Goldhaber, Michael Hansen (2012). Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance. CALDER Working Paper No. 73
Full Abstract
In 2002/03, the Charlotte-Mecklenburg Schools initiated a broad program of accelerating entry into algebra coursework. The proportion of moderately-performing students taking 8th grade algebra increased from less than half to nearly 90%, then reverted to baseline levels, in the span of just six age cohorts. We use this policy-induced variation to infer the impact of accelerated entry into algebra on student performance in math courses as students progress through high school. Students affected by the acceleration initiative scored significantly lower on end-of-course tests in Algebra I, and were either no more likely or significantly less likely to pass standard follow-up courses, Geometry and Algebra II, on a college-preparatory timetable. We also find that the district assigned teachers with weaker qualifications to Algebra I classes in the first year of the acceleration, but this reduction in teacher quality accounts for only a small portion of the overall effect.
Citation: Charles Clotfelter, Helen Ladd, Jacob Vigdor (2012). The Aftermath of Accelerating Algebra: Evidence from a District Policy Initiative. CALDER Working Paper No. 69
Full Abstract
Educators in public schools in the United States are typically enrolled in defined-benefit pension plans, which penalize across-plan mobility. We use administrative data from Missouri to examine how the mobility penalties affect the labor market for school leaders, and show that pension borders greatly reduce leadership flows across schools. Our most conservative estimates indicate that removing a pension border that divides two groups of schools will increase leadership flows between the groups by roughly 100 percent. We consider the implications of our findings for workforce quality in schools near pension borders in Missouri. Our results are of general interest given that thousands of public schools operate near pension boundaries nationwide. See Working Paper 67 for an updated version.
Citation: Cory Koedel, Jason Grissom, Shawn Ni, Michael Podgursky (2012). Pension-Induced Rigidities in the Labor Market for School Leaders. CALDER Working Paper No. 67
Full Abstract
In this paper we consider the challenges involved in evaluating teacher preparation programs when controlling for school contextual bias. Including school fixed effects in the achievement models used to estimate preparation program effects controls for school environment by relying on differences among student outcomes within the same schools to identify the program effects. However, identification of preparation program effects using school fixed effects requires teachers from different programs to teach in the same school. Even if program effects are identified, the precision of the estimated effects will depend on the degree to which graduates from different programs overlap across schools. In addition, if the connections between preparation programs result from the overlap of atypical graduates or from graduates teaching in atypical school environments, use of school effects could produce bias. Using statewide data from Florida, we show that teachers tend to teach in schools near the programs in which they received their training, but there is still sufficient overlap across schools to identify preparation program effects. We show that the ranking of preparation programs varies significantly depending on whether or not school environment is taken into account via school fixed effects. We find that schools and teachers that are integral to connecting preparation programs are atypical, with disproportionately high percentages of Hispanic teachers and students compared to the state averages. Finally, we find significant variance inflation in the estimated program effects when controlling for school fixed effects, and that the size of the variance inflation factor depends crucially on the length of the window used to compare graduates teaching in the same schools.
Citation: Kata Mihaly, Daniel McCaffery, Tim Sass, J.R. Lockwood (2012). Where You Come From or Where You Go? Distinguishing Between School Quality and the Effectiveness of Teacher Preparation Program Graduates. CALDER Working Paper No. 63
Full Abstract
With teacher quality repeatedly cited as the most important schooling factor influencing student achievement, there has been increased interest in examining the efficacy of teacher training programs. This paper presents research examining the variation between and impact that individual teacher training institutions in Washington state have on the effectiveness of teachers they train. Using administrative data linking teachers' initial endorsements to student achievement on state reading and math tests, we find the majority of teacher training programs produce teachers who are no more or less effective than teachers who trained out-of-state. However, we do find a number of cases where there are statistically significant differences between estimates of training program effects for teachers who were credentialed at various in-state programs. These findings are robust to a variety of different model specifications.
Citation: Dan Goldhaber, Stephanie Liddle (2012). The Gateway to the Profession: Assessing Teacher Preparation Programs Based on Student Achievement. CALDER Working Paper No. 65
Full Abstract
Although much has been written about the importance of leadership in the determination of organizational success, there is little quantitative evidence due to the difficulty of separating the impact of leaders from other organizational components – particularly in the public sector. Schools provide an especially rich environment for studying the impact of public sector management, not only because of the hypothesized importance of leadership but also because of the plentiful achievement data that provide information on institutional outcomes. Outcome-based estimates of principal value-added to student achievement reveal significant variation in principal quality that appears to be larger for high-poverty schools. Alternate lower-bound estimates based on direct estimation of the variance yield smaller estimates of the variation in principal productivity but ones that are still important, particularly for high poverty schools. Patterns of teacher exits by principal quality validate the notion that a primary channel for principal influence is the management of the teacher force. Finally, looking at principal transitions by quality reveals little systematic evidence that more effective leaders have a higher probability of exiting high poverty schools.
Citation: Gregory F. Branch, Eric Hanushek, Steven Rivkin (2012). Estimating the Effect of Leaders on Public Sector Productivity: The Case of School Principals. CALDER Working Paper No. 66
Full Abstract
This study seeks to identify the characteristics and training experiences of teachers who are differentially effective at promoting academic achievement among English language learners (ELLs). Our analyses indicate that general skills such as those reflected by scores on teacher certification exams and experience teaching non-ELL students are less predictive of achievement for ELL students than for other students. However, specific experience teaching ELL students is more important for predicting effectiveness with future ELL students than non-ELL students as is both in-service and pre-service training focused on ELL-specific instructional strategies.
Citation: Ben Master, Susanna Loeb, Camille Whitney, James Wyckoff (2012). Different Skills: Identifying Differentially Effective Teachers of English Language Learners. CALDER Working Paper No. 68
Full Abstract
Researchers and policymakers often assume that teacher turnover harms student achievement, but recent evidence calls into question this assumption. Using a unique identification strategy that employs grade-level turnover and two classes of fixed-effects models, this study estimates the effects of teacher turnover on over 1.1 million New York City 4th grade student observations over 10 years. The results indicate that students in grade-levels with higher turnover score lower in both ELA and math and that this effect is particularly strong in schools with more low-performing and black students. Moreover, the results suggest that there is a disruptive effect of turnover beyond changing the composition in teacher quality.
Citation: Matthew Ronfeldt, Susanna Loeb, James Wyckoff (2012). How Teacher Turnover Harms Student Achievement. CALDER Working Paper No. 70
Full Abstract
In a provocative and influential paper, Jesse Rothstein (2010) finds that standard value-added models (VAMs) suggest implausible future teacher effects on past student achievement, a finding that obviously cannot be viewed as causal. This is the basis of a falsification test (the Rothstein falsification test) that appears to indicate bias in VAM estimates of current teacher contributions to student learning. More precisely, the falsification test is designed to identify whether or not students are effectively randomly assigned conditional on the covariates included in the model. Rothstein's finding is significant because there is considerable interest in using VAM teacher effect estimates for high-stakes teacher personnel policies, and the results of the Rothstein test cast considerable doubt on the notion that VAMs can be used fairly for this purpose. However, in this paper, we illustrate—theoretically and through simulations—plausible conditions under which the Rothstein falsification test rejects VAMs even when students are randomly assigned, conditional on the covariates in the model, and even when there is no bias in estimated teacher effects.
Citation: Dan Goldhaber, Duncan Chaplin (2012). Assessing the “Rothstein Test”. Does it Really Show Teacher Value-Added Models are Biased?. CALDER Working Paper No. 71
Full Abstract
Traditionally, states have required individuals complete a program of study in a university-based teacher preparation program in order to be licensed to teach. In recent years, however, various "alternative certification" programs have been developed and the number of teachers obtaining teaching certificates through routes other than completing a traditional teacher preparation program has skyrocketed. In this paper I use a rich longitudinal data base from Florida to compare the characteristics of alternatively certified teachers with their traditionally prepared colleagues. I then analyze the relative effectiveness of teachers who enter the profession through different pathways by estimating "value-added" models of student achievement. In general, alternatively certified teachers have stronger pre-service qualifications than do traditionally prepared teachers, with the least restrictive alternative attracting the most qualified perspective teachers. These differences are less pronounced when controlling for the grade level of teachers, however. On average, alternatively certified science teachers have also had much more coursework in science while in college than traditionally prepared science teachers. The same is not true for math teachers, where the hours of college coursework are approximately equal across pathways. Of the three alternative certification pathways studied, teachers who enter through the path requiring no coursework have substantially greater effects on student achievement than do either traditionally prepared teachers or alternative programs that require some formal coursework in education. These results suggest that the additional education coursework required in traditional teacher preparation programs either does little to boost the human capital of teachers or that whatever gains accrue from traditional teacher education training are offset by greater innate ability of individuals who enter teaching through routes requiring little formal training in education.
Citation: Tim Sass (2011). Certification Requirements and Teacher Quality. CALDER Working Paper No. 64
Full Abstract
This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools — which comprise three levels of clustering (students in classrooms in schools) — to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises frequently in practice because many available data sets identify the schools that students attend but not the classrooms in which they are taught. Do studies conducted under these circumstances yield results that are substantially different from what they would have been if this information had been available? The paper first considers this problem in the context of planning a school randomized study based on preexisting two-level information about how academic outcomes for students vary across schools and across students within schools (but not across classrooms in schools). The paper next considers this issue in the context of estimating intervention effects from school-randomized studies. Findings are based on empirical analyses of four multisite data sets using academic outcomes for students within classrooms within schools. The results indicate that in almost all situations one will obtain nearly identical results whether or not the classroom or middle level is omitted when designing or analyzing studies.
Citation: Pei Zhu, Robin Jacob, Howard Bloom, Zeyu Xu (2011). Designing and Analyzing Studies that Randomize Schools To Estimate Intervention Effects on Student Academic Outcomes Without Classroom-Level Information. CALDER Working Paper No. 61
Full Abstract
Increasing parental choice has been a leading theme of recent education policy intended to enhance the academic achievement of low-performing students in the United States. These policies aim to “level the playing field” in access to high-quality education for disadvantaged students who cannot otherwise afford higher-quality schooling options. Public school choice programs in D.C. are successful; disadvantaged students are able to attend higher-performing schools than their neighborhood public schools, even with prolonged commutes. Overall, the findings provide evidence that the relatively advantaged students are taking advantage of public school choice programs. However, choice exacerbates student quality disparities between low- and high-poverty schools, casting some doubt on the benefits of such programs.
Citation: Umut Özek (2011). Public School Choice in the District of Columbia: A Descriptive Analysis. CALDER Working Paper No. 130 411
Full Abstract
Principals tend to prefer working in schools with higher-achieving students from more advantaged socioeconomic backgrounds. Principals often use schools with many poor or low-achieving students as stepping stones to what they view as more desirable assignments. District leadership can also exacerbate principal turnover by implementing policies aimed at improving low-performing schools such as rotating school leaders. Using longitudinal data from one large urban school district we find principal turnover is detrimental to school performance. Frequent turnover results in lower teacher retention and lower student achievement gains, which are particularly detrimental to students in high-poverty and failing schools.
Citation: Tara Beteille, Demetra Kalogrides, Susanna Loeb (2011). Stepping Stones: Principal Career Paths and School Outcomes. CALDER Working Paper No. 58
Full Abstract
While prior research has documented differences in the distribution of teacher characteristics across schools serving different student populations, few studies have examined how teacher sorting occurs within schools. Comparing teachers who teach in the same grade and school in a given year, the authors find that less experienced, minority, and female teachers are assigned students with lower average prior achievement, more prior behavioral problems, and lower prior attendance rates than their more experienced, white and male colleagues. Though more effective (higher value-added) teachers and those with advanced degrees are also assigned less difficult classes, controlling for these factors does not eliminate the association between experience, race, gender, and assignments. These patterns have negative implications for teacher retention given the importance of working conditions for teachers' career decisions.
Citation: Demetra Kalogrides, Susanna Loeb, Tara Beteille (2011). Power Play? Teacher Characteristics and Class Assignments. CALDER Working Paper No. 59
Full Abstract
This paper assesses the determinants of teacher job change and the impact of such mobility on the distribution of teacher quality. High and low-quality teachers are more likely to leave than those in the middle of the distribution. In contrast, the relationship between teacher productivity and inter-school mobility is relatively weak. Teachers who rank above their faculty colleagues are more likely to transfer to a new school within a district and exit teaching. As the share of peer teachers with more experience, advanced degrees or professional certification increase, the likelihood of moving within district decreases. There is also evidence of assortative matching among teachers. The most effective teachers who transfer tend to go to schools whose faculties are in the top quartile of teacher quality. Teacher mobility exacerbates differences in teacher quality across schools.
Citation: Li Feng, Tim Sass (2011). Teacher Quality and Teacher Mobility. CALDER Working Paper No. 57
Full Abstract
Research on teacher productivity, and recently developed accountability systems for teachers, rely on value-added models to estimate the impact of teachers on student performance. The authors test many of the central assumptions required to derive value-added models from an underlying structural cumulative achievement model and reject nearly all of them. Moreover, they find that teacher value added and other key parameter estimates are highly sensitive to model specification. While estimates from commonly employed value-added models cannot be interpreted as causal teacher effects, employing richer models that impose fewer restrictions may reduce the bias in estimates of teacher productivity.
Citation: Douglas Harris, Tim Sass, Anastasia Semykina (2010). Value-Added Models and the Measurement of Teacher Productivity. CALDER Working Paper No. 54
Full Abstract
Over 2000 teachers in Washington state received reduction-in-force (RIF) notices in the past two years. Linking data on these RIF notices to a unique dataset of student, teacher, school, and district variables the authors determine factors that predict the likelihood of a teacher receiving a RIF notice. A teacher's seniority is the greatest predictor, but (all else equal) master's degree teachers and credentialed teachers in the "high-needs areas" of math, science, and special education were less likely to receive a RIF notice. For a subset of the teachers there is no observed relationship between effectiveness and the likelihood of receiving a RIF notice. Results suggest a different group of teachers would be targeted for layoffs under an effectiveness-based vs. seniority-driven layoff system.
Citation: Dan Goldhaber, Roddy Theobald (2010). Assessing the Determinants and Implications of Teacher Layoffs. CALDER Working Paper No. 55