In this paper we examine academic recovery in 12 mid- to large-sized school districts across 10 states during the 2021–22 school year. Our findings highlight the challenges that recovery efforts faced during the 2021–22 school year. Although, on average, math and reading test score gains during the school year reached the pace of pre-pandemic school years, they were not accelerated beyond that pace. This is not surprising given that we found that districts struggled to implement recovery programs at the scale they had planned. In the districts where we had detailed data on student participation in academic interventions, we found that recovery efforts often fell short of original expectations for program scale, intensity of treatment, and impact. Interviews with a subsample of district leaders revealed several implementation challenges, including difficulty engaging targeted students consistently across schools, issues with staffing and limitations to staff capacity, challenges with scheduling, and limited engagement of parents as partners in recovery initiatives. Our findings on the pace and trajectory of recovery and the challenges of implementing recovery initiatives raise important questions about the scale of district recovery efforts. 

Citation: Maria V. Carbonari, Miles Davison, Michael DeArmond, Daniel Dewey, Elise Dizon-Ross, Dan Goldhaber, Ayesha Hashim, Thomas J. Kane, Andrew McEachin, Emily Morton, Tyler Patterson, Douglas O. Staiger (2022). The Challenges of Implementing Academic COVID Recovery Interventions: Evidence from the Road to Recovery Project. CALDER Working Paper No. 275-1222

Measures of student disadvantage—or risk—are critical components of equity-focused
education policies. However, the risk measures used in contemporary policies have significant limitations, and despite continued advances in data infrastructure and analytic capacity, there has been little innovation in these measures for decades. We develop a new measure of student risk for use in education policies, which we call Predicted Academic Performance (PAP). PAP is a flexible, data-rich indicator that identifies students at risk of poor academic outcomes. It blends concepts from emerging “early warning” systems with principles of incentive design to balance the competing priorities of accurate risk measurement and suitability for policy use. PAP is more effective than common alternatives at identifying students who are at risk of poor academic outcomes and can be used to target resources toward these students—and students who belong
to several other associated risk categories—more efficiently.

Citation: Ishtiaque Fazlul, Cory Koedel, Eric Parsons (2022). Using Predicted Academic Performance to Identify At-Risk Students in Public Schools. CALDER Working Paper No. 261-0922

More than one out of eight students have an identified disability, and students with disabilities tend to lag behind their typical peers on a variety of outcomes. It has been well established that teacher quality is an important determinant of student success, and there are persistent shortages of special education teachers. The available evidence suggests that, on average, students with disabilities are not being assigned to teachers of different quality in comparison to students without disabilities. However, there are many challenges to studying the quality of the teachers who instruct special education students. As a result, we know relatively little about the quality of special education teachers and what factors determine special education teacher quality. One existing study suggests that the determinants of teacher effectiveness for students with disabilities may be rather different than for teachers of nondisabled students; certification status and advanced degree attainment are positively correlated with a teacher’s ability to increase achievement for students with disabilities, but not so for the general student population. Given the difficulty that districts face in hiring and retaining special education teachers, more research on special education teacher quality would be valuable when assessing potential policies such as recruiting bonuses, loan forgiveness, or differential pay.

CALDER Policy Brief No. 11-0918-1

Citation: Curran Prettyman, Tim Sass (2018). Teacher Quality and Outcomes for Students with Disabilities. CALDER Policy Brief No. 11

CALDER Policy Brief No. 7-0918-1

Citation: Umut Özek (2018). The Effects of Instruction Time on Student Outcomes. CALDER Policy Brief No. 7

CALDER Policy Brief No. 4-0918-2

Citation: Carrie Conaway, Dan Goldhaber (2018). Appropriate Standards of Evidence for Education Policy Decision-Making. CALDER Policy Brief No. 4

This paper examines the value of strategically assigning disproportionately larger classes to the strongest teachers in order to optimize student learning in the face of differential teacher effectiveness. The rationale is straightforward: Larger classes for the best teachers benefit the pupils who are reassigned to them; they also help the less effective teachers improve their instruction by enabling them to concentrate on fewer students. But just how much of a difference could manipulating class sizes in this way make for overall student learning and access to effective teaching? This study performs a simulation based on North Carolina data to estimate plausible student outcomes under this approach. In the North Carolina data, I find there is a very slight tendency to place more students in the classes of effective teachers; but still only about 25 percent of students are taught by the top 25 percent of teachers. Intensively reallocating eighth-grade students—so that the most effective teachers have up to twelve more pupils than the average classroom—may produce gains equivalent to adding roughly two-and-a-half extra weeks of school. Even adding a handful of students to the most effective eighth-grade teachers (up to six more than the school’s average) produces gains in math and science akin to extending the school year by nearly two weeks or, equivalently, to removing the lowest 5 percent of teachers from the classroom. The potential impacts on learning are more modest in fifth grade, where the large majority of teachers are in self-contained classrooms. Results show that this strategy shows an overall improvement in student access to effective teaching, yet gaps in access for economically disadvantaged students persist. For instance, disadvantaged eighth-grade students are about 8 percent less likely than non-disadvantaged peers to be assigned to a teacher in the top 25 percent of performance. This gap in access changes little in spite of the policy putting more students in front of effective teachers — because the pool of available teachers in high-poverty schools does not change under this strategy. Thus, this policy alone shows little promise in reducing achievement gaps.

Citation: Michael Hansen (2014). Right-Sizing the Classroom: Making the Most of Great Teachers. CALDER Working Paper No. 110