Publications
|
Working Papers | 2009 | 2008 | 2007 | Jump to Policy Briefs
This paper addresses two questions: How well do teachers understand their current pension plans? And, what do they think about alternative plan structures? The data come from administrative records and a 2006 survey of teachers in Washington State. The results suggest Washington’s teachers are fairly knowledgeable about their pensions, though new entrants and mid-career teachers appear to be less knowledgeable than veteran teachers. As for teachers’ preferences for plan structure, the survey suggests that when it comes to investing additional retirement savings, a plurality of teachers favor defined contribution plans which offer more portability and choice, but more risk than traditional defined benefit plans. Perhaps unsurprisingly, all else equal, teachers newer to the profession are more likely than veteran teachers to favor a defined contribution structure. Published: June 2010 | Download:
Reform advocates and policymakers concerned about the quality and distribution of teachers support proposals of alternative compensation for teachers in hard-to-hire subject areas, hard-to-staff schools, and with special knowledge and skills. The successful implementation of such proposals depends in large part on teacher attitudes. The current body of research on teacher attitudes toward compensation reform paints an inconsistent picture of teachers’ views, largely ignoring the influence of individual and workplace characteristics on teacher attitudes. Results from a 2006 survey of teachers in Washington State linked to school and district data confirm earlier findings that teacher opinion about pay reform is not uniform, and further illustrates teacher preferences for different pay structures vary substantially by individual and workplace characteristics. Nearly three quarters of teachers favored higher pay for hard-to-staff schools. In contrast, only 17% favored merit pay. Teachers with a high degree of confidence in their principal were more likely to support merit pay than those with greater sense of trust and respect for their fellow teachers than for their principal. Policymakers interested in implementing new pay systems should carefully assess teacher opinion in determining where (and how) they invest in them. Published: June 2010 | Download:
This paper contributes importantly to the growing literature on the training of special education teachers and how it translates into classroom practice and student achievement. The authors examine the impact of pre-service preparation and in-service formal and informal training on the ability of teachers to promote academic achievement among students with disabilities. Using student-level longitudinal data from Florida over a five-year span the authors estimate “value-added” models of student achievement. There is little support for the efficacy of in-service professional development courses focusing on special education. However, teachers with advanced degrees are more effective in boosting the math achievement of students with disabilities than are those with only a baccalaureate degree. Also pre-service preparation in special education has statistically significant and quantitatively substantial effects on the ability of teachers of special education courses to promote gains in achievement for students with disabilities, especially in reading. Certification in special education, an undergraduate major in special education, and the amount of special education coursework in college are all positively correlated with the performance of teachers in special education reading courses. Published: June 2010 | Download:
Does differential access to computer technology at home compound the educational disparities between the rich and the poor? Would a program of government provision of computers to early secondary school students reduce these disparities? This study covers years 2000 to 2005, a period when home computers and high-speed Internet access expanded dramatically. Using administrative data on North Carolina public school students to corroborate earlier surveys that document broad racial and socioeconomic gaps in home computer access and use, the authors compared the children's reading and math scores before and after they acquired a home computer, and compared these scores to those of peers who had a home computer by fifth grade and to test scores of students who never acquired a home computer. The introduction of home computer technology is associated with modest but statistically significant and persistent negative impacts on student math and reading test scores. The authors also conclude that home computers are put to more productive use in households where parental monitoring is more effective. Further evidence suggests that providing universal access to home computers and high-speed internet access would broaden, rather than narrow, math and reading achievement gaps. Published: June 2010 | Download:
Struggling schools that come under increased accountability pressure face a number of challenges, including changing instructional policies and practices to facilitate student improvement. But what effect does school accountability have on teachers’ mobility decisions? This study is the first to exploit policy variation within the same state to examine the effects of school accountability on teacher job changes. Using student-level data from Florida State the authors measure the degree to which schools and teachers were “surprised” by the change in Florida’s school grading system (A+ Plan for Education) in the summer of 2002— what they refer to as an “accountability shock.” They observed the mobility decisions of teachers in the years before and after the school grading change and found over half of all schools in the state experienced an accountability “shock” due to this grading change. Teachers were more likely to leave schools facing increased accountability pressure; even more likely to leave schools shocked downward to a grade of “F”; and less likely to leave schools facing decreased accountability pressure. Schools facing increased accountability pressure also saw a rise in the average quality of the teachers who stayed. If these schools were able to retain more of their high- quality teachers, perhaps through increased incentives to remain in the school, the performance gains associated with school accountability pressure could be greater than those already observed. Published: June 2010 | Download:
Voucher options like tuition tax credit-funded scholarship programs have become increasingly popular in recent years. This study examines the effects of private school competition on public school students’ test scores in the wake of Florida’s Corporate Tax Credit Scholarship (FTC) program which offered scholarships to eligible low-income students to attend private schools. The authors examine whether students in schools exposed to a more competitive private school landscape saw greater improvements in their students’ test scores after the introduction of the program, than did students in schools that faced less competition. Students in public schools faced with increased private school competition showed greater gains in test scores than students in other public schools with the introduction of the program. These findings are not an artifact of pre-policy trends; the degree of competition from nearby private schools matters only after the announcement of the new program, which makes nearby private competitors more affordable for eligible students. The gains appear to be much more pronounced in the schools most at risk of losing students and in the schools that are on the margin of Title I funding. Published: June 2010 | Download:
Many studies have estimated the relationship between teachers' characteristics (i.e., experience and academic performance) and their value-added to student achievement. Few have explored whether instructional practices predict student test score gains. In this study, authors ask what classroom practices, if any, differentiate teachers with high impact on student achievement in middle school English Language Arts from those with lower impact. The study further explores the extent to which value-added measures signal differences in instructional quality. Even with the small sample used in the analysis, the authors find evidence that high value-added teachers have a different profile of instructional practices than do low value-added teachers. Teachers in the top quartile as measured by value-added scores score higher than second-quartile teachers on all 16 elements of instruction that were measured. The differences are statistically significant for a subset of practices including explicit strategy instruction. Published: May 2010 | Download:
Research has consistently shown that teacher quality is distributed very unevenly among schools to the clear disadvantage of minority students and those from low-income families. Using information on teaching spells in North Carolina, the authors examine the potential for using salary differentials to overcome this pattern. They conclude that salary differentials are a far less effective tool for retaining teachers with strong pre-service qualifications than for retaining other teachers in schools with high proportions of minority students. Consequently, large salary differences would be needed to level the playing field when schools are segregated. This conclusion reflects the finding that teachers with stronger qualifications are both more responsive to the racial and socioeconomic mix of a school's students and less responsive to salary than are their less well qualified counterparts when making decisions about remaining in their current school, moving to another school or district, or leaving the teaching profession. Published: May 2010 | Download:
The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to provide empirical information needed to design adequately powered studies that randomize schools using data from Florida and North Carolina. The authors assess how different covariates contribute to improving the statistical power of a randomization design and examine differences between math and reading tests; differences between test types (curriculum-referenced tests versus norm-referenced tests); and differences between elementary school and secondary school, to see if the test subject, test type, or grade level makes a large difference in the crucial design parameters. Finally they assess bias in 2-level models that ignore the clustering of students in classrooms. Published: May 2010 | Download:
Search theory suggests early career job changes lead to better matches that benefit both workers and firms, but this may not hold true in teacher labor markets characterized by salary rigidities, barriers to entry, and substantial differences in working conditions. Education policy makers are particularly concerned that teacher turnover may have adverse effects on the quality of instruction in schools serving predominantly disadvantaged children. Although these schools experience higher turnover, on average, than other schools, the impact on the quality of instruction depends on whether more productive teachers are more likely to depart. In Texas, the availability of matched panel data of students and teachers enables the isolation of teachers' contributions to achievement. Teachers who remain in their school tend to outperform those who leave, particularly those who exit Texas public schools entirely. This gap is larger for schools serving mainly low income students— evidence that high turnover is not nearly as damaging as many suggest. Published: May 2010 | Download:
Using student-level microdata from 2000-2001 to 2004-2005 from Florida and North Carolina, this paper compares the effectiveness of teachers in high-poverty elementary schools (>70% FRL students) with that of teachers in lower-poverty elementary schools (<70% FRL students and <30% FRL students). Teachers in high-poverty schools are on average less effective than those in lower-poverty schools, as measured by their value-added to math and reading achievement. The gap in the effectiveness of teachers between high- and lower-poverty schools is most pronounced at the bottom of the teacher performance distribution. The best teachers, by comparison, are equally effective across school poverty settings. This gap in teacher effectiveness cannot simply be explained by the higher concentration of inexperienced teachers in high-poverty schools. In fact, it is largely driven by the lower “pay off” to experience in high-poverty schools. That is, the productivity gain associated with increase in experience is systematically lower in high-poverty schools than in other schools. The findings suggest policies that rely on redistributing teacher experience are insufficient to narrow the achievement gap between high- and- low-poverty schools. The findings suggest that policymakers should look beyond the number of years of experience in crafting policies aimed that the redistribution of effective teachers in high-poverty schools, and instead focus on policies aimed at recruiting qualified experienced teachers. Additionally, while the focus on teacher retention is right, policymakers must also focus on the productivity growth of teachers. 2009 | Back to Top
This study presents a generalization to the standard career concerns model and applies it to the public teacher labor market. The model predicts optimal teacher effort levels decline with both tenure at a school and experience, all things being equal. Using administrative data from North Carolina spanning 14 school years through 2008, the author finds significant changes in teacher sick leave consistent with the generalized career concerns model. By exploiting exogenous variation in career concerns in the form of principal turnover, the author shows the observed behaviors cannot be due to the endogeneity of teacher mobility decisions alone. Also examined are the effects of career concerns incentives breaking down. There is evidence suggestive of teacher shirking, and evidence on an unobservable measure of effort taken from the Schools and Staffing Survey that corroborates findings from observable teacher absence behavior. In sum,teachers exert considerable discretion over their own effort levels in response to these incentives.This has important policy implications. Published: December 2009 | Download:
While it is generally understood that defined benefit pension systems concentrate benefits on career teachers and impose costs on mobile teachers, there has been very little analysis of the magnitude of these effects. The authors develop a measure of implicit redistribution of pension wealth among teachers at varying ages of separation. Compared to a neutral system, often about half of an entering cohort's net pension wealth is redistributed to teachers who separate in their fifties from those who separate earlier. There is some variation across six state systems. This implies large costs for interstate mobility. Estimates show teachers who split a thirty-year career between two pension plans often lose over half their net pension wealth compared to teachers who complete a career in a single system. Plan options that permit purchases of service years mitigate few or none of these losses. It is difficult to explain these patterns of costs and benefits on efficiency grounds. More likely explanations include the relative influence of senior versus junior educators in interest group politics and a coordination problem between states. Published: December 2009 | Download:
This paper uses data from New York City to estimate how the characteristics of school principals relate to school performance, as measured by students' standardized exam scores and other outcomes. There is little evidence of any relationship between school performance and principal education and pre-principal work experience, but some evidence that experience as an assistant principal at the principal's current school is associated with higher performance among inexperienced principals. There is a positive relationship between principal experience and school performance, particularly for math test scores and student absences. The experience profile is especially steep over the first few years of principal experience. Finally, there is mixed evidence on the relationship between formal principal training and professional development programs and school performance, with the caveat that the selection and assignment of New York City principals participating in these programs make it hard to isolate their effects. The positive returns to principal experience suggest that policies which cause principals to leave their posts early (e.g., via early retirement or a move into district administration) will be costly, and the tendency for less-advantaged schools to be run by less experienced principals could exacerbate educational inequality. Published: December 2009 | Download:
Teachers are systematically sorted across schools. Often, schools serving the lowest-achieving students staffed by the least-skilled teachers. While teachers' school preferences account for some of the sorting, school practices are also likely to be a key factor. Using value-added methods, the authors examine the relationship between a school's effectiveness during a given principal's tenure and the retention, recruitment and development of its teachers. Three key findings emerge about principal effectiveness. More effective principals: (1) are able to retain higher-quality teachers and remove less-effective teachers; (2) are able to attract and hire higher-quality teachers to fill vacancies; (3) have teachers who improve at a greater pace than those in schools with less effective leadership (there is some evidence for this, albeit weak). These findings drive home the importance of personnel practices for effective school leadership. Published: December 2009 | Download:
In this study authors use longitudinal data from one large school district – Miami-Dade County Public Schools, to investigate the distribution of principals across schools. They find schools serving many low-income, non-white, and low-achieving students have principals with less experience, less education, and who attended less selective colleges. This distribution of principals is partially driven by the initial match of first-time principals to schools at the beginning of their careers and is exacerbated by systematic attrition and transfer away from these schools. Supplementing these data with surveys of principals, the authors find principals' stated preferences for school characteristics mirror observed distribution and transfer patterns. Principals prefer to work in easier to serve schools with favorable working conditions which also tend to be schools with fewer poor, minority and/or low-achieving students. Published: December 2009 | Download:
While the importance of effective principals is undisputed, few studies have addressed what specific skills principals need to promote school success. This study draws on unique data combining survey responses from principals, assistant principals, teachers and parents with rich administrative data to identify which principal skills matter most for school outcomes. Factor analysis of a 42-item task inventory distinguishes five skill categories, yet only one of them, the principals' organization management skills, consistently predicts student achievement growth and other success measures. Analysis of evaluations of principals by assistant principals confirms this central result. The analysis argues for a broad view of instructional leadership that includes general organizational management skills as a key complement to the work of supporting curriculum and instruction. Published: December 2009 | Download:
School principals have complex jobs. To better understand the work lives of principals, this study uses observational time-use data for all high school principals in Miami-Dade County Public Schools. This paper examines the relationship between the time principals spent on different types of activities and school outcomes including student achievement, teacher and parent assessments of the school, and teacher satisfaction. Time spent on Organization Management activities is associated with positive school outcomes, such as student test score gains and positive teacher and parent assessments of the instructional climate, whereas Day-to-Day Instruction activities are marginally or not at all related to improvements in student performance and often have a negative relationship with teacher and parent assessments. This paper suggests that a single-minded focus on principals as instructional leaders operationalized through direct contact with teachers may be detrimental if it forsakes the important role of principals as organizational leaders. Published: December 2009 | Download:
This study uses data from North Carolina to examine the extent to which survey based perceptions of working conditions are predictive of policy-relevant outcomes, independent of other school characteristics such as the demographic mix of the school's students. Working conditions emerge as highly predictive of teachers' stated intentions to remain in or leave their schools, with leadership emerging as the most salient dimension. Teachers' perceptions of their working conditions are also predictive of one-year actual departure rates and student achievement, but the predictive power isfar lower. These weaker findings for actual outcome measures help to highlight both the strengths and weaknesses of using teacher survey data for understanding outcomes of policy interest. Published: December 2009 | Download:
Much has been written about the importance of school leadership, but there is surprisingly little systematic evidence on this topic. This paper presents preliminary estimates of key elements of the market for school principals, employing rich panel data on principals from Texas State. The consideration of teacher movements across schools suggests that principals follow patterns quite similar to those of teachers – preferring schools that have less demands as indicated by higher income students, higher achieving students, and fewer minority students. Looking at the impact of principals on student achievement, there are some small but significant effects of the tenure of a principal in a school. Moreover, the variation in principal effectiveness tends to be largest in high poverty schools, consistent with hypothesis that principal ability is most important in schools serving the most disadvantaged students. Finally, principals who stay in a school tend to be more effective than those who move to other schools. Published: December 2009 | Download:
Reforming teacher tenure is an idea that appears to be gaining traction with the underlying assumption being that one can infer to a reasonable degree how well a teacher will perform over her career based on estimates of her early-career effectiveness. Here we explore the potential for using value-added models to estimate performance and inform tenure decisions. We find little evidence of convergence or divergence in teacher effectiveness across teachers as they advance in their careers, but strong evidence that prior year estimates of job performance for individual teachers predict student achievement even when there is a multi-year lag between the two. Last revised: February 2010 | Download:
Mounting pressure in the policy arena to improve teacher productivity either by improving signals that predict teacher performance or through creating incentive contracts based on performance—has spurred two related questions: Are there important determinants of teacher productivity that are not captured by teacher credentials but that can be measured by subjective assessments? And would evaluating teachers based on a combination of subjective assessments and student outcomes more accurately gauge teacher performance than student test scores alone? Using data from a midsize Florida school district, this paper explores both questions by calculating teachers' "value added" and comparing those outcomes with subjective ratings of teachers by school principals. Teacher value-added and principals' subjective ratings are positively correlated and principals' evaluations are better predictors of a teacher's value added than traditional approaches to teacher compensation focused on experience and formal education. In settings where schools are judged on student test scores, teachers' ability to raise those scores is important to principals, as reflected in their subjective teacher ratings. Also, teachers' subject knowledge, teaching skill, and intelligence are most closely associated with both the overall subjective teacher ratings and the teacher value added. Finally, while past teacher value added predicts future teacher value added the principals' subjective ratings can provide additional information and substantially increase predictive power. Published: September 2009 | Download:
Most studies that have fueled alarm over the attrition and mobility rates of teachers have relied on proxy indicators of teacher quality, even though these proxies correlate only weakly with student performance. This paper examines the attrition and mobility of early-career teachers of varying quality using value-added measures of teacher performance. Unlike previous studies, this paper focuses on the variation in these effects across the effectiveness distribution. On average, more effective teachers tend to stay in their initial schools and in teaching. But the lowest performing teachers, who are generally the most likely to transfer between schools, appear to "churn" within the system, and teacher mobility appears significantly affected by student demographics and achievement levels. Published: August 2009 | Download:
This paper explores the relative effects of school and neighborhood characteristics on student achievement in Texas. Previous empirical studies have estimated one of these effects in the absence of controls for the other, leading to potentially misleading results. School variables are more robust and explain a greater degree of the variance in test scores than neighborhood characteristics. Neighborhood level variables, as a group, are statistically significant even in the presence of school variables. The particular pattern of effects varies by the manner in which the school context was controlled, by poverty status, move status, and location in the conditional achievement distribution. But neighborhood always mattered. Even if neighborhood conditions are less robust than school context effects, concern about neighborhood conditions is still justified. Reducing the concentration of poverty and economic segregation may be the easiest way to decrease the "savage inequalities" that exist between schools. Published: July 2009 | Download:
Do charter schools draw good teachers from traditional, mainstream public schools? Using an eleven-year panel of North Carolina public school teachers, the author finds nuanced patterns of teacher quality flowing into charter schools. High rates of inexperienced and unlicensed teachers moved to charter schools, but among regularly licensed teachers changing schools, charter movers had higher licensure test scores than other moving teachers, and they were more likely to be highly experienced. The author estimates measures of value added for a subset of elementary teachers and show that charter movers were less effective than other mobile teachers and colleagues within their sending schools, by 3 to 4 percent of a student-level standard deviation in achievement. Last Revised: June 2010 | Download:
This paper analyzes households' response to the introduction of intra-district school choice and examines the impact of this choice on student test scores in Pinellas County Schools, one of the largest school districts in the United States. Households react strongly to the incentives created by such programs, leading to significant changes in the frequency of exercising alternative public schooling options, as well as changes in the composition of the "opt out" students. However, using proximity to public alternatives as an instrument for opting out of the assigned public school, the author finds no significant benefit of opting out on student achievement and that those who opt out of their default public schools often perform significantly worse on standardized tests than similar students who stay behind. The results further suggest that the short-run detrimental effects of opting out are stronger for students who opt out closer to the terminal grade of the school level. Yet the detrimental effects are weaker for disadvantaged students, who typically constitute the proposed target of school choice reforms. Published: May 2009 | Download:
When given the opportunity, many teachers choose to leave schools serving poor, low-performing, and minority students. While substantial research has documented this phenomenon, far less effort has gone into understanding what features of the working conditions in these schools drive this relatively high turnover rate. This paper explores the relationship between school contextual factors and teacher retention decisions in New York City. The methodological approach separates the effects of teacher characteristics from school characteristics by modeling the relationship between the assessments of school contextual factors by one set of teachers and the turnover decisions by other teachers within the same school. Teachers' perceptions of the school administration have by far the greatest influence on teacher-retention decisions. This effect of administration is consistent for first-year teachers and the full sample of teachers and is confirmed by a survey of teachers who have recently left teaching in New York City. Published: May 2009 | Download:
Using detailed data from North Carolina, this paper examines the frequency, incidence, and consequences of teacher absences in public schools, as well as the impact of a policy designed to reduce absences. The incidence of teacher absences is regressive: when schools are ranked by the fraction of students receiving free or reduced-price lunch, schools in the poorest quartile averaged almost one extra sick day per teacher than schools in the highest income quartile, and schools with persistently high rates of teacher absence were much more likely to serve low-income than high-income students. In regression models incorporating teacher fixed effects, absences are associated with lower student achievement in elementary grades. There is evidence that the demand for discretionary absences is price-elastic. Our estimates suggest that a policy intervention that simultaneously raised teacher base salaries and broadened financial penalties for absences could both raise teachers' expected income and lower districts' expected costs. Published: April 2009 | Download:
Teacher attrition has attracted considerable attention as federal, state and local policies- intended to improve student outcomes, increasingly focus on recruiting and retaining more qualified and effective teachers. But policy makers are often frustrated by the seemingly high rates of attrition among teachers earlier on in their careers. This paper analyzes attrition patterns among teachers in New York City elementary and middle schools and explores whether teachers who transfer among schools, or leave teaching entirely, are more or less effective than those who remain. Findings show first-year teachers who are less effective in improving student math scores have higher attrition rates than do more effective teachers. This raises important questions about current retention and transfer policies. Published: March 2009 | Download:
This paper describes the school mobility rates for elementary and middle school students in North Carolina and attempts to estimate the effect of school mobility on the performance of different groups of students using student fixed effects models. School mobility is defined as changing schools at times that are non-promotional (e.g., moving from middle to high school). We used detailed administrative data on North Carolina students and schools from 1996 to 2005 and followed four cohorts of 3rd graders for six years each. School mobility rates were highest for minority and disadvantaged students. School mobility rates for Hispanic students declined across successive cohorts, but increased for Black students. Findings on effects were most pronounced in math. School mobility hurt the math performance of Black and Hispanic students, but not the math performance of white students. School mobility improved the reading performance of white and more advantaged students, but had no effect on the reading performance of minority students. "Strategic" school moves (cross-district) benefitted or had no effect on student performance, but "reactive" moves (within district) hurt all groups of students. White and Hispanic students were more likely to move to a higher quality school while Blacks were more likely to move to a lower quality school. The negative effects of school mobility increased with the number of school moves. Published: March 2009 | Download:
No Child Left Behind judges the effectiveness of schools based on their students' achievement status. However, many policy analysts argue that schools should be measured, instead, by their students' achievement growth. Using a ten-year student-level panel dataset from North Carolina, we examine how school-specific pressure related to two school accountability approaches (status and growth) affects student achievement at different points in the prior-year achievement distribution. Achievement gains for students below the proficiency cut point emerge in response to both types of accountability systems. We find little or no evidence that schools in North Carolina ignore students far below proficiency under either approach. Importantly, we find that the status, but not the growth, approach reduces the reading achievement of higher performing students, with the losses in the aggregate exceeding the gains at the bottom. The distributional effects of accountability pressure depend on the type of pressure for which schools are held accountable and the tested subject. Published: March 2009 | Download: 2008 | Back to Top
There are fierce debates over the best way to prepare teachers. Some argue that easing entry into teaching is necessary to attract strong candidates, while others argue that investing in high quality teacher preparation is the most promising approach. Most agree, however, that we lack a strong research basis for understanding how to prepare teachers. This paper is one of the first to estimate the effects of features of teachers' preparation on teachers' value-added to student test score performance in Math and English Language Arts. Our results indicate variation across preparation programs in the average effectiveness of the teachers they are supplying to New York City schools. In particular, preparation directly linked to practice appears to benefit teachers in their first year. Published: August 2008 | Downloads:
Value-added models in education research allow researchers to explore how a wide variety of policies and measured school inputs affect the academic performance of students. The impacts of such interventions are typically quantified in terms of effect sizes. We estimate the overall extent of test measurement error and how this varies across students using the covariance structure of student test scores across grades in New York City from 1999 to 2007. Results reinforce the importance of accounting for measurement error, as it meaningfully increases effect size estimates associated with teacher attributes. There are important differences in teacher effectiveness that are systematically related to observed teacher attributes. Such effects are important in the formulation and implementation of personnel policies. Published: June 2008 | Download:
Using a unique longitudinal dataset covering all Florida public school students in grades 3–10 over a five-year period, we analyze the impact of classroom peers on individual student performance. Unlike many previous data sets used to study peer effects in education, our data allow us to identify each member of a given student's classroom peer group in elementary, middle and high school as well as the classroom teacher responsible for instruction. As a result, we can control for individual student fixed effects simultaneously with individual teacher fixed effects, thereby alleviating biases due to endogenous assignment of both peers and teachers, including some dynamic aspects of such assignments. We find some sizable, significant peer effects within nonlinear models, but not with linear specifications. We find peer effects depend on a student's own ability and on the ability of the peers under consideration. Peer effects tend to be smaller when teacher fixed effects are included, a result that suggests co-movement of peer and teacher quality within a student over time. We also find that peer effects tend to be stronger at the classroom level than the grade level. Published: June 2008 | Download:
Teach for America (TFA) selects and places graduates from the most competitive colleges as teachers in the lowest-performing schools in the country. This paper is the first study that examines TFA effects in high school. We use rich longitudinal data from North Carolina and estimate TFA effects through cross-subject student and school fixed-effects models. We find that TFA teachers tend to have a positive effect on high school student test scores relative to non-TFA teachers, including those who are certified in-field. Such effects exceed the impact of additional years of experience and are particularly strong in math and science. Last Revised: March 2009 | Download:
This paper uses administrative data for the public K-12 schools of North Carolina to measure racial segregation in the public schools of North Carolina. Using data for the 2005/06 school year, the authors update previous calculations that measure segregation in terms of unevenness in racial enrollment patterns both between schools and within schools. They find that classroom segregation generally increased between 2000/01 and 2005/06, continuing, albeit at a slightly slower rate, the trend observed over the preceding six years. Segregation increased sharply in Charlotte-Mecklenburg, which introduced a new choice plan in 2002. Over the same period, racial and economic disparities in teacher quality widened in that district. Published: February 2008 | Download:
Since the 1996/97 school year, North Carolina has awarded bonuses of up to $1,500 to teachers in schools that exhibit test score gains above certain thresholds. This article reviews the details of the bonus program, describes patterns of differences between schools that qualify for bonuses of differing amounts, and presents basic data to address the question of whether the bonus program has improved student achievement, or has led to a narrowing of racial or socioeconomic achievement gaps. There is some evidence to suggest an improvement in overall test scores, particularly in math, but less evidence to suggest that achievement gaps have narrowed. Published: February 2008 | Download:
This paper uses evidence from Durham, North Carolina to examine the impact of school choice on racial and class-based segregation across schools. The findings suggest that school choice increases segregation. Furthermore, the effects of choice on segregation by class are larger than the effects on segregation by race. These results are consistent with the theoretical argument—developed in sociology and economics literature—that the segregating choices of students from advantaged backgrounds are likely to outweigh any integrating choices by disadvantaged students. Published: February 2008 | Download: 2007 | Back to Top
This paper examines the effect of accountability policy on school practices and student outcomes with remarkably comprehensive and detailed data that include a multi-wave five-year survey of the census of public schools in Florida and administrative data on individual student performance over time. The authors show that low-performing schools facing accountability pressure changed their instructional practices in meaningful ways. In addition, they present medium-run evidence school accountability promotes improved student test scores, and find that a significant portion of these test score gains can likely be attributed to the changes in school policies and practices uncovered in these surveys. Published: November 2007 | Download:
Most studies that have fueled alarm over the attrition and mobility rates of high-quality teachers have relied on proxy indicators of teacher quality, which recent research finds to be only weakly correlated with value-added measures of teachers' performance. We examine attrition and mobility of teachers using teacher value-added measures for early-career teachers in North Carolina public schools from 1996 to 2002. Our findings suggest that the most-effective teachers tend to stay in teaching and in specific schools. Contrary to common expectations, we do not find that more-effective teachers are more likely to leave more-challenging schools. Published: October 2007 | Download:
One of the first papers to ever estimate teacher effects at the secondary school level, this groundbreaking work presents evidence that teacher credentials affect secondary school student success in systematic ways and to a significant, policy-relevant extent. We use data on statewide end-of-course tests in North Carolina to examine the relationship between teacher credentials and student achievement at the high school level. We find compelling evidence that teacher credentials affect student achievement in systematic ways and that the magnitudes are large enough to be policy relevant. As a result, the uneven distribution of teacher credentials by race and socio-economic status of high school students- a pattern we also document- contributes to achievement gaps in high school. Published: October 2007 | Download:
This paper explores how the distribution of teacher qualifications and student achievement in New York City have changed from 2000 through 2005 using data on teachers and students. We find: the gap between the qualifications of New York City teachers in high-poverty schools and low-poverty schools has narrowed substantially over this period, and that this gap-narrowing associated with new hires has been driven almost entirely by the substitution of teachers entering through alternative certification routes, for uncertified teachers in high-poverty schools, these changes resulted from a direct policy intervention eliminating unlicensed teachers, and perhaps most intriguing, much larger gains could result if teachers with strong teacher qualifications could be recruited. Published: September 2007 | Download:
This paper explores the relationship between teacher testing and teacher effectiveness using a unique dataset that links teachers to their individual students. My findings show a positive relationship between some teacher licensure tests and student achievement. But they also suggest that states face significant tradeoffs when they require particular performance levels as a precondition to becoming a teacher: some teachers whom we might wish were not in the teacher workforce based on their contribution toward student achievement are eligible to teach based on their performance on these tests, while other individuals who would be effective teachers are ineligible. Published: April 2007 | Download:
This paper is the first to systematically document the relationship between individual teacher performance incentives and student achievement using United States data. We combine data from the National Education Longitudinal Survey with original survey data regarding the use of teacher incentives. We find that test scores are higher in schools offering individual financial incentives for good performance. Moreover, the relationship between the presence of merit pay and student test scores is strongest in schools that may have the least parental oversight. The association between teacher incentives and student performance could be due to better schools adopting teacher incentives or to teacher incentives eliciting more effort from teachers. Published: April 2007 | Download:
This paper is the first to explore the effects of school accountability systems on high-achieving students' long-term performance. Using data from a large state university, we relate school accountability pressure in high school to a student's university-level grades and study habits. We find that an accountability system based on a low-level test of basic skills apparently led to reduced performance by high-achieving students, while an accountability system based on a more challenging criterion-referenced exam apparently led to improved performance in college on mathematics and other technical subjects. Both types of systems are associated with increased "cramming" by students in college. The results indicate that the nature of an accountability system can influence its effectiveness. Published: April 2007 | Download:
Defined Benefit pension plans often generate odd time patterns of benefits. One typical pattern exhibits low accrual in early years, accelerating in mid-late years, followed by dramatic decline, or even negative returns in years that are relatively young for retirement. We consider four states for specific analysis: Arkansas, Missouri, California and Massachusetts. There are interesting variations among these states' formulas, which affect the incentive to retire early. We identify key factors in the defined benefit formulas that drive such patterns and likely consequences for employee behavior. We examine the efficiency and equity consequences of these systems and lessons that might be drawn for pension reform. Published: April 2007 | Download:
This paper examines late career mobility and retirement decisions for a cohort of mid-career Missouri public school teachers. The rate of accrual of traditional defined benefit pension systems is highly nonlinear and back-loaded with most of the gain occurring in the final years prior to retirement. Also, these pension systems have rules that introduce kinks or discontinuities in the rate of accrual after 30 years. This paper explores the effect of these pension rules on retirement patterns. Missouri permits teachers to continue teaching part-time while collecting benefits. Teachers can also retire from one pension system and begin teaching in another. The paper examines both types of behavior. Published: April 2007 | Download:
This study considers the efficacy of a certification system for teachers established by the National Board for Professional Teaching Standards (NBPTS). The authors utilize a four-year span of the longitudinal data from Florida to determine the relationship between teacher NBPTS certification and student test scores on low-stakes and high-stakes exams. They find evidence that NBPTS certification provides a positive signal of teacher productivity in some cases, but it is highly variable. The process of becoming NBPTS certified does not appear to increase teacher productivity nor do NBPTS-certified teachers appear to enhance the productivity of their colleagues. Published: March 2007 | Download: Read commentary on this working paper by Mary Dilworth of the NBPTS, Daniel McCaffrey of the RAND Corporation, and CALDER researchers, Helen F. Ladd and Tim R. Sass
Using longitudinal data from the state of Florida, this study examines the effects of various types of education and training on the ability of teachers to promote student achievement. It suggests that teacher training generally has little influence on productivity. One exception is that content-focused teacher professional development is positively associated with productivity in middle and high school math. In addition, more experienced teachers appear more effective in teaching elementary and middle school reading. There is no evidence that either pre-service (undergraduate) training or the scholastic aptitude of teachers influences their ability to increase student achievement. Published: March 2007 | Download:
In this paper, the authors use a ten-year span of longitudinal data from North Carolina to explore a range of questions related to the relationship between teacher characteristics and credentials, on the one hand, and student achievement on the other. They conclude that a teacher's experience, test scores and regular licensure all have positive effects on student achievement, with larger effects for math than for reading. Taken together the various teacher credentials exhibit quite large effects on math achievement, whether compared to the effects of changes in class size or to the socio-economics characteristics of students. Published: March 2007 | Download: Read commentary on this working paper by Mary Dilworth of the NBPTS, Daniel McCaffrey of the RAND Corporation, and CALDER researchers, Helen F. Ladd and Tim R. Sass
The central question for this study is how the quality of the teachers and principals in high poverty schools in North Carolina compares to that in the schools serving more advantaged students. A related question is why these differences emerge. The consistency of the patterns across many measures of qualifications for both teachers and principals leaves no doubt that students in the high poverty schools are served by school personnel with lower qualifications than those in the lower poverty schools. Moreover, in many cases the differences are large. Additional evidence documents that the differences largely reflect predictable outcomes of the labor market for teachers and principals. Published: March 2007 | Download: Policy Briefs | Back to Top
Race to the Top encourages states to adopt policies that measure the impact of individual teachers on student learning and use those measures to inform human capital decisions including tenure and compensation. As a number of states begin to revamp their tenure-granting policies, the idea that high-stakes personnel decisions need to be linked to direct measures of teacher effectiveness is gaining traction among education policymakers. Contributing to the debate about policies that can enhance the quality of teachers, this brief evaluates how well early-career performance signals teacher effectiveness after tenure. Published: May 2010 | Download:
Can value-added measures provide valuable information to assess the quality of teachers and to create incentives for improvement? CALDER researchers tackle this important and timely question by describing the analytic framework of value-added measures, by identifying methodological concerns about value-added estimation and ways to mitigate them, and by discussing the policy uses of value-added estimates of teacher effectiveness. Published: May 2010 | Download:
In an era of greater school accountability, leadership matters. For decades, principals have been recognized as vital to the effectiveness of schools, but strong empirical evidence on the extent to which, and the ways in which, school leaders matter has not been available. CALDER researchers have advanced our knowledge in this area by skillfully drawing on rich state longitudinal databases. This brief synthesizes new findings on the effectiveness and distribution of principals, the characteristics of good leadership, and how best to prepare principals for this increasingly demanding job. Published: April 2010 | Download: 2008| Back to Top
This research brief examines differences in teacher effectiveness by school transition status and school characteristics in a large urban school district in Texas, using estimates of teacher effectiveness based on teacher contributions to student learning outcomes across classrooms. This research finds little or no evidence to support the view that more effective teachers have higher exit probabilities. In fact, the study finds that teachers who exit are significantly less effective, on average, than those who stay. Published: November 2008 | Download:
This important research explores the effects of district policy interventions on the distribution of teacher qualifications and student achievement. Authors use a 5-year span of individual teacher- and student-level longitudinal data from New York City (NYC) from 2000 through 2005 to estimate the differences in the effectiveness of teachers entering NYC schools through different pathways to teaching. The study finds that the gap between the qualifications of NYC teachers in high-poverty and low-poverty NYC schools has narrowed substantially since 2000, mostly ensuing from the city's concentrated effort to match exceptionally capable teachers with very needy students and the virtual substitution of newly hired uncertified teachers in high-poverty schools with new hires from alternative certification routes: NYC Teaching Fellows and Teach for America. Published: November 2008 | Download:
This research brief describes the legal and operational structure of the Texas longitudinal data system related to recent changes in the Family Educational Rights and Privacy Act of 1974 (FERPA)—which establishes the rights of parents to access their children's educational records and protects the confidentiality of student information—that more closely align law and practice. The U.S. Department of Education's FERPA Final Regulations Amendments took effect January 8, 2009. Published: November 2008 | Download:
There is little doubt that teacher quality is a key determinant of student achievement, but finding ways to identify and reward the best teachers has proven illusive. This research brief considers the stability of value-added measures of teacher effectiveness over time and the resulting implications for the design and implementation of performance-based teacher compensation schemes. Published: November 2008 | Download:
Using individual teacher and student-level longitudinal data from North Carolina, this research brief presents selected findings from work examining the stability of value-added model estimates of teacher effectiveness, focusing on their implication for teacher tenure policies and making high stakes personnel decisions. Findings show year-to-year correlations in teacher effects are modest, but pre-tenure estimates of teacher job performance do predict estimated post-tenure performance in both math and reading, and would therefore seem to be a reasonable metric to use as a factor in making substantive teacher selection decisions. Published: November 2008 | Download:
This research brief estimates the overall extent of test measurement error and how this varies across students using New York City student- level longitudinal data across grades 3-8 from 1999- 2007. Results reinforce the importance of accounting for measurement error, as it meaningfully increases effect size estimates associated with teacher attributes. There are important differences in teacher effectiveness that are systematically related to observed teacher attributes. Such effects are important in the formulation and implementation of personnel policies. Also, effect sizes as traditionally measured have led analysts to understate the magnitudes of effects because the standard deviation of observed scores overstates the dispersion of true achievement in the student population. Published: November 2008 | Download:
This brief describes estimation and measurement issues relevant to estimating the quality of instruction in the context of a cumulative model of learning. The discussion highlights the importance of accounting for student differences and the advantages of focusing on student achievement gains as opposed to differences in test scores. Published: November 2007 | Download:
This brief calculates graduation rates for the state of Florida using longitudinal data. We describe our measurement strategies and compare them with the state’s official measurement procedures. We calculate the diploma and GED attainment rates of six separate cohorts of Florida 9th graders who began high school between 1995/96 and 2000/01. We then present rates of both diploma receipt and GED receipt at four years and in later years. The results show an increasing trend in graduation rates in the state over the period studied and a substantial bump at five years, with growth flattening out after that time. Published: July 2008 | Download: The research reported here was supported in part by the Institute of Education Sciences, U.S. Department of Education, through Grant R305A060018 to the Urban Institute. The opinions expressed are those of the authors and do not represent views of the Institute of Education Sciences, the U.S. Department of Education, or the Urban Institute. | |
 | |
CALDER provides timely and accessible independent research and analysis on education policy to policy leaders, researchers, media and the public. Our research scientists are capitalizing on state longitudinal databases- what are emerging as the richest new sources of information on schools, teachers, and students in the U.S.- to address some critical questions about education policy.
