Florida
|
CALDER Authors Related Publications
This paper contributes importantly to the growing literature on the training of special education teachers and how it translates into classroom practice and student achievement. The authors examine the impact of pre-service preparation and in-service formal and informal training on the ability of teachers to promote academic achievement among students with disabilities. Using student-level longitudinal data from Florida over a five-year span the authors estimate “value-added” models of student achievement. There is little support for the efficacy of in-service professional development courses focusing on special education. However, teachers with advanced degrees are more effective in boosting the math achievement of students with disabilities than are those with only a baccalaureate degree. Also pre-service preparation in special education has statistically significant and quantitatively substantial effects on the ability of teachers of special education courses to promote gains in achievement for students with disabilities, especially in reading. Certification in special education, an undergraduate major in special education, and the amount of special education coursework in college are all positively correlated with the performance of teachers in special education reading courses. Published: June 2010 | Download:
Struggling schools that come under increased accountability pressure face a number of challenges, including changing instructional policies and practices to facilitate student improvement. But what effect does school accountability have on teachers’ mobility decisions? This study is the first to exploit policy variation within the same state to examine the effects of school accountability on teacher job changes. Using student-level data from Florida State the authors measure the degree to which schools and teachers were “surprised” by the change in Florida’s school grading system (A+ Plan for Education) in the summer of 2002— what they refer to as an “accountability shock.” They observed the mobility decisions of teachers in the years before and after the school grading change and found over half of all schools in the state experienced an accountability “shock” due to this grading change. Teachers were more likely to leave schools facing increased accountability pressure; even more likely to leave schools shocked downward to a grade of “F”; and less likely to leave schools facing decreased accountability pressure. Schools facing increased accountability pressure also saw a rise in the average quality of the teachers who stayed. If these schools were able to retain more of their high- quality teachers, perhaps through increased incentives to remain in the school, the performance gains associated with school accountability pressure could be greater than those already observed. Published: June 2010 | Download:
Voucher options like tuition tax credit-funded scholarship programs have become increasingly popular in recent years. This study examines the effects of private school competition on public school students’ test scores in the wake of Florida’s Corporate Tax Credit Scholarship (FTC) program which offered scholarships to eligible low-income students to attend private schools. The authors examine whether students in schools exposed to a more competitive private school landscape saw greater improvements in their students’ test scores after the introduction of the program, than did students in schools that faced less competition. Students in public schools faced with increased private school competition showed greater gains in test scores than students in other public schools with the introduction of the program. These findings are not an artifact of pre-policy trends; the degree of competition from nearby private schools matters only after the announcement of the new program, which makes nearby private competitors more affordable for eligible students. The gains appear to be much more pronounced in the schools most at risk of losing students and in the schools that are on the margin of Title I funding. Published: June 2010 | Download:
The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to provide empirical information needed to design adequately powered studies that randomize schools using data from Florida and North Carolina. The authors assess how different covariates contribute to improving the statistical power of a randomization design and examine differences between math and reading tests; differences between test types (curriculum-referenced tests versus norm-referenced tests); and differences between elementary school and secondary school, to see if the test subject, test type, or grade level makes a large difference in the crucial design parameters. Finally they assess bias in 2-level models that ignore the clustering of students in classrooms. Published: May 2010 | Download:
Teachers are systematically sorted across schools. Often, schools serving the lowest-achieving students staffed by the least-skilled teachers. While teachers' school preferences account for some of the sorting, school practices are also likely to be a key factor. Using value-added methods, the authors examine the relationship between a school's effectiveness during a given principal's tenure and the retention, recruitment and development of its teachers. Three key findings emerge about principal effectiveness. More effective principals: (1) are able to retain higher-quality teachers and remove less-effective teachers; (2) are able to attract and hire higher-quality teachers to fill vacancies; (3) have teachers who improve at a greater pace than those in schools with less effective leadership (there is some evidence for this, albeit weak). These findings drive home the importance of personnel practices for effective school leadership. Published: December 2009 | Download:
In this study authors use longitudinal data from one large school district – Miami-Dade County Public Schools, to investigate the distribution of principals across schools. They find schools serving many low-income, non-white, and low-achieving students have principals with less experience, less education, and who attended less selective colleges. This distribution of principals is partially driven by the initial match of first-time principals to schools at the beginning of their careers and is exacerbated by systematic attrition and transfer away from these schools. Supplementing these data with surveys of principals, the authors find principals' stated preferences for school characteristics mirror observed distribution and transfer patterns. Principals prefer to work in easier to serve schools with favorable working conditions which also tend to be schools with fewer poor, minority and/or low-achieving students. Published: December 2009 | Download:
While the importance of effective principals is undisputed, few studies have addressed what specific skills principals need to promote school success. This study draws on unique data combining survey responses from principals, assistant principals, teachers and parents with rich administrative data to identify which principal skills matter most for school outcomes. Factor analysis of a 42-item task inventory distinguishes five skill categories, yet only one of them, the principals' organization management skills, consistently predicts student achievement growth and other success measures. Analysis of evaluations of principals by assistant principals confirms this central result. The analysis argues for a broad view of instructional leadership that includes general organizational management skills as a key complement to the work of supporting curriculum and instruction. Published: December 2009 | Download:
School principals have complex jobs. To better understand the work lives of principals, this study uses observational time-use data for all high school principals in Miami-Dade County Public Schools. This paper examines the relationship between the time principals spent on different types of activities and school outcomes including student achievement, teacher and parent assessments of the school, and teacher satisfaction. Time spent on Organization Management activities is associated with positive school outcomes, such as student test score gains and positive teacher and parent assessments of the instructional climate, whereas Day-to-Day Instruction activities are marginally or not at all related to improvements in student performance and often have a negative relationship with teacher and parent assessments. This paper suggests that a single-minded focus on principals as instructional leaders operationalized through direct contact with teachers may be detrimental if it forsakes the important role of principals as organizational leaders. Published: December 2009 | Download:
Mounting pressure in the policy arena to improve teacher productivity either by improving signals that predict teacher performance or through creating incentive contracts based on performance—has spurred two related questions: Are there important determinants of teacher productivity that are not captured by teacher credentials but that can be measured by subjective assessments? And would evaluating teachers based on a combination of subjective assessments and student outcomes more accurately gauge teacher performance than student test scores alone? Using data from a midsize Florida school district, this paper explores both questions by calculating teachers' "value added" and comparing those outcomes with subjective ratings of teachers by school principals. Teacher value-added and principals' subjective ratings are positively correlated and principals' evaluations are better predictors of a teacher's value added than traditional approaches to teacher compensation focused on experience and formal education. In settings where schools are judged on student test scores, teachers' ability to raise those scores is important to principals, as reflected in their subjective teacher ratings. Also, teachers' subject knowledge, teaching skill, and intelligence are most closely associated with both the overall subjective teacher ratings and the teacher value added. Finally, while past teacher value added predicts future teacher value added the principals' subjective ratings can provide additional information and substantially increase predictive power. Published: September 2009 | Download:
This paper analyzes households' response to the introduction of intra-district school choice and examines the impact of this choice on student test scores in Pinellas County Schools, one of the largest school districts in the United States. Households react strongly to the incentives created by such programs, leading to significant changes in the frequency of exercising alternative public schooling options, as well as changes in the composition of the "opt out" students. However, using proximity to public alternatives as an instrument for opting out of the assigned public school, the author finds no significant benefit of opting out on student achievement and that those who opt out of their default public schools often perform significantly worse on standardized tests than similar students who stay behind. The results further suggest that the short-run detrimental effects of opting out are stronger for students who opt out closer to the terminal grade of the school level. Yet the detrimental effects are weaker for disadvantaged students, who typically constitute the proposed target of school choice reforms. Published: May 2009 | Download:
Using a unique longitudinal dataset covering all Florida public school students in grades 3–10 over a five-year period, we analyze the impact of classroom peers on individual student performance. Unlike many previous data sets used to study peer effects in education, our data allow us to identify each member of a given student's classroom peer group in elementary, middle and high school as well as the classroom teacher responsible for instruction. As a result, we can control for individual student fixed effects simultaneously with individual teacher fixed effects, thereby alleviating biases due to endogenous assignment of both peers and teachers, including some dynamic aspects of such assignments. We find some sizable, significant peer effects within nonlinear models, but not with linear specifications. We find peer effects depend on a student's own ability and on the ability of the peers under consideration. Peer effects tend to be smaller when teacher fixed effects are included, a result that suggests co-movement of peer and teacher quality within a student over time. We also find that peer effects tend to be stronger at the classroom level than the grade level. Published: June 2008 | Download:
This paper examines the effect of accountability policy on school practices and student outcomes with remarkably comprehensive and detailed data that include a multi-wave five-year survey of the census of public schools in Florida and administrative data on individual student performance over time. The authors show that low-performing schools facing accountability pressure changed their instructional practices in meaningful ways. In addition, they present medium-run evidence school accountability promotes improved student test scores, and find that a significant portion of these test score gains can likely be attributed to the changes in school policies and practices uncovered in these surveys. Published: November 2007 | Download:
This paper is the first to systematically document the relationship between individual teacher performance incentives and student achievement using United States data. We combine data from the National Education Longitudinal Survey with original survey data regarding the use of teacher incentives. We find that test scores are higher in schools offering individual financial incentives for good performance. Moreover, the relationship between the presence of merit pay and student test scores is strongest in schools that may have the least parental oversight. The association between teacher incentives and student performance could be due to better schools adopting teacher incentives or to teacher incentives eliciting more effort from teachers. Published: April 2007 | Download:
This paper is the first to explore the effects of school accountability systems on high-achieving students' long-term performance. Using data from a large state university, we relate school accountability pressure in high school to a student's university-level grades and study habits. We find that an accountability system based on a low-level test of basic skills apparently led to reduced performance by high-achieving students, while an accountability system based on a more challenging criterion-referenced exam apparently led to improved performance in college on mathematics and other technical subjects. Both types of systems are associated with increased "cramming" by students in college. The results indicate that the nature of an accountability system can influence its effectiveness. Published: April 2007 | Download:
This study considers the efficacy of a certification system for teachers established by the National Board for Professional Teaching Standards (NBPTS). The authors utilize a four-year span of the longitudinal data from Florida to determine the relationship between teacher NBPTS certification and student test scores on low-stakes and high-stakes exams. They find evidence that NBPTS certification provides a positive signal of teacher productivity in some cases, but it is highly variable. The process of becoming NBPTS certified does not appear to increase teacher productivity nor do NBPTS-certified teachers appear to enhance the productivity of their colleagues. Published: March 2007 | Download: Read commentary on this working paper by Mary Dilworth of the NBPTS, Daniel McCaffrey of the RAND Corporation, and CALDER researchers, Helen F. Ladd and Tim R. Sass
Using longitudinal data from the state of Florida, this study examines the effects of various types of education and training on the ability of teachers to promote student achievement. It suggests that teacher training generally has little influence on productivity. One exception is that content-focused teacher professional development is positively associated with productivity in middle and high school math. In addition, more experienced teachers appear more effective in teaching elementary and middle school reading. There is no evidence that either pre-service (undergraduate) training or the scholastic aptitude of teachers influences their ability to increase student achievement. Published: March 2007 | Download:
This brief calculates graduation rates for the state of Florida using longitudinal data. We describe our measurement strategies and compare them with the state’s official measurement procedures. We calculate the diploma and GED attainment rates of six separate cohorts of Florida 9th graders who began high school between 1995/96 and 2000/01. We then present rates of both diploma receipt and GED receipt at four years and in later years. The results show an increasing trend in graduation rates in the state over the period studied and a substantial bump at five years, with growth flattening out after that time. Published: July 2008 | Download:
| |
 | |
