Learn by the Numbers
Arthur Reynolds et al.
Science, forthcoming
Abstract:
Advances in understanding the effects of early education have benefited public policy and developmental science. Although preschool has demonstrated positive effects on life-course outcomes, limitations in knowledge on program scale, subgroup differences, and dosage levels have hindered progress. We report the effects of the Child-Parent Center Education Program on indicators of well-being up to 25 years later for more than 1400 participants. This established, publicly funded intervention begins in preschool and provides up to 6 years of service in inner-city Chicago schools. Relative to the comparison group receiving the usual services, program participation was independently linked to higher educational attainment, income, socioeconomic status (SES), and health insurance coverage, as well as lower rates of justice-system involvement and substance abuse. Evidence of enduring effects was strongest for preschool, especially for males and children of high school dropouts. The positive influence of 4 years or more of service was limited primarily to education and SES. Dosage within program components was mostly unrelated to outcomes. Findings demonstrate support for the enduring effects of sustained school-based early education to the end of the third decade of life.
----------------------
Children Left Behind: The Effects of Statewide Job Loss on Student Achievement
Elizabeth Oltmans Ananat et al.
NBER Working Paper, June 2011
Abstract:
Given the magnitude of the recent recession, and the high-stakes testing the U.S. has implemented under the No Child Left Behind Act (NCLB), it is important to understand the effects of large-scale job losses on student achievement. We examine the effects of state-level job losses on fourth- and eighth-grade test scores, using federal Mass Layoff Statistics and 1996-2009 National Assessment of Educational Progress data. Results indicate that job losses decrease scores. Effects are larger for eighth than fourth graders and for math than reading assessments, and are robust to specification checks. Job losses to 1% of a state's working-age population lead to a .076 standard deviation decrease in the state's eighth-grade math scores. This result is an order of magnitude larger than those found in previous studies that have compared students whose parents lose employment to otherwise similar students, suggesting that downturns affect all students, not just students who experience parental job loss. Our findings have important implications for accountability schemes: we calculate that a state experiencing one-year job losses to 2% of its workers (a magnitude observed in seven states) likely sees a 16% increase in the share of its schools failing to make Adequate Yearly Progress under NCLB.
----------------------
The Impact of No Child Left Behind on Student Achievement
Thomas Dee & Brian Jacob
Journal of Policy Analysis and Management, Summer 2011, Pages 418-446
Abstract:
The No Child Left Behind (NCLB) Act compelled states to design school accountability systems based on annual student assessments. The effect of this federal legislation on the distribution of student achievement is a highly controversial but centrally important question. This study presents evidence on whether NCLB has influenced student achievement based on an analysis of state-level panel data on student test scores from the National Assessment of Educational Progress (NAEP). The impact of NCLB is identified using a comparative interrupted time series analysis that relies on comparisons of the test-score changes across states that already had school accountability policies in place prior to NCLB and those that did not. Our results indicate that NCLB generated statistically significant increases in the average math performance of fourth graders (effect size 5 0.23 by 2007) as well as improvements at the lower and top percentiles. There is also evidence of improvements in eighth-grade math achievement, particularly among traditionally low-achieving groups and at the lower percentiles. However, we find no evidence that NCLB increased fourth-grade reading achievement.
----------------------
The Impact of Tougher Education Standards: Evidence from Florida
Damon Clark
Economics of Education Review, forthcoming
Abstract:
Many of the policies that fall under the school accountability umbrella are designed to incentivize students. Prominent among these are high school exit exams, standardized tests that, in some states, students must pass to earn a high school diploma. Proponents of these tests argue that by incentivizing students, they induce them to work harder and, therefore, improve their high school performance and, perhaps, longer-run outcomes; some of these proponents argue that these exams would be even more helpful if they were set at a higher standard. Critics worry that these exams prevent some students from graduating and cause others to dropout; they contend that these effects are worse if standards are higher. In this paper we investigate the impacts of an increase in the exit exam standard in Florida. Using difference-in-difference methods, we show that this had few of the negative effects claimed by critics. We cannot detect any positive effects of the higher standard, although such effects may be too small to be picked up with our data.
----------------------
Judith Scott-Clayton
Journal of Human Resources, Summer 2011, Pages 614-646
Abstract:
Programs linking college aid to academic achievement could work either by lowering the cost of college or by inducing additional student effort. I examine the PROMISE program in West Virginia, which offers free tuition to students who maintain a minimum GPA and course load. Using administrative data, I exploit discontinuities in the eligibility formula and the timing of implementation to estimate causal effects. I find robust and significant impacts on key academic outcomes. Impacts are concentrated around the annual requirements for scholarship renewal, suggesting that the program works via incentives for academic achievement, not simply by relaxing financial constraints.
----------------------
Marcus Winters & Jay Greene
Educational Evaluation and Policy Analysis, June 2011, Pages 138-158
Abstract:
The authors expand on research evaluating public school response to school choice policies by considering the particular influence of voucher programs for disabled students-a growing type of choice program that may have different implications for public school systems from those of more conventional choice programs. The authors provide a theoretical framework to show that special education vouchers could influence both school quality and the likelihood that a school will choose to identify the marginal child as disabled. Using a rich panel data set from Florida, the authors find some evidence that competition from a voucher program for disabled students decreased the likelihood that a student was diagnosed as having a mild disability and was positively related to academic achievement in the public schools.
----------------------
Conditional Cash Penalties in Education: Evidence from the Learnfare Experiment
Thomas Dee
Economics of Education Review, forthcoming
Abstract:
Wisconsin's influential Learnfare initiative is a conditional cash penalty program that sanctions a family's welfare grant when covered teens fail to meet school attendance targets. In the presence of reference-dependent preferences, Learnfare provides uniquely powerful financial incentives for student performance. However, a 10-county random-assignment evaluation suggested that Learnfare had no sustained effects on school enrollment and attendance. This study evaluates the data from this randomized field experiment. In Milwaukee County, the Learnfare procedures were poorly implemented and the random-assignment process failed to produce balanced baseline traits. However, in the nine remaining counties, Learnfare increased school enrollment by 3.5 percent (effect size = 0.08) and attendance by 4.5 percent (effect size = 0.10). These results suggest that well-designed financial incentives may be an effective mechanism for improving the school persistence of at-risk students at scale.
----------------------
Making a difference? The effects of Teach For America in high school
Zeyu Xu, Jane Hannaway & Colin Taylor
Journal of Policy Analysis and Management, Summer 2011, Pages 447-469
Abstract:
Teach For America (TFA) selects and places graduates from the most competitive colleges as teachers in the lowest-performing schools in the country. This paper is the first study that examines TFA effects in high school. We use rich longitudinal data from North Carolina and estimate TFA effects through cross-subject student and school fixed effects models. We find that TFA teachers tend to have a positive effect on high school student test scores relative to non-TFA teachers, including those who are certified in field. Such effects offset or exceed the impact of additional years of experience and are particularly strong in science.
----------------------
Imaging the Frame: Media Representations of Teachers, Their Unions, NCLB, and Education Reform
Rebecca Goldstein
Educational Policy, July 2011, Pages 543-576
Abstract:
This article examines the political discourse surrounding NCLB, educational reform, and how that discourse shaped perceptions of public education during the Bush Administration. Examining mass media campaigns in the New York Times and Time Magazine, the article demonstrates how the media has visually and textually framed and reinforced NCLB and market reforms as the only solution to address the failures of public education by attacking teachers' unions and individual teachers. Visual and textual data were collected, cataloged, and analyzed employing frame analysis in concert with critical discourse and visual analysis. Analysis revealed that media framing presented an overwhelmingly negative image of teachers' unions as opposed to NCLB and other school reform efforts. Even in the rare instances where unions were presented positively, the debate resonated with general public perception so that even when individuals or the general public are critical of NLCB and educational reform efforts, they support overall premises about "saving" public education.
----------------------
Identifying Effective Classroom Practices Using Student Achievement Data
Thomas Kane et al.
Journal of Human Resources, Summer 2011, Pages 587-613
Abstract:
Research continues to find large differences in student achievement gains across teachers' classrooms. The variability in teacher effectiveness raises the stakes on identifying effective teachers and teaching practices. This paper combines data from classroom observations of teaching practices and measures of teachers' ability to improve student achievement as one contribution to these questions. We find that observation measures of teaching effectiveness are substantively related to student achievement growth and that some observed teaching practices predict achievement more than other practices. Our results provide information for both individual teacher development efforts, and the design of teacher evaluation systems.
----------------------
The Effectiveness of Private Voucher Education: Evidence From Structural School Switches
Bernardo Lara, Alejandra Mizala & Andrea Repetto
Educational Evaluation and Policy Analysis, June 2011, Pages 119-137
Abstract:
In this article the authors analyze the effect of private voucher education on student academic performance using new data on Chilean students and a novel identification strategy. Most schools in Chile provide either primary or secondary education. The authors analyze the effect of private voucher education on students who are forced to enroll at a different school to attend secondary education once graduated from primary schooling-structural switches. Moreover, the data set the authors use in this article contains information on previous academic achievement and thus allows them to identify differences in students' unobservable characteristics. Using a number of propensity-score-based econometric techniques and the changes-in-changes estimation method, the authors find that private voucher education leads to small, sometimes not statistically significant differences in academic performance. The estimated effect of private voucher education amounts to about 4% to 6% of one standard deviation in test scores. In contrast, the literature on Chile based on cross-sectional data had previously found positive effects of about 15% to 20% of one standard deviation.
----------------------
Improved Learning in a Large-Enrollment Physics Class
Louis Deslauriers, Ellen Schelew & Carl Wieman
Science, 13 May 2011, Pages 862-864
Abstract:
We compared the amounts of learning achieved using two different instructional approaches under controlled conditions. We measured the learning of a specific set of topics and objectives when taught by 3 hours of traditional lecture given by an experienced highly rated instructor and 3 hours of instruction given by a trained but inexperienced instructor using instruction based on research in cognitive psychology and physics education. The comparison was made between two large sections (N = 267 and N = 271) of an introductory undergraduate physics course. We found increased student attendance, higher engagement, and more than twice the learning in the section taught using research-based instruction.
----------------------
Conserving Time in the Classroom: The Clicker Technique
Lindsay Anderson et al.
Quarterly Journal of Experimental Psychology, forthcoming
Abstract:
Any technique that conserves classroom instructional time without sacrificing the amount learned is of great educational value. This research compared a laboratory analogue of the clicker technique to analogues of other classroom pedagogical methods that all involve repeated testing during teaching. The clicker analogue mimics the classroom practice of dropping material that is understood by the majority of the class, as revealed by testing with clicker questions, from further lecture. A fact learning and retrieval paradigm was used, in which college students learned facts about unfamiliar countries. Compressing instruction time based on group-level performance produced as much learning as no compression and as compression based on individual-level performance. Results suggest that the clicker technique is an efficient and cost-effective method of conserving instructional time without loss of amount learned.
----------------------
Increased Structure and Active Learning Reduce the Achievement Gap in Introductory Biology
David Haak et al.
Science, 3 June 2011, Pages 1213-1216
Abstract:
Science, technology, engineering, and mathematics instructors have been charged with improving the performance and retention of students from diverse backgrounds. To date, programs that close the achievement gap between students from disadvantaged versus nondisadvantaged educational backgrounds have required extensive extramural funding. We show that a highly structured course design, based on daily and weekly practice with problem-solving, data analysis, and other higher-order cognitive skills, improved the performance of all students in a college-level introductory biology class and reduced the achievement gap between disadvantaged and nondisadvantaged students - without increased expenditures. These results support the Carnegie Hall hypothesis: Intensive practice, via active-learning exercises, has a disproportionate benefit for capable but poorly prepared students.
----------------------
Roger Wojtkiewicz & Mellisa Holtzman
Sociological Spectrum, July/August 2011, Pages 498-521
Abstract:
We use data from the National Longitudinal Education Study (NELS) to build upon previous research that considered the negative effects of living in mother-only families and stepparent families on the subsequent educational attainment of children. Our results break new ground in finding that although those who lived in a mother-only family are not less likely overall to graduate college than those who lived with two biological parents, they are significantly less likely to graduate college given four-year college attendance even when other important factors are controlled. In addition, we find that those who lived in a stepparent family are less likely overall to graduate college than those who lived with two biological parents when other important factors are controlled. This difference for those who lived in a stepparent family is due to lower chances of four-year college attendance given high school graduation and of college graduation given four-year college attendance.
----------------------
From High School to College: The Transition Experiences of Black and White Students
Pidi Zhang & William Smith
Journal of Black Studies, July 2011, Pages 828-845
Abstract:
Based on a quantitative study of students at a midsize public university in the Southeast and informed by Astin's input-environment-outcome model, this article explores how the transition experiences of Black students differed from those of White students. Black students relied more on guidance counselors in high school and orientation programs in college. Although the academic ethic was strongly related to grade point average (GPA) and a substantially larger proportion of Black females had a strong academic ethic, their GPAs were not different from those of Black males and were significantly lower than those of both White females and White males. The analysis found an inflated perception of the amount of help parents provided in the transition.
----------------------
Amanda Berhenke et al.
Early Childhood Research Quarterly, forthcoming
Abstract:
Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in young children. Head Start graduates completed challenging puzzle and trivia tasks during their kindergarten year. Children's emotion expression and task engagement were assessed based on their observed facial and verbal expressions and behavioral cues. Hierarchical regression analyses revealed that observed persistence and shame predicted teacher ratings of children's academic achievement, whereas interest, anxiety, pride, shame, and persistence predicted children's social skills and learning-related behaviors. Children's emotional and behavioral responses to challenge thus appeared to be important indicators of school success. Observation of such responses may be a useful and valid alternative to self-report measures of motivation at this age.