Findings

For extra credit

Kevin Lewis

March 27, 2013

School Choice: Supporters and Opponents

David Brasington & Diane Hite
Contemporary Economic Policy, forthcoming

Abstract:
We examine the attitudes of Ohio homeowners about school choice, which includes open enrollment programs, school vouchers, tuition tax credits, and charter schools. Previous studies examine more limited forms of choice and investigate fewer possible influences. Overall we report at least five new findings and five findings that contradict previous studies. We find the strongest predictors of opposition for school choice are people having graduate degrees and living in high-performing public school districts. We find people living in blue collar areas and using private schools to be the strongest predictors of support. Males tend to oppose choice and African Americans support it. We find no role for income, the convenience of alternative schools, or the protection of house values in support for school choice. Overall we report at least five new findings and five findings that contradict previous studies.

----------------------

School Vouchers and Student Outcomes: Experimental Evidence from Washington, DC

Patrick Wolf et al.
Journal of Policy Analysis and Management, Spring 2013, Pages 246-270

Abstract:
School vouchers are the most contentious form of parental school choice. Vouchers provide government funds that parents can use to send their children to private schools of their choice. Here we examine the empirical question of whether or not a school voucher program in Washington, DC, affected achievement or the rate of high school graduation for participating students. The District of Columbia Opportunity Scholarship Program (OSP) has operated in the nation's capital since 2004, funded by a federal government appropriation. Because the program was oversubscribed in its early years of operation, and vouchers were awarded by lottery, we were able to use the "gold standard" evaluation method of a randomized experiment to determine what impacts the OSP had on student outcomes. Our analysis revealed compelling evidence that the DC voucher program had a positive impact on high school graduation rates, suggestive evidence that the program increased reading achievement, and no evidence that it affected math achievement. We discuss the implications of these findings in light of recent policy developments including the reauthorization of the OSP and the enactment or expansion of more than a dozen school voucher or voucher-type programs throughout the United States in 2011 and 2012.

----------------------

School Vouchers and Student Attainment: Evidence from a State-Mandated Study of Milwaukee's Parental Choice Program

Joshua Cowen et al.
Policy Studies Journal, February 2013, Pages 147-168

Abstract:
In this article we examine educational attainment levels for students in Milwaukee's citywide voucher program and a comparable group of public school students. Using unique data collected as part of a state-mandated evaluation of the program, we consider high school graduation and enrollment in postsecondary institutions for students initially exposed to voucher schools and those in public schools at the same time. We show that exposure to voucher schools was related to graduation and, in particular, to enrollment and persistence in a 4-year college. These differences are apparent despite controls for student neighborhoods, demographics, early-career test scores and - for a subsample of survey respondents - controls for parental education, income, religious behavior, and marital status. We conclude by stressing the implications for future scholarship and policy, including the importance of attainment outcomes in educational research.

----------------------

The Effects of HOPE on Post-College Retention in the Georgia Workforce

David Sjoquist & John Winters
Regional Science and Urban Economics, May 2013, Pages 479-490

"Previous researchers have examined the effects of merit scholarship programs including Georgia's HOPE Scholarship on a number of important variables, but the effects on post-college retention have been largely overlooked...Together our two sets of results suggest that HOPE kept many students in-state for college, but the students who attended college in Georgia because of HOPE were less attached to the state and more likely to leave after college. As a result, Georgia's HOPE Scholarship Program did not increase the percentage of the state's college-bound high school students who remain in the state after college."

----------------------

Does Sorting Students Improve Scores? An Analysis of Class Composition

Courtney Collins & Li Gan
NBER Working Paper, February 2013

Abstract:
This paper examines schools' decisions to sort students into different classes and how those sorting processes impact student achievement. There are two potential effects that result from schools creating homogeneous classes - a "tracking effect," which allows teachers to direct their focus to a more narrow range of students, and a peer effect, which causes a particular student's achievement to be influenced by the quality of peers in his classroom. In schools with homogeneous sorting, both the tracking effect and the peer effect should benefit high performing students. However, the effects would work in opposite directions for a low achieving student; he would benefit from the tracking effect, but the peer effect should decrease his score. This paper seeks to determine the net effect for low performing students in order to understand the full implications of sorting on all students. We use a unique student-level data set from Dallas Independent School District that links students to their actual classes and reveals the entire distribution of students within a classroom. We find significant variation in sorting practices across schools and use this variation to identify the effect of sorting on student achievement. Implementing a unique instrumental variables approach, we find that sorting homogeneously by previous performance significantly improves students' math and reading scores. This effect is present for students across the score distribution, suggesting that the net effect of sorting is beneficial for both high and low performing students. We also explore the effects of sorting along other dimensions, such as gifted and talented status, special education status, and limited English proficiency.

----------------------

Revisiting "Kindergarten as academic boot camp": A nationwide study of ability grouping and psycho-social development

Sophia Catsambis & Anthony Buttaro
Social Psychology of Education, December 2012, Pages 483-515

Abstract:
We revisit Harry L. Gracey's perspective of kindergarten as academic boot camp where, at school entry, children acquire the student role through a structured program of activities. We provide further insights into the crucial mechanisms of socialization that occur in U.S. kindergartens by examining the relationship between within-class ability grouping and attributes of children's psycho-social development that are critical for school success. Using data from the Early Childhood Longitudinal Study (ECLS-K) and incorporating stratified propensity scores into multi-level models, our analyses link within-class ability grouping to student behaviors in a manner that supports the concerns raised by ability grouping critics. Children in low ability groups show slower development in approaches to learning than comparable ungrouped children. Children in high ability groups show more accelerated development in all psycho-social attributes considered (approaches to learning, interpersonal skills, self control and externalizing problem behaviors) than comparable ungrouped children. These asymmetrical findings suggest that children placed in high and low ability groups are socialized into different versions of the student role.

----------------------

Born at the Wrong Time: Selection Bias in the NHL Draft

Robert Deaner, Aaron Lowen & Stephen Cobley
PLoS ONE, February 2013

Abstract:
Relative age effects (RAEs) occur when those who are relatively older for their age group are more likely to succeed. RAEs occur reliably in some educational and athletic contexts, yet the causal mechanisms remain unclear. Here we provide the first direct test of one mechanism, selection bias, which can be defined as evaluators granting fewer opportunities to relatively younger individuals than is warranted by their latent ability. Because RAEs are well-established in hockey, we analyzed National Hockey League (NHL) drafts from 1980 to 2006. Compared to those born in the first quarter (i.e., January-March), those born in the third and fourth quarters were drafted more than 40 slots later than their productivity warranted, and they were roughly twice as likely to reach career benchmarks, such as 400 games played or 200 points scored. This selection bias in drafting did not decrease over time, apparently continues to occur, and reduces the playing opportunities of relatively younger players. This bias is remarkable because it is exhibited by professional decision makers evaluating adults in a context where RAEs have been widely publicized. Thus, selection bias based on relative age may be pervasive.

----------------------

The Effects of Single-Sex Compared With Coeducational Schooling on Mathematics and Science Achievement: Data From Korea

Erin Pahlke, Janet Shibley Hyde & Janet Mertz
Journal of Educational Psychology, forthcoming

Abstract:
Some U.S. school districts are experimenting with single-sex schooling, hoping that it will yield better academic outcomes for students. Empirical research on the effects of single-sex schooling, however, has been equivocal, with various studies finding benefits, disadvantages, or no effect. Most of this research is marred because families generally choose whether the child attends a single-sex or coeducational school, so there are selection effects that create pre-existing differences between students in the different types of schools. The research reported here capitalized on the case of Korea, where students are randomly assigned to single-sex or coeducational schools. Using 2007 Trends in International Mathematics and Science Study (TIMSS) data, we applied hierarchical linear modeling to account for the nesting of students within schools. Results for eighth graders indicated no differences between students in single-sex and coeducational schools in mathematics and science achievement. Results from the 2003 TIMSS data replicated the finding: students' mathematics and science achievement was unrelated to the gender composition of their school. These results call into question whether single-sex schooling has the academic advantages claimed by its proponents.

----------------------

The Impact of Chicago's Small High School Initiative

Lisa Barrow, Amy Claessens & Diane Whitmore Schanzenbach
NBER Working Paper, March 2013

Abstract:
This project examines the effects of the introduction of new small high schools on student performance in the Chicago Public School (CPS) district. Specifically, we investigate whether students attending small high schools have better graduation/enrollment rates and achievement than similar students who attend regular CPS high schools. We show that students who choose to attend a small school are more disadvantaged on average. To address the selection problem, we use an instrumental variables strategy and compare students who live in the same neighborhoods but differ in their residential proximity to a small school. In this approach, one student is more likely to sign up for a small school than another statistically identical student because the small school is located closer to the student's house and therefore the "cost" of attending the school is lower. We find that small schools students are substantially more likely to persist in school and eventually graduate. Nonetheless, there is no positive impact on student achievement as measured by test scores. The finding of no test score improvement but a strong improvement in school attainment is consistent with a growing literature suggesting that interventions aimed at older children are more effective at improving their non-cognitive skills than their cognitive skills.

----------------------

Valuing school quality using boundary discontinuities

Stephen Gibbons, Stephen Machin & Olmo Silva
Journal of Urban Economics, May 2013, Pages 15-28

Abstract:
Existing research shows that house prices respond to local school quality as measured by average test scores. However, higher test scores could signal higher academic value-added or higher ability, more sought-after intakes. In our research, we show that both school value-added and student prior achievement - linked to the background of children in schools - affect households' demand for education. In order to identify these effects, we improve the boundary discontinuity regression methodology by matching identical properties across admissions authority boundaries; by allowing for boundary effects and spatial trends; by re-weighting our data towards transactions that are closest to district boundaries; by eliminating boundaries that coincide with major geographical features; and by submitting our estimates to a number of novel falsification tests. Our results survive this battery of tests and show that a one-standard deviation change in either school average value-added or prior achievement raises prices by around 3%.

----------------------

Effects of Sesame Street: A meta-analysis of children's learning in 15 countries

Marie-Louise Mares & Zhongdang Pan
Journal of Applied Developmental Psychology, forthcoming

Abstract:
Sesame Street is broadcast to millions of children globally, including in some of the world's poorest regions. This meta-analysis examines the effects of children's exposure to international co-productions of Sesame Street, synthesizing the results of 24 studies, conducted with over 10,000 children in 15 countries. The results indicated significant positive effects of exposure to the program, aggregated across learning outcomes, and within each of the three outcome categories: cognitive outcomes, including literacy and numeracy; learning about the world, including health and safety knowledge; social reasoning and attitudes toward out-groups. The effects were significant across different methods, and they were observed in both low- and middle-income countries and also in high-income countries. The results are contextualized by considering the effects and reach of the program, relative to other early childhood interventions.

----------------------

School markets: The impact of information approximating schools' effectiveness

Alejandra Mizala & Miguel Urquiola
Journal of Development Economics, forthcoming

Abstract:
The impact of competition on academic outcomes is likely to depend on whether parents are informed about schools' effectiveness or value added (which may or may not be correlated with absolute measures of their quality), and on whether this information influences their school choices, thereby affecting schools' market outcomes. To explore these issues, this paper considers Chile's SNED program, which seeks to identify effective schools, selecting them from within "homogeneous groups" of arguably comparable institutions. Its results are widely disseminated, and the information it generates is quite different from that conveyed by a simple test-based ranking of schools (which in Chile, turns out to largely resemble a ranking based on socioeconomic status). We rely on a sharp regression discontinuity to estimate the effect that being identified as a SNED winner has on schools' enrollment, tuition levels, and socioeconomic composition. Through five applications of the program, we find no consistent evidence that winning a SNED award affects these outcomes.

----------------------

When Accountability Strategies Collide: Do Policy Changes That Raise Accountability Standards Also Erode Public Satisfaction?

Rebecca Jacobsen, Andrew Saultz & Jeffrey Snyder
Educational Policy, March/April 2013, Pages 360-389

Abstract:
No Child Left Behind (NCLB) requires that two accountability strategies - raising standards and public pressure through publicizing performance data - be implemented simultaneously. However, when coupled, they may produce an inappropriate consequence for public opinion. The public may misunderstand the drop in achievement that occurs when the bar is raised and become dissatisfied with school performance. To examine this potential negative consequence, the authors analyze data from New York City. The authors find parent satisfaction declined when school performance grades dropped after the implementation of higher standards. This article contributes to our understanding of how the public responds to school accountability data. Because public support for sustained and successful reforms is key, understanding how accountability policies may erode support is critical.

----------------------

Early Teacher Expectations Disproportionately Affect Poor Children's High School Performance

Nicole Sorhagen
Journal of Educational Psychology, forthcoming

Abstract:
This research used prospective longitudinal data to examine the associations between first-grade teachers' over- and underestimation of their students' math abilities, basic reading abilities, and language skills and the students' high school academic performance, with special attention to the subject area and moderating effects of student demographic characteristics. Teachers' inaccurate expectations in first grade predicted students' math, reading comprehension, vocabulary knowledge, and verbal reasoning standardized test scores at age 15. Significant interactions between students' family income and teachers' misperceptions of students' math and language skills were found, such that teachers' over- and underestimation of abilities had a stronger impact on students from lower income families than on students from more affluent homes. In contrast, the effects of teachers' misperceptions of students' basic reading abilities on performance at age 15 did not differ by income. These results have implications for understanding the complexities of self-fulfilling prophecies and for understanding the achievement gap between students from disadvantaged and advantaged homes.

----------------------

Head Start Participation and School Readiness: Evidence From the Early Childhood Longitudinal Study-Birth Cohort

RaeHyuck Lee et al.
Developmental Psychology, forthcoming

Abstract:
Using data from the Early Childhood Longitudinal Study-Birth Cohort (n ≈ 6,950), a nationally representative sample of children born in 2001, we examined school readiness (academic skills and socioemotional well-being) at kindergarten entry for children who attended Head Start compared with those who experienced other types of child care (prekindergarten, other center-based care, other nonparental care, or parental care). Using propensity score matching methods and ordinary least squares regressions with rich controls, we found that Head Start participants had higher early reading and math scores than children in other nonparental care or parental care but also higher levels of conduct problems than those in parental care. Head Start participants had lower early reading scores compared with children in prekindergarten and had no differences in any outcomes compared with children in other center-based care. Head Start benefits were more pronounced for children who had low initial cognitive ability or parents with low levels of education or who attended Head Start for more than 20 hr per week.

----------------------

Child-Care Subsidies and School Readiness in Kindergarten

Anna Johnson, Anne Martin & Jeanne Brooks-Gunn
Child Development, forthcoming

Abstract:
The federal child-care subsidy program represents one of the government's largest investments in early care and education. Using data from the nationally representative Early Childhood Longitudinal Study-Birth Cohort, this study examines associations, among subsidy-eligible families, between child-care subsidy receipt when children are 4 years old and a range of school readiness outcomes in kindergarten (sample n ≈ 1,400). Findings suggest that subsidy receipt in preschool is not directly linked to subsequent reading or social-emotional skills. However, subsidy receipt predicted lower math scores among children attending community-based centers. Supplementary analyses revealed that subsidies predicted greater use of center care, but this association did not appear to affect school readiness.

----------------------

Effects of college educational debt on graduate school attendance and early career and lifestyle choices

Lei Zhang
Education Economics, Spring 2013, Pages 154-175

Abstract:
This paper examines how college educational debt affects various post-baccalaureate decisions of bachelor's degree recipients. I employ the Baccalaureate and Beyond 93/97 survey data. Using college-aid policies as instrumental variables to correct for the endogeneity of student college debt level, I find that for public college graduates, college debt has a negative and significant effect on graduate school attendance. This negative effect is concentrated on more costly programs associated with doctoral, MBA, and first professional (FP) degrees, and debt has no effect on the choice of a master's program. For private college students, debt does not have an effect on the overall graduate school attendance, but this absence of effect conceals the differential effects of debt on different graduate programs - debt has a positive and significant effect on the choice of an MBA or an FP program, and a zero effect on other programs. For both public and private college students, debt has no effects on early career choices such as salary, sector of occupation, marital status, and homeownership.

----------------------

Educational Systems and the Trade-Off between Labor Market Allocation and Equality of Educational Opportunity

Thijs Bol & Herman van de Werfhorst
Comparative Education Review, forthcoming

Abstract:
Educational systems with a high level of tracking and vocational orientation have been shown to improve the allocation of school-leavers in the labor market. However, tracked educational systems are also known to increase inequality of educational opportunity. This presumed trade-off between equality and labor market preparation is clearly rooted in two different perspectives on the origin of differentiation in educational systems, dating back to the nineteenth century. Tracking was seen both as a way to prepare students for an industrializing labor market and as a way for the elite to formalize social distances in the educational system. We empirically study the trade-off with newly developed country-level indicators for tracking and vocational orientation. Our country-level regressions largely support the existence of the trade-off between labor market allocation and equality of opportunity.

----------------------

Evaluating Urban Public Schools: Parents, Teachers, and State Assessments

Nathan Favero & Kenneth Meier
Public Administration Review, forthcoming

Abstract:
Among the most contentious questions in public administration is how the performance of public organizations should be evaluated, and nowhere is this issue more salient than in urban public schools. While significant attention has been devoted to studying administrative measures of public organizations, the views of citizens concerning performance have been widely criticized and are not frequently gathered by schools. How these assessments relate to each other is central to many questions in education policy (e.g., choice, equity) and has important implications for democracy, bureaucratic professionalism, and public performance. This debate can be viewed as focusing on the distinction between convergent validity and discriminant validity. Using data from New York City's public school system with a cross-sectional time-series approach, parent and teacher evaluations are compared to government records of schools' characteristics and performance. The findings suggest that parents and teachers are able to conduct intelligent, meaningful evaluations of school quality.

----------------------

The Big-Fish-Little-Pond Effect and a National Policy of Within-School Ability Streaming: Alternative Frames of Reference

Gregory Arief Liem et al.
American Educational Research Journal, April 2013, Pages 326-370

Abstract:
The big-fish-little-pond effect (BFLPE) was evaluated with 4,461 seventh to ninth graders in Singapore where a national policy of ability streaming is implemented. Consistent with the BFLPE, when prior achievement was controlled, students in the high-ability stream had lower English and mathematics self-concepts (ESCs and MSCs) and those in the lower-ability stream had higher ESCs and MSCs. Consistent with the local-dominance effect, the effect of stream-average achievement on ESCs and MSCs was more negative than - and completely subsumed - the negative effect of school-average achievement. However, stream-average achievement was stronger than, or as strong as, the more local class-average achievement. Taken together, findings highlight the potential interplay of a local dominance effect with variability and/or salience of target comparisons in academic self-concept formations.

----------------------

Do preschool special education services make a difference in kindergarten reading and mathematics skills?: A propensity score weighting analysis

Amanda Sullivan & Samuel Field
Journal of School Psychology, April 2013, Pages 243-260

Abstract:
The purpose of this study was to examine the average treatment effect of preschool special education services on children's kindergarten academic skills. Using data from a nationally representative sample of United States children who participated in the Early Childhood Longitudinal Study-Birth Cohort, we examined the effectiveness of preschool special education services by comparing reading and math outcomes for children who received special education services at preschool-age to a propensity-score-weighted sample of children who did not receive these services. Results indicated that the receipt of these special education services had a statistically significant moderate negative effect on children's kindergarten skills in both reading (d = - 0.21) and mathematics (d = - 0.29). These findings have implications for the implementation and evaluation of services for young children experiencing developmental delays or disabilities.

----------------------

Quizzing in Middle-School Science: Successful Transfer Performance on Classroom Exams

Mark McDaniel et al.
Applied Cognitive Psychology, forthcoming

Abstract:
We examined whether learning from quizzing arises from memorization of answers or fosters more complete understanding of the quizzed content. In middle-school science classes, we spaced three multiple-choice quizzes on content in a unit. In Experiment 1, the class exams included questions given on quizzes, transfer questions targeting the same content, and content that had not been quizzed (control content). The quizzing procedure was associated with significant learning benefits with large effect sizes and similar effect sizes for both transfer items and identical items. In Experiment 2, quiz questions focused on definitional information or application of the principle. Application questions increased exam performance for definitional-type questions and for different application questions. Definition questions did not confer benefits for application questions. Test-enhanced learning, in addition to other factors in the present quizzing protocol (repeated, spaced presentation of the content), may create deeper understanding that leads to certain types of transfer.

----------------------

Sleep duration, positive attitude toward life, and academic achievement: The role of daytime tiredness, behavioral persistence, and school start times

Nadine Perkinson-Gloor, Sakari Lemola & Alexander Grob
Journal of Adolescence, April 2013, Pages 311-318

Abstract:
Sleep timing undergoes profound changes during adolescence, often resulting in inadequate sleep duration. The present study examines the relationship of sleep duration with positive attitude toward life and academic achievement in a sample of 2716 adolescents in Switzerland (mean age: 15.4 years, SD = 0.8), and whether this relationship is mediated by increased daytime tiredness and lower self-discipline/behavioral persistence. Further, we address the question whether adolescents who start school modestly later (20 min; n = 343) receive more sleep and report better functioning. Sleeping less than an average of 8 h per night was related to more tiredness, inferior behavioral persistence, less positive attitude toward life, and lower school grades, as compared to longer sleep duration. Daytime tiredness and behavioral persistence mediated the relationship between short sleep duration and positive attitude toward life and school grades. Students who started school 20 min later received reliably more sleep and reported less tiredness.


Insight

from the

Archives

A weekly newsletter with free essays from past issues of National Affairs and The Public Interest that shed light on the week's pressing issues.

advertisement

Sign-in to your National Affairs subscriber account.


Already a subscriber? Activate your account.


subscribe

Unlimited access to intelligent essays on the nation’s affairs.

SUBSCRIBE
Subscribe to National Affairs.