Paragraphs

Impact evaluation has become an increasingly integral part of development project design and execution in recent years. Many questions remain, however, about what methods yield the most compelling evaluations, and how best to implement them. The Rural Education Action Project (REAP) is among the most successful impact evaluation groups currently operating in China. The goal of this paper is to share five practical strategies that REAP has employed to maximize the effectiveness of our impact evaluations. These strategies include the use of randomization and other experimental and quasi experimental research designs; pursuit of local and international collaboration; strict attention to policy relevance; a modular, incremental research approach; and robust outreach. 

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
Journal of Development Effectiveness
Authors
Matthew Boswell
Scott Rozelle

Encina Hall East, 4th Floor,
Stanford, CA 94305-6055

0
matthew_boswell_-vert.jpeg

Matthew Boswell oversees SCCEI’s efforts to bring cutting edge, quantitative research on China out of academia and into the public sphere where it can more usefully inform the China debate. His work has been featured in leading media outlets and appeared in The Washington Quarterly, Foreign Affairs, and other policy journals. Prior to his role at SCCEI, Matthew led major research projects for the Rural Education Action Program (REAP), now one of SCCEI’s flagship initiatives. He is a fluent Mandarin speaker.  

Associate Director, External Affairs, Stanford Center on China's Economy and Institutions
Date Label
Paragraphs

The overall goal of this paper is to try to understand in the context China’s middle school education system what is the tradeoff between community service and educational performance. In addition, we seek to understand some of the other effects of participation in community service activities. When students participate in community service, does their self-esteem rise and/or self-efficacy rise? Finally, we also want to know if students participate in community service activities will their sense of social responsibility rise.

Because the nature of this question is so broad we must necessarily reduce the scope of the paper. To do so, we study a community service program funded and run by a private US foundation in 592 junior high and high school classes in two counties in Shaanxi province. While we understand that there are many institutional and pedagogical issues that will affect the relationship among community service, grades and a sense of social responsibility (e.g., citation), we will focus our efforts on empirically evaluating the linkages. We also recognize that by focusing on the activities of an NGO in a single part of China that many of the findings will be affected by the context of the program. However, we also believe that we may be able to observe and measure more fundamental behavioral relationships. At the very least we seek to provide rigorous, statistically-based evidence from a case study which hopefully can be combined with other work to help us more fully understand community service, social responsibility and educational performance.

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
Journal of Moral Education
Authors
Scott Rozelle
Paragraphs

The education of the disadvantaged population has been a long-standing challenge to education systems in both developed and developing countries. Although computer-assisted learning (CAL) has been considered one alternative to improve learning outcomes in a cost-effective way, the empirical evidence of its impacts on improving learning outcomes is mixed. This paper uses a randomized field experiment to explore the effects of CAL on student academic and non-academic outcomes for students in migrant schools in Beijing. Our results show that a remedial CAL program held out of regular school hours improved the student standardized math scores by 0.15 standard deviations and most of the program effect took place within 2 months after the start of the program. Students with less-educated parents benefited more from the program. Moreover, CAL also significantly increased the students’ interest in learning

All Publications button
1
Publication Type
Journal Articles
Publication Date
Authors
Scott Rozelle

Encina Hall East, 4th Floor,
Stanford, CA 94305-6055

0
alexis-new.jpg MA

Alexis Medina is the Associate Director for Research Programs at SCCEI, and also Associate Director of the Rural Education Action Program (REAP). At SCCEI, she helps to connect China-oriented faculty and graduate students with university resources and with one another, as well as to navigate administrative bureaucracies on both sides of the Pacific. She has been directly involved in building research networks and fostering connections between the US and China since 2006, and has extensive experience in international program management, including leading survey teams in rural China, overseeing the design and development of field projects, and coordinating data collection efforts and analysis. Her academic expertise lies at the intersection of health and education, and she has co-authored dozens of academic publications in this area. Alexis speaks fluent Mandarin, and has previously held research positions at the Harvard T.H. Chan School of Public Health, and Shandong University in China.

Associate Director, Research Programs, Stanford Center on China's Economy and Institutions
Associate Director, Rural Education Action Program
Date Label
Paragraphs

In a randomized trial conducted with primary school students in China, we find that pairing high and low achieving classmates as benchmates and offering them group incentives for learning improved low achiever test scores by approximately 0.265 standard deviations without harming the high achievers. Offering only low achievers incentives for learning in a separate trial had no effect. Pure peer effects at the benchmate level are not sufficiently powerful to explain the differences between these two results. We interpret our evidence as suggesting that group incentives can increase the effectiveness of peer effects.

 
All Publications button
1
Publication Type
Journal Articles
Publication Date
Authors
Scott Rozelle
Subscribe to China