Technology
Paragraphs

Previous literature suggests subpar teaching is a primary reason why rural Chinese students lag behind academically. We initiate an investigation into the potential of educational technology (EdTech) to increase teaching quality in rural China. First, we discuss why conventional approaches of improving teaching in remote schools are infeasible in China’s context, referring to past research. We then explore the capacity of technology-assisted instruction to improve academic performance by examining previous empirical analyses. Third, we show that China is not limited by the resource constraints of other developing countries due to substantial policy support and a thriving EdTech industry. Finally, we identify potential implementation-related challenges based on the results of a preliminary qualitative survey of pilots of EdTech interventions. With this paper, we lay the foundation for a long-term research investigation into whether EdTech can narrow China’s education gap.

All Publications button
1
Publication Type
Working Papers
Publication Date
Authors
Cody Abbey
Yue Ma
Guirong Li
Matthew Boswell
Matthew Boswell
Claire Cheng
Robert Fairlie
Oliver Lee
Prashant Loyalka
Prashant Loyalka
Andrew Mi
Evan Peng
Scott Rozelle
Scott Rozelle
Adrian Sun
Andy Zeng
Jenny Zhao
Paragraphs

We assess and compare computer science skills among final-year computer science undergraduates (seniors) in four major economic and political powers that produce approximately half of the science, technology, engineering, and mathematics graduates in the world. We find that seniors in the United States substantially outperform seniors in China, India, and Russia by 0.76–0.88 SDs and score comparably with seniors in elite institutions in these countries. Seniors in elite institutions in the United States further outperform seniors in elite institutions in China, India, and Russia by ∼0.85 SDs. The skills advantage of the United States is not because it has a large proportion of high-scoring international students. Finally, males score consistently but only moderately higher (0.16–0.41 SDs) than females within all four countries.

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
Proceedings of the National Academy of Sciences of the United States of America
Authors
Prashant Loyalka
Prashant Loyalka
Ou Lydina Liu
Guirong Li
Igor Chirikov
Elena Kardanova
Lin Gu
Guangming Ling
Ningning Yu
Fei Guo
Liping Ma
Shangfeng Hu
Angela Sun Johnson
Ashutosh Bhuradia
Saurabh Khanna
Isak Froumin
Jinghuan Shi
Pradeep Kumar Choudhury
Tara Beteille
Francisco Marmolejo
Namrata Tognatta
Paragraphs

Education of poor and disadvantaged populations has been a long-standing challenge for education systems in both developed and developing countries. In China, millions of students in rural areas and migrant communities lag far behind their urban counterparts in terms of academic achievement. When they fall behind, they often have no way to catch up. Many of their parents have neither the skills nor the money to provide remedial tutoring; rural teachers often do not have time to give students the individual attention they need. Given this, there is growing interest by both educators and policymakers in helping underperforming students catch up using computer assisted learning (CAL). While CAL interventions have been shown to be effective internationally and elsewhere in China, traditional software-based CAL programs are difficult and costly to implement. An online version of CAL (OCAL), however, may be able to bypass many of offline CAL’s implementation problems and enhance the remedial tutoring experience. Unfortunately, there is little empirical evidence on whether OCAL programs can be effective in improving the quality of rural primary school education in developing countries. The objective of this paper is to examine the impact of an OCAL intervention on the academic and non-academic performance of students and to explore the mechanism behind OCAL’s impact. Importantly, we also aim to assess the cost effectiveness of the new OCAL program versus traditional CAL interventions. To achieve these objectives, we carried out a randomized controlled trial (RCT) involving over 1650 fifth grade students in 44 schools in rural areas and migrant communities across China. Students in the 22 treatment schools attended two 40- minute OCAL sessions during their computer class each week for one semester; the students in the other 22 schools were in the control group and did not receive any intervention. According to our findings, OCAL improved overall English scores of students in the treatment group relative to the control group by 0.56 standard deviations. This impact is large when compared with offline CAL programs. We found that OCAL also led to a positive change in the attitudes of students towards English learning and towards student aspirations for their future education level. We found three possible explanations for OCAL’s impact. After rejecting the possibility of the Hawthorne Effect or self-efficacy-induced changes, we believe interest-oriented stimulation is the main source of improvement among students. The chance for comparison and competition with peers, as well as customized remedial question banks tailored to each student’s individual needs, likely contributed to the measured increases in academic performance among students in our sample. Cost-effectiveness analysis showed that the OCAL program is more cost-effective than traditional offline CAL, a comparison which is significant for policymakers as it indicates high potential for OCAL program expansion. 

Keywords: Education, computer assisted learning, randomized controlled trial, online learning
All Publications button
1
Publication Type
Working Papers
Publication Date
Journal Publisher
Working Paper
Authors
Bin Tang
Boya Wang
Di Mo
Linxiu Zhang
Scott Rozelle
Emma Auden
Blake Mandell
Paragraphs

One Laptop Per Child (OLPC) is a high profile initiative to narrow the inequality of access to ICT and improve educational performance. However, there is little empirical evidence on its impacts. In order to assess the effectiveness of OLPC, we conducted a randomized experiment of OLPC with Chinese characteristics involving 300 third-grade students in Beijing migrant schools. Our results show that the program improved student computer skills by 0.33 standard deviations and math scores by 0.17 standard deviations. The program also increased student time spent using educational software and decreased student time spent watching TV. Student selfesteem also improved.

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
World Development
Authors
Matthew Boswell
Scott Rozelle
Paragraphs
Evidence from developed countries shows that there is a significant gender gap in STEM occupations. Girls may begin to underperform in math early as primary school. One possible explanation is the negative stereotype threat towards girls. However, this has been understudied in rural China. In this paper, we describe the math performance gender gap in rural China, compare the gender gap between rural and urban China, and finally compare the Chinese situation with other countries. We further examine possible explanations for the math performance gender gap from comparative perspectives. Using first hand datasets of 3,789 primary students and 12,702 junior high students in northwest China, combing with OECD 2012 Program for International Student Assessment (PISA) survey data, we find that in both rural and urban China, boys outperform girls in math. As students grow older, the gap widens. The size of the gender gap in rural China is larger than that in urban China, and larger than in many other countries. We further find that both the gender gaps in math self-concept and math anxiety and discriminatory family investment towards girls are not sufficient to explain the wide math performance gaps. Our study suggests the inequality of education in rural China still merits concern and calls for further work to explain the observed gender gap in math performance. 
 
All Publications button
1
Publication Type
Working Papers
Publication Date
Authors
Meichen Lu
Fang Chang
Scott Rozelle
Number
Working Paper
Paragraphs

The education of poor and disadvantaged populations has been a long-standing challenge for education systems in both developed and developing countries. Drawing on data from two randomised controlled trials involving two cohorts of grade 3 students in poor rural minority schools in China’s Qinghai province, this paper explores the effects of computer-assisted learning (CAL) on student academic and non-academic outcomes for underserved student populations, and how interactions between the CAL programme and existing classroom resources affect the programme effectiveness. Results show that CAL could have significant beneficial effects on both student academic and non-academic outcomes. However, when the scope of the programme expanded to include a second subject (in this case, math – which was added on top of the Mandarin subject matter that was the focus of the first phase of the programme), some schools had to use regular school hours for CAL sessions. As a result, the phase II programme did not generate any (statistically) significant improvement over the first phase. 

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
Journal of Development Effectiveness
Authors
Yu Bai
Fang Chang
Scott Rozelle
Paragraphs

Abstract: Recent attention has been placed on whether integrating Information Communication Technology (hereafter, ICT) into education can effectively improve learning outcomes. However, the empirical evidence of the impact of programmes that adopt ICT in schooling is mixed. Theory suggests it may be due to differences in whether or not the ICT pro-grammes are integrated into a teaching programme of a class. Unfortunately, few empirical studies compare the relative effectiveness of programmes that integrate ICT into teaching with the ones that do not. In order to understand the most effective way to design new programmes that attempt to utilize ICT to improve English learning, we conducted a clustered randomized controlled trial (RCT) with some schools receiving ICT that was in-tegrated into the teaching programme of the class; with some schools that received ICT without having it integrated into the teaching programme; and with other schools being used as controls. The RCT involved 6304 fifth grade students studying English in 127 rural schools in rural China. Our results indicate that when the programme is integrated into the teaching programme of a class it is effective in improving student test scores relative to the control schools. No programme impact, however, is found when the ICT programme is not integrated into the teaching program. We also find that when ICT programmes are inte-grated into teaching, the programmes work similarly for students that have either high or low initial (or baseline) levels of English competency. When ICT programmes are not in-tegrated with teaching, they only raise the educational performance of English students who were performing better during the baseline.

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
Elsevier
Authors
Yu Bai
Matthew Boswell
Scott Rozelle
Paragraphs

There is a great degree of heterogeneity among the studies that investigate whether computer technologies improve education and how students benefit from them – if at all. The overall goal of this study is to assess the effectiveness of computing technologies to raise educational performance and non-cognitive outcomes and identify what program components are most effective in doing so. To achieve this aim we pool the data sets of five separate studies about computer technology programs that include observations of 16,856 students from 171 primary schools across three provinces in China. We find that overall computing technologies have positive and significant impacts on student academic achievement in both math and in Chinese. The programs are found to be more effective if they are implemented out-of-school, avoiding what appear to be substitution effects when programs are run during school. The programs also have heterogeneous effects by gender. Specifically, boys gain more than girls in Chinese. We did not find heterogeneous effects by student initial achievement levels. We also found that the programs that help students learn math—but not Chinese—have positive impacts on student self-efficacy.

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
China Economic Review
Authors
Weiming Huang
Di Mo
Yaojiang Shi
LInxiu Zhang
Matthew Boswell
Matthew Boswell
Scott Rozelle
Scott Rozelle
Paragraphs
Computer assisted learning (CAL) programs have been shown to be effective in improving educational outcomes. However, the existing studies on CAL have almost all been conducted over a short period of time. There is very little evidence on how the impact evolves over time. In response, we conducted a clustered randomized experiment involving 2741 boarding students in 72 rural schools in China to evaluate impacts of CAL programs over the long term. Our results indicate that a CAL program that was implemented for one year and a half increased math scores by 0.25 standard deviations for third graders and 0.26 standard deviations for fifth graders. In addition, we have shown that students gained in math learning in both CAL Phase I (which ran for one semester in spring 2011) and CAL Phase II (which ran for both semesters of the 2011–2012 academic year) programs. By testing for heterogeneous effects, we find that the CAL intervention worked well for both the poorer performing and better performing students in the third and fifth grades.We also find that the third grade girls seem to have improved more than the boys in math in the short term (CAL Phase I).
All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
Journal of Computer Assisted Learning
Authors
Di Mo
Linxiu Zhang
Jiafu Wang
Weiming Huang
Yaojiang Shi
Matthew Boswell
Matthew Boswell
Scott Rozelle
Scott Rozelle
Paragraphs

One Laptop per Child (OLPC) is one of the high profile initiatives to try to narrow the inequality of access to ICT (digital divide). However, despite the fact that OLPC currently has distributed more than two million laptops in more than 40 countries, there is little empirical evidence that is available to help us understand the impacts of the program. The goal of our study is to assess the effectiveness of OLPC in narrowing the digital divide between poor and rich children in China and in increasing the human capital of disadvantaged children. In order to do so, we conducted a randomized experiment involving 300 third-grade students in 13 migrant schools in Beijing. Our results show that, the OLPC program improved student computer skill scales by 0.33 standard deviations and standardized math scores by 0.17 standard deviations after 6 months of intervention. Less-skilled students improved more in computer skills after the program. Moreover, the OLPC program also significantly increased student learning activity using computer software and decreased the time students spent watching TV. Students’ self-esteem also improved with the program.

All Publications button
1
Publication Type
Journal Articles
Publication Date
Journal Publisher
World Development
Authors
Di Mo
Johan Swinnen
Linxiu Zhang
Hongmei Yi
Qinghe Qu
Matthew Boswell
Matthew Boswell
Scott Rozelle
Scott Rozelle
Subscribe to Technology