Isolating the "Tech" from EdTech: Experimental Evidence on Computer Assisted Learning in China

EdTech,  which  includes  computer  assisted  learning  (CAL),  online  education,  and  remote instruction,  was  expanding  rapidly  even  before  the  current  full-scale  substitution  for  in-person learning  at  all  levels  of  education  around  the  world  because  of  COVID-19.  Studies  of  CAL interventions  often  find  positive  effects,  however,  these “CAL  programs”  often  include  non-technology based inputs such as more time on learning and instructional support by facilitators in addition to technology-based components. In this paper, we discuss the possible channels by which CAL programs affect academic outcomes among schoolchildren. We isolate the technology-based effects  of  CAL  from  the  total  program  effects  by  designing  a  novel  multi-treatment  field experiment with more than four thousand schoolchildren in rural China. For the full sample, we find null effects for both the total CAL program and the technology-based effects of CAL (which are measured relative to a traditional pencil-and-paper learning treatment) on math test scores. For boys, however, we find a positive and statistically significant effect of the CAL program, but  do not find evidence of a positive effect for the technology-based effect of CAL. When focusing on grades, we find evidence of positive CAL program effects but find null effects when we isolate the technology-based effects of CAL. Our empirical results suggest that the “Tech” in EdTech may have  relatively  small  additional  effects  on  academic  outcomes  and  yet  that  tech  programs  can substitute atleast to a certain extent for traditional learning.