Abstract

Computational thinking (CT) has become an important skill for the new generation, and CT teaching games have been introduced to lower the barriers that novices face in learning programming. However, despite the prevalence of and demand for these games, little is known about the effectiveness of their design or about the principles that are conducive to learning using these games. In this article, we present a project in which we triangulated design research with controlled experiments to evaluate the effectiveness of a computational puzzle design (CPD) framework in guiding the development of CT teaching games for children. Using CT tests, game logs, and a survey, we evaluated the learning outcomes of and engagement with various versions of the game LittleWorld, designed based on various principles of the CPD framework and implemented in Chinese elementary education (n = 202). The results validate the CPD framework and demonstrate that it is a practical and systematic tool for designing CT teaching games. The findings of this study provide design implications concerning (1) the application of meta-gaming and (2) how serious game design research should be conducted.