Abstract
In this study, a peer assessment-based game development approach is proposed for improving students’ learning achievements, motivations and problem-solving skills. An experiment has been conducted to evaluate the effectiveness of the proposed approach in a science course at an elementary school. A total of 167 sixth graders participated in the experiment, 82 of whom were assigned to the experimental group and learned with the peer assessment-based game development approach, while 85 students were in the control group and learned with the conventional game development approach. From the empirical results, it was found that the proposed approach could effectively promote students’ learning achievement, learning motivation, problem-solving skills, as well as their perceptions of the use of educational computer games. Moreover, it was found from the open-ended questions that most of the students perceived peer assessment-based game development as an effective learning strategy that helped them improve their deep learning status in terms of “in-depth thinking,” “creativity,” and “motivation.”
Similar content being viewed by others
References
Ali, A. (2009). A conceptual model for learning to program in introductory programming courses. Informing Science and Information Technology, 6, 517–529.
Bouzidi, L., & Jaillet, A. (2009). Can online peer assessment be trusted? Educational Technology & Society, 12(4), 257–268.
Bulu, S. T., & Yildirim, Z. (2008). Communication behaviors and trust in collaborative online teams. Educational Technology & Society, 11(1), 132–147.
Burguillo, J. C. (2010). Using game theory and competition-based learning to stimulate student motivation and performance. Computers & Education, 55(2), 566–575.
Chang, C.-C., & Tseng, K.-H. (2009). Using a web-based portfolio assessment system to elevate project-based learning performances. Interactive Learning Environments, 19(3), 211–230.
Chang, C.-C., Tseng, K.-H., Chou, P.-N., & Chen, Y.-H. (2011). Reliability and validity of web-based portfolio peer assessment: A case study for a senior high school’s students taking computer course. Computers & Education, 57(1), 1306–1316.
Chen, C.-H. (2010). The implementation and evaluation of a mobile self- and peer-assessment system. Computers & Education, 55(1), 229–236.
Chen, N. S., Wei, C. W., Wu, K. T., & Uden, L. (2009). Effects of high level prompts and peer assessment on online learners’ reflection levels. Computers & Education, 52, 283–291.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
Dickey, M. D. (2011a). Murder on Grimm Isle: The impact of game narrative design in an educational game-based learning environment. British Journal of Educational Technology 42(3), 456–469.
Dickey, M. D. (2011b). World of Warcraft and the impact of game culture and play in an undergraduate game design course. Computers & Education, 56(1), 200–209.
Ebner, M., & Holzinger, A. (2007). Successful implementation of user-centered game based learning in higher education: An example from civil engineering. Computers & Education, 49(3), 873–890.
Falchikov, N., & Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70(3), 287–322.
Fallows, S., & Chandramohan, B. (2001). Multiple approaches to assessment: Reflections on use of tutor, peer and self-assessment. Teaching in Higher Education, 6(2), 229–246.
Fuhrmann, T., Kali, Y., & Hoadley, C. M. (2008). Hel** education students understand learning through designing. Educational Technology, 48(2), 26–33.
Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467.
Hayes, E. (2008). Game content creation and it proficiency: An exploratory study. Computers & Education, 51(1), 97–108.
Hong, J.-C., & Liu, M.-C. (2003). A study on thinking strategy between experts and novices of computer games. Computers in Human Behaviors, 19(2), 245–258.
Hsieh, S. W., Jang, Y. R., Hwang, G. J., & Chen, N. S. (2011). Effects of teaching and learning styles on students’ reflection levels for ubiquitous learning. Computers & Education, 57, 1194–1201.
Hung, C. M., Hwang, G. J., & Huang, I. (2012). A Project-based digital storytelling approach to improving students’ learning motivation, problem-solving competence and learning achievement. Educational Technology & Society, 15(4), 368–379.
Hwang, G. J., Sung, H. Y., Hung, C. M., & Huang, I. (2012a). Development of a personalized educational computer game based on students’ learning styles. Educational Technology Research and Development, 60(4), 623–638.
Hwang, G. J., Sung, H. Y., Hung, C. M., Yang, L. H., & Huang, I. (2012b). A knowledge engineering approach to develo** educational computer games for improving students’ differentiating knowledge. British Journal of Educational Technology,. doi:10.1111/j.1467-8535.2012.01285.x.
Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013). A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Computers & Education, 69, 121–130.
Jenkins, M. (2004). Unfulfilled promise: Formative assessment using computer-aided assessment. Learning and Teaching in Higher Education, 1, 67–80.
Jonassen, D. H., & Carr, C. S. (2000). Mindtools: Affording multiple knowledge representations for learning. In S. P. Lajoie (Ed.), Computers as cognitive tools: No more walls (Vol. 2, pp. 165–196). Hillsdale: Lawlence Erlbaum Associates Inc.
Jonassen, D. H., Carr, C., & Yueh, H. P. (1998). Computers as Mindtools for engaging learners in critical thinking. TechTrends, 43(2), 24–32.
Kafai, Y. (2006). Playing and making games for learning: Instructionist and constructionist perspectives for game studies. Games and Culture, 1(1), 36–40.
Kafai, Y., Ching, C., & Marshall, S. (1997). Children as designers of educational multimedia software. Computers & Education, 29, 117–126.
Kiili, K. (2007). Foundation for problem-based gaming. British Journal of Educational Technology, 38(3), 394–404.
Li, Q. (2010). Digital game building: Learning in a participatory culture. Educational Research, 52(4), 427–443.
Liu, T. Y., & Chu, Y. L. (2010). Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation. Computers & Education, 55(2), 630–643.
Liu, E. Z. F., Lin, S. S. J., Chiu, C. H., & Yuan, S. M. (2001). Web-based peer review: The learner as both adapter and reviewer. IEEE Transaction on Education, 44(3), 246–251.
Mak, B., & Coniam, D. (2008). Using wikis to enhance and develop writing skills among secondary school students in Hong Kong. System, 36(3), 437–455.
Mayer, R. E., Dyck, J. L., & Vilberg, W. (1986). Learning to program and learning to think: What’s the connection? Communications of ACM, 29(7), 605–610.
Mayer, R. E., & Wittrock, R. C. (2006). Problem solving. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (pp. 287–304). Mahwah: Erlbaum.
Merrill, M. D., & Gibert, C. G. (2008). Effective peer interaction in problem-centered instructional strategy. Distance Education, 29(2), 199–207.
Min, H.-T. (2006). The effects of trained peer review on EFL students’ revision types and writing quality. Journal of Second Language Writing, 15(2), 118–141.
Moreno-Ger, P., Burgos, D., Martínez-Ortiz, I., Sierra, J. L., & Fernández-Manjón, B. (2008). Educational game design for online education. Computers in Human Behavior, 24(6), 2530–2540.
Pan, I. Y. (2001). A Study on the effects of the play-based elementary science teaching . (Unpublished master’s thesis), Taiwan: Taipei Municipal University of Education.
Papastergiou, M. (2009). Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation. Computers & Education, 52(1), 1–12.
Prensky, M. (2001). Digital game-based learning. New York: McGraw Hill.
Prensky, M. (2008). Students as designers and creators of educational computer games: Who else? British Journal of Educational Technology, 39(6), 1004–1019.
Prins, F. J., Sluijsmans, D. M. A., Kirschner, P. A., & Strijbos, J. W. (2005). Formative peer assessment in a CSCL environment: A case study. Assessment and Evaluation in Higher Education, 30(4), 417–444.
Purchase, H. C. (2000). Learning about interface design through peer assessment. Assessment & Evaluation in Higher Education, 25(4), 341–352.
Robertson, J., & Howells, C. (2008). Computer game design: Opportunities for successful learning. Computers & Education, 50(2), 559–578.
Schmal, V., Grabinski, C. J., & Bowman, S. (2008). Use of games as a learner-centered strategy in gerontology, geriatrics, and aging-related courses. Gerontology & Geriatrics Education, 29(3), 225–233.
Su, H. L., & Hsieh, H. Y. (2006). The study of science game incorporated into elementary school natural science and technology instructions on problem-solving ability. Journal of Scientific and Technological Studies, 40(1), 47–68.
Sung, H. Y., & Hwang, G. J. (2013). A collaborative game-based learning approach to improving students’ learning performance in science courses. Computers & Education, 63(1), 43–51.
Tarkan, S., Sazawal, V., Druin, A., Foss, E., Golub, E., Hatley, L., Khatri, T., Massey, S., Walsh, G., & Torres, G. (2009). Designing a Novice Programming Environment with Children. Poster session of 40th Annual SIGCSE Technical Symposium.
Top**, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276.
Towler, L., & Broadfoot, P. (1992). Self-assessment in the primary school. Educational Review, 44(2), 137–151.
Triantafyllakos, G., Palaigeorgiou, G., & Tsoukalas, I. A. (2011). Designing educational software with students through collaborative design games: The We!Design&Play framework. Computers & Education, 56(1), 227–242.
Tsai, C.-C., & Liang, J.-C. (2009). The development of science activities via on-line peer assessment: The role of scientific epistemological views. Instructional Science, 37(3), 293–310.
Tsivitanidou, O. E., Zacharia, Z. C., & Hovardas, T. (2011). Investigating secondary school students’ unmediated peer assessment skills. Learning and Instruction, 21(4), 506–519.
Tuan, H. L., Chin, C. C., & Shieh, S. H. (2005). The development of a questionnaire to measure students’ motivation towards science learning. International Journal of Science Education, 27(6), 639–654.
Tuzun, H., Meryem, Y. S., Karakus, T., Inal, Y., & Kızılkaya, G. (2009). The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education, 52(1), 68–77.
van den Boom, G., Paas, F., & van Merriënboer, J. G. (2007). Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction, 17(5), 532–548.
Villalta, M., Gajardo, I., Nussbaum, M., Andreu, J. J., Echeverría, A., & Plass, J. L. (2011). Design guidelines for classroom multiplayer presential games. Computers & Education, 57(3), 2039–2053.
Wang, M. J. (2004). A study on online peer feedback. English Teaching & Learning, 29(2), 63–77.
Wen, M. L., & Tsai, C.-C. (2008). Online peer assessment in an inservice science and mathematics teacher education course. Teaching in Higher Education, 13(1), 55–67.
**ao, Y., & Lucking, R. (2008). The impact of two types of peer assessment on students’ performance and satisfaction within a Wiki environment. The Internet and Higher Education, 11(3–4), 186–193.
Yang, M., Badger, R., & Yu, Z. (2006). A comparative study of peer and teacher feedback in a Chinese EFL writing class. Journal of Second Language Writing, 15(3), 179–200.
Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72–83.
Yien, J. M., Hung, C. M., Hwang, G. J., & Lin, Y. C. (2011). A game-based learning approach to improving students’ learning achievements in a nutrition course. Turkish Online Journal of Educational Technology, 10(2), 1–10.
Acknowledgments
This study is supported in part by the National Science Council of the Republic of China under contract number NSC 101-2511-S-011-005-MY3 and NSC 100-2511-S-110-001-MY3.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hwang, GJ., Hung, CM. & Chen, NS. Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach. Education Tech Research Dev 62, 129–145 (2014). https://doi.org/10.1007/s11423-013-9320-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-013-9320-7