SpringerLink
Log in

Combining intelligent tutoring systems and gamification: a systematic literature review

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

One of the Information and Communication Technology (ICT) developments used in the learning process is the Intelligent Tutoring System (ITS), and gamification can overcome boredom, lack of interest or motivation, and monotony when using the ITS. In this study, the application of ITS equipped with Gamification is called ITS + G. Currently, several studies have built the ITS + G. However, there has not been a Systematic Literature Review (SLR) that synthesizes the characteristics of the ITS and Gamification combination. Several previous SLRs have been carried out and discussed the ITS only and several other SLRs discussed gamification only. Therefore, this SLR focused on the characteristics of ITS and gamification as a unit. This study succeeded in synthesizing that ITS + G has the potential to be applied to both STEM and non-STEM subjects. Three main game elements are mostly used in ITS + G: levels, points, and progress bars, which are supported for several reasons. Several techniques that have been used to measure the success of ITS + G are synthesized. Several positive impacts of ITS + G are revealed. Some negative impacts that need to be considered and studied in future research are also noticed. The results of this study could be the basis for ITS + G research in the future and increase the repertoire of knowledge related to ITS and Gamification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Data Availability

All information regarding the reviewed articles has been included in the Reference section.

References

  • Abramovich, S., Schunn, C., & Higashi, R. M. (2013). Are badges useful in education?: It depends upon the type of badge and expertise of learner. Educational Technology Research and Development, 61, 217–232. https://doi.org/10.1007/s11423-013-9289-2

    Article  Google Scholar 

  • Al-Qaysi, N., Mohamad-Nordin, N., & Al-Emran, M. (2020). Employing the technology acceptance model in social media: A systematic review. Education and Information Technologies, 25, 4961–5002. https://doi.org/10.1007/s10639-020-10197-1

    Article  Google Scholar 

  • Albacete, P. L., & Vanlehn, K. (2000). The Conceptual Helper: An Intelligent Tutoring System for Teaching Fundamental Physics Concepts. In Proceedings of International Conference on Intelligent Tutoring Systems (pp 564–573). https://doi.org/10.1007/3-540-45108-0_60

  • Almasri, A., Ahmed, A., Al-Masri, N., Sultan, Y. A., Mahmoud, A. Y., Zaqout, I., Akkila, A. N., & Abu-Naser, S. S. (2019). Intelligent Tutoring Systems Survey for the period 2000–2018. International Journal of Academic Engineering Research (IJAER), 3(5), 21–37.

    Google Scholar 

  • Amela, V., Díez, J. L., & Vallés, M. (2011). New Framework for The Control of LMS in Intelligent Tutoring Systems. In IFAC Proceedings Volumes (IFAC Papers-OnLine) 18:8533–8538. https://doi.org/10.3182/20110828-6-IT-1002.01817

  • Angelides, M. C., & Paul, R. J. (1999). A methodology for specific, total enterprise, role-playing, intelligent gaming-simulation environment development. Decision Support Systems, 25, 89–108. https://doi.org/10.1016/S0167-9236(99)00002-0

    Article  Google Scholar 

  • Arroyo, I., Woolf, B. P., Burelson, W., Muldner, K., Rai, D., & Tai, M. (2014). A Multimedia Adaptive Tutoring System for Mathematics that addresses cognition, metacognition and affect. International Journal of Artificial Intelligence in Education, 24, 387–426. https://doi.org/10.1007/s40593-014-0023-y

    Article  Google Scholar 

  • Babar, M. A., & Zhang, H. (2009). Systematic Literature Reviews in Software Engineering: Preliminary Results from Interviews with Researchers. in The Proceedings of the 3rd International Symposium on Empirical Software Engineering and Measurement. https://doi.org/10.1109/ESEM.2009.5314235

  • Bailey, K. A., Horacek, D., Worthington, S., Nanthakumar, A., Preston, S., & Ilie, C. C. (2019). STEM/Non-STEM divide structures undergraduate beliefs about gender and talent in Academia. Frontiers in Sociology, 4, 26. https://doi.org/10.3389/fsoc.2019.00026

    Article  Google Scholar 

  • Barata, G., Gama, S., Jorge, J., & Gonçalves, D. (2017). Studying student differentiation in gamified education: A long-term study. Computers in Human Behavior, 71, 550–585. https://doi.org/10.1016/j.chb.2016.08.049

    Article  Google Scholar 

  • Beyyoudh, M., Idrissi, M. K., & Bennani, S. (2018). A new approach of designing an intelligent tutoring system based on adaptive workflows and pedagogical games. In Proceedings of 17th International Conference on Information Technology Based Higher Education and Training (ITHET). https://doi.org/10.1109/ITHET.2018.8424619

  • Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. The Journal of Systems and Software, 80, 571–583. https://doi.org/10.1016/j.jss.2006.07.009

    Article  Google Scholar 

  • Butz, B. P., Mille, S. M., Duarte, M., Wlodarczy, B., & Cooper, R. A. (2006). Work in Progress: An Intelligent Tutoring System for Forensic Biology. In Proceedings of 36th ASEE/IEEE Frontiers in Education Conference (pp. 19–20). https://doi.org/10.1109/FIE.2006.322736

  • Choi, Y. S. (2015). Effectiveness of game based learning to minimize boolean functions. Multimedia Tools and Applications, 74, 7131–7146. https://doi.org/10.1007/s11042-014-1956-8

    Article  Google Scholar 

  • Craighead, J. (2008). Distributed, Game-Based, Intelligent Tutoring Systems - The Next Step in Computer Based Training?. in Proceedings of the International Symposium on Collaborative Technologies and Systems (pp 247–256). https://doi.org/10.1109/CTS.2008.4543938

  • DeFalco, J. A., Rowe, J. P., Paquette, L., Georgoulas-Sherry, V., Brawner, K., Mott, B. W., Baker, R. S., & Lester, J. C. (2018). Detecting and addressing frustration in a serious game for military training. International Journal of Artificial Intelligence in Education, 28, 152–193. https://doi.org/10.1007/s40593-017-0152-1

    Article  Google Scholar 

  • Dermeval, D., Paiva, R., Bittencourt, I. B., Vassileva, J., & Borges, D. (2018). Authoring Tools for Designing Intelligent Tutoring Systems: a Systematic Review of the Literature. International Journal of Artificial Intelligence in Education, 28, 336–384. https://doi.org/10.1007/s40593-017-0157-9

  • Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining “gamification”. In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (pp 9–11). https://doi.org/10.1145/2181037.2181040

  • Di Pietro, R., & Distefano, S. (2019). An Intelligent Tutoring System Tool Combining Machine Learning and Gamification in Education. In Proceedings of International Conference on Objects, Components, Models and Patterns (pp. 218–226). https://doi.org/10.1007/978-3-030-29852-4_18

  • Doleck, T., Basnet, R. B., Poitras, E., & Lajoie, S. (2014). Augmenting the Novice-Expert Overlay Model in an Intelligent Tutoring System: Using Confidence-Weighted Linear Classifiers. In Proceedings of IEEE International Conference on Computational Intelligence and Computing Research. https://doi.org/10.1109/ICCIC.2014.7238298

  • Ellet, M. L. C., & Beausang, C. C. (2002). Introduction to qualitative research. Gastroenterology Nursing, 25(1), 10–14.

    Article  Google Scholar 

  • Er, M., & Siekmann, J. (2004). ACTIVEMATH: An intelligent tutoring system for mathematics. In Proceedings of International Conference on Artificial Intelligence and Soft Computing (pp 91–101). https://doi.org/10.1007/978-3-540-24844-6_12

  • Escudero, H., & Fuentes, R. (2010). Exchanging courses between different Intelligent Tutoring Systems: A generic course generation authoring tool. Knowledge-Based Systems, 23, 864–874. https://doi.org/10.1016/j.knosys.2010.05.011

  • Faghihi, U., Brautigam, A., Jorgenson, K., Martin, D., Brown, A., Measures, E., & MaldonadoBouchard, S. (2014). How Gamification Applies for Educational Purpose Specially with College Algebra. In Proceedings of 5th Annual International Conference on Biologically Inspired Cognitive Architectures (pp 182–187). https://doi.org/10.1016/j.procs.2014.11.102

  • Fernández-Rovira, C., Valdés, J. A., Molleví, G., & Nicolas-Sans, R. (2021). The digital transformation of business. Towards the datafication of the relationship with customers. Technological Forecasting & Social Change, 162, 120339. https://doi.org/10.1016/j.techfore.2020.120339

  • Forsyth, C. M., Graesser, A., & Millis, K. (2020). Predicting Learning in a Multi–component Serious Game. Technology. Knowledge and Learning, 25, 251–277. https://doi.org/10.1007/s10758-019-09421-w

  • Giraffa, L. C. M. M., Móra, M. C., & Viccari, R. M. (1999). Modelling an interactive ITS using a MAS approach: from design to pedagogical evaluation. in Proceedings of The Third International Conference on Computational Intelligence and Multimedia Applications. https://doi.org/10.1109/ICCIMA.1999.798520

  • Goldberg, B., & Cannon-Bowers, J. (2015). Feedback source modality effects on training outcomes in a serious game: Computers in Human Behavior, 52, 1–11. https://doi.org/10.1016/j.chb.2015.05.008

  • Gonzalez, G., Mora, A., & Toledo, P. (2014). Gamification in intelligent tutoring systems. In Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality (pp 221–225). https://doi.org/10.1145/2669711.2669903

  • Grund, J., Umfahrer, M., Buchweitz, L., Gay, J., Theil, A., & Korn, O. (2020). A gamified and adaptive learning system for neurodivergent workers in electronic assembling tasks. In Proceedings of Mensch und Computer 2020 (pp. 491–494). https://doi.org/10.1145/3404983.3410420

  • Guo, L., Wang, D., Gu, F., Li, Y., Wang, Y., & Zhou, R. (2021). Evolution and trends in intelligent tutoring systems research: A multidisciplinary and scientometric view. Asia Pacific Education Review. https://doi.org/10.1007/s12564-021-09697-7

    Article  Google Scholar 

  • Gutierrez, F., & Atkinson, J. (2011). Adaptive feedback selection for intelligent tutoring systems. Expert Systems with Applications, 38, 6146–6152.

    Article  Google Scholar 

  • Hassan, L., & Hamari, J. (2020). Gameful civic engagement: A review of the literature on gamification of e-participation. Government Information Quarterly, 37, 101461. https://doi.org/10.1016/j.giq.2020.101461

  • Hitchens, M., & Tulloch, R. (2018). A gamification design for the classroom. Interactive Technology and Smart Education, 15, 1, 28–45. https://doi.org/10.1108/ITSE-05-2017-0028

  • Hongyan, D., Zhen, Z., & **ngyan, T. (2009). Artificial Pet Game-based Intelligent Tutoring System. in Proceedings of the 4th International Conference on Computer Science & Education (pp 1711–1714). https://doi.org/10.1109/ICCSE.2009.5228298

  • Hooshyar, D., Ahmad, R. B., Yousefi, M., Fathi, M., Horng, S. J., Hooshyar, M., & Dooraki, A. R. (2015). Improving web-based problem solving skills of students with a novel game-based intelligent tutoring system. In Proceedings of the International Conference on Science in Information Technology (ICSITech) (pp. 63–66). https://doi.org/10.1109/ICSITech.2015.7407778

  • Hooshyar, D., Ahmad, R. B., Yousefi, M., Fathi, M., Horng, S. J., & Lim, H. (2016a). Applying an online game-based formative assessment in a flowchart-based intelligent tutoring system for improving problem-solving skills. Computers & Education, 94, 18e36. https://doi.org/10.1016/j.compedu.2015.10.013

  • Hooshyar, D., Ahmad, R. B., Yousefi, M., Fathi, M., Abdollahi, A., Horng, S. J., & Lim, H. (2016b). A solution-based intelligent tutoring system integrated with an online game-based formative assessment: Development and evaluation. Educational Technology Research and Development, 64, 787–808. https://doi.org/10.1007/s11423-016-9433-x

    Article  Google Scholar 

  • Howell, S., & Veale, T. (2009). Designing Serious Games with Linguistic Resources. in The Proceedings of the 4th International Conference on Foundations of Digital Games (pp 291–298). https://doi.org/10.1145/1536513.1536564

  • Hsu, C. C., & Wang, T. I. (2018). Applying game mechanics and student-generated questions to an online puzzle-based game learning system to promote algorithmic thinking skills. Computers & Education, 121, 73–88. https://doi.org/10.1016/j.compedu.2018.02.002

  • Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J. (2020). The impact of gamification in educational settings on student learning outcomes: A meta–analysis. Educational Technology Research and Development, 68, 1875–19011. https://doi.org/10.1007/s11423-020-09807-z

    Article  Google Scholar 

  • Jackson, M. (2016). Gamification Elements to Use for Learning. Enspire. https://trainingindustry.com/content/uploads/2017/07/enspire_cs_gamification_2016.pdf. Accessed 12 December 2021.

  • Joaquim, S., Bittencourt, I. I., Silva, R. A., Espinheira, P. L., & Reis, M. (2021). What to do and what to avoid on the use of gamified intelligent tutor system for low–income students. Education and Information Technologies. https://doi.org/10.1007/s10639-021-10728-4

  • Johnson, D., Deterding, S., Kuhn, K. A., Staneva, A., Stoyanov, S., & Hides, L. (2016). Gamification for health and wellbeing: A systematic review of the literature. Renewable and Internet Interventions, 6, 89–106. https://doi.org/10.1016/j.invent.2016.10.002

    Article  Google Scholar 

  • Johnson, D., Horton, E., Mulcahy, R., & Foth, M. (2017). Gamification and serious games within the domain of domestic energy consumption: A systematic review. Renewable and Sustainable Energy Reviews, 73, 249–264. https://doi.org/10.1016/j.rser.2017.01.134

  • Katsionis, G., & Virvou, M. (2008). Personalised e-learning through an educational virtual reality game using web services. Multimedia Tools and Applications, 39, 47–71. https://doi.org/10.1007/s11042-007-0155-2

    Article  Google Scholar 

  • Khan, M. M. (2002). Implementing an Intelligent Tutoring System for adventure learning. The Electronic Library, 2, 2, 134–142. https://doi.org/10.1108/02640470210424473

    Article  Google Scholar 

  • Kitchenham, B. (2004). Procedures for Performing Systematic Reviews. Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1. ISSN:1353–7776. https://www.inf.ufsc.br/~aldo.vw/kitchenham.pdf. Accessed 13 December 2021.

  • Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature Reviews in Software Engineering. Evidence-Based Software Engineering (EBSE) Technical Report, EBSE-2007-01, UK. https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf. Accessed 13 December 2021.

  • Kitchenham, B., Pretorius, R., Budgen, D., Brereton, O. P., Turner, M., Niazi, M., & Linkman, S. (2010). Systematic literature reviews in software engineering – A tertiary study. Information and Software Technology, 52, 792–805. https://doi.org/10.1016/j.infsof.2010.03.006

  • Klock, A. C. T., Gasparini, I., Pimenta, M. S., & Hamari, J. (2020). Tailored gamification: A review of literature. International Journal of Human-Computer Studies, 144, 102495. https://doi.org/10.1016/j.ijhcs.2020.102495

  • Koravuna, S., & Surepally, U. K. (2020). Educational gamification and artificial intelligence for promoting digital literacy. In Proceedings of the 2nd International Conference on Intelligent and Innovative Computing Applications (pp. 1–6). https://doi.org/10.1145/3415088.3415107

  • Kusuma, G. P., Wigati, E. K., Utomo, Y., & Suryapranata, L. K. P. (2018). Analysis of Gamification Models in Education Using MDA Framework. Procedia Computer Science, 135, 385–392. https://doi.org/10.1016/j.procs.2018.08.187

  • Laird, T. F., N, McCormick, A. C., Sullivan, D. F., & Zimmerman, C. (2011). STEM/Non-STEM differences in Engagement at US institutions. Peer Review, 13, 3.

    Google Scholar 

  • Linnenluecke, M. K. (2020). Conducting systematic literature reviews and bibliometric analyses. Australian Journal of Management, 45, 2, 175–194. https://doi.org/10.1177/0312896219877678

  • Liu, Y., Alexandrova, T., & Nakajima, T. (2011). Gamifying intelligent environments. In Proceedings of the 2011 international ACM workshop on Ubiquitous meta user interfaces (pp. 7–12).

  • Maciuszek, D., Weicht, M., & Martens, A. (2012). Seamless Integration of Game and Learning Using Modeling and Simulation. in Proceedings of the 2012 Winter Simulation Conference. https://doi.org/10.1109/WSC.2012.6465234

  • Metwally, A. H. S., Nacke, L. E., Chang, M., Wang, Y., & Yousef, A. M. H. (2021). Revealing the hotspots of educational gamification: An umbrella review. International Journal of Educational Research, 109, 101832. https://doi.org/10.1016/j.ijer.2021.101832

  • Muñoz, K., Kevitt, P. M., Lunney, T., Noguez, J., & Neri, L. (2011). An emotional student model for game-play adaptation. Entertainment Computing, 2, 133–141. https://doi.org/10.1016/j.entcom.2010.12.00

    Article  Google Scholar 

  • Nand, K., Baghaei, N., Casey, J., Barmada, B., Mehdipour, F., & Liang, H. N. (2019). Engaging children with educational content via Gamification. Smart Learning Environments, 6, 6. https://doi.org/10.1186/s40561-019-0085-2

    Article  Google Scholar 

  • Negoita, M. G., & Pritchard, D. (2004). Using a virtual student model for testing intelligent tutoring systems. Interactive Technology & Smart Education, 1, 3, 195–204. https://doi.org/10.1108/17415650480000023

  • Neuman, W. L. (2007). Basics of Social Research - qualitative and quantitative approaches. USA: Wisconsin-Whitewater.

    Google Scholar 

  • Noblit, G. W., & Hare, R. D. (1988). Meta-ethnography: Synthesizing qualitative studies. London: SAGE Publications, Inc.

    Book  Google Scholar 

  • Nye, B. (2015). Intelligent Tutoring Systems by and for the develo** world: A review of Trends and Approaches for Educational Technology in a global context. International Journal of Artificial Intelligence in Education, 25, 177–203. https://doi.org/10.1007/s40593-014-0028-6

    Article  Google Scholar 

  • Okoli, C. (2015). A Guide to Conducting a Standalone Systematic Literature Review. Communications of the Association for Information Systems, 37, 43, 879–910. https://doi.org/10.17705/1CAIS.03743

  • Pashazadeh, A., & Navimipour, N. J. (2018). Big data handling mechanisms in the healthcare applications: A comprehensive and systematic literature review. Journal of Biomedical Informatics, 82, 47–62. https://doi.org/10.1016/j.jbi.2018.03.014

  • Pereira, L. A., Bastos, M. C., Dermeval, D., Paiva, R., Coelho, J. A. P. M., & Lima, D. (2019). Evaluation of an Intelligent Tutoring System Prototype for the Teaching of Electrocardiogram. in Proceedings of the IEEE 19th International Conference on Advanced Learning Technologies (ICALT) (pp 327–328). https://doi.org/10.1109/ICALT.2019.00104

  • Pian, Y., Lu, Y., Huang, Y., & Bittencourt, I. I. (2020). A Gamified Solution to the Cold-Start Problem of Intelligent Tutoring System. In Proceedings of the International Conference on Artificial Intelligence in Education (pp. 376–381). https://doi.org/10.1007/978-3-030-52240-7_68

  • Putz, L. M., Hofbauer, F., & Treiblmaier, H. (2020). Can gamification help to improve education? Findings from a longitudinal study. Computers in Human Behavior, 110. https://doi.org/10.1016/j.chb.2020.106392

  • Ramadhan, A., Sensuse, D. I., & Muladno, Arymurthy, A. M. (2013). Synthesizing Success Factors for e-Government Initiative. Research Journal of Applied Sciences. Engineering and Technology, 6, 9, 1685–1702. https://doi.org/10.19026/rjaset.6.3891

  • Recker, J. (2013). Scientific Research in Information Systems. Berlin, Germany.

  • Ribeiro, L. A., da Silva, T. L., & Mussi, A. Q. (2018). Gamification: A methodology to motivate engagement and participation in a higher education environment. International Journal of Education and Research, 6, 4.

    Google Scholar 

  • Roscoe, R. D., Allen, L. K., Weston, J. L., Crossley, S. A., & McNamara, D. S. (2014). The Writing Pal Intelligent Tutoring System: Usability Testing and Development. Computers and Composition, 34, 39–59. https://doi.org/10.1016/j.compcom.2014.09.002

  • Sailer, M., Hense, J., Mandl, H., & Klevers, M. (2013). Psychological perspectives on motivation through Gamification. Interaction Design and Architecture(s) Journal, 19, 28–37.

    Article  Google Scholar 

  • Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371–380. https://doi.org/10.1016/J.CHB.2016.12.033

    Article  Google Scholar 

  • Sanchez, R. P., Bartel, C. M., Brown, E., & DeRosier, M. (2014). The acceptability and efficacy of an intelligent social tutoring system. Computers & Education, 78, 321e332. https://doi.org/10.1016/j.compedu.2014.06.013

  • Santos, L. M. A. L. D., da Costa, M. B., Kothe, J. V., Benitez, G. B., Schaefer, J. L., Baierle, I. C., & Nara, E. O. B. (2020). Industry 4.0 collaborative networks for industrial performance. Journal of Manufacturing Technology Management, 32, 2, 1245–1265. https://doi.org/10.1108/JMTM-04-2020-0156

  • Sardi, L., Idri, A., & Fernández-Alemán, J. L. (2017). A systematic review of gamification in e-Health. Journal of Biomedical Informatics, 71, 31–48. https://doi.org/10.1016/j.jbi.2017.05.011

  • Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74, 14–31. https://doi.org/10.1016/j.ijhcs.2014.09.006

    Article  Google Scholar 

  • Sekaran, U., & Bougie, R. (2016). Research Methods for business: A Skill Building Approach. United Kingdom: John Wiley & Son.

    Google Scholar 

  • Shute, V. J., & Glaser, R. (2012). An intelligent tutoring system for exploring principles of economics. In R. Snow, E, & D. E. Wiley (Eds.), Improving Inquiry in Social Science. New York: Routledge.

    Google Scholar 

  • Siemer, J., & Angelides, M. C. (1994). Embedding an Intelligent Tutoring System in A Business Gaming-Simulation Environment. In Proceedings of the 1994 Winter Simulation Conference (pp 1399–1406). https://doi.org/10.1109/WSC.1994.717537

  • Snow, E. L., Jackson, G. T., & McNamara, D. S. (2014). Emergent behaviors in computer-based learning environments: Computational signals of catching up. Computers in Human Behavior, 41, 62–70. https://doi.org/10.1016/j.chb.2014.09.011

  • Snow, E. L., Allen, L. K., Jackson, G. T., & McNamara, D. S. (2015). Spendency: Students’ propensity to Use System Currency. International Journal of Artificial Intelligence in Education volume, 25, 407–427. https://doi.org/10.1007/s40593-015-0044-1

    Article  Google Scholar 

  • Snow, E. L., Likens, A. D., Allen, L. K., & McNamara, D. S. (2016). Taking control: Stealth Assessment of deterministic behaviors within a game-based system. International Journal of Artificial Intelligence in Education, 26, 1011–1032. https://doi.org/10.1007/s40593-015-0085-5

    Article  Google Scholar 

  • Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039

  • Strmečki, D., Bernik, A., & Radošević, D. (2015). Gamification in e-learning: Introducing gamified design elements into e-learning systems. Journal of Computer Sciences, 11, 12, 1108–1117. https://doi.org/10.3844/jcssp.2015.1108.1117

  • Tahir, F., Mitrovic, A., & Sotardi, V. (2021). Do Gaming Experience and Prior Knowledge Matter When Learning with a Gamified ITS?. in Proceedings of the International Conference on Advanced Learning Technologies (ICALT) (pp 75–77). https://doi.org/10.1109/ICALT52272.2021.00030

  • Tan, D. Y., & Cheah, C. W. (2021). Develo** a gamified AI-enabled online learning application to improve students’ perception of university physics. Computers and Education: Artificial Intelligence, 2, 100032. https://doi.org/10.1016/j.caeai.2021.100032

  • Tao, X., Wang, F., & Li, X. (2018). A Visualized Analysis of Game-Based Learning Research from 2013 to 2017. In Proceedings of 2018 International Joint Conference on Information, Media and Engineering (ICIME) (pp. 192–196). https://doi.org/10.1109/ICIME.2018.00047

  • Tenório, K., Challco, G. C., Dermeval, D., Lemos, B., Nascimento, P., Santos, R., & da Silva, A. P. (2020). Hel** Teachers assist their students in Gamified Adaptive Educational Systems: Towards a Gamification Analytics Tool. In I. Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Millán (Eds.), Artificial Intelligence in Education. AIED 2020 (12164 vol.). Cham: Springer. Lecture Notes in Computer Science https://doi.org/10.1007/978-3-030-52240-7_57

    Chapter  Google Scholar 

  • Tenório, K., Dermeval, D., Monteiro, M., Peixoto, A., & da Silva, A. P. (2021). Exploring Design Concepts to Enable Teachers to Monitor and Adapt Gamification in Adaptive Learning Systems: A Qualitative Research Approach. International Journal of Artificial Intelligence in Education, 32, 867–891. https://doi.org/10.1007/s40593-021-00274-y

  • Tranfield, D., Denyer, D., & Smart, P. (2003). Towards a Methodology for Develo** Evidence-Informed Management Knowledge by Means of Systematic Review. British Journal of Management, 14, 3, 207–222. https://doi.org/10.1111/1467-8551.00375

  • van der Werf, J., M., E., M., and, & Steehouwer, L. (2019). CoRA: An Online Intelligent Tutoring System to Practice Coverability Graph Construction. In Proceedings of International Conference on Applications and Theory of Petri Nets and Concurrency (pp. 91–100). https://doi.org/10.1007/978-3-030-21571-2_6

  • van Gaalen, A. E. J., Brouwer, J., Schönrock–Adema, J., Bouwkamp–Timmer, T., Jaarsma, A. D. C., & Georgiadis, J. R. (2021). Gamification of health professions education: A systematic review. Advances in Health Sciences Education, 26, 683–711. https://doi.org/10.1007/s10459-020-10000-3

    Article  Google Scholar 

  • Virvou, M., & Katsionis, G. (2003). Web services for an Intelligent tutoring system that operates as a virtual reality game. in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483) (pp 378–383). https://doi.org/10.1109/ICSMC.2003.1243845

  • Vištica, M., Grubišic, A., & Žitko, B. (2016). Automated essay scoring in applied games: Reducing the teacher bandwidth problem in online training. The International Journal of Information and Learning Technology, 33(4), 202–218. https://doi.org/10.1108/IJILT-03-2016-0011

    Article  Google Scholar 

  • Westera, W., Dascalu, M., Kurvers, H., Ruseti, S., & Trausan-Matu, S. (2018). Automated essay scoring in applied games: Reducing the teacher bandwidth problem in online training. Computers & Education, 123, 212–224. https://doi.org/10.1016/j.compedu.2018.05.010

    Article  Google Scholar 

  • Whalen, D. F., & Shelley, M. C. (2010). Academic success for STEM and Non-STEM majors. Journal of STEM Education, 11(1), 45–60.

    Google Scholar 

  • Wilson, C., & Scott, B. (2016). Adaptive systems in education: A review and conceptual unification. The International Journal of Information and Learning Technology, 34(1), 2–19. https://doi.org/10.1108/IJILT-09-2016-0040

    Article  MathSciNet  Google Scholar 

  • **, N., & Hamari, J. (2020). Does gamification affect brand engagement and equity? A study in online brand communities. Journal of Business Research, 109, 449–460. Doi: https://doi.org/10.1016/j.jbusres.2019.11.058

  • Xu, F., Weber, J., & Buhalis, D. (2013). Gamification in Tourism. Information and Communication Technologies in Tourism 2014, 525–537. https://doi.org/10.1007/978-3-319-03973-2_38

  • Yang, J., & Li, D. (2021). Exploring the inverted-U relationship between gamification achievement and health management performance. Computers in Human Behavior, 121, 106805. https://doi.org/10.1016/j.chb.2021.106805

  • Yuce, A., Abubakar, A. M., & Ilkan, M. (2019). Intelligent tutoring systems and learning performance applying task-technology fit and IS success model. Online Information Review, 43(4), 600–616. https://doi.org/10.1108/OIR-11-2017-0340

    Article  Google Scholar 

  • Zainuddin, Z., Chu, S. K. W., Shujahat, M., & Perera, C. J. (2020). The impact of gamification on learning and instruction: A systematic review of empirical evidence. International Educational Research Review, 30, 100326. https://doi.org/10.1016/j.edurev.2020.100326

  • Zhang, B., & Jia, J. (2017). Evaluating an Intelligent Tutoring System for Personalized Math Teaching. In Proceedings of 2017 International Symposium on Educational Technology (ISET) (pp. 126–130). https://doi.org/10.1109/ISET.2017.37

Download references

Acknowledgements

We want to share our gratitude for the technical help from Mr. Adi Suryaputra Paramita and Mr. Satrio Pradono Suryodiningrat, both of them are Doctoral students at Doctor of Computer Science, Bina Nusantara University, Indonesia.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. School of Computing, Telkom University, Bandung, Indonesia

    Arief Ramadhan

  2. Computer Science Department, BINUS Graduate Program, Doctor of Computer Science, Bina Nusantara University, Jakarta, Indonesia

    Harco Leslie Hendric Spits Warnars

  3. Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia

    Fariza Hanis Abdul Razak

Authors
  1. Arief Ramadhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Harco Leslie Hendric Spits Warnars
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fariza Hanis Abdul Razak
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AR made substantial contributions to the whole part of the Manuscript and the data analysis, also involved in revising the manuscript to meet the journal standard. HLHSW and FHAR were involved in the analysis of data and conducting the quality assessment. HLHSW and FHAR involved in revising the manuscript.

Corresponding author

Correspondence to Arief Ramadhan.

Ethics declarations

Competing interests

Not applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramadhan, A., Warnars, H.L.H.S. & Razak, F.H.A. Combining intelligent tutoring systems and gamification: a systematic literature review. Educ Inf Technol 29, 6753–6789 (2024). https://doi.org/10.1007/s10639-023-12092-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-023-12092-x

Keywords

Search

Navigation