Abstract
Machine learning (ML) based adaptive learning promises great improvements in personalized learning for various learning contexts. However, it is necessary to look into the effectiveness of different interventions in specific learning areas. We conducted an online-controlled experiment to compare an online learning environment for spelling to an ML based implementation of the same learning platform. The learning platform is used in schools from all types in Germany. Our study focuses on the role of different machine learning-based adaptive task sequencing interventions that are compared to the control group. We evaluated nearly 500,000 tasks using different metrics. In total almost 6,000 students from class levels 5 to 13 (ages from 11–19) participated in the experiment. Our results show that the relative number of incorrect answers significantly decreased in both intervention groups. Other factors such as dropouts or competencies reveal mixed results. Our experiment showed that personalized task sequencing can be implemented as ML based interventions and improves error rates and dropout rates in language learning for students. However, the impact depends on the specific type of task sequencing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
10.17605/OSF.IO/3R5Y7.
References
Chen, C.-M., Lee, H.-M., Chen, Y.-H.: Personalized e-learning system using Item Response Theory. Comput. Educ. 44(3), 237–255 (2005)
Cock, J., Meier, B.:. Task sequencing and learning. In: Seel, N.M. (ed.) Springer reference. Encyclopedia of the Sciences of Learning: With 68 Tables, pp. 3266–3269. Springer (2012). https://doi.org/10.1007/978-1-4419-1428-6_514
Corbalan, G., Kester, L., van Merriënboer, J.J.: Selecting learning tasks: effects of adaptation and shared control on learning efficiency and task involvement. Contemp. Educ. Psychol. 33(4), 733–756 (2008). https://doi.org/10.1016/j.cedpsych.2008.02.003
Csikszentmihalyi, M.: Flow: The psychology of Optimal Experience (1990)
Embretson, S.E., Reise, S.P.: Item Response Theory for Psychologists. Multivariate Applications Book Series. Psychology Press (2000)
Ghysels, J., Haelermans, C.: New evidence on the effect of computerized individualized practice and instruction on language skills. J. Comput. Assist. Learn. 34(4), 440–449 (2018). https://doi.org/10.1111/jcal.12248
Hooshyar, D., Yousefi, M., Lim, H.: A procedural content generation-based framework for educational games: toward a tailored data-driven game for develo** early english reading skills. J. Educ. Comput. Res. 56(2), 293–310 (2018). https://doi.org/10.1177/0735633117706909
Mitrovic, A., Martin, B.: Evaluating adaptive problem selection. In: De Bra, P.M.E., Nejdl, W. (eds.) AH 2004. LNCS, vol. 3137, pp. 185–194. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-27780-4_22
Narvekar, S., Sinapov, J., Stone, P.: Autonomous task sequencing for customized curriculum design in reinforcement learning. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization (2017). https://doi.org/10.24963/ijcai.2017/353
Ronimus, M., Eklund, K., Westerholm, J., Ketonen, R., Lyytinen, H.: A mobile game as a support tool for children with severe difficulties in reading and spelling. J. Comput. Assist. Learn. 36(6), 1011–1025 (2020). https://doi.org/10.1111/jcal.12456
Rzepka, N., Simbeck, K., Müller, H.‑G., Pinkwart, N.: An Online controlled experiment design to support the transformation of digital learning towards adaptive learning platforms. In: Proceedings of the 14th International Conference on Computer Supported Education. SCITEPRESS – Science and Technology Publications (2022). https://doi.org/10.5220/0010984000003182
Shute, V., Hansen, E., Almond, R.: Evaluating ACED: The impact of feedback and adaptivity on learning. In: Luckin, R., Koedinger, K.R., Greer, J.E. (eds.) Frontiers in Artificial Intelligence and Applications, vol. 158. Artificial intelligence in Education: Building Technology Rich Learning Contexts that Work. IOS Press (2007)
Simpson, T., Park, S.: The effect of technology-supported, student-centered instruction on seventh grade students’ learning in english/language arts. In: McBride, R., Searson, M. (eds.) SITE 2013, pp. 2431–2439. Association for the Advancement of Computing in Education (AACE) (2013). https://www.learntechlib.org/p/48467/
Taylor, M. E., Stone, P.: Transfer learning for reinforcement learning domains: a survey (2009). https://www.jmlr.org/papers/volume10/taylor09a/taylor09a.pdf?ref=https://codemonkey.link
van Oostendorp, H., van der Spek, E.D., Linssen, J.: Adapting the complexity level of a serious game to the proficiency of players. EAI Endorsed Trans. Game-Based Learn. 1(2), e5 (2014). https://doi.org/10.4108/sg.1.2.e5
Vanbecelaere, S., van den Berghe, K., Cornillie, F., Sasanguie, D., Reynvoet, B., Depaepe, F.: The effectiveness of adaptive versus non-adaptive learning with digital educational games. J. Comput. Assist. Learn. 36(4), 502–513 (2020)
Wright, B.D.: Solving measurement problems with the Rasch model. J. Educ. Meas. 14(2), 97–116 (1977). http://www.jstor.org/stable/1434010
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rzepka, N., Simbeck, K., Müller, HG., Pinkwart, N. (2023). Go with the Flow: Personalized Task Sequencing Improves Online Language Learning. In: Wang, N., Rebolledo-Mendez, G., Matsuda, N., Santos, O.C., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2023. Lecture Notes in Computer Science(), vol 13916. Springer, Cham. https://doi.org/10.1007/978-3-031-36272-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-36272-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36271-2
Online ISBN: 978-3-031-36272-9
eBook Packages: Computer ScienceComputer Science (R0)