Abstract
Courseware as an adaptive instructional system is a complex environment to develop. The student will encounter lessons of content with integrated formative practice, adaptive activities, and assessments in their learning path. The alignment of all course features, including the scaffolding structure of the adaptive activities, may vary between courses and the teams who created them. In a previous analysis of adaptive activities [1], these activities had net positive effects on student learning estimates and summative assessment scores. In this paper, we will analyze three additional non-STEM courses that had less effective adaptive activities using the same methods as the original study, and further investigate course features that could be influencing their effectiveness, such as alignment, difficulty, and amount of practice. The results of this analysis can provide guidance on how to best create content for adaptive courseware and provide an example of the critical role data analysis has in the evaluation and iterative improvement of student learning environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Van Campenhout, R., Jerome, B., Johnson, B.G.: The impact of adaptive activities in Acrobatiq courseware - investigating the efficacy of formative adaptive activities on learning estimates and summative assessment scores. In: Sottilare, R.A., Schwarz, J. (eds.) HCII 2020. LNCS, vol. 12214, pp. 543–554. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50788-6_40
Black, P., William, D.: Inside the black box: raising standards through classroom assessment. Phi Delta Kappan 92(1), 81–90 (2010). https://doi.org/10.1177/003172171009200119
Dunlosky, J., Rawson, k., Marsh, E., Nathan, M., Willingham, D.: Improving students’ learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychol. Sci. Public Interest 14(1), 4–58 (2013). https://doi.org/10.1177/1529100612453266
Koedinger, K., Kim, J., Jia, J., McLaughlin, E., Bier, N.: Learning is not a spectator sport: doing is better than watching for learning from a MOOC. Learning at Scale, Vancouver, Canada, pp. 111–120 (2015). https://doi.org/10.1145/2724660.2724681
Koedinger, K., McLaughlin, E., Jia, J., Bier, N.: Is the doer effect a causal relationship? how can we tell and why it’s important. Learning Analytics and Knowledge. Edinburgh, United Kingdom (2016). https://doi.org/10.1145/2883851.2883957
Koedinger, K.R., Scheines, R., Schaldenbrand, P.: Is the doer effect robust across multiple data sets? In: Proceedings of the 11th International Conference on Educational Data Mining, EDM 2018, pp. 369–375 (2018)
Olsen, J., Johnson, B.G.: Deeper collaborations: a finding that may have gone unnoticed. Paper presented at the IMS Global Learning Impact Leadership Institute, San Diego, CA (2019)
Baker, F. The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation. College Park, MD (2001). http://echo.edres.org:8080/irt/baker/
Embretson, S., Reise, S.: Item Response Theory for Psychologists. Erl-baum, Mahwah (2000)
Fox, J.: Bayesian Item Response Modeling: Theory and Applications. Springer, New York (2010). https://doi.org/10.1007/978-1-4419-0742-4
Sanders, D., Welk, D.: Strategies to scaffold student learning: applying Vygotsky’s zone of proximal development. Nurse Educ. 30(5), 203–204 (2005)
Sweller, J.: The worked example effect and human cognition. Learn. Instr. 16(2), 165–169 (2006). https://doi.org/10.1016/j.learninstruc.2006.02.005
Goodell, J., Thai, K.-P.: A learning engineering model for learner-centered adaptive systems. In: Stephanidis, C., Harris, D., Li, W.-C., Schmorrow, D.D., Fidopiastis, C.M., Zaphiris, P., Ioannou, A., Fang, X., Sottilare, R.A., Schwarz, J. (eds.) HCII 2020. LNCS, vol. 12425, pp. 557–573. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-60128-7_41
Acknowledgements
The authors sincerely thank Leandro Ucha for his assistance in preparing the data for the analysis of the adaptive activities.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Van Campenhout, R., Jerome, B., Dittel, J.S., Johnson, B.G. (2021). Investigating Adaptive Activity Effectiveness Across Domains: Insights into Design Best Practices. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. Design and Evaluation. HCII 2021. Lecture Notes in Computer Science(), vol 12792. Springer, Cham. https://doi.org/10.1007/978-3-030-77857-6_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-77857-6_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77856-9
Online ISBN: 978-3-030-77857-6
eBook Packages: Computer ScienceComputer Science (R0)