Abstract
Recent studies show that physiological data can detect changes in mental effort, making way for the development of wearable sensors to monitor mental effort in school, work, and at home. We have yet to explore how such a device would work with a single participant over an extended time duration. We used a longitudinal case study design with ~38 h of data to explore the efficacy of electrodermal activity, skin temperature, and heart rate for classifying mental effort. We utilized a 2-state Markov switching regression model to understand the efficacy of these physiological measures for predicting self-reported mental effort during logged activities. On average, a model with state-dependent relationships predicted within one unit of reported mental effort (training RMSE = 0.4, testing RMSE = 0.7). This automated sensing of mental effort can have applications in various domains including student engagement detection and cognitive state assessment in drivers, pilots, and caregivers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Paas, F., Sweller, J.: Implications of cognitive load theory for multimedia learning. In: The Cambridge handbook of multimedia learning,. pp. 27–42. Cambridge University Press, New York (2014)
Sweller, J., Chandler, P., Kalyuga, S.: Cognitive load theory. Springer, New York (2011)
Sweller, J., van Merriënboer, J.J., Paas, F.: Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, pp. 1–32 (2019)
Sweller, J.: Element interactivity and intrinsic, extraneous, and germane cognitive load. Educ. Psychol. Rev. 22, 123–138 (2010). https://doi.org/10.1007/s10648-010-9128-5
Cowan, N.: The magical mystery four: how is working memory capacity limited, and why? Curr. Directions Psychol. Sci. 19, 51–57 (2010)
Cowan, N.: The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav. Brain Sci. 24, 87–114 (2001)
Sweller, J., Van Merrienboer, J.J., Paas, F.G.: Cognitive architecture and instructional design. Educ. Psychol. Rev. 10, 251–296 (1998)
Sweller, J.: Cognitive load theory, learning difficulty, and instructional design. Learn. Instr. 4, 295–312 (1994)
Chandler, P., Sweller, J.: Cognitive load theory and the format of instruction. Cogn. Instr. 8, 293–332 (1991)
Young, J.Q., Van Merrienboer, J., Durning, S., Ten Cate, O.: Cognitive load theory: implications for medical education: AMEE Guide No. 86. Med. Teach. 36, 371–384 (2014)
Leppink, J., Duvivier, R.: Twelve tips for medical curriculum design from a cognitive load theory perspective. Med. Teach. 38, 669–674 (2016)
Van Merriënboer, J.J., Sweller, J.: Cognitive load theory in health professional education: design principles and strategies. Med. Educ. 44, 85–93 (2010)
Paas, F.G.: Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J. Educ. Psychol. 84, 429–434 (1992). https://doi.org/10.1037/0022-0663.84.4.429
Cook, A.E., Wei, W., Preziosi, M.A.: The use of ocular-motor measures in a convergent approach to studying cognitive load. Cognitive load measurement and application: A theoretical framework for meaningful research and practice, pp. 112–128 (2018)
Korbach, A., Brünken, R., Park, B.: Differentiating Different Types of Cognitive Load: a Comparison of Different Measures. Educ. Psychol. Rev. 30, 503–529 (2018). https://doi.org/10.1007/s10648-017-9404-8
Antonenko, P., Paas, F., Grabner, R., van Gog, T.: Using electroencephalography to measure cognitive load. Educ. Psychol. Rev. 22, 425–438 (2010). https://doi.org/10.1007/s10648-010-9130-y
Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. Presented at the Proceedings of the human factors and ergonomics society annual meeting (2006)
Charles, R.L., Nixon, J.: Measuring mental workload using physiological measures: a systematic review. Applied Ergonomics. 74, 221–232 (2019)
Or, C.K., Duffy, V.G.: Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. Occupational Ergonomics. 7, 83–94 (2007)
De Jong, T.: Cognitive load theory, educational research, and instructional design: some food for thought. Instr. Sci. 38, 105–134 (2010)
Schroeder, N.L., Cenkci, A.T.: Do measures of cognitive load explain the spatial split-attention principle in multimedia learning environments? A systematic review. J. Educ. Psychol. (2019)
Zheng, R.Z.: Cognitive load measurement and application: a theoretical framework for meaningful research and practice. Routledge (2017)
de Avila, U.E.R., de França Campos, F.R., Leocadio-Miguel, M.A., Araujo, J.F.: 15 Mins of attention in class: variability of heart rate, personality, emotion and chronotype. Creative Educ. 10, 2428 (2019)
Di Lascio, E., Gashi, S., Santini, S.: Unobtrusive assessment of students’ emotional engagement during lectures using electrodermal activity sensors. In: Proceedings ACM Interactive Mobile Wearable Ubiquitous Technology, vol. 2, pp. 1–21 (2018). https://doi.org/10.1145/3264913.
Romine, W.L., et al.: Using machine learning to train a wearable device for measuring students’ cognitive load during problem-solving activities based on electrodermal activity, skin temperature, and heart rate: development of a cognitive load tracker for both personal and classroom use. Sensors. 20, 4833 (2020)
Larmuseau, C., Vanneste, P., Cornelis, J., Desmet, P., Depaepe, F.: Combining physiological data and subjective measurements to investigate cognitive load during complex learning. Frontl. Learn. Res. 7, 57–74 (2019)
Lundervold, D.A., Belwood, M.F.: The best kept secret in counseling: Single-case (N=1) experimental designs. J. Counsel. Dev. 78, 92–102 (2000)
Stake, R.: The Art of Case Study Research. Sage Publications, New York (1995)
Morgan, D.L., Morgan, R.K.: Single-participant research design: bringing science to managed care. Am. Psychol. 56(2), 119–127 (2001)
Foster, L.H.: A best kept secret: single-subject research design in counseling. Counsel. Outcome Res. Eval. 1(2), 30–39 (2010)
Hamilton, J.D.: A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica J. Econ. Soc. 357–384 (1989)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Romine, W., Schroeder, N., Edwards, A., Banerjee, T. (2021). Longitudinal Classification of Mental Effort Using Electrodermal Activity, Heart Rate, and Skin Temperature Data from a Wearable Sensor. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12662. Springer, Cham. https://doi.org/10.1007/978-3-030-68790-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-68790-8_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68789-2
Online ISBN: 978-3-030-68790-8
eBook Packages: Computer ScienceComputer Science (R0)
