Abstract
Emotions can both facilitate and hinder learning. Emotional design features such as colors and shapes can be embedded in multimedia learning environments to manipulate learners’ affects and learning outcomes. However, some studies suggest that emotional designs promote learning, while others show that they hinder it. Although Brom et al. (Educational Research Review 25:100–119, Brom et al. 2018) published a meta-analysis on the use of emotional designs in multimedia learning, an updated search showed that more studies were published recently. Thus, the present meta-analysis is a replication and extension of Brom et al.’s (Educational Research Review 25:100–119, Brom et al. 2018) meta-analysis. A total of 28 articles yielded the following independent effect sizes for each outcome examined: retention (k = 28), transfer (k = 38), comprehension (k = 16), mental effort (k = 28), perceived difficulty (k = 19), change in positive affect (k = 25), intrinsic motivation (k = 28), and liking/enjoyment (k = 19). Results showed that including emotional designs enhanced learning outcomes (retention: g+ = 0.35; transfer: g+ = 0.27; comprehension: g+ = 0.29), change in positive affect (g+ = 0.09), intrinsic motivation (g+ = 0.15), mental effort (g+ = 0.11), liking/enjoyment (g+ = 0.10), and reduced perceived difficulty (g+ = − 0.21). Moderator analyses were conducted for retention, mental effort, intrinsic motivation, and positive affect, and findings showed that mean effect sizes were moderated by participant characteristics as well as methodological and contextual features of the studies. We discuss these findings as well as their theoretical and practical implications.
Similar content being viewed by others
References
The asterisk indicates studies included in this meta-analysis.
Baddeley, A. (1992). Working memory. Science, 255(5044), 556–559. https://doi.org/10.1126/science.1736359.
Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. https://doi.org/10.2307/2533446.
Benjaminni, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B: Methodological, 57(1), 289–300.
Berney, S., & Bétrancourt, M. (2016). Does animation enhance learning? A meta-analysis. Computers & Education, 101, 150–167. https://doi.org/10.1016/j.compedu.2016.06.005.
Berry, D. S., & McArthur, L. Z. (1985). Some components and consequences of a babyface. Journal of Personality and Social Psychology, 48(2), 312–323. https://doi.org/10.1037/0022-3514.48.2.312.
Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, England: Wiley.
Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2013). Comprehensive meta-analysis (Version 3.0) [Computer software]. Englewood, NJ.
Brand, S., Reimer, T., & Opwis, K. (2007). How do we learn in a negative mood? Effects of negative mood on transfer and learning. Learning and Instruction, 17(1), 1–16. https://doi.org/10.1016/j.learninstruc.2006.11.002.
*Brom, C., Hannemann, T., Stárková, T., Bromová, E., & Děchtěrenko, F. (2016). Anthropomorphic faces and funny graphics in an instructional animation may improve superficial rather than deep learning: a quasi-experimental study. In J. Novotna & A. Jancarik (Eds.), Proceedings of the 15th European Conference on e-Learning, Prague, Czech Republic (pp. 89-97). Academic Conference and Publishing International Limited: Reading, UK.
Brom, C., Stárková, T., & D’Mello, S. K. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119. https://doi.org/10.1016/j.edurev.2018.09.004.
*Chui, T. K., Jong, M. S., & Mok, I. A. C. (2020). Does learner expertise matter when designing emotional multimedia for learners of primary school mathematics? Educational Technology Research and Development. Advanced online publication. https://doi.org/10.1007/s11423-020-09775-4
Dehn, D. M., & van Mulken, S. (2000). The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies, 52(1), 1–22. https://doi.org/10.1006/ijhc.1999.0325.
*Dong, C. (2007). Positive emotions and learning: what makes a difference in multimedia design? (Unpublished doctoral dissertation). New York University: New York.
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple graphical test. British Medical Journal, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629.
Franco, A., Malhotra, N., & Simonovits, G. (2014). Publication bias in the social sciences: unlocking the file drawer. Science, 345(6203), 1502–1505. https://doi.org/10.1126/science.1255484.
*Gong, S., Shangguan, C., Zhai, K., & Guo, Y. (2017). The effects of emotional design on multimedia learning. Acta Psychologica Sinica, 49(6), 771-782. https://doi.org/10.3724/SP.J.1041.2017.00771
Gorn, G. J., Chattopadhyay, A., Yi, T., & Dahl, D. W. (1997). Effects of color as an executional cue in advertising: they’re in the shade. Management Science, 43(10), 1387–1400. https://doi.org/10.1287/mnsc.43.10.1387.
Grant, H., & Dweck, C. S. (2001). Cross-cultural response to failure: considering outcome attributions with different goals. In F. Salili, G. Ghiu, & Y. Hong (Eds.), Student motivation: the culture and context of learning (pp. 203–219). New York: Kluwer Academic/Plenumm Publishers.
*Haaranen, L., Ihantola, P., Sorva, J., & Vihavainen, A. (2015). In search of the emotional design effect in programming. In Proceedings of the 37th International Conference on Software Engineering, ICSE 2015, 2, 428-434.
Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: a theory of cognitive interest in science learning. Journal of Educational Psychology, 50, 414–434. https://doi.org/10.1037/0022-0663.90.3.414.
Hasler, B. S., Kersten, B., & Sweller, J. (2007). Learner control, cognitive load and instructional animation. Applied Cognitive Psychology, 21(6), 713–729. https://doi.org/10.1002/acp.1345.
Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6(2), 107–128.
*Heidig, S., Müller, J., & Reichelt, M. (2015). Emotional design in multimedia learning: differentiation on relevant design features and their effects on emotions and learning. Computers in Human Behavior, 44, 81–95. https://doi.org/10.1016/j.chb.2014.11.009
Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558.
Höffler, T. N., & Leutner, D. (2007). Instructional animation versus static pictures: a meta-analysis. Learning and Instruction, 17(6), 722–738. https://doi.org/10.1016/j.learninstruc.2007.09.013.
Höffler, T. N., & Schwartz, R. N. (2011). Effects of pacing and cognitive style across dynamic and non-dynamic representations. Computers & Education, 57(2), 1716–1726. https://doi.org/10.1016/j.compedu.2011.03.012.
Isen, A., & Reeve, M. (2005). The influence of positive affect on intrinsic and extrinsic motivation: facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion, 29(4), 295–323. https://doi.org/10.1007/s11031-006-9019-8.
Isen, A. M., Daubman, K. A., & Nowicki, G. P. (1987). Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology, 52(6), 1122–1131. https://doi.org/10.1037/0022-3514.52.6.1122.
Jamet, E., Gavota, M., & Quaireau, C. (2008). Attention guiding in multimedia learning. Learning and Instruction, 18(2), 135–145. https://doi.org/10.1016/j.learninstruc.2007.01.011.
Kumar, J. A. (2016). Effects of multimedia induced emotions on achievement, intrinsic motivation and satisfaction among polytechnic students with different levels of emotional intelligence. (Unpublished doctoral dissertation). Malaysia: Universiti Sains Malaysia.
*Kumar, J. A., Balakrishnan, M., & Yahaya, W. A. J. W. (2016). Emotional design in multimedia learning: how emotional intelligence moderates learning outcomes. International Journal of Modern Education and Computer Science, 8(5), 54–63. https://doi.org/10.5815/ijmecs.2016.05.07
*Kumar, J. A., Balakrishnan, M., & Yahaya, W. A. J. W. (2019). Exploring the effects of emotional design and emotional intelligence in multimedia-based learning: an engineering educational perspective. New Review of Hypermedia and Multimedia, 25(1-2), 57-86. https://doi.org/10.1080/13614568.2019.1596169
Lakens, D., Hilgard, J., & Staaks, J. (2016). On the reproducibility of meta-analyses: six practical recommendations. BMC psychology, 4(1), 1–10. https://doi.org/10.1186/s40359-016-0126-3.
*Le, Y., Liu, J., Deng, C., & Dai., D. Y. (2018) Heart rate variability reflects the effects of emotional design principle on mental effort in multimedia learning. Computers in Human Behavior, 89, 40-47. https://doi.org/10.1016/j.chb.2018.07.037
Linnenbrink, E. A. (2006). Emotion research in education: Theoretical and methodological perspectives on the integration of affect, motivation, and cognition. Educational Psychology Review, 18(4), 307–314. https://doi.org/10.1007/s10648-006-9028-x.
Lowe, R. K., & Schnotz, W. (2014). Animation principles in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., p. 513–546). New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.026
Matsumoto, D., Consolacion, T., Yamada, H., Suzuki, R., Franklin, B., Paul, S., et al. (2002). Cognition and Emotion, 16(6), 721–747. https://doi.org/10.1080/02699930143000608.
Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 43–71). New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005.
Mayer, R. E. (2017). Using multimedia for e-learning: multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197.
*Mayer, R. E., & Estrella, G. (2014). Benefits of emotional design in multimedia instruction. Learning and Instruction, 33, 12–18. https://doi.org/10.1016/j.learninstruc.2014.02.004
Mayer, R. E., & Fiorella, L. (2014). Principles for reducing extraneous processing in multimedia learning: coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 279–315). New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.015.
Mega, C., Ronconi, L., & De Beni, R. (2014). What makes a good student? How emotions, self-regulated learning, and motivation contribute to academic achievement. Journal of Educational Psychology, 106(1), 121–131. https://doi.org/10.1037/a0033546.
*Miller, C. (2011). Aesthetics and e-assessment: the interplay of emotional design and learner performance. Distance Education, 32(3), 307–337. https://doi.org/10.1080/01587919.2011.610291
*Moremoholo, T. P., & de Lange, R. W. (2018). Anthropomorphic graphics: how useful are they as an instructional aid to facilitate learning? The Independent Journal of Teaching and Learning, 13(2), 67–81.
Moreno, R. (2006). Does the modality principle hold for different media? A test of the method-affects-learning hypothesis. Journal of Computer Assisted Learning, 22(3), 149–158.
Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309–326.
Münchow, H. (2017). I feel therefore I learn – effectiveness of affect induction interventions and possible covariates on learning outcomes. (Unpublished doctoral dissertation). Würzburg: Julius-Maximillians-Universität: Würzburg, Germany.
*Münchow, H., & Bannert, M. (2019). Feeling good, learning better? Effectivity of an emotional design procedure in multimedia learning. An International Journal of Experimental Educational Psychology, 39(4), 530-549. https://doi.org/10.1080/01443410.2018.1524852
*Münchow, H., Mengelkamp, C., & Bannert, M. (2017). The better you feel the better you learn: do warm colors and rounded shapes enhance learning outcome in multimedia learning? Education Research International, 2017, 1-15. doi:https://doi.org/10.1155/2017/2148139
Napolitano, A. C., & Sloutsky, V. M. (2004). Is a picture worth a thousand words? The flexible nature of modality dominance in young children. Child Development, 75(6), 1850–1870. https://doi.org/10.1111/j.1467-8624.2004.00821.x.
*Navratil, S. D., Kühl, T., & Heidig, S. (2018). Why the cells look like that – the influence of learning with emotional design and elaborative interrogations. Frontiers in Psychology, 9, 1–15. https://doi.org/10.3389/fpsyg.2018.01653.
*Ng, K. H., & Chiu, T. K. F. (2017). Emotional multimedia design for develo** mathematical problem-solving skills. In W. W. K. Ma, C.-K. Chan, K. Tong, H. Fung, & C. W. R. Fong (Eds.), New ecology for education — communication x learning (pp. 131–141). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-10-4346-8_11
*Nurminen, M. (2016). Effects of emotional design and goal orientation on students’ emotions and learning outcomes in university programming education (Unpublished thesis). Tampere University of Technology: Tampere, Finland.
*Nurminen, M. I., Leppanen, L., Vaataja, H., & Ihantola, P. (2017). Search of the emotional design effect in programming revised. In É. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Data driven approaches in digital education (Vol. 10474). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-66610-5
Orwin, R. G. (1983). A Fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. https://doi.org/10.2307/1164923.
Paivio, A. (1986). Mental representations: a dual-coding approach. Oxford, England: Oxford University Press.
Palmer, S. E., & Schloss, K. B. (2010). An ecological valence theory of human color preference. Proceedings of the National Academy of Sciences, 107(19), 8877–8882. https://doi.org/10.1073/pnas.0906172107.
Park, B., Plass, J. L., & Brünken, R. (2014). Cognitive and affective processes in multimedia learning. Learning and Instruction, 29, 125–127. https://doi.org/10.1016/j.learninstruc.2013.05.005.
*Park, B., Knörzer, L., Plass, J. L., & Brünken, R. (2015). Emotional design and positive emotions in multimedia learning: an eyetracking study on the use of anthropomorphisms. Computers & Education, 86, 30–42. https://doi.org/10.1016/j.compedu.2015.02.016
Pekrun, R. (2006). The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9.
Pett, D., & Wilson, T. (1996). Color research and its application to the design of instructional materials. Educational Technology Research and Development, 44(3), 19–35. https://doi.org/10.1007/BF02300423.
Pintrich, P. R. (2003). A motivational science perspective on the role of student motivation in learning and teaching contexts. Journal of Educational Psychology, 95(4), 667–686. https://doi.org/10.1037/0022-0663.95.4.667.
Plass, J. L., & Kalyuga, S. (2019). Four ways of considering emotion in cognitive load theory. Educational Psychology Review, 31(2), 339–359. https://doi.org/10.1007/s10648-019-09473-5.
Plass, J. L., & Kaplan, U. (2016). Emotional design in digital media for learning. In S. Y. Tettegah & M. Gartmeier (Eds.), Emotions, technology, design, and learning (pp. 131–161). New York: Elsevier.
*Plass, J. L., Heidig, S., Hayward, E. O., Homer, B. D., & Um, E. (2014). Emotional design in multimedia learning: effects of shape and colour on affect and learning. Learning and Instruction, 29, 128–140. https://doi.org/10.1016/j.learninstruc.2013.02.006
Raffaelli, M., Crockett, L. J., & Shen, Y.-L. (2005). Developmental stability and change in self-regulation from childhood to adolescence. Journal of Genetic Psychology, 166(1), 54–76.
Rey, G. D. (2012). A review of research and a meta-analysis of the seductive detail effect. Educational Research Review, 7(3), 216–237. https://doi.org/10.1016/j.edurev.2012.05.003.
Rop, G., Schüler, A., Verkoeijen, P. P. J. L., Scheiter, K., & Van Gog, T. (2018). Effects of task experience and layout on learning from text and pictures with or without unnecessary picture descriptions. Journal of Computer Assisted Learning, 34(4), 458–470. https://doi.org/10.1111/jcal.12287.
Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638.
*Schneider, S., Häßler, A., Habermeyer, T., Beege, M., & Rey, G. D. (2018a). The more human, the higher the performance? Examining the effects of anthropomorphism on learning with media. Journal of Educational Psychology, 111(1), 57–72. https://doi.org/10.1037/edu0000273.
*Schneider, S., Nebel, S., Beege, M., & Rey, G. D., (2018b). Anthropomorphism in decorative pictures: Benefit or harm for learning? Journal of Educational Psychology, 110(2), 218–232. https://doi.org/10.1037/edu0000207.
*Shangguan, C., Wang, Z., Gong, S., Guo, Y., & Xu, S. (2019). More attractive or more interactive? The effects of multi-leveled emotional design on middle school students’ multimedia learning. Frontiers in Psychology, 10, 1-12. https://doi.org/10.3389/fpsyg.2019.03065.
*Shangguan, C., Gong, S., Guo, Y., Wang, X., & Lu, J. (2020). The effects of emotional design on middle school students’ multimedia learning: the role of learners’ prior knowledge. Educational Psychology, 1–18. https://doi.org/10.1080/01443410.2020.1714548
*Stárková, T., Lukavský, J., Javora, O., & Brom, C. (2018). Anthropomorphisms in multimedia learning: attract attention but do not enhance learning? Journal of Computer Assisted Learning, 35, 555-568. https://doi.org/10.1111/jcal.12359
Tabbers, H. K., & de Koeijer, B. (2010). Learner control in animated multimedia instructions. Instructional Science, 38(5), 441–453. https://doi.org/10.1007/s11251-009-9119-4.
Tabbers, H. K., Martens, R. L., & Merriënboer, J. J. G. (2004). Multimedia instructions and cognitive load theory: effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71–81. https://doi.org/10.1348/000709904322848824.
Tyng, C. M., Amin, H. U., Saad, M. N. M., & Malik, A. S. (2017). The influences of emotion on learning and memory. Frontiers in Psychology, 8, 1–22. https://doi.org/10.3389/fpsyg.2017.01454.
Um, E. R. (2008). The effect of positive emotions on cognitive processes in multimedia -based learning. (Publication No. 3308294), [Doctoral Dissertation, New York University]. ProQuest Dissertations Publishing.
*Um, E. R., Song, H. S., & Plass, J. L. (2007). The effect of positive emotions on multimedia learning. In C. Montgomerie & J. Seale (Eds.), EdMedia: World Conference on Educational Media and Technology, Vancouver, Canada (pp. 4176–4185). Association for the Advancement of Computing in Education (AACE): Waynesville, NC.
*Um, E. R., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485–498. https://doi.org/10.1037/a0026609.
*Uzun, A. M., & Yildirim, Z. (2018). Exploring the effect of using different levels of emotional design features in multimedia science learning. Computers & Education, 119, 112-128. https://doi.org/10.1016/j.compedu.2018.01.002
Wang, Z., & Adesope, O. (2017). Do focused self-explanation prompts overcome seductive details? A multimedia study. Journal of Educational Technology & Society, 20(4), 47–57.
Waytz, A., Cacioppo, J., & Epley, N. (2010). Who sees human? The stability and importance of individual differences in anthropomorphism. Perspectives on Psychological Science, 5(3), 219–232. https://doi.org/10.1177/1745691610369336.
Wittrock, M. C. (1989). Generative processes of comprehension. Educational Psychologist, 24(4), 345–376. https://doi.org/10.1207/s15326985ep2404_2.
Wolfson, S., & Case, G. (2000). The effects of sound and color on responses to a computer game. Interacting with Computers, 13(2), 183–192. https://doi.org/10.1016/S0953-5438(00)00037-0
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(XLSX 18 kb)
Rights and permissions
About this article
Cite this article
Wong, R.M., Adesope, O.O. Meta-Analysis of Emotional Designs in Multimedia Learning: A Replication and Extension Study. Educ Psychol Rev 33, 357–385 (2021). https://doi.org/10.1007/s10648-020-09545-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10648-020-09545-x