Log in

The interaction effects of an instructor’s emotions in instructional videos and students’ emotional intelligence on L2 vocabulary learning

  • Research Article
  • Published:
Educational technology research and development Aims and scope Submit manuscript

Abstract

Language learning has long been a topic of interest, and instructional videos which allow students to learn anywhere and anytime have become an important language learning tool. However, the emotional characteristics of both instructors and students, which have the potential to influence students’ second language learning from instructional videos, have yet to be fully explored. The current study investigated the interaction effects of an instructor’s emotions (positive vs. negative vs. neutral) and students’ emotional intelligence (low vs. high) on students’ second language vocabulary learning from instructional videos with consideration of attention paid to the learning material (i.e., average fixation time, referring to the duration of each fixation on the learning material), learning experience (i.e., motivation, engagement, interaction), and learning performance (both immediate and delayed). Results showed that (1) only the interaction effect on attention was verified, and that (2) students with high emotional intelligence showed a larger average fixation time in the positive condition than in the negative condition, while (3) students with low emotional intelligence showed a smaller average fixation time in the neutral condition than in the negative condition. Furthermore, the results verified the benefits of the instructor’s positive emotion on students’ motivation, interaction, and immediate performance. Our findings shine a light onto the influence of an instructor’s emotions and students’ emotional intelligence on second language learning, and provide practical implications for the design of instructional videos and second language learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Abdolrezapour, P. (2013). The relationship between emotional intelligence and EFL learners’ writing performance. Procedia - Social and Behavioral Sciences, 70, 331–339.

    Article  Google Scholar 

  • Aki, O. (2006). Is emotional intelligence or mental intelligence more important in language learning? Journal of Applied Sciences, 6(1), 66–70.

    Article  Google Scholar 

  • Andrä, C., Mathias, B., Schwager, A., Macedonia, M., & Kriegstein, K. V. (2020). Learning foreign language vocabulary with gestures and pictures enhances vocabulary memory for several months post-learning in eight-year-old school children. Educational Psychology Review, 32, 815–850.

    Article  Google Scholar 

  • Austin, E. J. (2004). An investigation of the relationship between trait emotional intelligence and emotional task performance. Personality and Individual Differences, 36(8), 1855–1864.

    Article  Google Scholar 

  • Austin, E. J. (2009). A reaction time study of responses to trait and ability emotional intelligence test items. Personality and Individual Differences, 46(3), 381–383.

    Article  Google Scholar 

  • Baker, W. (2011). Intercultural awareness: Modelling an understanding of cultures in intercultural communication through English as a lingua franca. Language and Intercultural Communication, 11(3), 197–214.

    Article  Google Scholar 

  • Berglund-Barraza, A., Tian, F., Basak, C., & Evans, J. L. (2019). Word frequency is associated with cognitive effort during verbal working memory: A functional near infrared spectroscopy (fNIRS) study. Frontiers in Human Neuroscience, 13, 433.

    Article  Google Scholar 

  • Booth, B. M., Seamans, T. J., & Narayanan, S. S. (2018). An evaluation of EEG-based metrics for engagement assessment of distance learners. In Proceedings of the 40th annual international conference of the IEEE engineering in medicine and biology society. IEEE, Honolulu, HI, USA, 307–310

  • Brom, C., Stárková, T., & D’Mello, S. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119.

    Article  Google Scholar 

  • Chattopadhyay, S., Zary, L., Quek, C., & Prasad, D. K. (2021). Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network. Expert Systems with Applications, 184(10), 115548.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.

    Google Scholar 

  • Cooper, A., & Petrides, K. V. (2010). A psychometric analysis of the trait emotional intelligence questionnaire–short form (TEIQue–SF) using item response theory. Journal of Personality Assessment, 92(5), 449–457.

    Article  Google Scholar 

  • Daly, C. J., Bulloch, J. M., Ma, M., & Aidulis, D. (2016). A comparison of animated versus static images in an instructional multimedia presentation. AJP Advances in Physiology Education, 40(2), 201–205.

    Article  Google Scholar 

  • Dao, P., & Sato, M. (2021). Exploring fluctuations in the relationship between learners’ positive emotional engagement and their interactional behaviours. Language Teaching Research, 25(6), 972–994.

    Article  Google Scholar 

  • Dewaele, J. M., & Li, C. (2021). Teacher enthusiasm and students’ social-behavioral learning engagement: The mediating role of student enjoyment and boredom in Chinese EFL classes. Language Teaching Research, 25(6), 922–945.

    Article  Google Scholar 

  • Ferrando, M., Prieto, M. D., Almeida, L. S., Ferrandiz, C., Bermejo, R., Lopez-Pina, J. A., et al. (2011). Trait emotional intelligence and academic performance: Controlling for the effects of IQ, personality, and self-concept. Journal of Psychoeducational Assessment, 29(2), 150–159.

    Article  Google Scholar 

  • Frenzel, A. C., Kurz, B. B., Pekrun, R., Goetz, T., & Lüdtke, O. (2018). Emotion transmission in the classroom revisited: A reciprocal effects model of teacher and student enjoyment. Journal of Educational Psychology, 110(5), 628–639.

    Article  Google Scholar 

  • Frijda, N. H. (1986). The emotions. Cambridge University Press.

    Google Scholar 

  • Gardner, H. (1983). Frames of mind: The theory of multiple intelligences. Basic Books.

    Google Scholar 

  • Ge, X. (2021). Emotion matters for academic success. Educational Technology Research and Development, 69, 67–70.

    Article  Google Scholar 

  • Gibson, K. R., & Tallerman, M. (2011). The Oxford handbook of language evolution. Oxford University Press.

    Book  Google Scholar 

  • Godfroid, A. (2019). Eye tracking in second language acquisition and bilingualism: A research synthesis and methodological guide. Routledge.

    Book  Google Scholar 

  • Gutiérrez-Cobo, M. J., Cabello, R., & Fernández-Berrocal, P. (2016). The relationship between emotional intelligence and cool and hot cognitive processes: A systematic review. Frontiers in Behavioral Neuroscience, 10, 101.

    Article  Google Scholar 

  • Gvozdenko, E., & Chambers, D. (2007). Beyond test accuracy: Benefits of measuring response time in computerised testing. Australasian Journal of Educational Technology, 23(4), 542–558.

    Article  Google Scholar 

  • Hagenauer, G., Hascher, T., & Volet, S. (2015). Teacher emotions in the classroom: Associations with students’ engagement, classroom discipline and the interpersonal teacher-student relationship. European Journal of Psychology of Education, 30(4), 385–403.

    Article  Google Scholar 

  • Horovitz, T., & Mayer, R. E. (2021). Learning with human and virtual instructors who display happy or bored emotions in video lectures. Computers in Human Behavior, 119(4), 106724.

    Article  Google Scholar 

  • Johnson, B., & Christensen, L. B. (2012). Educational research: Quantitative, qualitative, and mixed approaches (4th ed.). SAGE Publications.

    Google Scholar 

  • Kazuya, S., Jean-Marc, D., Mariko, A., & Yo, I. (2018). Motivation, emotion, learning experience, and second language comprehensibility development in classroom settings: A cross-sectional and longitudinal study. Language Learning, 68(3), 709–743.

    Article  Google Scholar 

  • Klingenberg, S., Jørgensen, M. L. M., Dandanell, G., Skriver, K., Mottelson, A., & Makransky, G. (2020). Investigating the effect of teaching as a generative learning strategy when learning through desktop and immersive VR: A media and methods experiment. British Journal of Educational Technology, 51(6), 2115–2138.

    Article  Google Scholar 

  • Köster, J. (2018). Video in the age of digital learning. Springer International Publishing.

    Book  Google Scholar 

  • Kristi, U., Burns, N. R., & Irina, B. (2015). Accuracy-based measures provide a better measure of sequence learning than reaction time-based measures. Frontiers in Psychology, 6, 1158.

    Google Scholar 

  • Kumar, J. A., Muniandy, B., & Wan Yahaya, W. A. J. (2016). Emotional design in multimedia learning: The relationship between emotional intelligence and learner satisfaction. In Proceedings of the 2nd international human computer interaction and user experience conference in Indonesia (CHIuXID), Jakarta, Indonesia

  • Kumar, J. A., Muniandy, B., & Wan Yahaya, W. A. J. (2019). Exploring the effects of emotional design and emotional intelligence in multimedia-based learning: An engineering educational perspective. New Review in Hypermedia & Multimedia, 25(1–2), 57–86.

    Article  Google Scholar 

  • Kushch, O., Igualada, A., & Prieto, P. (2018). Prominence in speech and gesture favour second language novel word learning. Language Cognition and Neuroscience, 33, 992–1004.

    Article  Google Scholar 

  • Laborde, S., Dosseville, F., & Scelles, N. (2010). Trait emotional intelligence and preference for intuition and deliberation: Respective influence on academic performance. Personality and Individual Differences, 49(7), 784–788.

    Article  Google Scholar 

  • Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., & Cheng, J. (2021a). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114, 106554.

    Article  Google Scholar 

  • Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021b). Do learners recognize and relate to the emotions displayed by virtual instructors? International Journal of Artificial Intelligence in Education, 31(1), 134–153.

    Article  Google Scholar 

  • Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021c). The positivity principle: Do positive instructors improve learning from video lectures? Educational Technology Research and Development, 69, 3101–3129.

    Article  Google Scholar 

  • Lee, H., & Mayer, R. E. (2018). Fostering learning from instructional video in a second language. Applied Cognitive Psychology, 32(5), 648–654.

    Article  Google Scholar 

  • Lewis, M., & Haviland-Jones, J. M. (2008). Handbook of emotions (3rd ed.). Guilford Press.

    Google Scholar 

  • Li, C., & Xu, J. (2019). Trait emotional intelligence and classroom emotions: A positive psychology investigation and intervention among Chinese EFL learners. Frontiers in Psychology Advance published online. https://doi.org/10.3389/fpsyg.2019.02453

    Article  Google Scholar 

  • Liew, T. W., Tan, S. M., Tan, T. M., & Kew, S. N. (2020). Does speaker’s voice enthusiasm affect social cue, cognitive load and transfer in multimedia learning? Voice enthusiasm. Information and Learning Sciences, 121(3/4), 117–135.

    Article  Google Scholar 

  • Liu, M. (2020). The emotional basis of the ideal multilingual self: The case of simultaneous language learners in China. Journal of Multilingual and Multicultural Development. https://doi.org/10.1080/01434632.2020.1755294

    Article  Google Scholar 

  • Macedonia, M., Müller, K., & Friederici, A. D. (2011). The impact of iconic gestures on foreign language word learning and its neural substrate. Human Brain Map**, 32, 982–998.

    Article  Google Scholar 

  • Mavrou, I., & Dewaele, J. (2020). Emotionality and pleasantness of mixed-emotion stimuli: The role of language, modality, and emotional intelligence. International Journal of Applied Linguistics, 30(2), 313–328.

    Article  Google Scholar 

  • Mavroveli, S., & Sánchez-Ruiz, M. J. (2011). Trait emotional intelligence influences on academic achievement and school behaviour. British Journal of Educational Psychology, 81(1), 112–134.

    Article  Google Scholar 

  • Mayer, R. E. (2021). Multimedia learning (3rd ed.). Cambridge University Press.

    Google Scholar 

  • Mayer, R. E., Fiorella, L., & Stull, A. (2020). Five ways to increase the effectiveness of instructional video. Educational Technology Research and Development, 68, 837–852.

    Article  Google Scholar 

  • Miller, Z. F., Fox, J. K., Moser, J. S., & Godfroid, A. (2018). Playing with fire: Effects of negative mood induction and working memory on vocabulary acquisition. Cognition and Emotion, 32(5), 1105–1113.

    Article  Google Scholar 

  • Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309–326.

    Article  Google Scholar 

  • Motorchi, F., & Ziafar, M. (2020). The relationship between contrastive lexical competence, willingness to communicate, and emotional intelligence: The case of Iranian EFL learners. International Journal of Innovation and Learning, 28(4), 483.

    Article  Google Scholar 

  • Muñoz, C., & Tragant, E. (1981). Second language acquisition and second language learning. Oxford University Press.

    Google Scholar 

  • Nias, J. (2006). Thinking about feeling: The emotions in teaching. Cambridge Journal of Education, 26(3), 293–306.

    Article  Google Scholar 

  • Norman, D. A. (2004). Emotional design. Basic Books.

    Google Scholar 

  • Owens, J. K., & Hudson, A. K. (2021). Prioritizing teacher emotions: Shifting teacher training to a digital environment. Educational Technology Research and Development, 69, 59–62.

    Article  Google Scholar 

  • Park, J., & Yoo, H. (2021). The effects of learning Korean through shortform video on the learning-related factors. The Journal of Learner-Centered Curriculum and Instruction, 21(17), 617–632.

    Google Scholar 

  • Pecchinenda, A., & Petrucci, M. (2016). Emotion unchained: Facial expression modulates gaze cueing under cognitive load. PLoS One, 11(12), e0168111.

    Article  Google Scholar 

  • Petrides, K. V. (2010). Trait emotional intelligence theory. Industrial & Organizational Psychology, 3(2), 136–139.

    Article  Google Scholar 

  • Petrides, K. V., & Furnham, A. (2000). On the dimensional structure of emotional intelligence. Personality and Individual Differences, 29, 313–320.

    Article  Google Scholar 

  • Petrides, K. V., & Furnham, A. (2003). Trait emotional intelligence: Behavioural validation in two studies of emotion recognition and reactivity to mood induction. European Journal of Personality, 17(1), 39–57.

    Article  Google Scholar 

  • Petrides, K. V., Frederickson, N., & Adrian, F. (2004). The role of trait emotional intelligence in academic performance and deviant behavior at school. Personality and Individual Differences, 36(2), 277–293.

    Article  Google Scholar 

  • Petrides, K. V., Mikolajczak, M., Mavroveli, S., Sanchez-Ruiz, M. J., & Furnham, A. (2016). Developments in trait emotional intelligence research. Emotion Review, 8(4), 335–341.

    Article  Google Scholar 

  • Pi, Z., Zhang, Y., Zhu, F., Chen, L., & Yang, J. (2021). The mutual influence of an instructor’s eye gaze and facial expression in video lectures. Interactive Learning Environments. https://doi.org/10.1080/10494820.2021.1940213

    Article  Google Scholar 

  • Plass, J. L., & Kalyuga, S. (2019). Four ways of considering emotion in cognitive load theory. Educational Psychology Review, 31, 339–359.

    Article  Google Scholar 

  • Plass, J. L., Heidig, S., Hayward, E. O., Homer, B. D., & Um, E. (2014). Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction, 29, 128–140.

    Article  Google Scholar 

  • Postel-Vinay, K. (2020). Globalization 4.0 and new modes of international cooperation. International Organisations Research Journal, 15(2), 82–92.

    Article  Google Scholar 

  • Prinzmetal, W., Mccool, C., & Park, S. (2005). Attention: Reaction time and accuracy reveal different mechanisms. Journal of Experimental Psychology, 134(1), 73–92.

    Article  Google Scholar 

  • Qadha, A., & Alward, M. A. (2020). The effect of using videos in teaching and learning English present progressive tense. Interactive Technology and Smart Education, 17(2), 159–170.

    Article  Google Scholar 

  • Rensik, P., & Dewaele, J. M. (2020). Trait emotional intelligence, positive and negative emotions in first and foreign language classes: A mixed-methods approach. System, 94, 102324.

    Article  Google Scholar 

  • Romanelli, F., Cain, J., & Smith, K. M. (2006). Emotional intelligence as a predictor of academic and/or professional success. American Journal of Pharmaceutical Education, 70(3), 69.

    Article  Google Scholar 

  • Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178.

    Article  Google Scholar 

  • Salovey, P., & Mayer, J. D. (1990). Emotional intelligence. Imagination Cognition and Personality, 9, 185–211.

    Article  Google Scholar 

  • Shao, K., Nicholson, L. J., Kutuk, G., & Lei, F. (2020). Emotions and instructed language learning: Proposing a second language emotions and positive psychology model. Frontiers in Psychology, 11, 2142.

    Article  Google Scholar 

  • Stull, A., Fiorella, L., & Mayer, R. E. (2018). An eye-tracking analysis of instructor presence in video lectures. Computers in Human Behavior, 88, 263–272.

    Article  Google Scholar 

  • Stull, A. T., Fiorella, L., & Mayer, R. E. (2021). The case for embodied instruction: The instructor as a source of attentional and social cues in video lectures. Journal of Educational Psychology, 113(7), 1441–1453.

    Article  Google Scholar 

  • Swain, M. (2013). The inseparability of cognition and emotion in second language learning. Language Teaching, 46(02), 1–13.

    Article  Google Scholar 

  • Taheri, H., Sadighi, F., Bagheri, M. S., & Bavali, M. (2019). EFL learners’ L2 achievement and its relationship with cognitive intelligence, emotional intelligence, learning styles, and language learning strategies. Cogent Education, 6(1), 1655882.

    Article  Google Scholar 

  • Teng, M. F. (2019). The effects of video caption types and advance organizers on incidental L2 collocation learning. Computers & Education, 142, 103655.

    Article  Google Scholar 

  • Wang, P. Y., Chiu, M. C., & Lee, Y. T. (2021). Effects of video lecture presentation style and questioning strategy on learner flow experience. Innovations in Education and Teaching International, 58(4), 473–483.

    Article  Google Scholar 

  • Wang, Y., Liu, Q., Chen, W., Wang, Q., & David, S. (2019). Effects of instructor’s facial expressions on students’ learning with video lectures. British Journal of Educational Technology, 50(3), 1381–1395.

    Article  Google Scholar 

  • Wong, R. M., & Adesope, O. O. (2020). Meta-analysis of emotional designs in multimedia learning: A replication and extension study. Educational Psychology Review, 33, 357–385.

    Article  Google Scholar 

  • Zebrowitz, L. A., Boshyan, J., Ward, N., Gutchess, A., & Hadjikhani, N. (2017). The older adult positivity effect in evaluations of trustworthiness: Emotion regulation or cognitive capacity? PLoS One, 12(1), e0169823.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant [62007023, 62177027]; the Social Science Foundation of Shaanxi Province under Grant [2020P021]; and Fundamental Research Funds for Central Universities of China under Grant (Excellent Doctoral Thesis Cultivation Project in Central China Normal University) [2022YBZZ026].

Author information

Authors and Affiliations

Authors

Contributions

FZ: Conception and design of study, drafting the manuscript, analysis and/or interpretation of data, revising the manuscript critically for important intellectual content. JY: Conception and design of study, acquisition of data, analysis and/or interpretation of data. ZP: Conception, acquisition of data, analysis and/or interpretation of data.

Author statement

All persons who meet authorship criteria are listed as authors, and all authors certify that they have participated sufficiently in the work to take public responsibility for the content, including participation in the concept, design, analysis, writing, or revision of the manuscript. Furthermore, each author certifies that this material or similar material has not been and will not be submitted to or published in any other publication.

Corresponding authors

Correspondence to Jiumin Yang or Zhongling Pi.

Ethics declarations

Conflict of interest

There is no conflict of interest, as we conducted this study only as part of our research program. The data that support the findings of this study are available from the corresponding author upon reasonable request.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, F., Yang, J. & Pi, Z. The interaction effects of an instructor’s emotions in instructional videos and students’ emotional intelligence on L2 vocabulary learning. Education Tech Research Dev 70, 1695–1718 (2022). https://doi.org/10.1007/s11423-022-10148-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-022-10148-2

Keywords

Navigation