Map** Action Units to Valence and Arousal Space Using Machine Learning

  • Conference paper
  • First Online:
Biologically Inspired Cognitive Architectures 2023 (BICA 2023)

Abstract

There are a lot of studies researching automated recognition of emotions. Emotions are represented as points in an emotion space. The emotion space itself is represented by different types of models. One is Facial Action Units System, another is Valence-Arousal-Dominance model. This study aims to create a map** between these two emotion spaces. The data for the study was collected in a series of experiments with real humans, where both types of measurements were collected simultaneously. Given the data, we study the ability of machine learning models to create this type of map**. We test different types of models against the task, such as tree-based models and linear models, and make conclusions about the optimal model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Hjortsjö, C.H.: Man’s face and mimic language. Studentlitteratur (1969)

    Google Scholar 

  2. Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  3. Zadeh A., Lim Y.C., Morency L.P.: OpenFace 2.0: facial behavior analysis toolkit. in: tadas baltrušaitis. In: IEEE International Conference on Automatic Face and Gesture Recognition (2018)

    Google Scholar 

  4. Facereader homepage. https://www.noldus.com/facereader. Last accessed 11 Aug 2023

  5. Mehrabian, A.: Basic dimensions for a general psychological theory: Implications for personality, social, environmental, and developmental studies. Oelgeschlager, Gunn & Hain, Cambridge, MA (1980)

    Google Scholar 

  6. Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)

    Article  Google Scholar 

  7. Shirokiy V.R. et al.: The loop of nonverbal communication between human and virtual actor: map** between spaces. In: Proceedings of the 11th Annual Meeting of the BICA Society. Brain-Inspired Cognitive Architectures for Artificial Intelligence: BICA* AI 2020, pp. 484–489, Springer International Publishing (2021)

    Google Scholar 

  8. Samsonovich, A.V.: Emotional biologically inspired cognitive architecture. BiolInspired Cogn. Arch. 6, 109–125 (2013). https://doi.org/10.1016/j.bica.2013.07.009

    Article  Google Scholar 

  9. Samsonovich, A.V.: Schema formalism for the common model of cognition. BiolInspired Cogn. Arch. 26, 1–19 (2018). https://doi.org/10.1016/j.bica.2018.10.008

    Article  Google Scholar 

  10. Breiman, L.: Random forests. Mach. Learn. 45, 5–32 (2001). https://doi.org/10.1023/A:1010933404324

    Article  Google Scholar 

  11. Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29(5), 1189–1232 (2002)

    MathSciNet  Google Scholar 

  12. Ke, G., et al.: Lightgbm: a highly efficient gradient boosting decision tree. Adv. Neural. Inf. Process. Syst. 30, 3146–3154 (2017)

    Google Scholar 

  13. Prokhorenkova, L., et al.: CatBoost: unbiased boosting with categorical features. In: 32nd Conference on Neural Information Processing Systems, pp. 6638–6648. Montreal, Canada

    Google Scholar 

  14. Samsonovich, A.V., Ascoli, G.A.: Cognitive map dimensions of the human value system extracted from natural language. Front. Artif. Intell. Appl. 157, 111–124 (2007). ISSN: 09226389

    Google Scholar 

  15. Samsonovich, A.V., De Jong, K.A., Kitsantas, A., Peters, E.E., Dabbagh, N., Kalbfleisch, M.L.: Cognitive constructor: an intelligent tutoring system based on a biologically inspired cognitive architecture (BICA). Front. Artif. Intell. Appl. 171(1), 311–325 (2008). ISSN: 09226389

    Google Scholar 

Download references

Acknowledgement

This study was supported by the Russian Science Foundation grant no. 22-11-00213, https://rscf.ru/en/project/22-11-00213/.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ismail M. Gadzhiev .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gadzhiev, I.M., Makarov, A.S., Tikhomirova, D.V., Dolenko, S.A., Samsonovich, A.V. (2024). Map** Action Units to Valence and Arousal Space Using Machine Learning. In: Samsonovich, A.V., Liu, T. (eds) Biologically Inspired Cognitive Architectures 2023. BICA 2023. Studies in Computational Intelligence, vol 1130. Springer, Cham. https://doi.org/10.1007/978-3-031-50381-8_35

Download citation

Publish with us

Policies and ethics

Navigation