Integrating Emotion Recognition Tools for Developing Emotionally Intelligent Agents

Samuel Marcos Pablos; Fernando Lobato Alejano; Francisco José García Peñalvo

Ayuda

Integrating Emotion Recognition Tools for Developing Emotionally Intelligent Agents

Samuel Marcos-Pablos ^[1] ; Fernando Lobato Alejano ^[2] ; Francisco José García-Peñalvo ^[1]
1. [1] Universidad de Salamanca
  
  Universidad de Salamanca
  
  Salamanca, España
2. [2] Universidad Pontificia de Salamanca
  
  Universidad Pontificia de Salamanca
  
  Salamanca, España
Localización: IJIMAI, ISSN-e 1989-1660, Vol. 7, Nº. 6, 2022 (Ejemplar dedicado a: Special Issue on New Trends in Disruptive Technologies, Tech Ethics and Artificial Intelligence), págs. 69-76
Idioma: inglés
DOI: 10.9781/ijimai.2022.09.004
Enlaces
- Texto completo (pdf)
Resumen
- Emotionally responsive agents that can simulate emotional intelligence increase the acceptance of users towards them, as the feeling of empathy reduces negative perceptual feedback. This has fostered research on emotional intelligence during last decades, and nowadays numerous cloud and local tools for automatic emotional recognition are available, even for inexperienced users. These tools however usually focus on the recognition of discrete emotions sensed from one communication channel, even though multimodal approaches have been shown to have advantages over unimodal approaches. Therefore, the objective of this paper is to show our approach for multimodal emotion recognition using Kalman filters for the fusion of available discrete emotion recognition tools. The proposed system has been modularly developed based on an evolutionary approach so to be integrated in our digital ecosystems, and new emotional recognition sources can be easily integrated. Obtained results show improvements over unimodal tools when recognizing naturally displayed emotions.
Referencias bibliográficas
- A. García-Holgado, S. Marcos-Pablos, F.J. García-Peñalvo, “A Model to Define an eHealth Technological Ecosystem for Caregivers”, in New Knowledge...
- S. Marcos-Pablos, A. García-Holgado, F.J. García-Peñalvo, “Modelling the business structure of a digital health ecosystem”, in Proceedings...
- S. Marcos-Pablos, F.J. García-Peñalvo, “Emotional Intelligence in Robotics: A Scoping Review”, In New Trends in Disruptive Technologies,...
- S. Poria, E. Cambria, R. Bajpai, and A. Hussain, “A review of affective computing: From unimodal analysis to multimodal fusion”, Information...
- M.G. Huddar, S.S. Sannakki, and V.S. Rajpurohit, “Attention-based Multimodal Sentiment Analysis and Emotion Detection in Conversation using...
- H. Daus and M. Backenstrass, “Feasibility and Acceptability of a MobileBased Emotion Recognition Approach for Bipolar Disorder”, International...
- M. Magdin, D. Držík, J. Reichel, and S. Koprda, “The Possibilities of Classification of Emotional States Based on User Behavioral Characteristics”,...
- S. Kirrane, “Intelligent software web agents: A gap analysis”, Journal of Web Semantics, 2021, vol. 71, 100659, https://doi.org/10.1016/j....
- W. Brenner, R. Zarnekow, and H. Wittig, “Intelligent Software Agents: Foundations and Applications”, Springer-Verlag Berlin, 1998, https://doi....
- P. Salovey, and J. D. Mayer, “Emotional Intelligence”, Imagination, Cognition and Personality, 1990, vol. 9, no. 3, pp. 185–211, https://doi....
- W. Ickes, “Empathic Accuracy”, Journal of Personality, 1993, vol. 61, no. 4, pp. 587–610, https://doi.org/10.1111/j.1467-6494.1993.tb00783.x....
- E. van der Kruk, M. M. Reijne, “Accuracy of human motion capture systems for sport applications; state-of-the-art review”, European Journal...
- L. Shu, J. Xie, M. Yang, Z. Li, D. Liao, X. Xu, and X. Yang, “A Review of Emotion Recognition Using Physiological Signals”, Sensors, 2018,...
- M.L. Rohlfing, D.P. Buckley, J. Piraquive, C.E. Stepp, and L.F. Tracy, “Hey Siri: How Effective are Common Voice Recognition Systems at Recognizing...
- N. Samadiani, G. Huang, B. Cai, W. Luo, C.H. Chi, Y. Xiang, and J. He, “A Review on Automatic Facial Expression Recognition Systems Assisted...
- P. Tzirakis, J. Chen, S. Zafeiriou, and B. Schuller, “End-to-end multimodal affect recognition in real-world environments”, Information Fusion,...
- D.C. Rubin and J.M. Talarico, “A comparison of dimensional models of emotion: Evidence from emotions, prototypical events, autobiographical...
- S. Marcos-Pablos, F.J. García-Peñalvo, and A. Vázquez-Ingelmo, “Emotional AI in Healthcare: A pilot architecture proposal to merge emotion...
- P. Ekman and E.L. Rosenberg, “What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system...
- G. Paltoglou, M. Thelwall, “Seeing Stars of Valence and Arousal in Blog Posts”, in IEEE Transactions on Affective Computing, 2013, vol. 4,...
- M. Olszanowski, G. Pochwatko, K. Kuklinski, M. Scibor-Rylski, P. Lewinski, and R.K. Ohme, “Warsaw set of emotional facial expression pictures:...
- B. Ristic, S. Arulampalam, and N. Gordon, “Beyond the Kalman Filter: Particle Filters for Tracking Applications”, Artech House, 2003.
- A. Bhattacharjee, T. Pias, M. Ahmad, and A. Rahman,”On the Performance Analysis of APIs Recognizing Emotions from Video Images of Facial...
- A. Mathur, A. Isopoussu, F. Kawsar, R. Smith, N.D. Lane, and N. Berthouze, “On Robustness of Cloud Speech APIs: An Early Characterization”,...
- S.R. Khanal, J. Barroso, N. Lopes, J. Sampaio, and V. Filipe, “Performance analysis of Microsoft’s and Google’s Emotion Recognition API using...
- W.E. Rinn, “The neuropsychology of facial expression: A review of the neurological and psychological mechanisms for producing facial expressions”,...
- T. Kanade, J.F. Cohn, and Y. Tian, “Comprehensive database for facial expression analysis”, in Proceedings of the Fourth IEEE International...
- Ryerson Emotion Database. (n.d.). Retrieved April 23, 2022, from https:// www.kaggle.com/datasets/ryersonmultimedialab/ryerson-emotiondatabase...
- J.M. Buenaposada, E. Muñoz, and L. Baumela, “Recognising facial expressions in video sequences”, Pattern Analysis and Applications, 2008,...
- I. Sneddon, M. McRorie, G. McKeown, and J. Hanratty, “The Belfast Induced Natural Emotion Database”, IEEE Transactions on Affective Computing,...
- T. Küntzler, T.T.A. Höfling, and G.W. Alpers, “Automatic Facial Expression Recognition in Standardized and Non-standardized Emotional Expressions”,...
- “A New Video Based Emotions Analysis System (VEMOS): An Efficient Solution Compared to iMotions Affectiva Analysis Software”. (n.d.). ASTES...
- Z. Kowalczuk and M. Czubenko, “Computational Approaches to Modeling Artificial Emotion – An Overview of the Proposed Solutions”, Frontiers...