Abstract
Online recommendation system is a computer-based intelligent technique which has become popular in many e-commerce Web sites. It is used to recommend items to a user on the basis of some information like past feedback of user, or similarity with other users’ buying pattern. Nowadays, the business in e-commerce is growing rapidly, and recommendation system plays a significant role to provide personalized recommendations to the customer or user. But the drawback of these methods is that these approaches need to collect and process huge amount of data to provide good recommendation. In this work, user’s facial expression is used to develop efficient recommendation system. Video of user’s facial expression is captured through a webcam. With the help of facial expressions, emotion of the user is detected, and analysis is done. The proposed work provides an intelligent recommendation system on-the-fly without relying on historical ratings or previous purchase records. This approach is used to predict the human emotion based on the facial features and develop ways to predict the reaction of a customer on selecting/purchasing a product. The experiment result shows that the proposed method can produce better online recommendation system as it captures customer’s face and reaction in real time, but at the time of providing rating of a product, a customer may not express actual feedback. The experimental results indicate its reliability based on its performance in real-world solution.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Mehta, D., Siddiqui, M.F.H., Javaid, A.Y.: Facial emotion recognition: A survey and real-world user experiences in mixed reality. Sensors 18, 416 (2018)
Bandyopadhyay, S., Thakur, S.S., Mandal, J.K.: A novel approach for product prediction using artificial neural networks. In: Mandal, J., Sinha, D. (eds.) Social Transformation—Digital Way. CSI 2018. Communications in Computer and Information Science, vol. 836. Springer, Singapore (2018)
Ramzan, B., Bajwa, I.S., Jamil, N., Amin, R., Ramzan, S., Mirza, F., Sarwar, N.: An intelligent data analysis for recommendation systems using machine learning. In: Scientific Programming, vol. 2019, Article ID 5941096, 20 pages (2019)
Cowie, R., et al.: Emotion recognition in human-computer interaction: IEEE Signal Process. Mag. 18(1), 32–80 (2001)
Paul, V., Michael, J.: Robust Real-time Face Detection. Int. J. Comput. Vision 57(2), 137–154 (2004)
Zhang, Z.: Feature-based facial expression recognition: Sensitivity analysis and experiments with a multilayer perceptron. Int. J. Pattern Recogn. Artif. Intell. 13(6), 893–911 (1999)
Kim, M.H., Joo, Y.H., Park, J.B.: Emotion detection algorithm using frontal face image. In: Proceedings of International Conference on Computer Application in Shipbuilding (ICCAS), (2005)
Morishima, S., Harashima, H.: Emotion space for analysis and synthesis of facial expression. In: IEEE International Workshop on Robot and Human Communication, pp. 188–193 (1993)
Zhao, J., Kearney, G.: Classifying facial emotions by back propagation neural networks with fuzzy inputs. In: International Conference on Neural Information Processing, vol. 1, pp. 454–457(1996)
Lien J.J., Kanade, T., Cohn, J.F., Li, C.C.: Automated facial expression recognition based on FACS action units. In: Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 390–395 (1998)
Joo, Y.H., Oh, J.H.: Emotion recognition using template vector and neural-network. J. Korea Fuzzy Intell. Syst. 13(6), 710–715 (2003)
Soleymani, M., Asghari-Esfeden, S., Fu, Y., Pantic, M.: Analysis of EEG signals and facial expressions for continuous emotion detection. IEEE Trans. Affect. Comput. 7(1), 17–28 (2016)
Hassouneh, A., Mutawa, A.M., Murugappan, M.: Development of a real-time emotion recognition system using facial expressions and EEG based on machine learning and deep neural network methods. Inf. Med. Unlocked. 20, 100372 (2020)
Zhao, G., Pietikainen M.: Dynamic texture recognition using volume local binary patterns. In: Vidal R., Heyden A., Ma Y. (eds.) Dynamical Vision. WDV 2006, WDV 2005. Lecture Notes in Computer Science, vol. 4358. Springer, Berlin, Heidelberg (2007)
Das, P.K., Behera, H.S., Pradhan S.K., Tripathy, H.K., Jena, P.K.: A modified real time a* algorithm and its performance analysis for improved path planning of mobile robot. In: Jain L., Behera H., Mandal J., Mohapatra D. (eds.) Computational Intelligence in Data Mining—Volume 2. Smart Innovation, Systems and Technologies, vol 32. Springer, New Delhi (2015)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. CVPR 1, 511–518 (2001)
Wilson, P.I., Fernandez, J.: Facial feature detection using haar classifiers. J. Comput. Sci. Coll. 21, 127–133 (2006)
Eleftheriou, G., Fatouros, P., Tsirmpas, C.: Unobtrusive emotion recognition system. US Patent App. 15/648,730 (2018)
Miranda, J.A., Canabal, M.F., Portela-Garcia, M., Ongil, C.L.: Embedded emotion recognition: autonomous multimodal affective internet of things. In: Cyber Physical Systems Summer School, Italy (2018)
Dzedzickis, A., Kaklauskas, A., Bucinskas, V.: Human emotion recognition: review of sensors and methods. Sensors 20, 592 (2020). https://doi.org/10.3390/s20030592
Feidakis, M., Daradoumis, T., Caballé, S.: Endowing e-learning systems with emotion awareness. In: Proceedings of 3rd IEEE International Conference on Intelligent Networking and Collaborative Systems, INCoS 2011, pp. 68–75 (2011). https://doi.org/10.1109/INCoS.2011.83
Kumar, G.A.R., Kumar, R.K., Sanyal, G.: Facial emotion analysis using deep convolution neural network. In: International Conference on Signal Processing and Communication (ICSPC), pp. 369–374. Coimbatore (2017)
Agarap, A.F.: Deep learning using rectified linear units (relu). ar**v preprint ar**v:1803.08375 (2018)
Wang, F., Cheng, J., Liu, W., Liu, H.: Additive margin Softmax for face verification. IEEE Signal Process. Lett. 25(7), 926–930 (2018)
Acknowledgements
The authors are thankful to Chairman, MCKVIE, and Principal, MCKVIE, for providing the required set up and computer laboratories to do the proposed work. The authors are also thankful to Mr. Ganesh Gupta, Ms. Vineeta Khaitan, Mr. Aditya Dubey, Mr. Sourav Sikaria, and Mr. Siddhartha Ghosh students of CSE Department of MCKVIE. This paper and the research work behind it would not have been possible without the contribution and support from the students who have worked with lot of interests, and finally, the complete execution of the recommendation system has been done.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Bandyopadhyay, S., Thakur, S.S., Mandal, J.K. (2022). Online Recommendation System Using Human Facial Expression Based Emotion Detection: A Proposed Method. In: Mandal, J.K., Buyya, R., De, D. (eds) Proceedings of International Conference on Advanced Computing Applications. Advances in Intelligent Systems and Computing, vol 1406. Springer, Singapore. https://doi.org/10.1007/978-981-16-5207-3_38
Download citation
DOI: https://doi.org/10.1007/978-981-16-5207-3_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-5206-6
Online ISBN: 978-981-16-5207-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)