SpringerLink
Log in

Stacked ensemble learning for facial gender classification using deep learning based features extraction

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Automatic gender classification is an important task in facial analysis. Recently, deep learning has achieved remarkable progress in extracting deep features for face image analysis, particularly in gender classification. Gender classification through facial analysis poses a difficult challenge in extracting reliable and relevant features from facial images and classifying them accurately, especially in uncontrolled environments. So, in this study, a novel deep convolutional neural network (DCNN) aided with convolutional long short-term memory (ConvLSTM) layer and squeeze-and-excitation (SE) block is designed to extract most distinguishable and relevant features from facial images. The ConvLSTM layer aims to establish spatial relationship among the extracted feature maps, while the SE block enhances the emphasis on critical features by directing more attention towards them. The extracted features are pre-processed and deployed to Kernel principle component analysis (KPCA) for dimensionality reduction. Finally, these reduced features are fed into a stacking classifier that utilizes several machine learning classifiers such as K-Nearest Neighbors (KNN), Linear Discriminant Analysis (LDA), Random Forest (RF), AdaBoost, Extra Tree Classifier (ETC), Gaussian Naive Bayes (GNB), XGBoost classifier (XBC), Support Vector classifier (SVC), Bagging Classifier, NuSVC, Gradient boosting classifier (GBC) for the first stage,and SVC as a meta-classifier for final gender prediction with Stratified K-fold cross-validation in order to mitigate the issue of overfitting. The proposed method was evaluated on two publicly available datasets, label faces in the wild (LFW) and Adience, and achieved accuracies of 99.20% and 98.01%, respectively. These results indicate that our proposed approach outperforms existing state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availibility

All data included in this study are available upon request by contact with the corresponding author.

References

  1. Dantcheva, A., Elia, P., Ross, A.: What else does your biometric data reveal? A survey on soft biometrics. IEEE Trans. Informa. Forensics Secur. 11(3), 441–467 (2015)

    Article  Google Scholar 

  2. Gragnaniello, D., Li, C.-T., Marra, F., Riccio, D.: Virtual special issue on advances in digital security: biometrics and forensics. Pattern Recognit. Lett. 159, 220–221 (2022)

    Article  Google Scholar 

  3. Nazir, M., Jan, Z., Sajjad, M.: Facial expression recognition using histogram of oriented gradients based transformed features. Clust. Comput. 21, 539–548 (2018)

    Article  Google Scholar 

  4. Gupta, S.K., Nain, N.: Single attribute and multi attribute facial gender and age estimation. Multimed. Tools Appl. 82(1), 1289–1311 (2023)

    Article  Google Scholar 

  5. Jain, A.K., Park, U.: Facial marks: Soft biometric for face recognition. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 37–40 (2009). IEEE

  6. Li, M., Yu, X., Ryu, K.H., Lee, S., Theera-Umpon, N.: Face recognition technology development with gabor, pca and svm methodology under illumination normalization condition. Clust. Comput. 21, 1117–1126 (2018)

    Article  Google Scholar 

  7. Prasad, D.V.V., Suresh, J.: A quick survey of artificial neural network based face classification algorithms. Clust. Comput. 22(Suppl 4), 9477–9488 (2019)

    Article  Google Scholar 

  8. Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unfiltered faces. IEEE Trans. Inform. Forens. Secur. 9(12), 2170–2179 (2014)

    Article  Google Scholar 

  9. Kang, M.-W., Kim, Y., Kim, Y.-S.: Collecting large training dataset of actual facial images from facebook for develo** a weighted bagging gender classifier. Clust. Comput. 20, 2157–2165 (2017)

    Article  Google Scholar 

  10. Annalakshmi, M., Roomi, S.M.M., Naveedh, A.S.: A hybrid technique for gender classification with slbp and hog features. Clust. Comput. 22, 11–20 (2019)

    Article  Google Scholar 

  11. Levi, G., Hassner, T.: Age and gender classification using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 34–42 (2015)

  12. Duan, M., Li, K., Yang, C., Li, K.: A hybrid deep learning cnn-elm for age and gender classification. Neurocomputing 275, 448–461 (2018)

    Article  Google Scholar 

  13. Greco, A., Saggese, A., Vento, M., Vigilante, V.: A convolutional neural network for gender recognition optimizing the accuracy/speed tradeoff. IEEE Access 8, 130771–130781 (2020)

    Article  Google Scholar 

  14. Antipov, G., Berrani, S.-A., Dugelay, J.-L.: Minimalistic cnn-based ensemble model for gender prediction from face images. Pattern Recognit. Lett. 70, 59–65 (2016)

    Article  Google Scholar 

  15. Althnian, A., Aloboud, N., Alkharashi, N., Alduwaish, F., Alrshoud, M., Kurdi, H.: Face gender recognition in the wild: an extensive performance comparison of deep-learned, hand-crafted, and fused features with deep and traditional models. Appl. Sci. 11(1), 89 (2020)

    Article  Google Scholar 

  16. Dong, Y., Liu, Y., Lian, S.: Automatic age estimation based on deep learning algorithm. Neurocomputing 187, 4–10 (2016)

    Article  Google Scholar 

  17. Sheoran, V., Joshi, S., Bhayani, T.R.: Age and gender prediction using deep cnns and transfer learning. In: Computer Vision and Image Processing: 5th International Conference, CVIP 2020, Prayagraj, India, December 4-6, 2020, Revised Selected Papers, Part II 5, pp. 293–304 (2021). Springer

  18. Wang, J.-G., Li, J., Lee, C.Y., Yau, W.-Y.: Dense sift and gabor descriptors-based face representation with applications to gender recognition. In: 2010 11th International Conference on Control Automation Robotics & Vision, pp. 1860–1864 (2010). IEEE

  19. Jabid, T., Kabir, M.H., Chae, O.: Gender classification using local directional pattern (ldp). In: 2010 20th International Conference on Pattern Recognition, pp. 2162–2165 (2010). IEEE

  20. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012)

  21. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  22. Hosseini, S., Lee, S.H., Kwon, H.J., Koo, H.I., Cho, N.I.: Age and gender classification using wide convolutional neural network and gabor filter. In: 2018 International Workshop on Advanced Image Technology (IWAIT), pp. 1–3 (2018). IEEE

  23. Dammak, S., Mliki, H., Fendri, E.: Gender estimation based on deep learned and handcrafted features in an uncontrolled environment. Multimed. Syst. 29(1), 421–433 (2023)

    Article  Google Scholar 

  24. Al_Dujaili, M.J., Salim ALRikabi, H.T., Niama ALRubeei, I.R., et al.: Gender recognition of human from face images using multi-class support vector machine (svm) classifiers. International Journal of Interactive Mobile Technologies 17(8) (2023)

  25. Kale, A., Altun, O.: Age, gender and ethnicity classification from face images with cnn-based features. In: 2021 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 1–6 (2021). IEEE

  26. Swaminathan, A., Chaba, M., Sharma, D.K., Chaba, Y.: Gender classification using facial embeddings: a novel approach. Procedia Comput. Sci. 167, 2634–2642 (2020)

    Article  Google Scholar 

  27. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 886–893 (2005). Ieee

  28. Zhang, L., Chu, R., **ang, S., Liao, S., Li, S.Z.: Face detection based on multi-block lbp representation. In: Advances in Biometrics: International Conference, ICB 2007, Seoul, Korea, August 27-29, 2007. Proceedings, pp. 11–18 (2007). Springer

  29. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  30. Mäkinen, E., Raisamo, R.: An experimental comparison of gender classification methods. Pattern Recognit. Lett. 29(10), 1544–1556 (2008)

    Article  Google Scholar 

  31. Shan, C.: Learning local binary patterns for gender classification on real-world face images. Pattern Recognit. Lett. 33(4), 431–437 (2012)

    Article  Google Scholar 

  32. Mirza, A.M., Hussain, M., Almuzaini, H., Muhammad, G., Aboalsamh, H., Bebis, G.: Gender recognition using fusion of local and global facial features. In: Advances in Visual Computing: 9th International Symposium, ISVC 2013, Rethymnon, Crete, Greece, July 29-31, 2013. Proceedings, Part II 9, pp. 493–502 (2013). Springer

  33. Nguyen, H.-T., Huong, T.T.N.: Unconstrained gender classification by multi-resolution lpq and sift. In: 2016 3rd National Foundation for Science and Technology Development Conference on Information and Computer Science (NICS), pp. 212–217 (2016). IEEE

  34. Çoban, B.S., Gökmen, M.: Gender classification with local zernike moments and local binary patterns. In: 2014 22nd Signal Processing and Communications Applications Conference (SIU), pp. 1475–1478 (2014). IEEE

  35. Tianyu, L., Fei, L., Rui, W.: Human face gender identification system based on mb-lbp. In: 2018 Chinese Control And Decision Conference (CCDC), pp. 1721–1725 (2018). IEEE

  36. Irhebhude, M.E., Kolawole, A.O., Goma, H.K.: A gender recognition system using facial images with high dimensional data. Malays. J. Appl. Sci. 6(1), 27–45 (2021)

    Google Scholar 

  37. Panner Selvam, I.R., Karuppiah, M.: Gender recognition based on face image using reinforced local binary patterns. IET Comput. Vis. 11(6), 415–425 (2017)

    Article  Google Scholar 

  38. Zhang, C., Ding, H., Shang, Y., Shao, Z., Fu, X.: Gender classification based on multiscale facial fusion feature. Math. Prob. Eng. 2018, 1–6 (2018)

    Google Scholar 

  39. Zhang, W., Smith, M.L., Smith, L.N., Farooq, A.: Gender and gaze gesture recognition for human-computer interaction. Comput. Vis. Image Underst.. 149, 32–50 (2016)

    Article  Google Scholar 

  40. Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4295–4304 (2015)

  41. Neggaz, I., Fizazi, H.: An intelligent handcrafted feature selection using archimedes optimization algorithm for facial analysis. Soft Comput. 26(19), 10435–10464 (2022)

    Article  Google Scholar 

  42. Afifi, M., Abdelhamed, A.: Afif4: Deep gender classification based on adaboost-based fusion of isolated facial features and foggy faces. J. Vis. Commun. Image Represent. 62, 77–86 (2019)

    Article  Google Scholar 

  43. Lapuschkin, S., Binder, A., Muller, K.-R., Samek, W.: Understanding and comparing deep neural networks for age and gender classification. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 1629–1638 (2017)

  44. Zhang, Y., Xu, T.: Landmark-guided local deep neural networks for age and gender classification. J. Sens. (2018). https://doi.org/10.1155/2018/5034684

    Article  Google Scholar 

  45. Haider, K.Z., Malik, K.R., Khalid, S., Nawaz, T., Jabbar, S.: Deepgender: real-time gender classification using deep learning for smartphones. J. Real-Time Image Process. 16, 15–29 (2019)

    Article  Google Scholar 

  46. Benkaddour, M.K.: Cnn based features extraction for age estimation and gender classification. Informatica 45(5) (2021)

  47. Lee, B., Gilani, S.Z., Hassan, G.M., Mian, A.: Facial gender classification-analysis using convolutional neural networks. In: 2019 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–8 (2019). IEEE

  48. Cheng, J., Li, Y., Wang, J., Yu, L., Wang, S.: Exploiting effective facial patches for robust gender recognition. Tsinghua Sci. Technol. 24(3), 333–345 (2019)

    Article  Google Scholar 

  49. Agbo-Ajala, O., Viriri, S., et al.: Deeply learned classifiers for age and gender predictions of unfiltered faces. Sci. World J. (2020). https://doi.org/10.1155/2020/1289408

    Article  Google Scholar 

  50. Sheikh Fathollahi, M., Heidari, R.: Gender classification from face images using central difference convolutional networks. Int. J. Multimed. Inform. Retr. 11(4), 695–703 (2022)

    Article  Google Scholar 

  51. Sharma, N., Sharma, R., **dal, N.: Face-based age and gender estimation using improved convolutional neural network approach. Wireless Pers. Commun. 124(4), 3035–3054 (2022)

    Article  Google Scholar 

  52. Foggia, P., Greco, A., Saggese, A., Vento, M.: Multi-task learning on the edge for effective gender, age, ethnicity and emotion recognition. Eng. Appl. Artif. Intell. 118, 105651 (2023)

    Article  Google Scholar 

  53. Oulad-Kaddour, M., Haddadou, H., Vilda, C.C., Palacios-Alonso, D., Benatchba, K., Cabello, E.: Deep learning-based gender classification by training with fake data. IEEE Access 11, 120766–120779 (2023)

    Article  Google Scholar 

  54. Aslam, A., Hayat, K., Umar, A.I., Zohuri, B., Zarkesh-Ha, P., Modissette, D., Khan, S.Z., Hussian, B.: Wavelet-based convolutional neural networks for gender classification. J. Electron. Imaging 28(1), 013012–013012 (2019)

    Article  Google Scholar 

  55. Asswin, C., KS, D.K., Dora, A., Ravi, V., Sowmya, V., Gopalakrishnan, E., Soman, K.,: Transfer learning approach for pediatric pneumonia diagnosis using channel attention deep cnn architectures. Eng. Appl. Artif. Intell. 123, 106416 (2023)

    Article  Google Scholar 

  56. Tavana, P., Akraminia, M., Koochari, A., Bagherifard, A.: An efficient ensemble method for detecting spinal curvature type using deep transfer learning and soft voting classifier. Exp. Syst. Appl. 213, 119290 (2023)

    Article  Google Scholar 

  57. Mohapatra, S., Maneesha, S., Mohanty, S., Patra, P.K., Bhoi, S.K., Sahoo, K.S., Gandomi, A.H.: A stacking classifiers model for detecting heart irregularities and predicting cardiovascular disease. Healthc. Anal. 3, 100133 (2023)

    Article  Google Scholar 

  58. Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2009)

    Article  Google Scholar 

  59. Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., Woo, W.-c.: Convolutional lstm network: A machine learning approach for precipitation nowcasting. Advances in neural information processing systems 28 (2015)

  60. Rahman, S.A., Adjeroh, D.A.: Deep learning using convolutional lstm estimates biological age from physical activity. Sci. Rep. 9(1), 11425 (2019)

    Article  Google Scholar 

  61. Majd, M., Safabakhsh, R.: A motion-aware convlstm network for action recognition. Appl. Intell. 49, 2515–2521 (2019)

    Article  Google Scholar 

  62. Zhu, G., Zhang, L., Yang, L., Mei, L., Shah, S.A.A., Bennamoun, M., Shen, P.: Redundancy and attention in convolutional lstm for gesture recognition. IEEE Trans. Neural Netw. Learn. Syst. 31(4), 1323–1335 (2019)

    Article  Google Scholar 

  63. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

  64. Dey, S., Bhattacharya, R., Malakar, S., Schwenker, F., Sarkar, R.: Covidconvlstm: a fuzzy ensemble model for covid-19 detection from chest x-rays. Exp. Syst. Appl. 206, 117812 (2022)

    Article  Google Scholar 

  65. Kinga, D., Adam, J.B., : A method for stochastic optimization. In: International Conference on Learning Representations (ICLR), vol. 5, p. 6 (2015). San Diego, California;

  66. Yi, D., Ahn, J., Ji, S.: An effective optimization method for machine learning based on adam. Appl. Sci. 10(3), 1073 (2020)

    Article  Google Scholar 

  67. Gewers, F.L., Ferreira, G.R., Arruda, H.F.D., Silva, F.N., Comin, C.H., Amancio, D.R., Costa, L.d.F.: Principal component analysis: a natural approach to data exploration. ACM Comput. Surv. (CSUR) 54(4), 1–34 (2021)

    Article  Google Scholar 

  68. Lee, W.J., Mendis, G.P., Triebe, M.J., Sutherland, J.W.: Monitoring of a machining process using kernel principal component analysis and kernel density estimation. J. Intell. Manuf. 31, 1175–1189 (2020)

    Article  Google Scholar 

  69. Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In: Workshop on Faces in’Real-Life’Images: Detection, Alignment, and Recognition (2008)

  70. Khan, K., Attique, M., Syed, I., Gul, A.: Automatic gender classification through face segmentation. Symmetry 11(6), 770 (2019)

    Article  Google Scholar 

  71. Zhang, K., Gao, C., Guo, L., Sun, M., Yuan, X., Han, T.X., Zhao, Z., Li, B.: Age group and gender estimation in the wild with deep ror architecture. IEEE Access 5, 22492–22503 (2017)

    Article  Google Scholar 

  72. Khan, K., Attique, M., Khan, R.U., Syed, I., Chung, T.-S.: A multi-task framework for facial attributes classification through end-to-end face parsing and deep convolutional neural networks. Sensors 20(2), 328 (2020)

    Article  Google Scholar 

  73. Kumar, S., Singh, S., Kumar, J., Prasad, K.: Age and gender classification using seg-net based architecture and machine learning. Multimed. Tools Appl. 81(29), 42285–42308 (2022)

    Article  Google Scholar 

  74. Liao, H., Yuan, L., Wu, M., Zhong, L., **, G., **ong, N.: Face gender and age classification based on multi-task, multi-instance and multi-scale learning. Appl. Sci. 12(23), 12432 (2022)

    Article  Google Scholar 

  75. Kuprashevich, M., Tolstykh, I.: Mivolo: Multi-input transformer for age and gender estimation. ar**v preprint ar**v:2307.04616 (2023)

  76. Rouhsedaghat, M., Wang, Y., Ge, X., Hu, S., You, S., Kuo, C.-C.J.: Facehop: A light-weight low-resolution face gender classification method. In: Pattern Recognition. ICPR International Workshops and Challenges: Virtual Event, January 10-15, 2021, Proceedings, Part VIII, pp. 169–183 (2021). Springer

Download references

Funding

This work was supported by the Special Project on Basic Research of Frontier Leading Technology of Jiangsu Province of China (Grant No. BK20192004C) and the Natural Science Foundation of Jiangsu Province of China (Grant No. BK20181269).

Author information

Authors and Affiliations

  1. School of Automation, Southeast University, Nan**g, 21006, Jiangsu, China

    Fazal waris, Feipeng Da & Shanghuan Liu

Authors
  1. Fazal waris
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Feipeng Da
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shanghuan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

FW is the main contributor to the manuscript and experiments.SL contributed to review and editing and FD supervised the study. All authors reviewed the manuscript.

Corresponding author

Correspondence to Feipeng Da.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest that are relevant to the content of this manuscript.

Ethical approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

waris, F., Da, F. & Liu, S. Stacked ensemble learning for facial gender classification using deep learning based features extraction. Cluster Comput (2024). https://doi.org/10.1007/s10586-024-04340-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10586-024-04340-7

Keywords

Search

Navigation