SpringerLink
Log in

Deep learning based features extraction for facial gender classification using ensemble of machine learning technique

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Accurate and efficient gender recognition is an essential for many applications such as surveillance, security, and biometrics. Recently, deep learning techniques have made remarkable advancements in feature extraction and have become extensively implemented in various applications, including gender classification. However, despite the numerous studies conducted on the problem, correctly recognizing robust and essential features from face images and efficiently distinguishing them with high accuracy in the wild is still a challenging task for real-world applications. This article proposes an approach that combines deep learning and soft voting-based ensemble model to perform automatic gender classification with high accuracy in an unconstrained environment. In the proposed technique, a novel deep convolutional neural network (DCNN) was designed to extract 128 high-quality and accurate features from face images. The StandardScaler method was then used to pre-process these extracted features, and finally, these preprocessed features were classified with soft voting ensemble learning model combining the outputs from several machine learning classifiers such as random forest (RF), support vector machine (SVM), linear discriminant analysis (LDA), logistic regression (LR), gradient boosting classifier (GBC) and XGBoost to improve the prediction accuracy. The experimental study was performed on the UTK, label faces in the wild (LFW), Adience and FEI datasets. The results attained evidently show that the proposed approach outperforms all current approaches in terms of accuracy across all datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data Availability

All data included in this study are available upon request by contact with the corresponding author.

References

  1. Dantcheva, A., Elia, P., Ross, A.: What else does your biometric data reveal? a survey on soft biometrics. IEEE Trans. Inform. Forensics Secur. 11(3), 441–467 (2015)

    Article  Google Scholar 

  2. Gragnaniello, D., Li, C.-T., Marra, F., Riccio, D.: Virtual special issue on advances in digital security: Biometrics and forensics. Pattern Recogn. Lett. 159, 220–221 (2022)

    Article  Google Scholar 

  3. Bommidi, K., Sundaramurthy, S.: A compressed string matching algorithm for face recognition with partial occlusion. Multimed. Syst. 27, 191–203 (2021)

    Article  Google Scholar 

  4. Adyapady, R.R., Annappa, B.: A comprehensive review of facial expression recognition techniques. Multimed. Syst. 29(1), 73–103 (2023)

    Article  Google Scholar 

  5. Abdurrahim, S.H., Samad, S.A., Huddin, A.B.: Review on the effects of age, gender, and race demographics on automatic face recognition. Vis. Comput. 34, 1617–1630 (2018)

    Article  Google Scholar 

  6. Li, J., Chen, Y., Zhang, E.: Multi-level fisher vector aggregated completed local fractional order derivative feature vector for face recognition. Multimed. Syst., 28(6), 2357–2365 (2022)

    Article  Google Scholar 

  7. Sheoran, V., Joshi, S., Bhayani, T.R.: Age and gender prediction using deep cnns and transfer learning. In: International Conference on Computer Vision and Image Processing, pp. 293– 304 ( 2020). Springer

  8. Wang, H., Ke, H., Liu, C.: An embedded method: improve the relevance of text and face image with enhanced face attributes. Signal Process. Image Commun. 108, 116815 (2022)

    Article  Google Scholar 

  9. Khan, K., Attique, M., Syed, I., Gul, A.: Automatic gender classification through face segmentation. Symmetry 11(6), 770 (2019)

    Article  Google Scholar 

  10. Neggaz, I., Neggaz, N., Fizazi, H.: Boosting Archimedes optimization algorithm using trigonometric operators based on feature selection for facial analysis. Neural Comput. Appl. 35(5), 3903–3923 (2023)

    Article  Google Scholar 

  11. Greco, A., Saggese, A., Vento, M., Vigilante, V.: A convolutional neural network for gender recognition optimizing the accuracy/speed tradeoff. IEEE Access 8, 130771–130781 (2020)

    Article  Google Scholar 

  12. Jamoliddin, U., Yoo, J.H.: Age and gender classification with small scale cnn. J. Korea Inst. Electron. Commun. Sci. 17(1), 99–104 (2022)

    Google Scholar 

  13. Danişman, T.: Bagging ensemble for deep learning based gender recognition using test-time augmentation on large-scale datasets. Turk. J. Electr. Eng. Comput. Sci. 29(4), 2084–2100 (2021)

    Article  Google Scholar 

  14. Sivachandiran, S., Mohan, K.J., Nazer, G.M.: Automated deep learning based age and gender classification model using facial features for video surveillance. J. Algebraic Stat. 13(2), 621–633 (2022)

    Google Scholar 

  15. Irhebhude, M.E., Kolawole, A.O., Goma, H.K.: A gender recognition system using facial images with high dimensional data. Malays. J. Appl. Sci. 6(1), 27–45 (2021)

    Google Scholar 

  16. Wang, J.-G., Li, J., Lee, C.Y., Yau, W.-Y.: Dense sift and gabor descriptors-based face representation with applications to gender recognition. In: 2010 11th International Conference on Control Automation Robotics & Vision, pp. 1860– 1864 (2010). IEEE

  17. Mäkinen, E., Raisamo, R.: An experimental comparison of gender classification methods. Pattern Recognit. Lett. 29(10), 1544–1556 (2008)

    Article  Google Scholar 

  18. Levi, G., Hassner, T.: Age and gender classification using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 34– 42 ( 2015)

  19. Haider, K.Z., Malik, K.R., Khalid, S., Nawaz, T., Jabbar, S.: Deepgender: real-time gender classification using deep learning for smartphones. J. Real-Time Image Proc. 16(1), 15–29 (2019)

    Article  Google Scholar 

  20. Dammak, S., Mliki, H., Fendri, E.: Gender estimation based on deep learned and handcrafted features in an uncontrolled environment. Multimed. Syst., 29(1), 421–433 (2022)

    Article  Google Scholar 

  21. Hosseini, S., Lee, S.H., Kwon, H.J., Koo, H.I., Cho, N.I.: Age and gender classification using wide convolutional neural network and Gabor filter. In: 2018 International Workshop on Advanced Image Technology (IWAIT), pp. 1– 3 ( 2018). IEEE

  22. Duan, M., Li, K., Yang, C., Li, K.: A hybrid deep learning cnn-elm for age and gender classification. Neurocomputing 275, 448–461 (2018)

    Article  Google Scholar 

  23. Kale, A., Altun, O.: Age, gender and ethnicity classification from face images with cnn-based features. In: 2021 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 1– 6 ( 2021). IEEE

  24. Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: A database for studying face recognition in unconstrained environments. In: Workshop on Faces in ’Real-Life’ Images: Detection, Alignment, and Recognition (2008)

  25. Zhang, Z., Song, Y., Qi, H.: Age progression/regression by conditional adversarial autoencoder. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5810–5818 (2017)

    Article  Google Scholar 

  26. Eidinger, E., Enbar, R., Hassner, T.: Age and gender estimation of unfiltered faces. IEEE Trans. Inf. Forensics Secur. 9(12), 2170–2179 (2014)

    Article  Google Scholar 

  27. Thomaz, C.E., Giraldi, G.A.: A new ranking method for principal components analysis and its application to face image analysis. Image Vis. Comput. 28(6), 902–913 (2010)

    Article  Google Scholar 

  28. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 886– 893 (2005). Ieee

  29. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  30. Mustafa, W.A., Yazid, H., Khairunizam, W., Jamlos, M.A., Zunaidi, I., Razlan, Z., Shahriman, A.: Image enhancement based on discrete cosine transforms (dct) and discrete wavelet transform (dwt): a review. IOP Conf. Ser. Mater. Sci. Eng. 557, 012027 (2019)

    Article  Google Scholar 

  31. Jabid, T., Kabir, M.H., Chae, O.: Local directional pattern (ldp) for face recognition. In: 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE), pp. 329– 330 ( 2010). IEEE

  32. El Dib, M.Y., El-Saban, M.: Human age estimation using enhanced bio-inspired features (ebif). In: 2010 IEEE International Conference on Image Processing, pp. 1589– 1592 (2010). IEEE

  33. Zhang, L., Chu, R., **ang, S., Liao, S., Li, S.Z.: Face detection based on multi-block lbp representation. In: Advances in Biometrics: International Conference, ICB 2007, Seoul, Korea, August 27-29, 2007. Proceedings, pp. 11– 18 (2007). Springer

  34. Gutta, S., Huang, J.R., Jonathon, P., Wechsler, H.: Mixture of experts for classification of gender, ethnic origin, and pose of human faces. IEEE Trans. Neural Netw. 11(4), 948–960 (2000)

    Article  Google Scholar 

  35. Moghaddam, B., Yang, M.-H.: Learning gender with support faces. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 707–711 (2002)

    Article  Google Scholar 

  36. Baluja, S., Rowley, H.A.: Boosting sex identification performance. Int. J. Comput. Vis. 71(1), 111–119 (2007)

    Article  Google Scholar 

  37. Yang, Z., Ai, H.: Demographic classification with local binary patterns. In: International Conference on Biometrics, pp. 464– 473 (2007). Springer

  38. Leng, X., Wang, Y.: Improving generalization for gender classification. In: 2008 15th IEEE International Conference on Image Processing, pp. 1656– 1659 (2008). IEEE

  39. Shan, C.: Learning local binary patterns for gender classification on real-world face images. Pattern Recogn. Lett. 33(4), 431–437 (2012)

    Article  Google Scholar 

  40. Jabid, T., Kabir, M.H., Chae, O.: Gender classification using local directional pattern (ldp). In: 2010 20th International Conference on Pattern Recognition, pp. 2162– 2165 (2010). IEEE

  41. Jia, S., Cristianini, N.: Learning to classify gender from four million images. Pattern Recogn. Lett. 58, 35–41 (2015)

    Article  Google Scholar 

  42. Annalakshmi, M., Roomi, S., Naveedh, A.S.: A hybrid technique for gender classification with slbp and hog features. Clust. Comput. 22(1), 11–20 (2019)

    Article  Google Scholar 

  43. Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4295– 4304 (2015)

  44. Panner Selvam, I.R., Karuppiah, M.: Gender recognition based on face image using reinforced local binary patterns. IET Comput. Vis. 11(6), 415–425 (2017)

    Article  Google Scholar 

  45. Zhang, C., Ding, H., Shang, Y., Shao, Z., Fu, X.: Gender classification based on multiscale facial fusion feature. Math. Probl. Eng. 2018, 1–6 (2018)

    Google Scholar 

  46. Zhang, W., Smith, M.L., Smith, L.N., Farooq, A.: Gender and gaze gesture recognition for human-computer interaction. Comput. Vis. Image Underst. 149, 32–50 (2016)

    Article  Google Scholar 

  47. Antipov, G., Berrani, S.-A., Dugelay, J.-L.: Minimalistic cnn-based ensemble model for gender prediction from face images. Pattern Recogn. Lett. 70, 59–65 (2016)

    Article  Google Scholar 

  48. Lapuschkin, S., Binder, A., Muller, K.-R., Samek, W.: Understanding and comparing deep neural networks for age and gender classification. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 1629–1638 ( 2017)

  49. Cheng, J., Li, Y., Wang, J., Yu, L., Wang, S.: Exploiting effective facial patches for robust gender recognition. Tsinghua Sci. Technol. 24(3), 333–345 (2019)

    Article  Google Scholar 

  50. Agbo-Ajala, O., Viriri, S.: Deeply learned classifiers for age and gender predictions of unfiltered faces. Sci. World J. 2020(1), 1289408 (2020)

    Google Scholar 

  51. Sheikh Fathollahi, M., Heidari, R.: Gender classification from face images using central difference convolutional networks. Int. J. Multimed. Inform. Retrieval 11(4), 695–703 (2022)

    Article  Google Scholar 

  52. Ciobotaru, A., Gota, D.I., Puscasiu, A., Stan, O., Fanca, A., Domuta, C., Valean, H., Miclea, L.: Comparing deep learning and genetic algorithms techniques for age and gender classification. In: 2023 3rd International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), pp. 1– 6 (2023) IEEE

  53. Oulad-Kaddour, M., Haddadou, H., Vilda, C.C., Palacios-Alonso, D., Benatchba, K., Cabello, E.: Deep learning-based gender classification by training with fake data. IEEE Access 11, 120766–120779 (2023)

    Article  Google Scholar 

  54. Benkaddour, M.K.: Cnn based features extraction for age estimation and gender classification. Informatica 45(5), 697–703 (2021)

  55. Saggu, G.S., Gupta, K., Mann, P.S.: Efficient classification for age and gender of unconstrained face images. In: Proceedings of International Conference on Computational Intelligence and Emerging Power System, pp. 13– 24 (2022). Springer

  56. Althnian, A., Aloboud, N., Alkharashi, N., Alduwaish, F., Alrshoud, M., Kurdi, H.: Face gender recognition in the wild: an extensive performance comparison of deep-learned, hand-crafted, and fused features with deep and traditional models. Appl. Sci. 11(1), 89 (2020)

    Article  Google Scholar 

  57. Singh, A., Singh, V.K.: A hybrid transformer-sequencer approach for age and gender classification from in-wild facial images. Neural Comput. Appl. 36(3), 1149–1165 (2024)

    Article  Google Scholar 

  58. Kumari, S., Kumar, D., Mittal, M.: An ensemble approach for classification and prediction of diabetes mellitus using soft voting classifier. Int. J. Cognit. Comput. Eng. 2, 40–46 (2021)

    Article  Google Scholar 

  59. Salur, M.U., Aydın, İ: A soft voting ensemble learning-based approach for multimodal sentiment analysis. Neural Comput. Appl. 34(21), 18391–18406 (2022)

    Article  Google Scholar 

  60. Islam, M.R., Nahiduzzaman, M.: Complex features extraction with deep learning model for the detection of covid19 from ct scan images using ensemble based machine learning approach. Expert Syst. Appl. 195, 116554 (2022)

    Article  Google Scholar 

  61. Srinivas, A., Mosiganti, J.P.: A brain stroke detection model using soft voting based ensemble machine learning classifier. Meas. Sens. 29, 100871 (2023)

    Article  Google Scholar 

  62. Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2009)

    Article  Google Scholar 

  63. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097–1105 (2012)

    Google Scholar 

  64. Khan, J., Alam, A., Hussain, J., Lee, Y.-K.: Enswf: effective features extraction and selection in conjunction with ensemble learning methods for document sentiment classification. Appl. Intell. 49(8), 3123–3145 (2019)

    Article  Google Scholar 

  65. Suresha, M., Kuppa, S., Raghukumar, D.: A study on deep learning spatiotemporal models and feature extraction techniques for video understanding. Int. J. Multimed. Inform. Retrieval 9, 81–101 (2020)

    Article  Google Scholar 

  66. Singh, D., Singh, B.: Investigating the impact of data normalization on classification performance. Appl. Soft Comput. 97, 105524 (2020)

    Article  Google Scholar 

  67. Cao, X.H., Stojkovic, I., Obradovic, Z.: A robust data scaling algorithm to improve classification accuracies in biomedical data. BMC Bioinform. 17(1), 1–10 (2016)

    Article  Google Scholar 

  68. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    Google Scholar 

  69. Ho, T.K.: Random decision forests. In: Proceedings of 3rd International Conference on Document Analysis and Recognition, vol. 1, pp. 278– 282 (1995). IEEE

  70. Dietterich, T.G.: Ensemble methods in machine learning. In: International Workshop on Multiple Classifier Systems, pp. 1– 15 (2000). Springer

  71. Khan, K., Attique, M., Khan, R.U., Syed, I., Chung, T.-S.: A multi-task framework for facial attributes classification through end-to-end face parsing and deep convolutional neural networks. Sensors 20(2), 328 (2020)

    Article  Google Scholar 

  72. Zhang, Y., Xu, T.: Landmark-guided local deep neural networks for age and gender classification. J. Sens. 2018(1), 5034684 (2018)

  73. Gupta, S.K., Yesuf, S.H., Nain, N.: Real-time gender recognition for juvenile and adult faces. Comput. Intell. Neurosci. (2022)

  74. Nagpal, S., Singh, M., Singh, R., Vatsa, M.: Attribute aware filter-drop for bias invariant classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 32– 33 (2020)

  75. Shi, X., Chen, G., Kan, J., Dong, F., Chen, K.: a new try for age estimation and gender recognition based on efficientnetb4. In: 2023 2nd International Conference on Computing, Communication, Perception and Quantum Technology (CCPQT), pp. 216– 221 (2023). IEEE

  76. Rai, P., Khanna, P.: An illumination, expression, and noise invariant gender classifier using two-directional 2dpca on real Gabor space. J. Vis. Lang. Comput. 26, 15–28 (2015)

    Article  Google Scholar 

  77. Kaya, Y., Ertuğrul, Ö.F.: Gender classification from facial images using gray relational analysis with novel local binary pattern descriptors. SIViP 11(4), 769–776 (2017)

    Article  Google Scholar 

  78. Almabdy, S., Elrefaei, L.: Feature extraction and fusion for face recognition systems using pre-trained convolutional neural networks. Int. J. Comput. Digit. Syst. 9, 1–7 (2021)

    Google Scholar 

  79. Ke, Z., Ce, G., Guo, L., Sun, M., **ngfang, Y., Tony, H., Zhenbing, Z., Baogang, L.: Age group and gender estimation in the wild with deep RoR architecture. IEEE Access 5, 22492–22503 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Special Project on Basic Research of Frontier Leading Technology of Jiangsu Province of China (Grant No. BK20192004C).

Author information

Authors and Affiliations

  1. School of Automation, Southeast University, Nan**g, 21006, Jiangsu, China

    Fazal Waris, Feipeng Da & Shanghuan Liu

Authors
  1. Fazal Waris
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Feipeng Da
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shanghuan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

FW proposed the research topic, did experiments and wrote the manuscript. FD did the supervision and provided guidance on the topic. SL was responsible for reviewing, editing and organizing the data. All authors reviewed the Manuscript.

Corresponding author

Correspondence to Feipeng Da.

Ethics declarations

Conflict of interest

The authors declare that they have no Conflict of interest that are relevant to the content of this manuscript.

Additional information

Communicated by Marie Katsurai.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Waris, F., Da, F. & Liu, S. Deep learning based features extraction for facial gender classification using ensemble of machine learning technique. Multimedia Systems 30, 200 (2024). https://doi.org/10.1007/s00530-024-01399-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00530-024-01399-5

Keywords

Search

Navigation