SpringerLink
Log in

A real-time multi view gait-based automatic gender classification system using kinect sensor

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Gender classification plays an important role in many applications such as security and medical applications. Human gender can be classified using different biometric techniques such as face recognition, voice recognition, activity recognition and gait recognition. Different approaches based on gait-recognition have been proposed for the identification of gender. However, performance and accuracy of such systems suffer from the recurring and inherent issues like occlusion of body parts, computational costs and false recognition of 3D joints. The problems can be subdued with deep feature-based analysis and extensive calculation but that may further degrade performance of the system. In this paper, we propose a limited feature-based, Three Dimensional (3D), real time, and multi-view gait-based automatic gender classification system using Microsoft kinect (MS Kinect). A statistical model is molded from the binary logistic regression of the gait data extracted at run time using the sensor. The proposed method is successfully implemented and evaluated by 80 (50 male and 30 female) users. The achieved accuracy rate (97.50%) proves applicability of the model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Institutional subscriptions

Algorithm 1
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Abouelenien M, Pérez-Rosas V, Mihalcea R, Burzo M (2017) Multimodal gender detection. In: Proceedings of the 19th ACM international conference on multimodal interaction, pp 302–311

  2. Ahmed F, Polash Paul P (2015) Gavrilova M.L.: Kinect-based gait recognition using sequences of the most relevant joint relative angles

  3. Ahmed M, Al-Jawad N, Sabir AT (2014) Gait recognition based on kinect sensor. In: Real-Time Image And Video Processing 2014, vol 9139, p 91390B. International Society for Optics and Photonics

  4. Ahmed MH, Sabir AT (2017) Human gender classification based on gait features using kinect sensor. In: 2017 3rd IEEE international conference on cybernetics (Cybconf), pp 1–5. IEEE

  5. Alharbi A, Alharbi F, Kamioka E (2019) Skeleton based gait recognition for long and baggy clothes. In: MATEC Web of conferences, vol 277, p 03005. EDP Sciences

  6. Ball A, Rye D, Ramos F, Velonaki M (2012) Unsupervised clustering of people from’skeleton’data. In: Proceedings of the seventh annual ACM/IEEE international conference on human-robot interaction, pp 225–226

  7. Begg RK, Palaniswami M, Owen B (2005) Support vector machines for automated gait classification. IEEE Trans Biomed Eng 52(5):828–838

    Google Scholar 

  8. BenAbdelkader C, Cutler R, Davis L (2002) View-invariant estimation of height and stride for gait recognition. In: International workshop on biometric authentication, pp 155–167. Springer

  9. BenAbdelkader C, Cutler R, Nanda H, Davis L (2001) Eigengait: motion-based recognition of people using image self-similarity. In: International conference on audio-and video-based biometric person authentication, pp 284–294. Springer

  10. Bobick AF, Johnson AY (2001) Gait recognition using static, activity-specific parameters. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, vol 1, pp I–I. IEEE

  11. Burkhardt F, Eckert M, Johannsen W, Stegmann J (2010) A database of age and gender annotated telephone speech. In: LREC. Malta

  12. Cao L, Dikmen M, Fu Y, Huang TS (2008) Gender recognition from body. In: Proceedings of the 16th ACM international conference on multimedia, pp 725–728

  13. Chaudhari S, Kagalkar R (2012) A review of automatic speaker age classification, recognition and identifying speaker emotion using voice signal. Int J Sci Res 3(11):1307–1311

    Google Scholar 

  14. Chen K, Zhang D, Yao L, Guo B, Yu Z, Liu Y (2021) Deep learning for sensor-based human activity recognition: overview, challenges, and opportunities. ACM Comput Surv (CSUR) 54(4):1–40

    Google Scholar 

  15. Chen X, Luo X, Weng J, Luo W, Li H, Tian Q (2021) Multi-view gait image generation for cross-view gait recognition. IEEE Trans Image Process 30:3041–3055

    Google Scholar 

  16. Chen Y, Yang Y, Lee J (2014) Gait based gender classification using kinect sensor

  17. Collins M, Zhang J, Miller P, Wang H (2009) Full body image feature representations for gender profiling. In: 2009 IEEE 12th International conference on computer vision workshops, ICCV workshops, pp 1235–1242. IEEE

  18. Dantcheva A, Elia P, Ross A (2015) What else does your biometric data reveal? A survey on soft biometrics. IEEE Trans Inform Forens Secur 11 (3):441–467

    Google Scholar 

  19. Davis JW (2001) Visual categorization of children and adult walking styles. In: International conference on audio-and video-based biometric person authentication, pp 295–300. Springer

  20. Deligianni F, Guo Y, Yang GZ (2019) From emotions to mood disorders: a survey on gait analysis methodology. IEEE J Biomed Health Inform 23 (6):2302–2316

    Google Scholar 

  21. Deng J, Guo J, Xue N, Zafeiriou S (2019) Arcface: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 4690–4699

  22. Dou H, Zhang W, Zhang P, Zhao Y, Li S, Qin Z, Wu F, Dong L, Li X (2021) Versatilegait: a large-scale synthetic gait dataset with fine-grainedattributes and complicated scenarios. ar**v:2101.01394

  23. Duong D, Tan H, Pham S (2016) Customer gender prediction based on e-commerce data. In: 2016 Eighth international conference on knowledge and systems engineering (KSE), pp 91–95. IEEE

  24. Echterhoff JM, Haladjian J, Brügge B (2018) Gait and jump classification in modern equestrian sports. In: Proceedings of the 2018 ACM international symposium on wearable computers, pp 88–91

  25. Etemad SA, Arya A (2014) Classification and translation of style and affect in human motion using rbf neural networks. Neurocomputing 129:585–595

    Google Scholar 

  26. Etemad SA, Arya A (2015) Correlation-optimized time war** for motion. Vis Comput 31(12):1569–1586

    Google Scholar 

  27. Etemad SA, Arya A (2016) Expert-driven perceptual features for modeling style and affect in human motion. IEEE Trans Human-Mach Syst 46(4):534–545

    Google Scholar 

  28. Farooq A, Jalal A, Kamal S (2015) Dense rgb-d map-based human tracking and activity recognition using skin joints features and self-organizing map. KSII Trans Internet Inform Syst (TIIS) 9(5):1856–1869

    Google Scholar 

  29. Gianaria E, Grangetto M (2019) Robust gait identification using kinect dynamic skeleton data. Multimed Tools Appl 78(10):13925–13948

    Google Scholar 

  30. Guo G, Mu G, Fu Y (2009) Gender from body: a biologically-inspired approach with manifold learning. In: Asian conference on computer vision, pp 236–245. Springer

  31. Gupta SK (2021) Reduction of covariate factors from silhouette image for robust gait recognition. Multimed Tools Appl 80(28):36033–36058

    Google Scholar 

  32. Han H, Otto C, Liu X, Jain AK (2014) Demographic estimation from face images: human vs. machine performance. IEEE Trans Pattern Anal Mach Intell 37(6):1148–1161

    Google Scholar 

  33. Han J, Bhanu B (2005) Individual recognition using gait energy image. IEEE Trans Pattern Anal Mach Intell 28(2):316–322

    Google Scholar 

  34. Jalal A, Kamal S, Kim D (2015) Shape and motion features approach for activity tracking and recognition from kinect video camera. In: 2015 IEEE 29th international conference on advanced information networking and applications workshops, pp 445–450. IEEE

  35. Jarchi D, Pope J, Lee TK, Tamjidi L, Mirzaei A, Sanei S (2018) A review on accelerometry-based gait analysis and emerging clinical applications. IEEE Rev Biomed Eng 11:177–194

    Google Scholar 

  36. Jhapate AK, Singh JP (2011) Gait based human recognition system using single triangle. Int J Comput Sci Technol 2(2):128–131

    Google Scholar 

  37. Johansson G (1973) Visual perception of biological motion and a model for its analysis. Percept Psychophys 14(2):201–211

    Google Scholar 

  38. Kola DGR, Samayamantula SK (2021) A novel approach for facial expression recognition using local binary pattern with adaptive window. Multimed Tools Appl 80(2):2243–2262

    Google Scholar 

  39. Kozlowski LT, Cutting JE (1977) Recognizing the sex of a walker from a dynamic point-light display. Percep Psychophys 21(6):575–580

    Google Scholar 

  40. Li R, Li H, Shi W (2020) Human activity recognition based on lpa. Multimed Tools Appl 79(41):31069–31086

    Google Scholar 

  41. Li X, Maybank SJ, Yan S, Tao D, Xu D (2008) Gait components and their application to gender recognition. IEEE Trans Syst Man Cybern Part C (Applic Rev) 38(2):145–155

    Google Scholar 

  42. Lin F, Wu Y, Zhuang Y, Long X, Xu W (2016) Human gender classification: a review. Int J Biometr 8(3-4):275–300

    Google Scholar 

  43. Lishani AO, Boubchir L, Khalifa E, Bouridane A (2019) Human gait recognition using gei-based local multi-scale feature descriptors. Multimed Tools Appl 78(5):5715–5730

    Google Scholar 

  44. Liu LF, Jia W, Zhu YH (2009) Survey of gait recognition. In: International conference on intelligent computing, pp 652–659. Springer

  45. Marsico MD, Mecca A (2019) A survey on gait recognition via wearable sensors. ACM Comput Surv (CSUR) 52(4):1–39

    Google Scholar 

  46. Meinedo H, Trancoso I (2010) Age and gender classification using fusion of acoustic and prosodic features. In: Eleventh annual conference of the international speech communication association

  47. Muro-De-La-Herran A, Garcia-Zapirain B, Mendez-Zorrilla A (2014) Gait analysis methods: an overview of wearable and non-wearable systems, highlighting clinical applications. Sensors 14(2):3362–3394

    Google Scholar 

  48. Murray MP (1967) Gait as a total pattern of movement: including a bibliography on gait. Amer J Phys Med Rehab 46(1):290–333

    Google Scholar 

  49. Nambiar A, Bernardino A, Nascimento JC (2019) Gait-based person re-identification: a survey. ACM Comput Surv (CSUR) 52(2):1–34

    Google Scholar 

  50. Nixon MS, Carter JN, Shutler JD, Grant MG (2002) New advances in automatic gait recognition. Inf Secur Tech Rep 7(4):23–35

    Google Scholar 

  51. Niyogi SA, Adelson EH, et al. (1994) Analyzing and recognizing walking figures in xyt. In: CVPR, vol 94, pp 469–474

  52. Oloyede MO, Hancke GP, Myburgh HC (2020) A review on face recognition systems: recent approaches and challenges. Multimed Tools Appl 79 (37):27891–27922

    Google Scholar 

  53. Perry J, Davids JR, et al. (1992) Gait analysis: normal and pathological function. J Pediatr Orthopaed 12(6):815

    Google Scholar 

  54. Preis J, Kessel M, Werner M, Linnhoff-Popien C (2012) Gait recognition with kinect. In: 1st international workshop on kinect in pervasive computing, New Castle, pp 1–4

  55. Rao PS, Sahu G, Parida P (2019) Methods for automatic gait recognition: a review. In: International conference on innovations in bio-inspired computing and applications, pp 57–65. Springer

  56. Rida I, Almaadeed N, Almaadeed S (2019) Robust gait recognition: a comprehensive survey. IET Biometr 8(1):14–28

    Google Scholar 

  57. Sarkar S, Phillips PJ, Liu Z, Vega IR, Grother P, Bowyer KW (2005) The humanid gait challenge problem: data sets, performance, and analysis. IEEE Trans Pattern Anal Mach Intell 27(2):162–177

    Google Scholar 

  58. Seneviratne S, Seneviratne A, Mohapatra P, Mahanti A (2015) Your installed apps reveal your gender and more!. ACM SIGMOBILE Mob Comput Commun Rev 18(3):55–61

    Google Scholar 

  59. Sepas-Moghaddam A, Etemad A (2020) View-invariant gait recognition with attentive recurrent learning of partial representations. IEEE Trans Biometr Behav Ident Sci 3(1):124–137

    Google Scholar 

  60. Sepas-Moghaddam A, Etemad A (2021) Deep gait recognition: a survey. ar**v:2102.09546

  61. Sepas-Moghaddam A, Ghorbani S, Troje NF, Etemad A (2021) Gait recognition using multi-scale partial representation transformation with capsules. In: 2020 25th International conference on pattern recognition (ICPR), pp 8045–8052. IEEE

  62. Sepas-Moghaddam A, Pereira FM, Correia PL (2020) Face recognition: a novel multi-level taxonomy based survey. IET Biometr 9(2):58–67

    Google Scholar 

  63. Singh JP, Jain S (2010) Person identification based on gait using dynamic body parameters. In: Trendz in information sciences & computing (TISC2010), pp 248–252. IEEE

  64. Sinha A, Chakravarty K, Bhowmick B, et al. (2013) Person identification using skeleton information from kinect. In: Proc. Intl. conf. on advances in computer-human interactions, pp 101–108

  65. Topaloglu M, Ekmekci S (2017) Gender detection and identifying one’s handwriting with handwriting analysis. Expert Syst Appl 79:236–243

    Google Scholar 

  66. Unar S, Wang X, Wang C, Wang Y (2019) A decisive content based image retrieval approach for feature fusion in visual and textual images. Knowl-Based Syst 179:8–20

    Google Scholar 

  67. Unar S, Wang X, Zhang C (2018) Visual and textual information fusion using kernel method for content based image retrieval. Inform Fus 44:176–187

    Google Scholar 

  68. Unar S, Wang X, Zhang C, Wang C (2019) Detected text-based image retrieval approach for textual images. IET Image Process 13(3):515–521

    Google Scholar 

  69. Verlekar TT, Correia PL, Soares LD (2018) Using transfer learning for classification of gait pathologies. In: 2018 IEEE international conference on bioinformatics and biomedicine (BIBM), pp 2376–2381. IEEE

  70. Wan C, Wang L, Phoha VV (2018) A survey on gait recognition. ACM Comput Surv (CSUR) 51(5):1–35

    Google Scholar 

  71. Wang C, Wang X, **a Z, Ma B, Shi YQ (2019) Image description with polar harmonic fourier moments. IEEE Trans Circuits Syst Video Technol 30(12):4440–4452

    Google Scholar 

  72. Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: a survey. Pattern Recogn Lett 119:3–11

    Google Scholar 

  73. Wang J, She M, Nahavandi S, Kouzani A (2010) A review of vision-based gait recognition methods for human identification. In: 2010 international conference on digital image computing: techniques and applications, pp 320–327. IEEE

  74. Wang M, Deng W (2021) Deep face recognition: a survey. Neurocomputing 429:215–244

    Google Scholar 

  75. Wang X, Wang Z (2013) A novel method for image retrieval based on structure elements’ descriptor. J Vis Commun Image Represent 24(1):63–74

    Google Scholar 

  76. Wang X, Wang Z (2014) The method for image retrieval based on multi-factors correlation utilizing block truncation coding. Pattern Recogn 47(10):3293–3303

    Google Scholar 

  77. Wang XY, Chen ZF (2009) A fast fractal coding in application of image retrieval. Fractals 17(04):441–450

    MathSciNet  MATH  Google Scholar 

  78. Winter DA (1991) Biomechanics and motor control of human gait: normal elderly and pathological

  79. Wu Q, Guo G (2014) Gender recognition from unconstrained and articulated human body. Sci World J, 2014

  80. Xu C, Makihara Y, Liao R, Niitsuma H, Li X, Yagi Y, Lu J (2021) Real-time gait-based age estimation and gender classification from a single image. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 3460–3470

  81. You Q, Bhatia S, Sun T, Luo J (2014) The eyes of the beholder: gender prediction using images posted in online social networks. In: 2014 IEEE International conference on data mining workshop, pp 1026–1030. IEEE

  82. Zhang H, Guo Y, Zanotto D (2019) Accurate ambulatory gait analysis in walking and running using machine learning models. IEEE Trans Neural Syst Rehabil Eng 28(1):191–202

    Google Scholar 

  83. Zhang J, Du K, Cheng R, Wei Z, Qin C, You H, Hu S (2016) Reliable gender prediction based on users’ video viewing behavior. In: 2016 IEEE 16th International conference on data mining (ICDM), pp 649–658. IEEE

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science & IT, University of Malakand, Chakdara, Pakistan

    Muhammad Azhar, Sehat Ullah, Muhammad Raees & Inam Ur Rehman

  2. Department of Statistics, Abdul Wali Khan University, Mardan, Pakistan

    Khaliq Ur Rahman

Authors
  1. Muhammad Azhar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sehat Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Raees
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Khaliq Ur Rahman
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Inam Ur Rehman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Azhar.

Ethics declarations

Ethics approval and consent to participate

All the techniques brought under use in the concerned study with the code of conduct and with the proper ethical standards of the institutional and national research committee.

Informed consent was obtained from all individual articles included in the study.

Conflict of Interests

We have no conflict of interest with any organization in this case.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azhar, M., Ullah, S., Raees, M. et al. A real-time multi view gait-based automatic gender classification system using kinect sensor. Multimed Tools Appl 82, 11993–12016 (2023). https://doi.org/10.1007/s11042-022-13704-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13704-3

Keywords

Search

Navigation