Abstract
Body gesture is the most important way of non-verbal communication for deaf and dumb people. Thus, a novel sign language recognition procedure is presented here where the movements of hands play a pivotal role for such kind of communications. Microsoft’s Kinect sensor is used to act as a medium to interpret such communication by tracking the movement of human body using 20 joints. A procedural approach has been developed to deal with unknown gesture recognition by generating in-order expression for AVL tree as a feature. Here, 12 gestures are taken into consideration, and for the classification purpose, kernel function-based support vector machine is employed with results to gesture recognition into an accuracy of 88.3%. The foremost goal is to develop an algorithm that act as a medium to human–computer interaction for deaf and dumb people. Here, the novelty lies in the fact that for gesture recognition in sign language interpretation, the whole body of the subject is represented using a hierarchical balanced tree (here AVL).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
K. Khoshelham and S. O. Elberink, “Accuracy and resolution of kinect depth data for indoor map** applications,” Sensors, vol. 12, no. 2, pp. 1437–1454, 2012.
Z. Ren, J. Yuan, J. Meng, and Z. Zhang, “Robust part-based hand gesture recognition using kinect sensor,” Multimedia, IEEE Trans., vol. 15, no. 5, pp. 1110–1120, 2013.
Y. Li, “Hand gesture recognition using Kinect,” in Software Engineering and Service Science (ICSESS), 2012 IEEE 3rd International Conference on, 2012, pp. 196–199.
M. Oszust and M. Wysocki, “Recognition of signed expressions observed by Kinect Sensor,” in Advanced Video and Signal Based Surveillance (AVSS), 2013 10th IEEE International Conference on, 2013, pp. 220–225.
T.-L. Le, M.-Q. Nguyen, and T.-T.-M. Nguyen, “Human posture recognition using human skeleton provided by Kinect,” in Computing, Management and Telecommunications (ComManTel), 2013 International Conference on, 2013, pp. 340–345.
K. K. Biswas and S. K. Basu, “Gesture recognition using microsoft kinect®,” in Automation, Robotics and Applications (ICARA), 2011 5th International Conference on, 2011, pp. 100–103.
O. Patsadu, C. Nukoolkit, and B. Watanapa, “Human gesture recognition using Kinect camera,” in Computer Science and Software Engineering (JCSSE), 2012 International Joint Conference on, 2012, pp. 28–32.
R. W. Irving and L. Love, “The suffix binary search tree and suffix AVL tree,” J. Discret. Algorithms, vol. 1, no. 5, pp. 387–408, 2003.
C. Cortes and V. Vapnik, “Support vector machine,” Mach. Learn., vol. 20, no. 3, pp. 273–297, 1995.
J. A. K. Suykens and J. Vandewalle, “Least squares support vector machine classifiers,” Neural Process. Lett., vol. 9, no. 3, pp. 293–300, 1999.
T. M. Mitchell, “Machine learning and data mining,” Commun. ACM, vol. 42, no. 11, pp. 30–36, 1999.
Acknowledgements
The research work is supported by the University Grants Commission, India, University with Potential for Excellence Program (Phase II) in Cognitive Science, Jadavpur University and University Grants Commission (UGC) for providing fellowship to the first author.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Saha, S., Bhattacharya, S., Konar, A. (2018). A Novel Approach to Gesture Recognition in Sign Language Applications Using AVL Tree and SVM. In: Sa, P., Sahoo, M., Murugappan, M., Wu, Y., Majhi, B. (eds) Progress in Intelligent Computing Techniques: Theory, Practice, and Applications. Advances in Intelligent Systems and Computing, vol 518. Springer, Singapore. https://doi.org/10.1007/978-981-10-3373-5_27
Download citation
DOI: https://doi.org/10.1007/978-981-10-3373-5_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-3372-8
Online ISBN: 978-981-10-3373-5
eBook Packages: EngineeringEngineering (R0)