Abstract
Face recognition with assistance of 3D models has been a successful approach recently. In this paper, we develop a face recognition system fusing 2D and 3D face information. First, the HarrLBP representation is proposed to represent the 2D faces. Then, the 3D morphable model (3DMM) is employed to estimate the 3D shape for the given 2D face, and five kinds of 3D facial geometrical features are extracted from the virtual 3D facial meshes to assist the face recognition. Finally, we fuse the 2D HarrLBP and the five 3D features under a linear self-adaptive weight scheme to promote the final recognition efficiency. The experimental results on ORL and JAFFE2 face database show the good performance of the proposed fusion method, and demonstrate that our method is robust to the facial expressions and poses to a certain extent.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3d and multi-modal 3d+2d face recognition. Computer Vision and Image Understanding 101(1), 1–15 (2006)
Chang, K.I., Bowyer, K.W., Flynn, P.J.: An evaluation of multimodal 2d+3d face biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(4), 619–624 (2005)
Lu, X., Jain, A.K., Colbry, D.: Matching 2.5d scans to 3d models. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(1), 31–43 (2006)
Mian, A.S., Bennamoun, M., Owens, R.A.: An efficient multimodal 2d-3d hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(11), 1927–1943 (2007)
Zhang, X., Zhao, S., Gao, Y.: On averaging face images for recognition under pose variations. In: Proc. of ICPR 2008, pp. 1–4 (2008)
Wang, L., Ding, L., Ding, X., Fang, C.: Improved 3d assisted poseinvariant face recognition. In: Proc. of ICASSP 2009, pp. 889–892 (2009)
Haar, A.: Zur theorie der orthogonalen funktionensysteme (German). Mathematische Annalen 69(3), 331–371 (1910)
Ojala, T., Pietikainen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29, 51–59 (1996)
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(12), 2037–2041 (2006)
Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 915–928 (2007)
Vazquez, H., Reyes, E., Molleda, Y.: A new image division for lbp method to improve face recognition under varying lighting conditions. In: Proc. of ICPR 2008, pp. 1–4 (2008)
Shan, C., Gong, S., McOwan, P.: Facial expression recognition based on local binary patterns: a comprehensive study. Image and Vision Computing 27, 803–816 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Tang, H., Sun, Y., Yin, B., Ge, Y. (2011). Mixed 2D-3D Information for Face Recognition. In: Pan, Z., Cheok, A.D., Müller, W., Yang, X. (eds) Transactions on Edutainment V. Lecture Notes in Computer Science, vol 6530. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-18452-9_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-18452-9_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-18451-2
Online ISBN: 978-3-642-18452-9
eBook Packages: Computer ScienceComputer Science (R0)