Abstract
Multimodal biometric systems aim to improve the recognition accuracy by minimizing the limitations of unimodal systems. In this paper, different fusion schemes based on feature-level and match score-level fusion are employed to provide a robust recognition system. The proposed method presents a multimodal approach based on face–palmprint biometric systems by match score-level fusion technique. Local binary patterns are performed as local feature extractor to obtain efficient texture descriptor. Feature selection is performed using backtracking search algorithm to select an optimal subset of face and palmprint extracted features. Hence, computation time and feature dimension are considerably reduced while obtaining the higher level of performance. Then, match score-level fusion is performed to show the effectiveness and accuracy of the proposed method. In score-level fusion, face and palmprint scores are normalized using tanh normalization and matching scores of individual classifiers are fused using sum rule method. The experimental results are tested on a developed virtual multimodal database combining FERET face and PolyU palmprint databases. The results demonstrate a significant improvement compared with unimodal identifiers, and the proposed approach significantly outperforms other face–palmprint multimodal systems with a recognition accuracy of 99.17 %. Additionally, the proposed approach is compared with the state-of-the-art methods.
Similar content being viewed by others
References
Ross, A., Nandakumar, K., Jain, A.K.: Handbook of Multibiometrics. Springer, New York (2006)
Jain, A.K., Ross, A., Prabhakar, S.: An introduction to biometric recognition. IEEE Trans. Circuits Syst. Video Technol. 14, 4–20 (2004)
Demirel, H., Anbarjafari, G.: Pose invariant face recognition using probability distribution functions in different color channels. IEEE Signal Process. Lett. 15, 537–540 (2008)
Prabhakar, S., Pankanti, S., Jain, A.K.: Biometric recognition: security and privacy concerns. IEEE Secur. Priv. Mag. 1, 33–42 (2003)
Jain, A.K., Bolle, RuudM, Pankanti, S.: Biometrics: Personal Identification in Networked Society. Kluwer, Massachusetts (1999)
Xu, Y., Zhang, D., Yang, J.-Y.: A feature extraction method for use with bimodal biometrics. Pattern Recogn. 43, 1106–1115 (2010)
Raghavendra, R., Dorizzi, B., Rao, A., Kumar, G.H.: Designing efficient fusion schemes for multimodal biometric systems using face and palmprint. Pattern Recogn. 44, 1076–1088 (2011)
**g, X.-Y., Li, S., Li, W.-Q., Yao, Y.-F., Lan, C., Lu, J.-S., Yang, J.-Y.: Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization. Sensors 12, 5551–5571 (2012)
Yao, Y.-F., **g, X.-Y., Wong, H.-S.: Face and palmprint feature level fusion for single sample biometrics recognition. Neurocomputing 70, 1582–1586 (2007)
**g, X.-Y., Yao, Y.-F., Zhang, D., Yang, J.-Y., Li, M.: Face and palmprint pixel level fusion and Kernel DCV-RBF classifier for small sample biometric recognition. Pattern Recognit. 40, 3209–3224 (2007)
Nirmala, S., Aloka, S.: Face and palmprint multimodal biometric systems using Gabor-Wigner transform as feature extraction. Pattern Anal. Appl. (2014). doi:10.1007/s10044-014-0414-6
Eskandari, M., Toygar, Ö.: Fusion of face and iris biometrics using local and global feature extraction methods. Signal Image Video Process. 8(6), 995–1006 (2014)
Eskandari, M., Toygar, Ö., Demirel, H.: Feature extractor selection for face–iris multimodal recognition. Signal Image Video Process. 8(6), 1189–1198 (2014)
Gholam, M.S., Mansoor, A.B., Masood, H., Mumtaz, M.: Personal identification using feature and score level fusion of palm- and fingerprints. Signal Image Video Process. 5(4), 477–483 (2011)
Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)
Wei, Y., Lin, G., Sha, Y., Yonggang, D., Pan, J., Jun, W., Shijun, L.: An improved LBP algorithm for texture and face classification. Signal Image Video Process. 8(1), 155–161 (2014)
Anbarjafari, G.: Face recognition using color local binary pattern from mutually independent color channels. EURASIP J. Image Video Process. (2013). doi:10.1186/1687-5281-2013-6
Izadpanahi, S., Toygar, Ö.: Human Age Classification with Optimal Geometric Ratios and Wrinkle Analysis. Int. J. Pattern Recognit. Artif. Intell. 28(2), 1456003-1–1456003-17 (2014)
Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture meature with classification based on feature distributions. Pattern Recognit. 29, 51–59 (1996)
Nanni, L., Lumini, A., Brahnam, S.: Survey on LBP based texture descriptors for image classification. J. Expert Syst. Appl. 39, 3634–3641 (2012)
Hadid, A., Dugelay, J.L., Pietikäinen, M.: On the use of dynamic features in face biometrics: recent advances and challenges. Signal Image Video Process. 5(4), 495–506 (2011)
Civicioglu, P.: Backtracking search optimization algorithm for numerical optimization problems. Appl. Math. Comput. 219, 8121–8144 (2013)
Jain, A.K., Nandakumara, K., Ross, A.: Score normalization in multimodal biometric systems. Pattern Recognit. 38, 2270–2285 (2005)
PolyU palmprint Database. http://www.comp.polyu.edu.hk/~biometrics/
FERET database. [Online] Department of Defense’s Counterdrug Technology Development Program 1993–1997, 7441, 74–81 (2012). http://www.itl.nist.gov/iad/humanid/feret/
Shan, C., Braspenning, R.: Recognizing facial expressions automatically from video. Handb. Ambient Intell. Smart Environ. 7441, 479–509 (2010)
Ramon-Balmaseda, E., Lorenzo-Navarro, J., Castrillon-Santana, M.: Gender classification in large databases. In: 17th Iberoamerican Congress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (CIARP2012). Lecture Notes in Computer Science, vol. 7441, pp. 74–81. Springer, Berlin, Heidelberg (2012)
ORL face database, AT&T Laboratories, Cambridge University, UK. http://www.uk.research.att.com/facedatabase.html
Essex face database, vision group, University of Essex, UK. http://cswww.essex.ac.uk/mv/allfaces/index.html
Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27, 684–698 (2005)
Extended Yale Face Database B, University of Yale. http://vision.ucsd.edu/~leekc/ExtYaleDatabase/ExtYaleB.html
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Farmanbar, M., Toygar, Ö. Feature selection for the fusion of face and palmprint biometrics. SIViP 10, 951–958 (2016). https://doi.org/10.1007/s11760-015-0845-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-015-0845-6