SpringerLink
Log in

Heterogeneous Similarity Learning for More Practical Kinship Verification

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Kinship verification via facial images is a relatively new and challenging problem in computer vision. Prior studies in the literature have focused solely on gender-fixed kin relation, i.e., on the question of whether one gender-fixed kin relationship between given subjects can be established. In practice, however, large scale gender annotation is time-consuming and expensive. Instead, we propose in this paper to learn and predict with gender-unknown kin relations. To address this, we present a novel heterogeneous similarity learning (HSL) method. Motivated by the fact that different kinship relations may not only share some common genetic characteristics but also have its own inherited traits from parents to offspring, we aim to learn a similarity function under which the commonality among different kinship relations are captured and the geometry of each relation is preserved, simultaneously. We further derive a multi-view HSL method by optimal fusion of the similarity models from multiple feature representations, such that the complementary knowledge in multi-view kin data can be leveraged to obtain refined information. Experimental results demonstrate the effectiveness of our proposed methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Canada)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  MATH  Google Scholar 

  2. Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7(1):2399–2434

    MathSciNet  MATH  Google Scholar 

  3. Benavent X, Garcia-Serrano A, Granados R, Benavent J, de Ves E (2013) Multimedia information retrieval based on late semantic fusion approaches: experiments on a Wikipedia image collection. IEEE Trans Multimed 15(8):2009–2021

    Article  Google Scholar 

  4. Chechik G, Sharma V, Shalit U, Bengio S (2009) Large scale online learning of image similarity through ranking. J Mach Learn Res 11:1109–1135

    MathSciNet  MATH  Google Scholar 

  5. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1. IEEE Computer Society, Washington, DC, pp 886–893

  6. Dehghan A, Ortiz EG, Villegas R, Shah M (2014) Who do i look like? Determining parent-offspring resemblance via gated autoencoders. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE

  7. Deng J, Berg AC, Fei-Fei L (2011) Hierarchical semantic indexing for large scale image retrieval. In: CVPR ’11 Proceedings of the 2011 IEEE conference on computer vision and pattern recognition. IEEE Computer Society, Washington, DC, pp 785–792

  8. Dibeklioglu H, Salah AA, Gevers T (2013) Like father, like son: facial expression dynamics for kinship verification. In: 2013 IEEE international conference on computer vision (ICCV), pp 1497–1504

  9. Fang R, Tang KD, Snavely N, Chen T (2010) Towards computational models of kinship verification. In: 2010 IEEE international conference on image processing (ICIP). IEEE, pp 1577–1580

  10. Gao X, Hoi SCH, Zhang Y, Wan J, Li J (2014) SOML: sparse online metric learning with application to image retrieval. In: Proceedings of AAAI

  11. Ghahramani M, Yau WY, Teoh EK (2014) Family verification based on similarity of individual family members facial segments. Mach Vis Appl 25(4):919–930

    Article  Google Scholar 

  12. Guo G, Wang X (2012) Kinship measurement on salient facial features. IEEE Trans Instrum Meas 61(8):2322–2325

    Article  Google Scholar 

  13. Hu J, Lu J, Yuan J, Tan YP (2014) Large margin multimetric learning for face and kinship verification in the wild. In: Proceeding of ACCV

  14. Jiang YG, Wang J, Xue X, Chang SF (2013) Query-adaptive image search with hash codes. IEEE Trans Multimed 15(2):442–453

    Article  Google Scholar 

  15. Kohli N, Singh R, Vatsa M (2012) Self-similarity representation of weber faces for kinship classification. In: 2012 IEEE fifth international conference on biometrics: theory, applications and systems (BTAS). IEEE, pp 245–250

  16. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  17. Lu J, Hu J, Liong VE, Zhou X, Bottino A, Islam IU, Vieira TF, Qin X, Tan X, Keller Y et al (2015) The fg 2015 kinship verification in the wild evaluation. In: 2015 IEEE international conference on automatic face and gesture recognition (FG)

  18. Lu J, Zhou X, Tan YP, Shang Y, Zhou J (2014) Neighborhood repulsed metric learning for kinship verification. IEEE Trans Pattern Anal Mach Intell 36(2):331–345

    Article  Google Scholar 

  19. Ma Z, Yang Y, Sebe N, Zheng K, Hauptmann AG (2013) Multimedia event detection using a classifier-specific intermediate representation. IEEE Trans Multimed 15(7):1628–1637

    Article  Google Scholar 

  20. Platek SM, Raines DM, Gallup GG Jr, Mohamed FB, Thomson JW, Myers TE, Panyavin IS, Levin SL, Davis JA, Fonteyn L et al (2004) Reactions to children’s faces: males are more affected by resemblance than females are, and so are their brains. Evol Hum Behav 25(6):394–405

    Article  Google Scholar 

  21. Qin X, Tan X, Chen S (2015) Tri-subject kinship verification: understanding the core of a family. IEEE Trans Multimed 17(10):1855–1867

    Article  Google Scholar 

  22. Qin X, Tan X, Chen S (2016) Mixed bi-subject kinship verification via multi-view multi-task learning. Neurocomputing 214:350–357

    Article  Google Scholar 

  23. Salter F (1996) Carrier females and sender males: an evolutionary hypothesis linking female attractiveness, family resemblance, and paternity confidence. Ethol Sociobiol 17(4):211–220

    Article  Google Scholar 

  24. Shao M, Kit D, Fu Y (2014) Generalized transfer subspace learning through low-rank constraint. Int J Comput Vis 109(1–2):74–93

    Article  MathSciNet  MATH  Google Scholar 

  25. Shao M, **a S, Fu Y (2014) Identity and kinship relations in group pictures. In: Fu Y (ed) Human-centered social media analytics. Springer, Cham, pp 175–190

  26. Spyromitros-**oufis E, Papadopoulos S, Kompatsiaris I, Tsoumakas G, Vlahavas I (2014) A comprehensive study over vlad and product quantizationin large-scale image retrieval. IEEE Trans Multimed 16(6):1713–1728

    Article  Google Scholar 

  27. Sulem P, Gudbjartsson DF, Stacey SN, Helgason A, Rafnar T, Magnusson KP, Manolescu A, Karason A, Palsson A, Thorleifsson G et al (2007) Genetic determinants of hair, eye and skin pigmentation in europeans. Nat Genet 39(12):1443–1452

    Article  Google Scholar 

  28. Syed N, Patil BK, Shareq Mohd Q (2014) Understanding familial relationship in an image. Int J Sci Res Educ 2(6):1037–1045

    Google Scholar 

  29. Wang G, Gallagher A, Luo J, Forsyth D (2010) Seeing people in social context: recognizing people and social relationships. In: Computer vision–ECCV 2010. Springer, pp 169–182

  30. **a S, Shao M, Fu Y (2011) Kinship verification through transfer learning. In: Proceedings of the twenty-second international joint conference on artificial intelligence, vol 3. AAAI Press, pp 2539–2544

  31. **a S, Shao M, Fu Y (2012) Toward kinship verification using visual attributes. In: 2012 international conference on pattern recognition (ICPR). IEEE, pp 549–552

  32. **a S, Shao M, Luo J, Fu Y (2012) Understanding kin relationships in a photo. IEEE Trans Multimed 14(4):1046–1056

    Article  Google Scholar 

  33. Xu M, Shang Y (2016) Kinship verification using facial images by robust similarity learning. Math Probl Eng 2016:1–8

    Google Scholar 

  34. Xu Z, Zhang Y, Cao L (2014) Social image analysis from a non-iid perspective. IEEE Trans Multimed 16(7):1986–1998

    Article  Google Scholar 

  35. Yan H, Lu J, Deng W, Zhou X (2014) Discriminative multi-metric learning for kinship verification. IEEE Trans Inf Forensics Secur 9(7):1169–1178

    Article  Google Scholar 

  36. Yan H, Lu J, Zhou X (2014) Prototype-based discriminative feature learning for kinship verification. IEEE Trans Cybern 45:2535–2545

    Article  Google Scholar 

  37. Zhang Z, Chen Y, Saligrama V (2015) Group membership prediction. ar**v preprint ar**v:1509.04783

  38. Zhou X, Hu J, Lu J, Shang Y, Guan Y (2011) Kinship verification from facial images under uncontrolled conditions. In: Proceedings of the 19th ACM international conference on multimedia. ACM, pp 953–956

  39. Zhou X, Lu J, Hu J, Shang, Y (2012) Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. In: Proceedings of the 20th ACM international conference on multimedia. ACM, pp 725–728

  40. Zhou X, Yan H, Shang Y (2016) Kinship verification from facial images by scalable similarity fusion. Neurocomputing 197:136–142

    Article  Google Scholar 

  41. Zoidi O, Tefas A, Nikolaidis N, Pitas I (2014) Person identity label propagation in stereo videos. IEEE Trans Multimed 16(5):1358–1368

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Huaiyin Normal University, No. 111 Changjiang West Road, Huai’an, 223300, China

    **aoqian Qin

  2. Yancheng Institute of Technology, Hope Road No. 1 Middle Road, Yancheng, 224051, China

    Dakun Liu

  3. Nan**g University of Aeronautics and Astronautics, No. 29 General Road, Nan**g, 210016, China

    Dong Wang

Authors
  1. **aoqian Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dakun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to **aoqian Qin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qin, X., Liu, D. & Wang, D. Heterogeneous Similarity Learning for More Practical Kinship Verification. Neural Process Lett 47, 1253–1269 (2018). https://doi.org/10.1007/s11063-017-9694-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-017-9694-3

Keywords

Search

Navigation