SpringerLink
Log in

Face Sketch Recognition via Data-Driven Synthesis

  • Chapter
  • First Online:
Handbook of Biometrics for Forensic Science

Part of the book series: Advances in Computer Vision and Pattern Recognition ((ACVPR))

  • 2113 Accesses

Abstract

In some real-world scenarios, there does not always exist a normal photo for face recognition or retrieval purpose, e.g. suspect searching for law enforcement. Under the circumstances, a sketch drawn by the artist is usually taken as the substitute for matching with the mug shot photos collected by the police office. However, due to the great discrepancy of the texture presentation between sketches and photos, common face recognition methods achieve limited performance on this task. In order to shrink this gap, sketches can be transformed to photos relying on some machine learning techniques and then synthesized photos are utilized to match with mug shot photos. Alternatively, photos can also be transformed to sketches and the probe sketch drawn by the artist is matched with the transformed sketches subsequently. Existing learning-based face sketch–photo synthesis methods are grouped into two major categories: data-driven methods (example-based methods) and model-based methods. This chapter would give a comprehensive analysis and comparison to advances on this topic.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 71.68
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 90.94
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info
Hardcover Book
EUR 128.39
Price includes VAT (Germany)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.adobe.com/products/photoshop.html.

  2. 2.

    http://xiuxiu.web.meitu.com/.

  3. 3.

    http://paperartist.net/.

References

  1. Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans Pattern Anal Mach Intell 24(9):1167–1183

    Article  Google Scholar 

  2. Chang L, Zhou M, Deng X, Han Y (2011) Face sketch synthesis via multivariate output regression. In: Proceedings of international conference on human-computer interaction, pp 555–561

    Google Scholar 

  3. Chang L, Zhou M, Han Y, Deng X (2010) Face sketch synthesis via sparse representation. In: Proceedings of international conference on pattern recognition, pp 2146–2149

    Google Scholar 

  4. Chen L, Liao H, Ko M, Lin J, Yu G (2000) A new lda-based face recognition system which can solve the small sample size problem. Pattern Recognit 33(10):1713–1726

    Article  Google Scholar 

  5. Elad M, Aharon M (2006) Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans Image Process 15(12):3736–3745

    Article  MathSciNet  Google Scholar 

  6. Gao X, Wang N, Tao D, Li X (2012) Face sketch-photo synthesis and retrieval using sparse representation. IEEE Trans Circuits Syst Video Technol 22(8):1213–1226

    Article  Google Scholar 

  7. Gao X, Zhong J, Li J, Tian C (2008) Face sketch synthesis algorithm using e-hmm and selective ensemble. IEEE Trans Circuits Syst Video Technol 18(4):487–496

    Article  Google Scholar 

  8. Gao X, Zhong J, Tao D, Li X (2008) Local face sketch synthesis learning. Neurocomputing 71(10–12):1921–1930

    Article  Google Scholar 

  9. Geng B, Tao D, Xu C, Yang L, Hua X (2012) Ensemble manifold regularization. IEEE Trans Pattern Anal Mach Intell 34(6):1227–1233

    Article  Google Scholar 

  10. Li X, Cao X (2012) A simple framework for face photo-sketch synthesis. Math Probl Eng:1–19

    Google Scholar 

  11. Liu Q, Tang X, ** H, Lu H, Ma S (2005) A nonlinear approach for face sketch synthesis and recognition. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1005–1010

    Google Scholar 

  12. Mairal J, Sapiro G, Elad M (2008) Learning multiscale sparse representations for image and video restoration. SIAM Multiscale Model Simul 17:214–241

    Article  MathSciNet  MATH  Google Scholar 

  13. Martinez A, Benavente R (1998) The ar face database. Technical report, CVC Technical Report #24

    Google Scholar 

  14. Messer K, Matas J, Kittler J, Luettin J, Maitre G (1999) Xm2vtsdb: the extended m2vts database. In: Proceedings of international conference on audio- and video-based biometric person authentication, pp 72–77

    Google Scholar 

  15. Peng C, Gao X, Wang N, Tao D, Li X, Li J (2015) Multiple representations based face sketch-photo synthesis. IEEE Trans Neural Netw Learn Syst:1–13

    Google Scholar 

  16. Tang X, Wang X (2002) Face photo recognition using sketches. In: Proceedings of IEEE international conference on image processing, pp 257–260

    Google Scholar 

  17. Tang X, Wang X (2003) Face sketch synthesis and recognition. In: Proceedings of IEEE international conference on computer vision, pp 687–694

    Google Scholar 

  18. Tang X, Wang X (2004) Face sketch recognition. IEEE Trans Circuits Syst Video Technol 14(1):1–7

    Article  Google Scholar 

  19. Turk M, Pentland A (1991) Face recognition using eigenfaces. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 586–591

    Google Scholar 

  20. Wang N, Li J, Tao D, Li X, Gao X (2013) Heterogeneous image transformation. Pattern Recognit Lett 34(1):77–84

    Article  Google Scholar 

  21. Wang N, Tao D, Gao X, Li X, Li J (2013) Transductive face sketch-photo synthesis. IEEE Trans Neural Netw Learn Syst 24(9):1364–1376

    Article  Google Scholar 

  22. Wang N, Tao D, Gao X, Li X, Li J (2014) A comprehensive survey to face hallucination. Int J Comput Vision 106(1):9–30

    Article  Google Scholar 

  23. Wang S, Zhang L, Liang Y, Pan Q (2012) Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 2216–2223

    Google Scholar 

  24. Wang X, Tang X (2009) Face photo-sketch synthesis and recognition. IEEE Trans Pattern Anal Mach Intell 31(11):1955–1967

    Article  Google Scholar 

  25. **ao B, Gao X, Tao D, Li X (2009) A new approach for face recognition by sketches in photos. Signal Process 89(8):1576–1588

    Article  MATH  Google Scholar 

  26. **ao B, Gao X, Tao D, Yuan Y, Li J (2010) Photo-sketch synthesis and recognition based on subspace learning. Neurocomputing 73(4–6):840–852

    Article  Google Scholar 

  27. Yang J, Wright J, Huang T, Ma, Y.: Image super-resolution as sparse representation of raw image patches. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1–8

    Google Scholar 

  28. Zhang S, Gao X, Wang N, Li J, Zhang M (2015) Face sketch synthesis via sparse representation-based greedy search. IEEE Trans Image Process 24(8):2466–2477

    Article  MathSciNet  Google Scholar 

  29. Zhang W, Wang X, Tang X (2010) Lighting and pose robust face sketch synthesis. In: Proceedings of European conference on computer vision, pp 420–423

    Google Scholar 

  30. Zhao W, Chellappa R, Phillips P, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458

    Article  Google Scholar 

  31. Zhong J, Gao X, Tian C (2007) Face sketch synthesis using e-hmm and selective ensemble. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing, pp 485–488

    Google Scholar 

  32. Zhou H, Kuang Z, Wong K (2012) Markov weight fields for face sketch synthesis. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1091–1097

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (under Grant 61501339 and 61671339).

Author information

Authors and Affiliations

  1. State Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, **dian University, No. 2 Taibai South Road, Yanta District, **’an, 710071, People’s Republic of China

    Nannan Wang

  2. Lab of Video & Image Processing Systems, School of Electronic Engineering, **dian University, No. 2 Taibai South Road, Yanta District, **’an, 710071, People’s Republic of China

    Shengchuan Zhang, Chunlei Peng, Jie Li & **nbo Gao

Authors
  1. Nannan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shengchuan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chunlei Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. **nbo Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to **nbo Gao .

Editor information

Editors and Affiliations

  1. University of Sassari, Alghero, Sassari, Italy

    Massimo Tistarelli

  2. University of Lausanne, Lausanne, Switzerland

    Christophe Champod

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Wang, N., Zhang, S., Peng, C., Li, J., Gao, X. (2017). Face Sketch Recognition via Data-Driven Synthesis. In: Tistarelli, M., Champod, C. (eds) Handbook of Biometrics for Forensic Science. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-50673-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-50673-9_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-50671-5

  • Online ISBN: 978-3-319-50673-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation