SpringerLink
Log in

Towards Evolutionary Super-Resolution

  • Conference paper
  • First Online:
Applications of Evolutionary Computation (EvoApplications 2018)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10784))

Abstract

Super-resolution reconstruction (SRR) allows for producing a high-resolution (HR) image from a set of low-resolution (LR) observations. The majority of existing methods require tuning a number of hyper-parameters which control the reconstruction process and configure the imaging model that is supposed to reflect the relation between high and low resolution. In this paper, we demonstrate that the reconstruction process is very sensitive to the actual relation between LR and HR images, and we argue that this is a substantial obstacle in deploying SRR in practice. We propose to search the hyper-parameter space using a genetic algorithm (GA), thus adapting to the actual relation between LR and HR, which has not been reported in the literature so far. The results of our extensive experimental study clearly indicate that our GA improves the capacities of SRR. Importantly, the GA converges to different values of the hyper-parameters depending on the applied degradation procedure, which is confirmed using statistical tests.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (Brazil)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (Brazil)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (Brazil)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Zhu, H., Song, W., Tan, H., Wang, J., Jia, D.: Super resolution reconstruction based on adaptive detail enhancement for ZY-3 satellite images. In: Proceedings ISPRS Congress, pp. 213–217 (2016)

    Google Scholar 

  2. Yang, F., Chen, Y., Wang, R., Zhang, Q.: Super-resolution microwave imaging: time-domain tomography using highly accurate evolutionary optimization method. In: Proceedings EuCAP, pp. 1–4. IEEE (2015)

    Google Scholar 

  3. Jiang, J., Hu, R., Wang, Z., Han, Z.: Face super-resolution via multilayer locality-constrained iterative neighbor embedding and intermediate dictionary learning. IEEE Trans. Image Process. 23(10), 4220–4231 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  4. Lukinavičius, G., Umezawa, K., Olivier, N., Honigmann, A., Yang, G., Plass, T., Mueller, V., Reymond, L., Corrêa Jr., I.R., Luo, Z.G., et al.: A near-infrared fluorophore for live-cell super-resolution microscopy of cellular proteins. Nature Chem. 5(2), 132–139 (2013)

    Article  Google Scholar 

  5. Capel, D., Zisserman, A.: Super-resolution enhancement of text image sequences. In: Proceedings IEEE ICPR, vol. 1, pp. 600–605

    Google Scholar 

  6. Demirel, H., Anbarjafari, G.: Discrete wavelet transform-based satellite image resolution enhancement. IEEE Trans. Geosci. Remote Sens. 49(6), 1997–2004 (2011)

    Article  MATH  Google Scholar 

  7. Qian, S.E., Chen, G.: Enhancing spatial resolution of hyperspectral imagery using sensor’s intrinsic keystone distortion. IEEE Trans. Geosci. Remote Sens. 50(12), 5033–5048 (2012)

    Article  Google Scholar 

  8. Li, L., Zhang, Y., Tian, Q.: Multi-face location on embedded dsp image processing system. In: Proceedings CISP, vol. 4, pp. 124–128 (2008)

    Google Scholar 

  9. Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9006, pp. 111–126. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16817-3_8

  10. Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings IEEE CVPR, pp. 5197–5206 (2015)

    Google Scholar 

  11. Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016)

    Article  Google Scholar 

  12. Liebel, L., Körner, M.: Single-image super resolution for multispectral remote sensing data using convolutional neural networks. In: Proceedings ISPRS Congress, pp. 883–890 (2016)

    Google Scholar 

  13. Kim, J., Kwon Lee, J., Mu Lee, K.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings IEEE CVPR, pp. 1646–1654 (2016)

    Google Scholar 

  14. Efrat, N., Glasner, D., Apartsin, A., Nadler, B., Levin, A.: Accurate blur models vs. image priors in single image super-resolution. In: Proceedings IEEE ICCV, pp. 2832–2839 (2013)

    Google Scholar 

  15. Nasrollahi, K., Moeslund, T.B.: Super-resolution: a comprehensive survey. Mach. Vis. Appl. 25(6), 1423–1468 (2014)

    Article  Google Scholar 

  16. Panagiotopoulou, A., Anastassopoulos, V.: Super-resolution image reconstruction techniques: trade-offs between the data-fidelity and regularization terms. Inf. Fusion 13(3), 185–195 (2012)

    Article  Google Scholar 

  17. Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP. Graph. Mod. Image Process. 53(3), 231–239 (1991)

    Article  Google Scholar 

  18. Schultz, R.R., Stevenson, R.L.: Extraction of high-resolution frames from video sequences. IEEE Trans. Image Process. 5(6), 996–1011 (1996)

    Article  Google Scholar 

  19. Wang, Y., Fevig, R., Schultz, R.R.: Super-resolution mosaicking of UAV surveillance video. In: Proceedings IEEE ICIP, pp. 345–348. IEEE (2008)

    Google Scholar 

  20. Akgun, T., Altunbasak, Y., Mersereau, R.M.: Super-resolution reconstruction of hyperspectral images. IEEE Trans. Image Process. 14(11), 1860–1875 (2005)

    Article  Google Scholar 

  21. Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)

    Article  Google Scholar 

  22. Hardie, R.: A fast image super-resolution algorithm using an adaptive wiener filter. IEEE Trans. Image Process. 16(12), 2953–2964 (2007)

    Article  MathSciNet  Google Scholar 

  23. Li, F., Jia, X., Fraser, D.: Universal HMT based super resolution for remote sensing images. In: Proceedings IEEE ICIP, pp. 333–336 (2008)

    Google Scholar 

  24. Ahrens, B.: Genetic algorithm optimization of superresolution parameters. In: Proceedings GECCO, pp. 2083–2088. ACM (2005)

    Google Scholar 

  25. Cheng, M.H., Hwang, K.S., Jeng, J.H., Lin, N.W.: PSO-based fusion method for video super-resolution. J. Sign. Proces. Syst. 73(1), 25–42 (2013)

    Article  Google Scholar 

  26. Wu, B., Li, C., Zhan, X.: Integrating spatial structure in super-resolution map** of hyper-spectral image. Procedia Eng. 29, 1957–1962 (2012)

    Article  Google Scholar 

  27. Zhong, Y., Zhang, L.: Remote sensing image subpixel map** based on adaptive differential evolution. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 42(5), 1306–1329 (2012)

    Article  Google Scholar 

  28. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Proces. 13, 600–612 (2004)

    Article  Google Scholar 

  29. Kawulok, M., Smolka, B.: Texture-adaptive image colorization framework. EURASIP J. Adv. Sign. Proces. 2011(99) (2011)

    Google Scholar 

  30. Kawulok, M., Benecki, P., Nalepa, J., Kostrzewa, D., Skonieczny, L.: Towards robust evaluation of super-resolution satellite image reconstruction. In: ACIIDS 2018, Part I. LNAI, vol. 10751. Springer, Cham (2018)

    Google Scholar 

  31. Yue, L., Shen, H., Li, J., Yuan, Q., Zhang, H., Zhang, L.: Image super-resolution: the techniques, applications, and future. Sig. Process. 128, 389–408 (2016)

    Article  Google Scholar 

  32. Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  33. Arcuri, A., Briand, L.: A practical guide for using statistical tests to assess randomized algorithms in software engineering. In: Proceedings ICSE, pp. 1–10. IEEE (2011)

    Google Scholar 

  34. Fister, I., Fister, I.: On the mutation operators in evolution strategies. In: Fister, I., Fister Jr., I. (eds.) Adaptation and Hybridization in Computational Intelligence. ALO, vol. 18, pp. 69–89. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-14400-9_3

  35. Lorenzo, P.R., Nalepa, J., Kawulok, M., Ramos, L.S., Pastor, J.R.: Particle swarm optimization for hyper-parameter selection in deep neural networks. In: Proceedings GECCO, pp. 481–488. ACM, New York (2017)

    Google Scholar 

Download references

Acknowledgments

The reported work is a part of the SISPARE project run by Future Processing and funded by European Space Agency. The authors were partially supported by Institute of Informatics funds no. BK-230/RAu2/2017 (MK) and BKM-509/RAu2/2017 (DK).

Author information

Authors and Affiliations

  1. Future Processing, Gliwice, Poland

    Michal Kawulok, Pawel Benecki, Daniel Kostrzewa & Lukasz Skonieczny

  2. Silesian University of Technology, Gliwice, Poland

    Michal Kawulok, Pawel Benecki & Daniel Kostrzewa

Authors
  1. Michal Kawulok
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pawel Benecki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniel Kostrzewa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lukasz Skonieczny
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michal Kawulok .

Editor information

Editors and Affiliations

  1. Edinburgh Napier University, Edinburgh, United Kingdom

    Kevin Sim

  2. Johannes Gutenberg University of Mainz, Mainz, Germany

    Paul Kaufmann

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kawulok, M., Benecki, P., Kostrzewa, D., Skonieczny, L. (2018). Towards Evolutionary Super-Resolution. In: Sim, K., Kaufmann, P. (eds) Applications of Evolutionary Computation. EvoApplications 2018. Lecture Notes in Computer Science(), vol 10784. Springer, Cham. https://doi.org/10.1007/978-3-319-77538-8_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77538-8_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77537-1

  • Online ISBN: 978-3-319-77538-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation