Abstract
Deep convolutional neural networks have achieved great success for image denoising recently. However, increasing the depth of the neural network cannot significantly boost the performance of the algorithms for image denoising. It is still a challenging research topic to recover structural information and fine details of the images. In this paper, we put forward a convolutional neural network for single image denoising, mainly consisting of a noise map** block (NMB), a texture compensation block (TCB), and a composition block (CB). The NMB borrows a series of standard residual blocks to learn the noise map**. Specifically, we employ the TCB to enhance the details via multi-scale dilated residual blocks (MDRBs) that hold the characteristics of fusing multi-scale contexture information with dilated convolution. Finally, the CB does an element-wise addition to composite the output. Besides, we have conducted extensive experiments on gray as well as color image datasets. Both quantitative and qualitative evaluations demonstrate the superior performance of our approach in comparison with the state-of-the-art methods.
Similar content being viewed by others
References
Malik JM, Perona P (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–39
Chambolle A (2004) An algorithm for total variation minimization and applications. J Math Imaging Vision 20(1):89–97
Yicong H, Fei W, Yingsong L, **g Q, Badong C (2020) Robust matrix completion via maximum correntropy criterion and half-quadratic optimization. IEEE Trans Signal Process 68:181–195
Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), 2, 60–65. IEEE
Huang X, Du B, Liu W (2020) Multichannel color image denoising via weighted schatten p-norm minimization. In: Twenty-Ninth International Joint Conference on Artificial Intelligence and Seventeenth Pacific Rim International Conference on Artificial Intelligence IJCAI-PRICAI-20
Elad M, Aharon M (2006) Image denoising via learned dictionaries and sparse representation. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06),1, 895–900. IEEE
Mosseri I, Zontak M, Irani M (2013) Combining the power of internal and external denoising. In: IEEE international conference on computational photography (ICCP), 1–9. IEEE
Aharon M, Elad M, Bruckstein A (2006) K-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322
Dong W, Zhang L, Shi G, Li X (2012) Nonlocally centralized sparse representation for image restoration. IEEE Trans Image Process 22(4):1620–1630
Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2009) Non-local sparse models for image restoration. In: 2009 IEEE 12th international conference on computer vision, 2272–2279. IEEE
Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095
Muhammad N, Khan H, Bibi N, Usman M, Ahmed N, Khan SN, Mahmood Z (2020) Frequency component vectorisation for image dehazing. J Exp Theoretical Artif Intell 4:1–14
Muhammad N, Bibi N, Kamran M, Bashir Y, Kim DG (2020) Image noise reduction based on block matching in wavelet frame domain. Multimed Tools Appl 79(35):26327–44
Muhammad N, Bibi N, Wahab A, Mahmood Z, Kim DG (2017) Image denoising with subband replacement and fusion process using bayes estimators. Comput Electr Eng 70:413–27
**njian H, Bo D, Dapeng T, Liangpei Z (2020) Spatial-spectral weighted nuclear norm minimization for hyperspectral image denoising. Neurocomputing 399:271–284
Muhammad N, Bibi N, Jahangir A, Mahmood Z (2017) Image denoising with norm weighted fusion estimators. Pattern Anal Appl 21(4):1013–22
Zhentao Hu, Zhiqiang Huang, **njian Huang, Fulin Luo, Renzhen Ye (2019) An adaptive nonlocal gaussian prior for hyperspectral image denoising. Geoence Remote Sens Lett IEEE 16(9):1487–1491
Muhammad N, Rubab, Bibi N, Song OY, Ali S (2020) Severity recognition of aloe vera diseases using ai in tensor flow domain. Cmc-Tech Science Press, Henderson
Naz I, Muhammad N, Yasmin M, Sharif M, Shah JH, Fernandes SL (2019) Robust discrimination of leukocytes protuberant types for early diagnosis of leukemia. J Mech Med Biol 19(06):1–4
Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: Can plain neural networks compete with bm3d? In: 2012 IEEE conference on computer vision and pattern recognition, 2392–2399. IEEE
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, 1097–1105
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1–9
Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Trans Image Process 26(7):3142–3155
Zhang K, Zuo W, Zhang L (2018) Ffdnet: Toward a fast and flexible solution for cnn-based image denoising. IEEE Trans Image Process 27(9):4608–4622
Guo S, Yan Z, Zhang K, Zuo W, Zhang L (2019) Toward convolutional blind denoising of real photographs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1712–1722
Mao X, Shen C, Yang YB (2016) Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In: Advances in neural information processing systems, 2802–2810
Li D, Chen H, ** G, ** Y, Zhu C, Chen E (2020) A multiscale dilated residual network for image denoising. Multimedia Tools and Applications 1–16
Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided cnn for image denoising. Neural Netw 124:117–129
Jain V, Seung S (2009) Natural image denoising with convolutional networks. Adv Neural Inf Process Sys 21:769–776
Chen Y, Pock T (2016) Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration. IEEE Trans Pattern Anal Mach Intell 39(6):1256–1272
Wu Y, Zhao H, Zhang L (2014) Image denoising with rectified linear units. In: International Conference on Neural Information Processing, 142–149. Springer
**e J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Advances in neural information processing systems, 341–349
Liu P, Zhang H, Zhang K, Lin L, Zuo W (2018) Multi-level wavelet-cnn for image restoration. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 773–782
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778
Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1646–1654
**e S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1492–1500
Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 7132–7141
Lim B, Son S, Kim H, Nah S, Mu Lee K (2017) Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 136–144
Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y (2018) Residual dense network for image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2472–2481
Chen C, **ong Z, Tian X, Wu F (2018) Deep boosting for image denoising. In: Proceedings of the European Conference on Computer Vision (ECCV), 3–18
Yu F, Koltun V (2015) Multi-scale context aggregation by dilated convolutions. ar**v preprint ar**v:1511.07122
Dong L, Zhang H, Ji Y, Ding Y (2020) Crowd counting by using multi-level density-based spatial information: A Multi-scale CNN framework. Inf Sci 528:79–91
Wang T, Sun M, Hu K (2017) Dilated deep residual network for image denoising. In: 2017 IEEE 29th international conference on tools with artificial intelligence (ICTAI), 1272–1279. IEEE
Peng Y, Zhang L, Liu S, Wu X, Zhang Y, Wang X (2019) Dilated residual networks with symmetric skip connection for image denoising. Neurocomputing 345:67–76
Tian C, Xu Y, Zuo W (2020) Image denoising using deep cnn with batch renormalization. Neural Netw 121:461–473
Wang P, Chen P, Yuan Y, Liu D, Huang Z, Hou X (2018) Cottrell G Understanding convolution for semantic segmentation. In: 2018 IEEE winter conference on applications of computer vision (WACV), 1451–1460. IEEE
Kingma DP, Ba J Adam (2014) A method for stochastic optimization. ar**v preprint ar**v:1412.6980
Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, 2, 416–423. IEEE
Ma K, Duanmu Z, Wu Q, Wang Z, Yong H, Li H, Zhang L (2016) Waterloo exploration database: New challenges for image quality assessment models. IEEE Trans Image Process 26(2):1004–1016
Zoran D, Weiss Y (2011) From learning models of natural image patches to whole image restoration. In: 2011 International Conference on Computer Vision, 479–486. IEEE
Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2862–2869
Ulyanov D, Vedaldi A, Lempitsky V Deep image prior. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
Papyan V, Romano Y, Sulam J, Elad M (2017) Convolutional dictionary learning via local processing
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, D., Li, P., Zhao, L. et al. Texture compensation with multi-scale dilated residual blocks for image denoising. Neural Comput & Applic 33, 12957–12971 (2021). https://doi.org/10.1007/s00521-021-05920-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-021-05920-z