浏览全部资源
扫码关注微信
Received：14 March 2019，
Revised：2019-5-10，
Accepted：17 May 2019，
Published：16 November 2019
移动端阅览
目的
2
大多数图像降噪算法都属于非盲降噪算法，其获得良好降噪性能的前提是能够准确地获知图像的噪声水平值。然而，现有的噪声水平估计（NLE）算法在噪声水平感知特征（NLAF）提取和噪声水平值映射两个核心模块中分别存在特征描述能力不足和预测准确性有待提高的问题。为此，提出了一种基于卷积神经网络（CNN）自动提取NLAF特征，并利用增强BP（back propagation）神经网络将其映射为相应噪声水平值的改进算法。
方法
2
在训练阶段，首先通过训练卷积神经网络模型并以全连接层中若干与噪声水平值相关系数较高的输出值构成NLAF特征矢量；然后，在AdaBoost技术的支撑下，利用多个映射能力相对较弱的BP神经网络构建一个非线性映射能力更强的增强BP神经网络预测模型，将NLAF特征矢量直接映射为噪声水平值。在预测阶段，首先从给定噪声图像中随机选取若干个图块输入到卷积神经网络模型中，提取每个图块的若干维NLAF特征值后，利用预先训练的BP网络模型将其映射为对应的噪声水平值，然后以估计值的中值作为图像噪声水平值的最终估计结果。
结果
2
对于具有不同噪声水平和内容结构的噪声图像，利用所提算法估计出的噪声水平值与真实值之间的估计误差小于0.5，均方根误差小于0.9，表现出良好的预测准确性和稳定性。此外，所提算法具有较高的执行效率，估计一幅512×512像素的图像的噪声水平值仅需约13.9 ms。
结论
2
实验数据表明，所提算法在高、中、低各个噪声水平下都具有稳定的预测准确性和较高的执行效率，与现有的主流噪声水平估计算法相比综合性能更佳，可以很好地应用于要求噪声水平作为关键参数的实际应用中。
Objective
2
Image denoising is a fundamental but challenging problem in low-level vision and image processing. Most existing image-denoising methods can be classified as so-called non-blind approaches
which are assumed to work under the premise of the availability of noise level. Thus
their denoising performance highly depends on the accuracy of the noise level fed into them. In practice
however
noise level is always unknown beforehand. As a result
fast and accurate noise level estimation (NLE) is often necessary for blind image denoising. To date
training-based NLE methods using handcrafted features that reflect the distortion level of a noisy image
i.e.
noise level-aware features (NLAFs)
still suffer from the weak ability of feature description and the low accuracy of nonlinear mapping in NLAF extraction and noise level-mapping modules
respectively. To this end
an NLE algorithm that automatically extracts NLAFs with a convolutional neural network (CNN) and directly maps the NLAFs to their corresponding noise level using AdaBoost backpropagation (BP) neural network was proposed.
Method
2
Substantially clean images were first corrupted with Gaussian noise at different noise levels to form a set of noisy images. The noisy patches extracted from the noisy images and their corresponding noise levels were then fed into a CNN to train a CNN-based NLE model. However
the CNN-based NLE model directly used to obtain the noise level of a noisy image had poor estimation accuracy. The major reasons were as follows: 1) no strong correlation between most of the output values of the fully connected layer of the CNN-based NLE model and the noise levels
and 2) an inadequate nonlinear mapping ability of the regression layer used to predict noise level in the CNN-based NLE model. Therefore
the correlation between the output values of the fully connected layer and the ground truths was analyzed and then several outputs that had higher correlation coefficient with the ground-truth noise levels were selected as the NLAFs in the form of feature vector. With the support of the AdaBoost technique
multiple BP neural networks with relative weak mapping ability were combined to build a strong nonlinear mapping prediction model
i.e.
enhanced BP network
and the obtained prediction model was used to map the extracted NLAFs to their corresponding noise level directly. In the prediction phase
given a noisy image to be denoised
several patches were first randomly extracted and then fed into the trained CNN-based NLE model. Next
several NLAFs were extracted from the fully connected layer of the CNN-based model. The extracted NLAFs were subsequently approximated to corresponding estimated noise levels via the enhanced BP neural network. Finally
the median value of the patch noise levels was taken as the final estimate of the entire image
which could effectively solve the over and underestimation problems and greatly improve the execution efficiency.
Result
2
Comparison experiments were conducted to test the validity of the proposed method from three aspects
namely
estimation accuracy
denoising effect
and execution efficiency. The proposed method was compared with several state-of-the-art NLE methods to demonstrate the estimation accuracy. The CNN-based NLE model used to automatically extract NLAFs in this work was also compared. These competing NLE methods were performed on two test image sets
namely
1) 10 commonly used images
including Cameraman
House
Pepper
Monarch
Plane
Lena
Barbara
Couple
Man
and Boat; and 2) 50 textured images borrowed from the BSD database (different from training). For a fair comparison
all methods were implemented in the environment of MATLAB 2017b
which ran on Inter (R) Core (TM) i7-3770 CPU @ 3.4 GHz RAM 8 GB. For noisy images with different noise levels and texture structures
the estimation error between the noise levels estimated by the proposed method and the ground truths was less than 0.5
and the root mean square error between the noise levels estimated by the proposed method and the ground truths was less than 0.9 across different noise levels (i.e.
5
15
35
55
75
and 95). These results indicated satisfactory and robust estimation accuracy. In denoising comparison
noise levels different from ones used in the training phase
i.e.
7.5
17.5
37.5
57.5
77.5
and 97.5
were added to 10 commonly used clean images. The classic benchmark denoising algorithm
block matching and 3D filtering (BM3D)
was adopted to restore noisy images of the test set. The peak signal-to-noise ratio results obtained by the BM3D algorithm fed into ground truths and estimated noise levels were nearly equal. The proposed NLE algorithm also had high execution efficiency and took only 13.9 ms to estimate the noise level for an image 512×512 pixels in size.
Conclusion
2
Experimental results demonstrate that the proposed NLE algorithm competes efficiently with the reference counterparts across different noise levels and image contents in terms of estimation accuracy and computational complexity. Unlike the previous training-based NLE algorithm with respect to NLAF extraction
the proposed algorithm is purely data-driven and does not rely on handcrafted features or other types of prior domain knowledge. These advantages make the proposed algorithm a preferable candidate for practical denoising. After the proposed NLE method is used as a preprocessing module
non-blind denoising algorithms can obtain good denoising performance when the noise level is required as the key parameter.
Xu S P, Zhang X Q, Jiang Y N, et al. Noise level estimation based on local means and its application to the blind BM3D denoising algorithm[J]. Journal of Image and Graphics, 2017, 22(4):422-434.
徐少平, 张兴强, 姜尹楠, 等.局部均值噪声估计的盲3维滤波降噪算法[J].中国图象图形学报, 2017, 22(4):422-434.[DOI:10.11834/jig.20170402]
Dabov K, Foi A, Katkovnik V, et al. Image denoising by sparse 3-D transform-domain collaborative filtering[J]. IEEE Transactions on Image Processing, 2007, 16(8):2080-2095.[DOI:10.1109/TIP.2007.901238]
Xie Y, Gu S H, Liu Y, et al. Weighted Schatten p-norm minimization for image denoising and background subtraction[J]. IEEE Transactions on Image Processing, 2016, 25(10):4842-4857.[DOI:10.1109/TIP.2016.2599290]
Zoran D, Weiss Y. Scale invariance and noise in natural images[C]//Proceedings of the 12th IEEE International Conferen ce on Computer Vision. Kyoto, Japan: IEEE, 2009: 2209-2216.[ DOI: 10.1109/ICCV.2009.5459476 http://dx.doi.org/10.1109/ICCV.2009.5459476 ]
Dong L, Zhou J T. Noise level estimation for natural images based on scale-invariant kurtosis and piecewise stationarity[J]. IEEE Transactions on Image Processing, 2017, 26(2):1017-1030.[DOI:10.1109/TIP.2016.2639447]
Liu X H, Tanaka M, Okutomi M. Single-image noise level estimation for blind denoising[J]. IEEE Transactions on Image Processing, 2013, 22(12):5226-5237.[DOI:10.1109/TIP.2013.2283400]
Pyatykh S, Hesser J, Zheng L. Image noise level estimation by principal component analysis[J]. IEEE Transactions on Image Processing, 2013, 22(2):687-699.[DOI:10.1109/TIP.2012.2221728]
Chen G Y, Zhu F Y, Heng P A. An efficient statistical method for image noise level estimation[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 477-485.[ DOI: 10.1109/ICCV.2015.62 http://dx.doi.org/10.1109/ICCV.2015.62 ]
Xu S P, Zeng X X, Tang Y L. Fast noise level estimation algorithm based on two-stage support vector regression[J]. Journal of Computer-Aided Design&Computer Graphics, 2018, 30(3):447-458.
徐少平, 曾小霞, 唐祎玲.基于两阶段支持向量回归的快速噪声水平估计算法[J].计算机辅助设计与图形学学报, 2018, 30(3):447-458.[DOI:10.3724/SP.J.1089.2018.16422]
Hu F, Xia G S, Wang Z F, et al. Unsupervised feature learning via spectral clustering of multidimensional patches for remotely sensed scene classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(5):2015-2030.[DOI:10.1109/JSTARS.2015.2444405]
Zhu H G, Chen X G, Dai W Q, et al. Orientation robust object detection in aerial images using deep convolutional neural network[C]//Proceedings of 2015 IEEE International Conference on Image Processing. Quebec City, Canada: IEEE, 2015: 3735-3739.[ DOI: 10.1109/ICIP.2015.7351502 http://dx.doi.org/10.1109/ICIP.2015.7351502 ]
Ren J J, Fang X Y, Chen S W, et al. Image deblurring based on fast convolutional neural networks[J]. Journal of Computer-Aided Design&Computer Graphics, 2017, 29(8):1444-1456.
任静静, 方贤勇, 陈尚文, 等.基于快速卷积神经网络的图像去模糊[J].计算机辅助设计与图形学学报, 2017, 29(8):1444-1456.[DOI:10.3969/j.issn.1003-9775.2017.08.007]
Long Y, Gong Y P, Xiao Z F, et al. Accurate object localization in remote sensing images based on convolutional neural networks[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(5):2486-2498.[DOI:10.1109/TGRS.2016.2645610]
Akcay S, Kundegorski M E, Willcocks C G, et al. Using deep convolutional neural network architectures for object classification and detection within X-ray baggage security imagery[J]. IEEE Transactions on Information Forensics and Security, 2018, 13(9):2203-2215.[DOI:10.1109/TIFS.2018.2812196]
Zhang M M, Li W, Du Q. Diverse region-based CNN for hyperspectral image classification[J]. IEEE Transactions on Image Processing, 2018, 27(6):2623-2634.[DOI:10.1109/TIP.2018.2809606]
Liu F Y, Shen C H, Lin G S. Deep convolutional neural fields for depth estimation from a single image[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 5162-5170.[ DOI: 10.1109/CVPR.2015.7299152 http://dx.doi.org/10.1109/CVPR.2015.7299152 ]
Zhou F Y, Jin L P, Dong J. Review of convolutional neural network[J]. Chinese Journal of Computers, 2017, 40(6):1229-1251.
周飞燕, 金林鹏, 董军.卷积神经网络研究综述[J].计算机学报, 2017, 40(6):1229-1251.[DOI:10.11897/SP.J.1016.2017.01229]
Chang L, Deng X M, Zhou M Q, et al. Convolutional neural networks in image understanding[J]. Acta Automatica Sinica, 2016, 42(9):1300-1312.
常亮, 邓小明, 周明全, 等.图像理解中的卷积神经网络[J].自动化学报, 2016, 42(9):1300-1312.[DOI:10.16383/j.aas.2016.c150800]
Arbelaez P, Maire M, Fowlkes C, et al. Contour detection and hierarchical image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(5):898-916.[DOI:10.1109/TPAMI.2010.161]
Zhang L, Zhang L, Mou X Q, et al. A comprehensive evaluation of full reference image quality assessment algorithms[C]//Proceedings of the 19th IEEE International Conference on Image Processing. Orlando, FL, USA: IEEE, 2012: 1477-1480.[ DOI: 10.1109/ICIP.2012.6467150 http://dx.doi.org/10.1109/ICIP.2012.6467150 ]
Baig M M, Awais M M, El-Alfy E S M. AdaBoost-based artificial neural network learning[J]. Neurocomputing, 2017, 248:120-126.[DOI:10.1016/j.neucom.2017.02.077]
Immerkær J. Fast noise variance estimation[J]. Computer Vision and Image Understanding, 1996, 64(2):300-302.[DOI:10.1006/cviu.1996.0060]
Yang S M, Tai S C. Fast and reliable image-noise estimation using a hybrid approach[J]. Journal of Electronic Imaging, 2010, 19(3):#033007.[DOI:10.1117/1.3476329]
Rakhshanfar M, Amer M A. Estimation of Gaussian, Poissonian-Gaussian, and processed visual noise and its level function[J]. IEEE Transactions on Image Processing, 2016, 25(9):4172-4185.[DOI:10.1109/TIP.2016.2588320]
相关文章
相关作者
相关机构
京公网安备11010802024621
