局部特定空间关系统计特征的RVIN噪声检测器
Random-valued impulse noise detector using local spatial structure statistics
- 2020年25卷第12期 页码:2494-2504
收稿:2019-12-06,
修回:2020-5-13,
录用:2020-5-20,
纸质出版:2020-12-16
DOI: 10.11834/jig.190657
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-12-06,
修回:2020-5-13,
录用:2020-5-20,
纸质出版:2020-12-16
移动端阅览
目的
2
随机脉冲噪声(random-valued impulse noise,RVIN)检测器将局部图像统计值(local image statistics,LIS)作为图块中心像素点是否为噪声的判断依据,但LIS的描述能力较弱,在不同程度上制约了RVIN检测器的检测正确率,影响了后续开关型降噪模块的修复效果。为此,提出了一种基于局部特定空间关系统计特征的RVIN噪声检测器。
方法
2
以局部中心像素点的8个邻域像素对数差值排序值(rank-ordered logarithmic difference,ROLD)并结合1个最小方向对数差值(minimum orientation logarithmic difference,MOLD)共9个反映局部特定空间关系的LIS统计值构成描述中心像素点是否为RVIN的噪声感知特征矢量,并通过在大量样本图块数据上提取的RVIN噪声感知特征矢量及其对应的噪声标签作为训练对(training pairs),训练获得一个基于多层感知网络(multi-layer perception,MLP)的RVIN噪声检测器。
结果
2
对比实验从检测正确率和实际应用效果2个方面检验所提出的RVIN检测器的有效性,分别在10幅常用图像和50幅BSD(Berkeley segmentation data)纹理图像上进行测试,并与经典的脉冲噪声降噪算法中包含的噪声检测器以及MLPNNC(MLP neural network classifier)噪声检测器相比较,以漏检数、误检数和错检总数作为评价噪声检测正确率的指标。在常用图像集上本文所提RVIN检测器的漏检数和误检数较为平衡,在错检总数上排名处于所有对比算法中的前2名,为后续的降噪模块打下了很好的基础。在BSD纹理图像集上,将本文提出的RVIN检测器和GIRAF(generic iteratively reweighted annihilating filter)算法组合构成一种RVIN噪声降噪算法(proposed-GIRAF),proposed-GIRAF算法在50幅BSD图像上的峰值信噪比(peak signal-to-noise ratio,PSNR)均值在各个噪声比例下均取得了最优结果,与排名第2的对比算法相比,提升了0.471.96 dB。实验数据表明,所提出的RVIN噪声检测器的检测正确率优于现有的检测器,与修复算法联用后即可获得一种降噪效果更佳的开关型RVIN降噪算法。
结论
2
本文提出的RVIN噪声检测器在各个噪声比例下具有鲁棒的预测准确性,配合GIRAF算法使用后,与经典的RVIN降噪算法相比,降噪效果最佳,具有很强的实用性。
Objective
2
Random-valued impulse noise (RVIN) is a common cause of image degradation that is frequently observed in images captured by digital camera sensors. In addition to degrading image quality
this type of noise also leads to pixel failure and inaccurate storage location or transmission. The presence of impulse noise may also introduce difficulties in feature extraction
target tracking
image classification
and subsequent image processing and analysis works. For RVIN
the noise value of a corrupted pixels uniformly distributed between 0 and 255. In this case
detecting the RVIN is very difficult. The available local image statistics for RVIN detection
which are used to determine whether the center pixel of an image patch is corrupted by RVIN noise or not
have are latively weak description ability
thereby restricting their accuracy to some extent and affecting the restoration performance of subsequent switching RVIN denoising modules.
Method
2
Nine local image statistics
including eight neighbor rank-ordered logarithmic difference (ROLD) statistics and one min-imum orientation logarithmic difference (MOLD) statistics
were used to construct a highly sensitive RVIN noise-aware feature vector that can describe the RVIN likeness of the center pixel of a given patch. Based on this vector
RVIN noise-aware feature vectors extracted from numerous noisy patches
their corresponding noise labels were formed as a set of training pairs for a multi-layer perception (MLP) network
and the MLP-based RVIN detector was trained.
Result
2
Comparative experiments were performed to test the estimation accuracy and denoising effect of the proposed RVIN detector. The proposed detector was compared with several state-of-the-art image denoising methods
including progressive switching median filter(PSMF)
ROLD-edge preserving regularization(ROLD-EPR)
adaptive switching median(ASWM)
robust outlyingness ratio nonlocal means(ROR-NLM)
MLP-edge preserving regularization(MLP-EPR)
convolutional neural network based(CNN-based)
blind convolutional neural network(BCNN)
and MLP neural network classifier(MLPNNC)
to demonstrate its estimation accuracy. Two image sets were used in the experiments. One image set included the "Lena"
"House"
"Peppers"
"Couple"
"Hill"
"Barbara"
"Boat"
"Man"
"Cameraman"
and "Monarch" images
whereas the other set contained 50 textured images that were randomly selected from the BSD database(unlike the noise detection model training set). For a fair comparison
all competing algorithms were implemented in the MATLAB 2017b environment on the same hardware platform. To verify the estimation accuracy of the proposed RVIN detector
we applied different RVIN noise ratios to images taken from commonly used image sets
applied the proposed detector to count the instances of error
false
and missed detections for a noisy image
and compared its performance with that of existing classical RVIN noise reduction algorithms. Usually
a higher rate of error detection indicates that more noise has been left undetected in an image
and a false detection can reduce the noise of normal non-distorted pixels during the noise reduction stage
which can lead to blurry images. The total number of errors represents the number of missed and false detections
whereas a smaller number of these detections corresponds to a lower algorithm detection error rate and a better image quality after noise reduction. Experimental results show that the proposed algorithm has a relatively balanced number of missed and false detections and ranks second among all compared algorithms in this respect
thereby offering a solid foundation for the subsequent noise reduction module. In the second image set
we combined the proposed RVIN detector with the generic iteratively reweighted annihilating filter(GIRAF) algorithm to form a RVIN noise reduction algorithm. To verify the effectiveness of the proposed detector
we applied different ratios of RVIN noise (i.e.
10%
20%
30%
40%
50%
and 60%) to 50 textured images and recorded the average peak signal-to-noise ratio (PSNR) of these images under each noise ratio. Experimental results show that the images restored by the proposed-GIRAF algorithm achieve the optimal PSNR under each noise ratio and that this algorithm greatly outperforms the Xu
Chen-GIRAF
and MLPNNC-GIRAF algorithms. The proposed-GIRAF algorithm also outperforms the second-best algorithm by 0.47 dB to 1.96 dB in terms of the average PSNR of its 50 images
thereby suggesting that the actual detection results of the proposed noise detector are the most effective for the subsequent noise reduction module. Experimental results also show that the proposed RVIN detector outperforms most of the existing detectors in terms of detection accuracy. As such
a switching RVIN removal method with an improved denoising performance can be obtained by combining the proposed RVIN detector with any inpainting algorithm.
Conclusion
2
Extensive experiments show that the estimation accuracy of the proposed MLP-based noise detector is robust across a wide range of noise ratios. When combined with the GIRAF algorithm
this detector significantly outperforms the traditional RVIN denoising algorithm in terms of denoising effect.
Akkoul S, Ledee R, Leconge R and Harba R. 2010. A new adaptive switching median filter. IEEE Signal Processing Letters, 17(6):587-590[DOI:10.1109/LSP.2010.2048646]
Arbeláez P, Maire M, Fowlkes C and Malik J. 2011. Contour detection and hierarchical image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(5):898-916[DOI:10.1109/TPAMI.2010.161]
Chan S H, Wang X R and Elgendy O A. 2017. Plug-and-play ADMM for image restoration:fixed-point convergence and applications. IEEE Transactions on Computational Imaging, 3(1):84-98[DOI:10.1109/TCI.2016.2629286]
Chen J Q, Zhang G Z, Xu S P and Yu H W. 2019. A blind CNN denoising model for random-valued impulse noise. IEEE Access, 7:124647-124661[DOI:10.1109/ACCESS.2019.2938799]
Dong Y Q, Chan R H and Xu S F. 2007. A detection statistic for random-valued impulse noise. IEEE Transactions on Image Processing, 16(4):1112-1120[DOI:10.1109/TIP.2006.891348]
Garnett R, Huegerich T, Chui C and He W J. 2005. A universal noise removal algorithm with an impulse detector. IEEE Transactions on Image Processing, 14(11):1747-1754[DOI:10.1109/TIP.2005.857261]
Guo Y Q, Jia X P and Paull D. 2018. Effective sequential classifier training for SVM-based multitemporal remote sensing image classification. IEEE Transactions on Image Processing, 27(6):3036-3048[DOI:10.1109/TIP.2018.2808767]
Jin K H and Ye J C. 2018. Sparse and low-rank decomposition of a Hankel structured matrix for impulse noise removal. IEEE Transactions on Image Processing, 27(3):1448-1461[DOI:10.1109/TIP.2017.2771471]
Kumar S V and Nagaraju C. 2018. Support vector neural network based fuzzy hybrid filter for impulse noise identification and removal from gray-scale image. Journal of King Saud University-Computer and Information Sciences: 1-16[ DOI: 10.1016/j.jksuci.2018.05.011 http://dx.doi.org/10.1016/j.jksuci.2018.05.011 ]
Li K, Li Y M, Hu X M and Shao F. 2018. A robust and accurate object tracking algorithm based on convolutional neural network. Acta Electronica Sinica, 46(9):2087-2093
李康, 李亚敏, 胡学敏, 邵芳. 2018.基于卷积神经网络的鲁棒高精度目标跟踪算法.电子学报, 46(9):2087-2093[DOI:10.3969/j.issn.0372-2112.2018.09.007]
Liu L C, Chen C L P, Zhou Y C and You X G. 2015. A new weighted mean filter with a two-phase detector for removing impulse noise. Information Sciences, 315:1-16[DOI:10.1016/j.ins.2015.03.067]
Nie F P, Yang S, Zhang R and Li X L. 2019. A general framework forauto-weighted feature selection via global redundancy minimization. IEEE Transactions on Image Processing, 28(5):2428-2438[DOI:10.1109/TIP.2018.2886761]
Ongie G and Jacob M. 2016. A fast algorithm for structured low-rank matrix recovery with applications to undersampled MRI reconstruction//Proceedings of the 13th IEEE International Symposium on Biomedical Imaging. Prague, Czech Republic: IEEE: 522-525[ DOI: 10.1109/ISBI.2016.7493322 http://dx.doi.org/10.1109/ISBI.2016.7493322 ]
Roy A, Singha J, Devi S S and Laskar R H. 2016. Impulse noise removal using SVM classification based fuzzy filter from gray scale images. Signal Processing, 128:262-273[DOI:10.1016/j.sigpro.2016.04.007]
Soleimany and Hamghalam. 2017. A novel random-valued impulse noise detector based on MLP neural network classifier//Proceedings of 2017 Artificial Intelligence and Robotics (IRANOPEN). Qazvin, Iran: IEEE: 165-169[ DOI: 10.1109/RIOS.2017.7956461 http://dx.doi.org/10.1109/RIOS.2017.7956461 ]
Turkmen I. 2016. The ANN based detector to remove random-valued impulse noise in images. Journal of Visual Communication and Image Representation, 34:28-36[DOI:10.1016/j.jvcir.2015.10.011]
Xiong B and Yin Z P. 2012. A universal denoising framework with a new impulse detector and nonlocal means. IEEE Transactions on Image Processing, 21(4):1663-1675[DOI:10.1109/TIP.2011.2172804]
Xu G Y and Tan J Q. 2014. A universal impulse noise filter with an impulse detector and nonlocal means. Circuits, Systems, and Signal Processing, 33(2):421-435[DOI:10.1007/s00034-013-9640-1]
Xu S P, Zhang G Z, Hu L Y and Liu T Y. 2018a. Convolutional neural network-based detector for random-valued impulse noise. Journal of Electronic Imaging, 27(5):#050501[DOI:10.1117/1.JEI.27.5.050501]
Xu Q, Li Y H, Guo Y J, Wu S and Sbert M. 2018b. Random-valued impulse noise removal using adaptive ranked-ordered impulse detector. Journal of Electronic Imaging, 27(1):#013001[DOI:10.1117/1.JEI.27.1.013001]
Zhou W and David Z. 1999. Progressive switching median filter for the removal of impulse noise from highly corrupted images. IEEE Transactions on Circuits and Systems Ⅱ:Analog and Digital Signal Processing, 46(1):78-80[DOI:10.1109/82.749102]
相关作者
相关机构
京公网安备11010802024621