浏览全部资源
扫码关注微信
纸质出版日期： 2020-07-16 ，
录用日期： 2020-02-29
移动端阅览
汤新雨, 李敏, 徐灵丽, 郝真, 张学武. 基于透射率修正的湍流模型与动态调整retinex的水下图像增强[J]. 中国图象图形学报, 2020,25(7):1380-1392.
Xinyu Tang, Min Li, Lingli Xu, Zhen Hao, Xuewu Zhang. Underwater image enhancement based on turbulence model corrected by transmittance and dynamically adjusted retinex[J]. Journal of Image and Graphics, 2020,25(7):1380-1392.
目的
2
为提高水下获取的结构物表面缺陷图像的对比度和清晰度，便于缺陷区域的分割、提取和识别工作，提出了一种基于改进的湍流模型和引导滤波平滑的retinex的图像增强方法。
方法
2
将光照不均的水下图像转换到Lab空间，对亮度空间进行自适应直方图均衡的匀光处理，根据暗通道先验理论估算匀光图像的透射率，结合大气湍流通用模型模拟退化图像，通过调整透射率系数获得退化图像。采用维纳滤波过滤图像噪声，将滤波后的图像作为导向图，利用导向滤波细化获得边缘保持的图像。根据3
σ
准则对3通道多尺度retinex（multi-scale retinex，MSR）的反射分量进行色彩矫正，获取最终增强后的水下结构物表面缺陷图像。
结果
2
选取多组在不同湍流环境下采集的图像为研究对象，采用本文提出的方法进行实验，并与经典的暗通道算法、直方图均衡算法以及单尺度retinex算法对比，使用信噪比、信息熵、标准差和平均梯度等指标进行评估。实验结果表明，本文方法的信息熵、标准差相较直方图均衡算法和单尺度retinex分别提高了11.7%和25.6%，分割准确率上升了3.1%。从主观效果上看，本文算法图像细节更为丰富，视觉效果自然。
结论
2
本文算法改善了退化模型的自适应问题，在信息熵、标准差、平均梯度等综合指标上均有优异表现，与暗通道先验方法相比，信噪比、平均梯度大幅提升，同时实现了缺陷的边缘保持效果，为下阶段的图像处理提供了良好的信息源。
Objective
2
The attenuation of light is typically serious even in the purest water after filtration. Experiments show that the attenuation of water is caused by two unrelated physical processes
namely
absorption and scattering. Water has obvious selectivity for light absorption
and the absorption abilities of different spectral regions vary. Such variation leads to the loss of light energy
which makes underwater imaging difficult with such phenomena as low definition and color distortion. The scattering of light by water can be divided into forward and backward scattering. The suspended particles in water cause the attenuation of light in the forward and reverse directions of propagation
which limits the detection range and distance of underwater optical imaging. This limitation results in a decrease in image contrast
blurred details
and degradation. A series of degradation problems has weakened the detection rate and accuracy of defects. Therefore
the denoising and enhancement of images with surface defects of underwater structures are significant. An improved image enhancement algorithm based on turbulence model and multiscale retinex (MSR) is proposed to improve the contrast and sharpness of surface defect images acquired underwater and facilitate the subsequent segmentation
extraction
and recognition of the defect region. The proposed method combines physical model with the nonphysical model method. Thus
this method improves the considerably simple model parameters and poor versatility. The color cast of the enhanced image is considered
and the image noise is suppressed.
Method
2
An underwater image with uneven illumination is converted from RGB space to Lab space
and histogram equalization (HE) is performed on the luminance space. After the incident light is reflected from the structure surface
it will be affected by the suspended particles from the water before it reaches the imaging device
and the scattering phenomenon will generate noise. The absorption of the spectrum by the water will attenuate the light intensity
and this condition will result in low image contrast. The process is similar to the imaging model of a foggy-degraded image. Thus
the reconstructed method of the degraded image can be used to process the blurred underwater image. The light intensity distribution in the imaged scene after homogenization is similar
which can be approximated as a fixed value. The transmittance of the homogenized image can be estimated in accordance with dark channel prior theory. It describes the medium transmission that is unscattered and reaches the light portion of the imaging system
and it is also the degree of blur at each pixel. It reflects the degree of transparency of the light source components in the scene
which indicates the extent to which the image is affected by the scattering of water. In consideration of the same degraded underwater images and remote sensing images
the two exhibit similarities in optical properties
fluid media
and external forms. The atmospheric turbulence model can accordingly be applied to simulate the degradation process of underwater images. The transmittance obtained above is combined with a general model of atmospheric turbulence to simulate an underwater degradation image by adjusting the transmittance coefficient. The image noise is filtered by Wiener filter
and the filtered image is used as a guide image. An edge-preserved image is obtained using a guide filter to refine. Image enhancement is performed in accordance with retinex theory. The MSR result is color-corrected on the basis of the 3
σ
criterion to obtain an enhanced underwater image. Multiple images collected under different turbulent environments are selected as the research object. The method proposed in this study is used and compared with classic methods
such as the dark channel
HE
and single-scale retinex (SSR) algorithms. The indicators of signal-to-noise ratio (SNR)
peak SNR
information entropy (IE)
standard deviation (SD)
and average gradient (AG) are evaluated.
Result
2
Experimental results show that the IE and SD of the proposed algorithm are 11.7% and 25.6% higher than those of HE algorithm and SSR
respectively. The AG is 31.2% higher than that of HE algorithm
and the segmentation accuracy is increased by 3.1%. The oversegmentation rate is the lowest among similar algorithms. From the perspective of subjective visual effects
the image after restoration by the dark channel algorithm is rich in color and prominent in detail
but its gray value is mostly distributed in the low-gray area. Such distribution results in a low image recognition rate and an unsatisfactory segmentation effect. The visual effect of HE algorithm is the closest to the original image
but the problem that the gray scale distribution is excessively concentrated remains. The segmentation accuracy is slightly improved compared with that of the dark channel algorithm. The image after SSR shows a color cast phenomenon
and the overall gray value of the image after the dynamically adjusted MSR decreases. The range of gray scale is enlarged
and the color cast effect is improved. The color and detail of the image are the richest
and the visual effect is the most natural among all the tested algorithms.
Conclusion
2
On the basis of the analysis of an underwater image degradation model and the difference among pixels
the image transmittance is estimated
and the gray scale distribution of the enhanced image is expanded by the 3σ criterion. An enhanced underwater image with high contrast
high definition
and balanced color is obtained. The algorithm improves the adaptive problem of the degenerate model with excellent performance in comprehensive indicators
such as IE
SD
and AG. Compared with the dark channel prior method
the proposed method exhibits greatly improved SNR and AG. The edge information of the image is preserved
which provides a good information source for image segmentation and recognition in the next stage.
水下图像增强湍流模型透射率维纳滤波多尺度retinex色彩校正
underwater image enhancementturbulence modeltransmittanceWiener filteringmulti-scale retinex(MSR)color correction
Dai C G, Lin M X, Wang Z, Zhang D and Guan Z G. 2018. Color compensation based on bright channel and fusion for underwater image enhancement. Acta Optica Sinica, 38(11):86-95
代成刚, 林明星, 王震, 张东, 管志光. 2018.基于亮通道色彩补偿与融合的水下图像增强.光学学报, 38(11):86-95[DOI:10.3788/AOS201838.1110003]
Fan X N, Chen J Y, Zhang X W, Shi P F and Zhang Z. 2018. Underwater polarized images restoration algorithm based on structural similarity. Journal of Image and Graphics, 23(7):1033-1041
范新南, 陈建跃, 张学武, 史朋飞, 张卓. 2018.结构相似性的水下偏振图像复原.中国图象图形学报, 23(7):1033-1041[DOI:10.11834/jig.180009]
Guo J C, Li C Y, Guo C L and Chen S J. 2017. Research progress of underwater image enhancement and restoration methods. Journal of Image and Graphics, 22(3):273-287
郭继昌, 李重仪, 郭春乐, 陈善继. 2017.水下图像增强和复原方法研究进展.中国图像图形学报, 22(3):273-287[DOI:10.11834/jig.20170301]
Huang D M, Wang Y, Song W, Wang Z H and Du Y L. 2018. Underwater image enhancement method using adaptive histogram stretching in different color models. Journal of Image and Graphics, 23(5):640-651
黄冬梅, 王龑, 宋巍, 王振华, 杜艳玲. 2018.不同颜色模型下自适应直方图拉伸的水下图像增强.中国图象图形学报, 23(5):640-651[DOI:10.11834/jig.170610]
Huang H, Zhou H, Yang X, Zhang L, Qi L and Zang A Y. 2019. Faster R-CNN for marine organisms detection and recognition using data augmentation. Neurocomputing, 337:372-384[DOI:10.1016/j.neucom.2019.01.084]
Huang Y H, Han Y and Turghunjan·Abdukirim. 2018. An underwater image enhancement algorithm based on àTrous algorithm. Electronic Design Engineering, 26(16):6-11, 18
黄允浒, 韩燕, 吐尔洪江·阿布都克力木. 2018.一种基于àTrous算法的水下图像增强算法.电子设计工程, 26(16):6-11, 18[DOI:10.3969/j.issn.1674-6236.2018.16.002]
Hufnagel R E, Stanley N R. 1964. Modulation transter function associated with image transmission through turbulent media. Journal of the Optical Society of America, 54(1):52-60
Jobson D J, Rahman Z and Woodell G A. 1997a. Properties and performance of a center/surround retinex. IEEE Transactions on Image Processing, 6(3):451-462[DOI:10.1109/83.557356]
Jobson D J, Rahman Z and Woodell G A. 1997b. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image Processing, 6(7):965-976[DOI:10.1109/83.597272]
Land E H. 1986. An alternative technique for the Computation of the designator in the Retinex theory of color vision. Proceedings of the National Academy of Sciences of the United States of America, 83(10):3078-3080[DOI:10.1073/pnas.83.10.3078]
Li C L, Sun Y W, Yan J W and Fan T H. 2019. Underwater color image enhancement algorithm based on multi-channel equalization. Journal of Huazhong University of Science and Technology (Nature Science Edition), 47(6):1-5, 29
李昌利, 孙亚伟, 闫敬文, 樊棠怀. 2019.基于多通道均衡化的水下彩色图像增强算法.华中科技大学学报(自然科学版), 47(6):1-5, 29[DOI:10.13245/j.hust.190601]
Li X C, Zhang H, Liu X Y, Zong F Y and Liu J L. 2019. A method of underwater image enhancement based on transmittance optimization and color calibration. Shandong Science, 32(2):7-14
李向春, 张浩, 刘晓燕, 宗芳伊, 刘军礼. 2019.基于透射率优化和颜色修正的水下图像增强方法.山东科学, 32(2):7-14[DOI:10.3976/j.issn.1002-4026.2019.02.002]
Liao Q X, Lu Z S and Peng J H. 2019. Research on PSF parameter estimation and image restoration of motion blurred image. Chinese High Technology Letters, 29(4):338-343
廖秋香, 卢在盛, 彭金虎. 2019.运动模糊图像PSF参数估计与图像复原研究.高技术通讯, 29(4):338-343[DOI:10.3772/j.issn.1002-0470.2019.04.004]
Singh G, Jaggi N, Vasamsetti S, Sardana H K, Kumar S and Mittal N. 2015. Underwater image/video enhancement using wavelet based color correction (WBCC) method//Proceedings of 2015 IEEE Underwater Technology. Chennai, India: IEEE: 23-25 (DOI: 10.1109/UT.2015.7108303http://dx.doi.org/10.1109/UT.2015.7108303]
Song W, Wang Y, Huang D M, He Q and Wang Z H. 2018. Combining background light fusion and underwater dark channel prior with color balancing for underwater image enhancement. Pattern Recognition and Artificial Intelligence, 31(9):856-868
宋巍, 王龑, 黄冬梅, 贺琪, 王振华. 2018.结合背景光融合及水下暗通道先验和色彩平衡的水下图像增强.模式识别与人工智能, 31(9):856-868[DOI:10.16451/j.cnki.issn1003-6059.201809008]
Wan M J, Gu G H, Qian W X, Ren K and Chen Q. 2018. Infrared small target enhancement:grey level mapping based on improved sigmoid transformation and saliency histogram. Journal of Modern Optics, 65(10):1161-1179[DOI:10.1080/09500340.2018.1426796]
Wang F P, Wang W X, Yang N and Sui L C. 2017. An urban traffic image enhancement method based on modified retinex. Journal of Transportation Systems Engineering and Information Technology, 17(5):53-59
王峰萍, 王卫星, 杨楠, 隋立春. 2017.基于改进Retinex的城市交通图像增强.交通运输系统工程与信息, 17(5):53-59[DOI:10.16097/j.cnki.1009-6744.2017.05.008]
Wang H R, Zhu Z J and Wang J. 2017. An efficient underwater image enhancement algorithm for unmanned underwater vehicle. Ship Engineering, 39(12):95-101
王红茹, 朱振杰, 王佳. 2017.一种面向水下无人航行器的实效图像增强算法.船舶工程, 39(12):95-101[DOI:10.13788/j.cnki.cbgc.2017.12.095]
Wang Y X, Diao M and Han C. 2018. Underwater image enhancement and color correction model based on homomorphic filter. Computer Engineering and Applications, 54(11):30-34, 80
王永鑫, 刁鸣, 韩闯. 2018.基于同态滤波的水下图像增强与色彩校正模型.计算机工程与应用, 54(11):30-34, 80[DOI:10.3778/j.issn.1002-8331.1801-0131]
Wen H C, Tian Y H, Huang T J and Gao W. 2013. Single underwater image enhancement with a new optical model//Proceedings of 2013 IEEE International Symposium on Circuits and Systems. Beijing, China: IEEE: 753-756[DOI: 10.1109/ISCAS.2013.6571956http://dx.doi.org/10.1109/ISCAS.2013.6571956]
Xie F Y, Tang M and Zhang R. 2019. Review of image enhancement algorithms based on Retinex. Journal of Data Acquisition and Processing, 34(1):1-11
谢凤英, 汤萌, 张蕊. 2019.基于Retinex的图像增强方法综述.数据采集与处理, 34(1):1-11[DOI:10.16337/j.1004-9037.2019.01.001]
Wen H B, Bi D Y, Ma S P and He L Y. 2016. Variational Retinex algorithm for infrared image enhancement with staircase effect suppression and detail enhancement. Acta Optica Sinica, 36(9):122-131
温海滨, 毕笃彦, 马时平, 何林远. 2016.消除阶梯效应与增强细节的变分Retinex红外图像增强算法.光学学报, 36(9):122-131[DOI:10.3788/AOS201636.0911005]
Xie N. 2017. Research on the image defogging algorithm based on image enhancement. Machine Design and Manufacturing Engineering, 46(12):31-33
谢娜. 2017.基于图像增强的图像去雾算法研究.机械设计与制造工程, 46(12):31-33[DOI:10.3969/j.issn.2095-509X.2017.12.007]
Xu T F, Su C, Luo X and Bian Z Y. 2017. Enhancement of the underwater range-gated degraded image. Transactions of Beijing Institute of Technology, 37(8):853-857, 862
许廷发, 苏畅, 罗璇, 卞紫阳. 2017.水下距离选通降质图像的增强.北京理工大学学报, 37(8):853-857, 862[DOI:10.15918/j.tbit1001-0645.2017.08.015]
Yang M and Sowmya A. 2015. An underwater color image quality evaluation metric. IEEE Transactions on Image Processing, 24(12):6062-6071[DOI:10.1109/TIP.2015.2491020]
Zhang C, Tan N L, Li X, Li G Z and Su S Q. 2019. Foggy image enhancement technologybased on improved Retinex algorithm. Journal of Beijing University of Aeronautics and Astronautics, 45(2):309-316
张驰, 谭南林, 李响, 李国正, 苏树强. 2019.基于改进型Retinex算法的雾天图像增强技术.北京航空航天大学学报, 45(2):309-316[DOI:10.13700/j.bh.1001-5965.2018.0316]
Zhang H, Xu Y R, Wan L, Tang X D and Cai H P. 2010. Processing method for underwater degenerative image. Journal of Tianjin University, 43(9):827-833
张赫, 徐玉如, 万磊, 唐旭东, 蔡昊鹏. 2010.水下退化图像处理方法.天津大学学报, 43(9):827-833[DOI:10.3969/j.issn.0493-2137.2010.09.012]
相关作者
相关机构
京公网安备11010802024621