不同颜色模型下自适应直方图拉伸的水下图像增强
Underwater image enhancement method using adaptive histogram stretching in different color models
- 2018年23卷第5期 页码:640-651
收稿:2017-11-21,
修回:2017-12-25,
纸质出版:2018-05-16
DOI: 10.11834/jig.170610
移动端阅览

浏览全部资源
扫码关注微信
收稿:2017-11-21,
修回:2017-12-25,
纸质出版:2018-05-16
移动端阅览
目的
2
水下图像是海洋信息的重要载体,然而与自然环境下的图像相比,其成像原理更复杂、对比度低、可视性差。为保证不同类型水下图像的增强效果,本文提出在两种颜色模型下自适应直方图拉伸的水下图像增强方法。
方法
2
首先,进行基于Gray-World理论对蓝、绿色通道进行颜色均衡化预处理。然后,根据红绿蓝(R-G-B)通道的分布特性和不同颜色光线在水下传播时的选择性衰减,提出基于参数动态优化的R-G-B颜色模型自适应直方图拉伸,并采用引导滤波器降噪。接下来,在CIE-Lab颜色模型,对‘L’亮度和‘a’‘b’色彩分量分别进行线性和曲线自适应直方图拉伸优化。最终,增强的水下图像呈现出高对比度、均衡的饱和度和亮度。
结果
2
选取不同类型的水下图像作为数据集,将本文方法与融合颜色模型(ICM)、非监督颜色纠正模型(UCM)、基于暗通道先验性(DCP)的水下图像复原和基于水下暗通道先验(UDCP)的图像复原方法相比较,增强后的图像具有高对比度和饱和度。定性和定量分析实验结果说明本文提出的方法能够获得更好视觉效果,增强后的图像拥有更高信息熵和较低噪声。
结论
2
在RGB颜色模型中,通过合理地考虑水下图像的分布特性和水下图像退化物理模型提出自适应直方图拉伸方法;在CIE-Lab颜色模型中,引入拉伸函数和指数型曲线函数重分布色彩和亮度两个分量,本方法计算复杂度低,适用于不同复杂环境下的水下图像增强。
Objective
2
Underwater image is an important carrier of ocean information
and clear images obtained underwater play a critical role in ocean engineering
such as underwater device inspection and marine biological recognition. However
compared with images captured in terrestrial environment
underwater images often exhibit color shift
low contrast
and poor visibility because the light is absorbed
scattered
and reflected by the water medium when traveling from an object to a camera in the complicated underwater environment. Existing methods cannot be effective and suitable for different types of underwater images. To address these problems
we propose a simple underwater image enhancement method using adaptive histogram stretching in different color models
which can improve the contrast and brightness of the underwater image
reduce the introduction of noise
and generate a relatively natural image.
Method
2
Given that images are rarely color balanced in the underwater situation
we first preprocess the underwater image with color equalization in the red
green
and blue (RGB) color model based on gray world assumption theory. Color equalization is employed only on the green and blue channels of the input image to avoid the inappropriate compensation for the red channel in the water
which is often achieved by simple color balancing. Then
we analyze the distribution characteristics of the RGB channels
which are focused on the regular range. Meanwhile
we determine the rule of selective attenuation in three channels of the underwater image
in which the red color is seriously affected and the wavelength of the red color is the longest
leading to most underwater images having a blue-green tone. On the basis of the results and analysis
we propose an adaptive histogram stretching approach in the RGB color model to adapt to different underwater images. Given that underwater images are disturbed by various factors
the stretching range is limited to the range[0.5%
99.5%] and is obtained based on the inherent characteristics similar to the variation of Rayleigh distribution to reduce the effect of several extreme pixels on the process of adaptive histogram stretching. The desired range of each channel is acquired according to Rayleigh distribution theory
the image formation model
and the residual energy ratios of different color channels underwater. These dynamic stretching ranges have considered the characteristics of histogram distribution in hazed image and in the expected output image simultaneously. Finally
four possible situations of histogram stretching on the basis of the desired range are introduced to preserve the enhanced underwater images from over-stretching or under-stretching. Although the smart method based on adaptive histogram stretching will not introduce obvious noise to the output image
the guided filter is employed to eliminate the effect of noise to improve the contrast and capture relevant details of the image. Then
in the CIE-Lab color model
the "L" luminance component
which is equivalent to image luminance
is applied with linear normalization in the stretch range[0.1%
99.9%]
and the brightness of the entire image is significantly improved. The "a" and "b" color components are modified to acquire the appropriate color correction using the exponential model curve function. Ultimately
a color-equalized
contrast-enhanced
and brightness-corrected underwater image can be produced as the perceivable output image.
Result
2
Our proposed method is evaluated by comparing it with two effective nonphysical methods and two state-of-the-art physical methods qualitatively and quantitatively. The integrated color model and the unsupervised color correction model
as typical nonphysical methods
are most similar to the proposed method in terms of histogram modification. The blind global histogram stretching usually tends to produce output images that contain under-enhanced or over-enhanced and undersaturated or oversaturated areas and high noise. The dark channel prior-based and underwater dark channel prior-based underwater image restoration are imposed to estimate the background light and transmission map (TM) to restore underwater images based on the optical physical model. Physical methods are appropriate only for the enhancement and restoration of certain underwater images under specific circumstances and are time consuming for estimating the TM. Experimental results of different types of underwater images
such as brown coral
underwater fishes
and stones with different color tones
show that our proposed method can achieve better enhanced quality. Our method obtains the highest average subjective quality score among the underwater image enhancement and restoration methods
further proving that our method exhibits the best visual effects. The proposed method is not only simple and effective but also improves the contrast
details
and colors of the input images. In quantitative assessment
the maximum value of UCIQE represents the balance of the chroma
saturation
and contrast of the enhanced image in all methods; the highest value of ENTROPY means that our method preserves the richest information and details; the lowest value of Q-MOS indicates better perceptual quality; and the lowest value of MSE and the highest value of the peak signal-to-noise ratio can reduce the introduction of noise when the original image is enhanced based on adaptive histogram stretching. In summary
the final results have shown that our method can recover natural underwater images
enhance the visibility of hazed images
and produce high-quality underwater images.
Conclusion
2
The proposed method consists of two parts
i.e.
color correction and contrast enhancement in the RGB color model and modification of the brightness and hue in the CIE-Lab color model. In the RGB color model
adaptive histogram stretching is proposed with reasonable consideration of the distribution characteristics of the underwater image and the physical model of underwater image degradation. In the CIE-Lab color model
the stretching and S-model curve functions are adopted to modify the luminance and colors. The proposed method can be of low complexity
can be appropriate for different underwater images under complicated scenarios
and can effectively enhance visibility according to the best perceptual quality
high contrast
and most information and details. Our method achieves impressive results for applicability and robustness compared with the representative underwater image enhancement and restoration methods. Despite its satisfactory performance
our method still needs some improvements:1) the influences of the distance from the object to the water surface and artificial light on the results of restoration and enhancement are all ignored to some extent; 2) the noise due to histogram stretching cannot be entirely removed based on the guided filter; 3) in deep ocean
the radiation of natural light spreading from the water surface to the object fades away and the artificial light becomes the main light source for underwater imaging. These limitations will be investigated
and the proposed method will be refined in future work.
Kocak D M, Dalgleish F R, Caimi F M, et al. A focus on recent developments and trends in underwater imaging[J]. Marine Technology Society Journal, 2008, 42(1):52-67.[DOI:10.4031/002533208786861209]
Mazel C H. In situ measurement of reflectance and fluorescence spectra to support hyperspectral remote sensing and marine biology research[C]//Proceedings of Oceans 2006. Boston, MA, USA: IEEE, 2006: 1-4. [ DOI: 10.1109/OCEANS.2006.307001 http://dx.doi.org/10.1109/OCEANS.2006.307001 ].
Ghani A S A, Isa N A M. Underwater image quality enhancement through Rayleigh-stretching and averaging image planes[J]. International Journal of Naval Architecture and Ocean Engineering, 2014, 6(4):840-866.[DOI:10.2478/IJNAOE-2013-0217]
Zhao X W, Jin T, Qu S. Deriving inherent optical properties from background color and underwater image enhancement[J]. Ocean Engineering, 2015, 94:163-172.[DOI:10.1016/j.oceaneng.2014.11.036]
Iqbal K, Salam R A, Osman A, et al. Underwater image enhancement using an integrated colour model[J]. IAENG International Journal of Computer Science, 2007, 34(2):239-244.
Iqbal K, Odetayo M, James A, et al. Enhancing the low quality images using unsupervised colour correction method[C]//Proceedings of 2010 IEEE International Conference on Systems Man and Cybernetics. Istanbul, Turkey: IEEE, 2010: 1703-1709. [ DOI: 10.1109/ICSMC.2010.5642311 http://dx.doi.org/10.1109/ICSMC.2010.5642311 ]
Ancuti C, Ancuti C O, Haber T, et al. Enhancing underwater images and videos by fusion[C]//Proceedings of 2012 IEEE conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012: 81-88. [ DOI: 10.1109/CVPR.2012.6247661 http://dx.doi.org/10.1109/CVPR.2012.6247661 ]
Ghani A S A, Isa N A M. Underwater image quality enhancement through composition of dual-intensity images and Rayleigh-stretching[J]. SpringerPlus, 2014, 3:#757.[DOI:10.1186/2193-1801-3-757]
Ghani A S A, Isa N A M. Underwater image quality enhancement through integrated color model with Rayleigh distribution[J]. Applied Soft Computing, 2015, 27:219-230.[DOI:10.1016/j.asoc.2014.11.020]
He K M, Sun J, Tang X O. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(12):2341-2353.[DOI:10.1109/TPAMI.2010.168]
Chao L, Wang M. Removal of water scattering[C]//Proceedings of the 2nd International Conference on Computer Engineering and Technology. Chengdu, China: 2010, 2: V2-35-V2-39. [ DOI: 10.1109/ICCET.2010.5485339 http://dx.doi.org/10.1109/ICCET.2010.5485339 ]
Carlevaris-Bianco N, Mohan A, Eustice R M. Initial results in underwater single image dehazing[C]//Proceedings of 2010 IEEE Conference on Oceans. Seattle, WA, USA: IEEE, 2010: 1-8. [ DOI: 10.1109/OCEANS.2010.5664428 http://dx.doi.org/10.1109/OCEANS.2010.5664428 ]
Yang H Y, Chen P Y, Huang C C, et al. Low complexity underwater image enhancement based on dark channel prior[C]//Proceedings of the 2nd International Conference on Innovations in Bio-Inspired Computing and Applications. Shenzhan, China: IEEE, 2011: 17-20. [ DOI: 10.1109/IBICA.2011.9 http://dx.doi.org/10.1109/IBICA.2011.9 ]
Chiang J Y, Chen Y C. Underwater image enhancement by wavelength compensation and dehazing[J]. IEEE Transactions on Image Processing, 2012, 21(4):1756-1769.[DOI:10.1109/TIP.2011.2179666]
Drews P, Do Nascimento E, Moraes F, et al. Transmission estimation in underwater single images[C]//Proceedings of 2013 IEEE International Conference on Computer Vision Workshops. Sydney, NSW, Australia: IEEE, 2013: 825-830. [ DOI: 10.1109/ICCVW.2013.113 http://dx.doi.org/10.1109/ICCVW.2013.113 ]
Wen H C, Tian Y H, Huang T J, et al. Single underwater image enhancement with a new optical model[C]//2013 IEEE International Symposium on Circuits and Systems. Beijing, China: IEEE, 2013: 753-756. [ DOI: 10.1109/ISCAS.2013.6571956 http://dx.doi.org/10.1109/ISCAS.2013.6571956 ]
Galdran A, Pardo D, Picón A, et al. Automatic Red-Channel underwater image restoration[J]. Journal of Visual Communication and Image Representation, 2015, 26:132-145.[DOI:10.1016/j.jvcir.2014.11.006]
Peng Y T, Zhao X, Cosman P C. Single underwater image enhancement using depth estimation based on blurriness[C]//Proceedings of 2015 IEEE International Conference on Image Processing. Quebec City, QC, Canada: IEEE, 2015: 4952-4956. [ DOI: 10.1109/ICIP.2015.7351749 http://dx.doi.org/10.1109/ICIP.2015.7351749 ]
Li C Y, Quo J C, Pang Y W, et al. Single underwater image restoration by blue-green channels dehazing and red channel correction[C] //Proceedings of 2016 IEEE International Conference on Acoustics, Speech and Signal Processing. Shanghai, China: IEEE, 2016: 1731-1735. [ DOI: 10.1109/ICASSP.2016.7471973 http://dx.doi.org/10.1109/ICASSP.2016.7471973 ]
McGlamery B L. A computer model for underwater camera systems[C]//Proceedings of SPIE Volume 0208, Ocean Optics Ⅵ. Monterey, United States: SPIE, 1980: 221-231. [ DOI: 10.1117/12.958279 http://dx.doi.org/10.1117/12.958279 ]
Jaffe J S. Computer modeling and the design of optimal underwater imaging systems[J]. IEEE Journal of Oceanic Engineering, 1990, 15(2):101-111.[DOI:10.1109/48.50695]
Narasimhan S G, Nayar S K. Vision and the atmosphere[J]. International Journal of Computer Vision, 2002, 48(3):233-254.[DOI:10.1023/A:1016328200723]
He K M, Sun J, Tang X O. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(6):1397-1409.[DOI:10.1109/TPAMI.2012.213]
Ancuti C O, Ancuti C, De Vleeschouwer C, et al. Color balance and fusion for underwater image enhancement[J]. IEEE Transactions on Image Processing, 2018, 27(1):379-393.[DOI:10.1109/TIP.2017.2759252]
Peng Y T, Cosman P C. Underwater image restoration based on image blurriness and light absorption[J]. IEEE Transactions on Image Processing, 2017, 26(4):1579-1594.[DOI:10.1109/TIP.2017.2663846]
Guo J C, Li C Y, Guo C L, et al. Research progress of underwater image enhancement and restoration methods[J]. Journal of Image and Graphics, 2017, 22(3):273-287.
郭继昌, 李重仪, 郭春乐, 等.水下图像增强和复原方法研究进展[J].中国图象图形学报, 2017, 22(3):273-287. [DOI:10.11834/jig.20170301]
Yang M, Sowmya A. An underwater color image quality evaluation metric[J]. IEEE Transactions on Image Processing, 2015, 24(12):6062-6071.[DOI:10.1109/TIP.2015.2491020]
Mantiuk R, Kim K J, Rempel A G, et al. HDR-VDP-2:a calibrated visual metric for visibility and quality predictions in all luminance conditions[J]. ACM Transactions on Graphics, 2011, 30(4):#40.[DOI:10.1145/2010324.1964935]
Guo J C, Li C Y, Zhang Y, et al. Quality assessment method for underwater images[J]. Journal of Image and Graphics, 2017, 22(1):1-8.
郭继昌, 李重仪, 张艳, 等.面向水下图像的质量评价方法[J].中国图象图形学报, 2017, 22(1):1-8. [DOI:10.11834/jig.20170101]
相关作者
相关机构
京公网安备11010802024621