浏览全部资源
扫码关注微信
Received：08 January 2018，
Revised：2018-2-27，
Published：16 July 2018
移动端阅览
目的
2
针对水下偏振图像存在雾状模糊和场景细节不明显的问题，以水体透射率图与目标反射光图像存在的相互独立性为基础，提出一种基于结构相似性的水下偏振图像复原方法，旨在提高水下偏振图像的清晰度、对比度和色彩真实度。
方法
2
首先，获取同一水下场景下具有正交偏振方向且分别具有最大和最小光强的两幅偏振图像；然后根据透射率图与目标反射光之间的统计无关性，使用结构相似性推导求解透射率的关系式，并通过偏振差分图像计算透射率的初始值，利用该关系式进行水体透射率的迭代求解；最后将透射率代入偏振成像模型得到目标反射光图像，进而进行颜色校正得到复原图像。
结果
2
选取多组正交的水下偏振图像作为研究对象，采用本文提出的方法与另两种偏振复原算法对其进行复原处理，使用对比度、信息熵、灰度平均梯度、峰值信噪比、增强量以及时间等量化指标进行评估。对比实验结果表明，本文算法在对比度、信息熵、灰度平均梯度、增强量以及颜色恢复上都优于另两种偏振图像复原方法，并有较大幅度的提高；灰度平均梯度和对比度较YY算法提高了一倍左右；本文复原图像的色彩分布较均匀使得图像的信息含量大，信息熵高；而突出的EME也证明本文算法的结果纹理清晰、对比度高以及图像复原程度好；提出算法的复原效果有显著的改善，但算法运行时间较长，实时性有待提高。
结论
2
本文基于水下偏振成像模型的分析以及透射率图与目标反射光图像之间的统计无关性，从水体透射率的估计出发进行图像复原，有效地解决了水下偏振图像细节模糊、对比度低的问题。通过对算法实验效果的主客观分析表明，本文算法能有效地复原水下偏振图像，得到对比度高、细节明显和色彩丰富的恢复图像。
Objective
2
Numerous restoration algorithms for single images exist. They are remarkable in the defogging of sky images
but most of them cannot be applied directly to the restoration of underwater images. Image restoration aims to process degenerated images to recover the original image (before degeneration). Underwater illumination is insufficient and unevenly distributed
and these light variations affect the results obtained by restoration methods of single images. In general
the results are unsatisfactory. Polarization is the basic feature of light
and the reflected light of underwater objects are mostly partially polarized. Therefore
polarized underwater images have special polarization characteristics
and underwater image restoration based on multiple polarized images has gradually become popular in recent years. Focusing on the mistiness and unobvious details of underwater polarized images
a restoration method for underwater polarized images based on structural similarity is proposed. This method is expected to improve the clarity
contrast
and color fidelity of images.
Method
2
First
images taken through a polarizer at orthogonal orientations are obtained. The images have the best and worst backscatters. The water transmittance is only related to the depth of field and the attenuation coefficient of the water body; the object radiance depends on the incident light and the surface characteristics of the object. Therefore
we can assume that they are mutually independent. The structural similarity can measure the similarity of two images from brightness
contrast
and structure and can directly describe the correlation between the two images. Second
on the basis of the irrelevance relationship between the transmittance and the object radiance
the solution formula of water transmittance is derived by the structural similarity. The difference of the two polarized images is also the difference of the background lights in these images. This difference is also the function of depth of field. Thus
the polarized-difference image is used for calculating the initial value of transmittance during the iterative solution. An accurate transmittance is necessary for the good restoration of images. Finally
object radiance is obtained by inversing the underwater polarization imaging model
and color is corrected to produce the restored image. The color correction is based on a single point and chooses the point that has well-kept color information as the reference pixel. Then
the global pixels are normalized by the reference pixel to realize the color correction of the entire image.
Result
2
In the experiment
the proposed algorithm is compared with two other polarized restoration algorithms to test its effectiveness
and several groups of underwater polarized images are selected as research objects. The images used in this study were obtained from relevant studies. Quantitative indicators
such as contrast
information entropy
gray mean grads (GMG)
peak signal-to-noise ratio (PSNR)
measure of enhancement (EME)
and runtime
are used for evaluating the effect. Results show that the contrast
information entropy
and GMG of our method are better than those of the two other algorithms. Moreover
a great restoration improvement effect is achieved. The YY algorithm removes the blur of the original images to a certain extent
but certain object areas of the recovered images are supersaturated. The images restored by the Huang algorithm are generally too dark to enable the identification of the scene details due to the inaccurate estimation of the degree of polarization of the object radiance. A comparison of the evaluation parameters shows that the contrast and GMG of our method are twice as high as those of the YY algorithm. Furthermore
the color distribution of the images recovered by our method are more homogeneous than those by YY
thus resulting in sufficient image information and the highest information entropy. The prominent EME also shows that our result has clear texture
high contrast
and good restoration. Certain color channels of the images obtained by the Huang algorithm are not recovered; thus
they have single color tones and the values of several color channels are as low as those of the raw images
thereby resulting in a small mean square error and an extremely high PSNR. In terms of time cost
our method and the Huang algorithm run relatively longer than YY because of the traversal process of the parameters.
Conclusion
2
On the basis of the analysis of the underwater polarization imaging model and the statistical independence relationship between the object radiance and water transmittance
image restoration is conducted successfully after the estimation of transmittance. The problems of blurred details and low contrast in polarized underwater images are effectively solved. The results of the subjective and objective analyses show that the proposed algorithm can recover polarized underwater images effectively and obtain restored images with high contrast
obvious details
and rich color. Compared to other algorithms
the proposed algorithm can improve the contrast
clarity
and color balance of polarized underwater images significantly
thus providing an important foundation of underwater target recognition and analysis.
Du A P, Zhao Y Q, Pan Q, et al. Image enhancement algorithm based on polarization character[J]. Computer Measurement&Control, 2007, 15(1):106-108.
都安平, 赵永强, 潘泉, 等.基于偏振特征的图像增强算法[J].计算机测量与控制, 2007, 15(1):106-108. [DOI:10.3969/j.issn.1671-4598.2007.01.037]
Zhao Y Q,Pan Q, Zhang H C. Calculation method of Stokes images based on sequence image fusion[J]. Journal of Optoelectronics·Laser, 2005, 16(3):354-357.
赵永强, 潘泉, 张洪才.基于图像序列融合的Stokes图像计算方法[J].光电子·激光, 2005, 16(3):354-357. [DOI:10.3321/j.issn:1005-0086.2005.03.025]
Cao N W, Liu W Q, Zhang Y J. Measuring the depolarization for scattering light at several kindsof media[J]. Acta Physica Sinica, 2000, 49(4):647-653.
曹念文, 刘文清, 张玉钧.几种散射介质散射光解偏度的测量[J].物理学报, 2000, 49(4):647-653. [DOI:10.3321/j.issn:1000-3290.2000.04.011]
Cao N W, Liu W Q, Zhang Y J. Quantitative study of improvements of the imaging contrast and imaging range by the polarization technique[J]. Acta Physica Sinica, 2000, 49(1):61-66.
曹念文, 刘文清, 张玉钧.偏振成像技术提高成像清晰度、成像距离的定量研究[J].物理学报, 2000, 49(1):61-66. [DOI:10.3321/j.issn:1000-3290.2000.01.014]
Liu W Q, Cao N W, Zhao G, et al. Laser polarization image of underwater objects[J]. Chinese Journal of QuantumElectronics, 1997, 14(6):520-526.
刘文清, 曹念文, 赵刚, 等.水下物体的激光偏振成像研究[J].量子电子学报, 1997, 14(6):520-526.
Zhao R, Gu G H, Yang W. Visible light image enhancement based on polarization imaging[J]. Laser Technology, 2016, 40(2):227-231.
赵蓉, 顾国华, 杨蔚.基于偏振成像的可见光图像增强[J].激光技术, 2016, 40(2):227-231. [DOI:10.7510/jgjs.issn.1001-3806.2016.02.016]
Ma W Y. Underwater target detection based on the polarization features[J]. Electronic Measurement Technology, 2014, 37(12):90-92, 98.
马伟英.基于偏振特征的水下目标检测[J].电子测量技术, 2014, 37(12):90-92, 98. [DOI:10.3969/j.issn.1002-7300.2014.12.021]
Li H L, Wang X, Zhang C T, et al. The development and analysis of target detection research based on polarization imaging technology[J]. Optical Technique, 2009, 35(5):695-700.
李海兰, 王霞, 张春涛, 等.基于偏振成像技术的目标探测研究进展及分析[J].光学技术, 2009, 35(5):695-700. [DOI:10.3321/j.issn:1002-1582.2009.05.035]
Schechner Y Y, Karpel N. Clear underwater vision[C]//Proceedings of 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC, USA: IEEE, 2004: I-536-I-543. [ DOI:10.1109/CVPR.2004.1315078 http://dx.doi.org/10.1109/CVPR.2004.1315078 ]
Cronin T W, Marshall J. Patterns and properties of polarized light in air and water[J]. Philosophical Transactions of the Royal Society B Biological Sciences, 2011, 366(1565):619-626.[DOI:10.1098/rstb.2010.0201]
Cronin T W, Shashar N, Caldwell R L, et al. Polarization signals in the marine environment[C]//Proceedings of SPIE 5158, Polarization Science and Remote Sensing. San Diego, California: SPIE, 2003. [ DOI:10.1117/12.507903 http://dx.doi.org/10.1117/12.507903 ]
Schechner Y Y, Karpel N. Recovery of underwater visibility and structure by polarization analysis[J]. IEEE Journal of Oceanic Engineering, 2005, 30(3):570-587.[DOI:10.1109/JOE.2005.850871]
Huang B J, Liu T G, Hu H F, et al. Underwater image recovery considering polarization effects of objects[J]. Optics Express, 2016, 24(9):9826-9838.[DOI:10.1364/OE.24.009826]
Zhou M. Research of polarization-based analysis of hazy image[D]. Hefei: Hefei University of Technology, 2012.
周明. 偏振信息在雾天图像分析中的应用研究[D]. 合肥: 合肥工业大学, 2012.
Guo J C, Li C Y, Guo C L, et al. Research progress of underwater image enhancement and restoration methods[J]. Journal of Image and Graphics, 2017, 22(3):273-287.
郭继昌, 李重仪, 郭春乐, 等.水下图像增强和复原方法研究进展[J].中国图象图形学报, 2017, 22(3):273-287. [DOI:10.11834/jig.20170301]
Ma J X, Fan X N, Wu Z X, et al. Underwater dam crack image enhancement algorithm based on improved dark channel prior[J]. Journal of Image and Graphics, 2016, 21(12):1574-1584.
马金祥, 范新南, 吴志祥, 等.暗通道先验的大坝水下裂缝图像增强算法[J].中国图象图形学报, 2016, 21(12):1574-1584. [DOI:10.11834/jig.20161202]
Yu C Y, Xu X D, Lin H X, et al. Low-illumination image enhancement method based on a fog-degraded model[J]. Journal of Image and Graphics, 2017, 22(9):1194-1205.
余春艳, 徐小丹, 林晖翔, 等.应用雾天退化模型的低照度图像增强[J].中国图象图形学报, 2017, 22(9):1194-1205. [DOI:10.11834/jig.170117]
Zeng J X, Yu Y L. Image defogging and edge preserving algorithm based on dark channel prior and bilateral filtering[J]. Journal of Image and Graphics, 2017, 22(2):147-153.
曾接贤, 余永龙.双边滤波与暗通道结合的图像保边去雾算法[J].中国图象图形学报, 2017, 22(2):147-153. [DOI:10.11834/jig.20170201]
Treibitz T, Schechner Y Y. Active polarization descattering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(3):385-399.[DOI:10.1109/TPAMI.2008.85]
Fattal R. Single image dehazing[J]. ACM Transactions on Graphics, 2008, 27(3):#72.[DOI:10.1145/1360612.1360671]
Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment:from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4):600-612.[DOI:10.1109/TIP.2003.819861]
Di H W, Liu X F. Image fusion quality assessment based on structural similarity[J]. Acta Photonica Sinica, 2006, 35(5):766-771.
狄红卫, 刘显峰.基于结构相似度的图像融合质量评价[J].光子学报, 2006, 35(5):766-771.
相关作者
相关机构
京公网安备11010802024621
