融合GF-MSRCR和暗通道先验的图像去雾
Image dehazing based on GF-MSRCR and dark channel prior
- 2019年24卷第11期 页码:1893-1905
纸质出版日期: 2019-11-16 ,
录用日期: 2019-05-20
DOI: 10.11834/jig.190089
移动端阅览
浏览全部资源
扫码关注微信
纸质出版日期: 2019-11-16 ,
录用日期: 2019-05-20
移动端阅览
刘万军, 白宛司, 曲海成, 赵庆国. 融合GF-MSRCR和暗通道先验的图像去雾[J]. 中国图象图形学报, 2019,24(11):1893-1905.
Wanjun Liu, Wansi Bai, Haicheng Qu, Qingguo Zhao. Image dehazing based on GF-MSRCR and dark channel prior[J]. Journal of Image and Graphics, 2019,24(11):1893-1905.
目的
2
针对雾天图像高亮和雾浓区域中容易出现场景透射率值求取不准确,导致复原后的图像细节丢失、出现光晕现象、对比度和色彩难以满足人眼的视觉特性等问题,提出了一种融合引导滤波优化的色彩恢复多尺度视网膜算法(GF-MSRCR)和暗通道先验的图像去雾算法。
方法
2
首先利用加权四叉树方法从最小通道图中快速搜索全局大气光值,再从图像增强角度应用GF-MSRCR算法初步估计场景透射率值,依据暗通道先验原理对最小通道图进行二次估测,根据两次求取结果按一定比例进行像素级图像融合,得到场景透射率估计值;利用变差函数修正估计值,经中值滤波进一步优化得到场景透射率的精确值,最后通过大气散射模型恢复雾天图像,调整对比度和恢复颜色后,得到了轮廓完整且细节清晰的无雾图像。
结果
2
理论分析和实验结果表明,经本文算法去雾处理后的图像信息熵、对比度、平均梯度、结构相似性分别平均提升了7.87%、21.95%、47.73%和15.58%,同时运行时间缩短了53.22%,对近景、含小部分天空区域、含大片天空区域和含白色物体场景的多种类型雾天图像显示出较好的复原效果。
结论
2
融合GF-MSRCR和暗通道先验的图像去雾算法能快速有效保留图像的细节信息、消除光晕,满足了人眼的视觉特性,具有一定的实用性以及普适性。
Objective
2
With the development of high-density industrial economy
the air quality gradually declines and haze occurs frequently. Haze is an aerosol system formed by the interaction of human daily life and special climate. Large particles in the air could scatter and absorb light
resulting in image collected degradation
which seriously affects image post-analysis. In general
two kinds of algorithms
namely
physical model image defogging and image enhancement defogging
have been adopted to improve the effect of weather factors on image quality. The former is to construct atmospheric scattering model to compensate distortion and obtain a clear image. The common de-fogging algorithms based on the physical model of atmospheric scattering are dark channel prior de-fogging algorithm and polarization imaging de-fogging algorithm and so on. In the last few years
based on the atmospheric scattering model
experts from all over the world have studied the dark channel priori de-fogging. Based on the dark channel priori principle of image de-fogging
on the one hand
the algorithm cannot keep the edge information of the image in the region where the depth of field changes greatly
and a halo phenomenon occurs in the fog-free image; on the other hand
when the global atmospheric light value is close to the pixel luminance component of the foggy image
the color distortion will occur in the restored image. The latter is achieved by improving the quality of image details according to the characteristics of human vision. The representative algorithms include de-fogging algorithm based on histogram equalization
homomorphic filtering
wavelet transform
Retinex theory
and atmospheric modulation transfer function. The basic idea of histogram equalization-based de-fogging algorithm is to obtain uniform distribution of histogram and increase the contrast of the image. The homomorphic filtering based de-fogging algorithm divides the image into irradiating component and reflection component in the frequency domain and increases the contrast of the image by enhancing the high-frequency information of the image. The fog algorithm based on wavelet transform in time domain and frequency domain transformation locally can effectively extract information from the signal. The de-fogging algorithm based on Retinex theory describes color invariance because it has good effect on dynamic range compression
detail enhancement
color fidelity
and so on. The de-fogging algorithm based on the atmospheric modulation transfer function predicts the corresponding upflow transfer function and aerosol transfer function through the formula
obtains the atmospheric modulation transfer function from the product of the two
and then recovers the degraded image in the frequency domain. The attenuation caused by the atmospheric modulation function is compensated. The MSRCR algorithm considers the ratio between the trichromatic channels of the image
so the color distortion should be eliminated to enhance the local detail to a certainextent.However
the time complexity of the algorithm is high
and the operation is complex. However
the following problems persist: the high light region and the thick foggy areas of the images acquired under the fog condition
the inaccurate transmittance calculation often results in detail loss of restored image
halo phenomenon
and contrast and color that cannot meet human visual characteristics. This paper proposes an image defogging algorithm combining GF-MSRCR with dark channel prior.
Method
2
Weighted quad tree method is adopted to fast search the minimum channel graph to obtain the global atmospheric light value. The GF-MSRCR algorithm is used to preliminarily estimate the transmittance for the image enhancement. According to the dark channel prior theory
the minimum channel graph is estimated again. The pixel fusion is operated on the two above results with a certain proportion to determine the transmittance estimation value
which is further modified by variation function and by median filtering to acquire the precise transmittance value. Finally
the atmospheric scattering model is used to restore the foggy image and obtain haze-removed image with complete contour and clear details after contrast and color correction.
Result
2
A computer with a lab platform of Intel (R) Core (TM) i5-7300HQ CPU @ 2.50 GHz 8 GB RAM is used
and the lab environment is MATLAB R2015b under Windows 10. Four types of fog sky images including close-range
small part sky area
large sky area and white object scene are defogged. Theoretical and experimental results show that on one hand
more edge information and local details in the image could be preserved by the proposed algorithm; moreover
color could be restored with high fidelity. With the aid of modification of variation function on scene transmittance and the smooth and optimization of median filtering
the algorithm could accurately process bright areas
such as sky
and retain more edge details. After the restoration and adjustment of the close-range image
the contrast and hue are well restored. After the image restoration and adjustment in the small sky area
the visual effect is better. After image restoration and adjustment
the contrast and color of sky region are more natural. After the white object image is restored and adjusted
the clarity and color can satisfy the visual characteristics of the human eye. When the proposed algorithm is applied to an image
the subjective visual effect of fog removal becomes evident. Five evaluation indicators
namely
information entropy
contrast
structural similarity
average gradient
and running time
are used to compare the image defogging quality of different algorithms. In particular
the running time obviously decreases by 53.22% with increases in the information entropy by 7.87%
contrast by 21.95%
average gradient by 47.73%
and structural similarity by 15.58%. The algorithm shows good restoration results for scene images containing fog close shot
a small sky area
a large sky area
or white objects.
Conclusion
2
The image dehazing algorithm fusing GF-MSRCR and dark channel prior could quickly and effectively retain image details
eliminate halo
and satisfy human visual characteristics. The algorithm possesses certain practicability and universality. Future research would capture fog images in more complex scenes and restore foggy images.
加权四叉树GF-MSRCR暗通道先验图像融合变差函数中值滤波
weighted quad treeGF-MSRCRdark channel priorimage fusionvariation functionmedian filtering
Wu D, Zhu Q S. The latest research progress of image dehazing[J]. Acta Automatica Sinica, 2015, 41(2):221-239.
吴迪, 朱青松.图像去雾的最新研究进展[J].自动化学报, 2015, 41(2):221-239.[DOI:10.16383/j.aas.2015.c131137]
Yu J, Xu D B, Liao Q M. Image defogging:a survey[J]. Journal of Image and Graphics, 2011, 16(9):1561-1576.
禹晶, 徐东彬, 廖庆敏.图像去雾技术研究进展[J].中国图象图形学报, 2011, 16(9):1561-1576.[DOI:10.11834/jig.20110920]
He K M, Sun J, Tang X O. Single image haze removal using dark channel prior[C]//Proceedings of 2009 IEEE Conference on. Computer Vision and Pattern Recognition, 2009. Miami, FL, USA: IEEE, 2009: 1956-1963.[DOI: 10.1109/CVPR.2009.5206515http://dx.doi.org/10.1109/CVPR.2009.5206515]
Wang J B, He N, Zhang L L, et al. Single image dehazing with a physical model and dark channel prior[J]. Neurocomputing, 2015, 149:718-728.[DOI:10.1016/j.neucom.2014.08.005]
Sun W, Wang H, Sun C H, et al. Fast single image haze removal via local atmospheric light veil estimation[J]. Computers&Electrical Engineering, 2015, 46:371-383.[DOI:10.1016/j.compeleceng.2015.02.009]
Gui P, Bi D Y, Ma S P, et al. Single image defogging based on Markov random field[J]. Application Research of Computers, 2016, 33(9):2844-2847.
眭萍, 毕笃彦, 马时平, 等.基于马尔可夫随机场框架的单幅图像去雾[J].计算机应用研究, 2016, 33(9):2844-2847.[DOI:10.3969/j.issn.1001-3695.2016.09.065]
Wang K, Chen Z Y, Wu M, et al. Fast signal image dehazing method based on channel dark element information[J]. Application Research of Computers, 2017, 34(7):2224-2227.
王凯, 陈朝勇, 吴敏, 等.基于通道暗元素信息的快速单幅图像去雾方法[J].计算机应用研究, 2017, 34(7):2224-2227.[DOI:10.3969/j.issn.1001-3695.2017.07.066]
Liu K, Bi D Y, Wang S P, et al. Single image dehazing based on sparse feature extraction[J]. Acta Optica Sinica, 2018, 38(3):#0310001.
刘坤, 毕笃彦, 王世平, 等.基于稀疏特征提取的单幅图像去雾[J].光学学报, 2018, 38(3):#0310001.
Cao X M, Liu C X, Zhang J D, et al. Fast image defogging algorithm based on luminance contrast enhancement and saturation compensation[J]. Journal of Computer-Aided Design&Computer Graphics, 2018, 30(10):1925-1934.
曹绪民, 刘春晓, 张金栋, 等.基于亮度对比度增强与饱和度补偿的快速图像去雾算法[J].计算机辅助设计与图形学学报, 2018, 30(10):1925-1934.[DOI:10.3724/SP.J.1089.2018.17000]
Zheng H, Wu J. Image enhancement algorithm based on wavelet frequency division histogram equalization[J]. Modern Electronics Technique.
郑辉, 吴谨.基于小波分频与直方图均衡的图像增强算法[J].现代电子技术, 2010, 33(16): 149-150, 153.[DOI: 10.3969/j.issn.1004-373X.2010.16.046http://dx.doi.org/10.3969/j.issn.1004-373X.2010.16.046]
Tian X P, Cheng X, Wu C M, et al. Color image enhancement method based on homomorphic filtering[J]. Journal of Xi'an University of Posts and Telecommunications, 2015, 20(6):51-55.
田小平, 程新, 吴成茂, 等.基于同态滤波的彩色图像增强[J].西安邮电大学学报, 2015, 20(6):51-55.[DOI:10.13682/j.issn.2095-6533.2015.06.011]
Ma Z L, Wen J. Single-scale Retinex sea fog removal algorithm fused the edge information[J]. Journal of Computer-Aided Design&Computer Graphics, 2015, 27(2):217-225.
马忠丽, 文杰.融合边缘信息的单尺度Retinex海雾去除算法[J].计算机辅助设计与图形学学报, 2015, 27(2):217-225.
Lee H G, Yang S, Sim J Y. Color preserving contrast enhancement for low light level images based on Retinex[C]//Proceedings of 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference. Hong Kong, China: IEEE, 2015: 884-887.[DOI: 10.1109/APSIPA.2015.7415397http://dx.doi.org/10.1109/APSIPA.2015.7415397]
Tang C M, Dong Y C, Sun X, et al. Image restoration algorithm for single nighttime weakly illuminated haze image[J]. Journal of Computer-Aided Design&Computer Graphics, 2018, 30(3):459-467.
汤春明, 董燕成, 孙欣, 等.单幅夜间弱照度雾霾图像的复原算法[J].计算机辅助设计与图形学学报, 2018, 30(3):459-467.[DOI:10.3724/SP.J.1089.2018.16308]
Li C L, Song Y Q, Liu X F. Haze removal method for traffic images based on multi-scale retinex theory[J]. Journal of Computer Applications, 2015, 35(S2):234-237.
李长领, 宋裕庆, 刘晓锋.基于MSR理论的交通图像去雾霾方法[J].计算机应用, 2015, 35(S2):234-237.
Li Y F, He X H, Wu X Q. Improved enhancement algorithm of fog image based on multi-scale Retinex with color restoration[J]. Journal of Computer Applications, 2014, 34(10):2996-2999, 3023.
李垚峰, 何小海, 吴小强.改进的带色彩恢复的多尺度Retinex雾天图像增强算法[J].计算机应用, 2014, 34(10):2996-2999, 3023.[DOI:10.11772/j.issn.1001-9081.2014.10.2996]
Liu W J, Zhao Q G, Qu H C. Image defog algorithm based on variogram and morphological filter[J]. Journal of Image and Graphics, 2016, 21(12):1610-1622.
刘万军, 赵庆国, 曲海成.变差函数和形态学滤波的图像去雾算法[J].中国图象图形学报, 2016, 21(12):1610-1622.[DOI:10.11834/jig.20161206]
相关作者
相关机构