改进双边滤波Retinex的多聚焦图像融合
Improved multifocus image fusion algorithm for bilateral filtering Retinex
- 2020年25卷第3期 页码:432-441
收稿:2019-05-24,
修回:2019-9-16,
录用:2019-9-23,
纸质出版:2020-03-16
DOI: 10.11834/jig.190201
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-05-24,
修回:2019-9-16,
录用:2019-9-23,
纸质出版:2020-03-16
移动端阅览
目的
2
针对传统Retinex算法存在的泛灰、光晕、边界突出以及高曝光区域细节增强不明显的现象,将Retinex和多聚焦融合的思想融合在一起,提出一种基于Retinex的改进双边滤波的多聚焦融合算法。
方法
2
首先根据图像情况在像素级层次将反射图像分解为最优亮暗区域两部分,然后利用线性积分变换和邻近像素最优推荐算法,将原始图像与最优亮区域多聚焦融合得到图像
T
,再将图像
T
与最优暗区域重复以上步骤得到图像
S
,最后利用引导滤波进行边界修复得到最终图像。
结果
2
选择两组图像girl和boat进行实验,与SSR(single scale Retinex)、BSSR(Retinex algorithm based on bilateral filtering)、BIFT(Retinex image enhancement algorithm based on image fusion technology)和RVRG(Retinex variational model based on relative gradient regularization and its application)4种方法进行对比,本文方法在方差和信息熵两方面表现出明显优势。在均值方面,比BIFT和RVRG分别平均提高16.37和20.90;在方差方面,比BIFT和RVRG分别平均提高1.25和4.42;在信息熵方面,比BIFT和RVRG分别平均提高0.1和0.17;在平均梯度方面,比BIFT和RVRG分别平均提高1.21和0.42。对比BIFT和RVRG的实验数据,证明了本文方法的有效性。
结论
2
实验结果表明,相比较其他图像增强算法,本文算法能更有效抑制图像的泛灰、光晕和边界突出现象,图像细节增强效果特别显著。
Objective
2
Many image processing models and algorithms in the field of image processing exist at present. Retinex algorithms and multifocus image fusion algorithms in the field have become the most widely used image processing algorithms because of their simplicity
efficiency
and easy implementation. However
Retinex algorithms and multifocus image fusion algorithms have limitations on image processing. This study aims to combine the algorithm with the ideas of Retinex and multifocus image fusion algorithms to achieve image enhancement. In view of the traditional Retinex algorithms
graying
halo
and boundary phenomena are considered
as well as the problem in which the details of high-exposure area is not enhanced. The traditional multifocus image fusion algorithms must capture multiple images of different focus points in the same scene
extract the focus area from multiple images of different focus points
and operate the focus area for multifocus fusion. Extracting the repeated operations of multiple image focus areas for the multifocus fusion algorithm is necessary. This study proposes a multifocus image fusion algorithm based on Retinex the improved bilateral filtering of Retinex.
Method
2
The Retinex algorithm is used to improve the process of estimating illumination images. The effects of image space proximity similarity and pixel similarity on the enhancement effect are fully considered. The improved kernel function of the traditional Retinex algorithm is enhanced to obtain an improved bilateral filter function. First
the improved bilateral filtering function is used to estimate the illumination image
and the influence of the illumination image on the visual effect is reduced or suppressed
and then the reflected image of the essence of the response image is obtained. Furthermore
the optimal parameters of the optimal bright and dark regions are calculated at the pixel level of the reflected image
and the optimal parameters are brought into the algorithm to find the optimal solution. The optimal solution can be used to decompose the reflected image into the optimal bright region and the optimal dark area. In combination with the idea of multifocus image fusion algorithms
the original image is introduced at the same time
which can ensure the enhancement effect of the image and preserve the detail and quality in the original image
so that the enhancement effect is more obvious and clear. The original image
optimal bright region image
and optimal dark region image are multifocus fusion
and the linear integral transform and adjacent pixel optimal recommendation algorithm are used to obtain a smooth and accurate steering map. The steering filter is used to further smooth the steering map. Using the processed guide map as a basis
the original image and optimal bright region are fused according to different focal lengths to obtain an image
T
. The image
T
is repeated with the optimal dark region image to obtain the process image
S
by the aforementioned experimental steps and finally utilized. The pilot filter performs boundary repair on the process image
S
to obtain a final result image.
Result
2
Pictures of a girl and a boat
which were selected for comparison experiments
with single-scale Retinex algorithm
bilateral filter-based Retinex algorithm
BIFT algorithm (Retinex image enhancement algorithm based on image fusion technology)
and RVRG algorithm (Retinex variational model based on relative gradient regularization and its application). The proposed algorithm shows obvious advantages in variance and information entropy
specifically with the average of 16.37 higher than that of BIFT
and the average is increased by 20.90 compared with RVRG. The average increase is 1.25 higher compared with BIFT in terms of variance
which is an average increase of 4.42 compared with that of RVRG. In terms of information entropy
the average increase is 0.1 compared with that of BIFT
which is an average increase of 0.17 compared with that of RVRG. In terms of average gradient
the average increase was 1.21 compared with that of BIFT
which was an average increase of 0.42 compared with that of RVRG. Experimental data comparing BIFT and RVRG demonstrate the effectiveness of the proposed algorithm. The details in the original image and the dark portion of the right side of the car body in the image of the girl are significantly enhanced
and the details of the bright areas in the original image are well-preserved while being enhanced. The overall pixel value of the image is low and the visual effect is darker in the image of the boat. After the enhancement
the outline of the character is clear
the water surface is distinct
and the reef texture enhancement effect is remarkable.
Conclusion
2
The extensive experiments show that due to the uncertainty of the process of acquiring images and the complexity of image information
the traditional algorithms are inevitably limited and the enhancement effect cannot meet the high-quality requirements of image preprocessing. Compared with the traditional algorithms
the combination of Retinex and multifocus fusion algorithms proposed in this paper has a better image enhancement effect. Compared with the single-scale Retinex
bilateral filter-based Retinex
BIFT
and RVRG
the reconstructed image is superior to the contrast algorithm at the subjective and objective levels. The objective evaluation parameters of the resulting image are greatly improved
especially in terms of information entropy. The algorithm in this paper can effectively suppress image graying
halo
and boundary prominent phenomena. The contrast is significantly enhanced and has a good enhancement effect on uneven illumination images and low contrast images
making it superior to other contrast algorithms in image enhancement and robustness. The image detail enhancement effect is particularly remarkable because it serves as the foundation for the subsequent image processing.
Chang J, Liu W, Bai J H. 2018. A Retinex image enhancement algorithm based on image fusion technology. Computer Engineering and Science, 40(9):1624-1635
常戬, 刘旺, 白佳弘. 2018.基于图像融合技术的Retinex图像增强算法.计算机工程与科学, 40(9):1624-1635)[DOI:10.3969/j.issn.1007-130X.2018.09.015]
Fang S, Yang J R, Cao Y, Wu P F, Rao R Z. 2012. Local multi-scale Retinex algorithm based on guided image filtering. Journal of Image and Graphics, 17(7):748-755
方帅, 杨静荣, 曹洋, 武鹏飞, 饶瑞中. 2012.图像引导滤波的局部多尺度Retinex算法.中国图象图形学报, 17(7):748-755)[DOI:10.11834/jig.20120702]
Fu Z L. 2000. The making of method for image threshold selection. Journal of Image and Graphics, 5(6):466-469
付忠良. 2000.图象阈值选取方法的构造.中国图象图形学报, 5(6):466-469)[DOI:10.3969/j.issn.1006-8961.2000.06.004]
Gonzalez R C, Woods R E. 2017. Digital Image Processing. Ruan Q Q and Ruan Y Z, trans. 3rd ed. Beijing: Publishing House of Electronics Industry: 4-17
冈萨雷斯, 伍兹. 2017.数字图像处理.阮秋琦, 阮宇智, 译. 3版.北京: 电子工业出版社: 4-17
Grady L. 2006. Random walks for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(11):1768-1783[DOI:10.1109/TPAMI.2006.233]
Kiragu H, Mwangi E. 2012. An improved enhancement of degraded binary text document images using morphological and single scale Retinex operations//Proceedings of 2012 IET Conference on Image Processing. London: IET: 112-112[ DOI:10.1049/cp.2012.0420 http://dx.doi.org/10.1049/cp.2012.0420 ]
L, E H. 1977. The Retinex theory of color vision. Scientific American, 237(6):108-128[DOI:10.1038/scientificamerican1277-108]
Li Z, Li J Z, Hu Y J, Zhang Y. 2019. Mixed prior and weighted guided filter image dehazing algorithm. Journal of Image and Graphics, 24(2):170-179
李喆, 李建增, 胡永江, 张岩. 2019.混合先验与加权引导滤波的图像去雾算法.中国图象图形学报, 24(2):170-179)[DOI:10.11834/jig.180450]
Liu Y H. 2018. Research on Image Enhancement and Quality Assessment Based on Biological Visual Perception Mechanism. Chengdu:University of Electronic Science and Technology of China
刘玉红. 2018.基于生物视觉感知机制的图像增强及质量评价的研究.成都:电子科技大学
Ma J L, Zhou Z Q, Wang B, Dong M J. 2017. Multi-focus image fusion based on multi-scale focus measures and generalized random walk//Proceedings of the 36th Chinese Control Conference. Dalian, China: IEEE: 5464-5468[ DOI:10.23919/ChiCC.2017.8028223 http://dx.doi.org/10.23919/ChiCC.2017.8028223 ]
Mao Z C, Han Y. 2018. Automatic image segmentation algorithm based on random walk. Transducer and Microsystem Technologies, 37(6):142-145
茅正冲, 韩毅. 2018.基于随机游走的自动图像分割算法.传感器与微系统, 37(6):142-145)[DOI:10.13873/j.1000-9787(2018)06-0142-04]
Nayar S K, Nakagawa Y. 1990. Shape from focus: an effective approach for rough surfaces//Proceedings of 1990 IEEE International Conference on Robotics and Automation. Cincinnati: IEEE: 218-225[ DOI:10.1109/ROBOT.1990.125976 http://dx.doi.org/10.1109/ROBOT.1990.125976 ]
Nayar S K, Nakagawa Y. 1994. Shape from focus. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(8):824-831[DOI:10.1109/34.308479]
Okuno T, Nishitani T. 2009. Efficient multi-scale Retinex algorithm using multi-rate image processing//Proceedings of the 16th IEEE International Conference on Image Processing. Cairo: IEEE: 3145-3148[ DOI:10.1109/ICIP.2009.5414428 http://dx.doi.org/10.1109/ICIP.2009.5414428 ]
Parthasarathy S, Sankaran P. 2012. Fusion based multi scale Retinex with color restoration for image enhancement//Proceedings of 2012 International Conference on Computer Communication and Informatics. Coimbatore: IEEE: 1-7[ DOI:10.1109/ICCCI.2012.6158793 http://dx.doi.org/10.1109/ICCCI.2012.6158793 ]
Peng Z M, Jing L, He Y M, Zhang P. 2014. Superresolution fusion of multi-focus image based on multiscale sparse dictionary. Optics and Precision Engineering, 22(1):169-176
彭真明, 景亮, 何艳敏, 张萍. 2014.基于多尺度稀疏字典的多聚焦图像超分辨融合.光学精密工程, 22(1):169-176)[DOI:10.3788/OPE.20142201.0169]
Shannon C E. 1941. Mathematical theory ofthe differential analyzer. Studies in Applied Mathematics, 20(1/4):337-354[DOI:10.1002/sapm1941201337]
Wang M, Li Y J. 2013. An improved random walk algorithm for image segmentation. Computer and Modernization, (8):1-6
王梅, 李玉鑑. 2013.一种改进的随机游走图像分割算法.计算机与现代化, (8):1-6)[DOI:10.3969/j.issn.1006-2475.2013.08.001]
Xie F Y, Tang M, Zhang R. 2019. Review of image enhancement algorithms based on Retinex. Journal of Data Acquisition and Processing, 34(1):1-11
谢凤英, 汤萌, 张蕊. 2019.基于Retinex的图像增强方法综述.数据采集与处理, 34(1):1-11)[DOI:10.16337/j.1004-9037.2019.01.001]
Yuan Y T. 2018. Research on Filtering Based Multi-Focus Image Fusion Algorithm. Xi'an:Northwest University
袁娅婷. 2018.基于滤波的多聚焦图像融合算法研究.西安:西北大学
Zhi N, Mao S J, Li M. 2017. Variational Retinex model based on an extension of TV regularization with relative gradient and its applicationRetinex. Journal on Communications, 38(11):65-75
智宁, 毛善君, 李梅. 2017.基于相对梯度正则化的Retinex变分模型及其应用.通信学报, 38(11):65-75)[DOI:10.11959/j.issn.1000-436x.2017212]
相关作者
相关机构
京公网安备11010802024621