融合区域和边缘特征的水平集水下图像分割
Level set method combining region and edge features for segmenting underwater images
- 2020年25卷第4期 页码:824-835
收稿:2019-07-11,
修回:2019-9-27,
录用:2019-10-4,
纸质出版:2020-04-16
DOI: 10.11834/jig.190356
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-07-11,
修回:2019-9-27,
录用:2019-10-4,
纸质出版:2020-04-16
移动端阅览
目的
2
水平集模型是图像分割中的一种先进方法,在陆地环境图像分割中展现出较好效果。特征融合策略被广泛引入到该模型框架,以拉伸目标-背景对比度,进而提高对高噪声、杂乱纹理等多类复杂图像的处理性能。然而,在水下环境中,由于水体高散射、强衰减等多因素的共同作用,使得现有图像特征及水平集模型难以适用于对水下图像的分割任务,分割结果与目标形态间存在较大差异。鉴于此,提出一种适用于水下图像分割的区域-边缘水平集模型,以提高水下图像目标分割的准确性。
方法
2
综合应用图像的区域特征及边缘特征对水下目标进行辨识。对于区域特征,引入水下图像显著性特征;对于边缘特征,创新性地提出了一种基于深度信息的边缘特征提取方法。所提方法在融合区域级和边缘级特征的基础上,引入距离正则项对水平集函数进行规范,以增强水平集函数演化的稳定性。
结果
2
基于YouTube和Bubblevision的水下数据集的实验结果表明,所提方法不仅对高散射强衰减的低对比度水下图像实现较好的分割效果,同时对处理强背景噪声图像也有较好的鲁棒性,与水平集分割方法(local pre-fitting,LPF)相比,分割精确度至少提高11.5%,与显著性检测方法(hierarchical co-salient detection via color names,HCN)相比,精确度提高6.7%左右。
结论
2
实验表明区域-边缘特征融合以及其基础上的水平集模型能够较好地克服水下图像分割中的部分难点,所提方法能够较好分割水下目标区域并拟合目标轮廓,与现有方法对比获得了较好的分割结果。
Objective
2
Image segmentation is to divide images into homogeneous parts. The level set model is an important method for image segmentation. In theory
this type of models is characterized by the implicit representation of curve evolution
which transforms the image segmentation task into the issue of the mathematical minimization by curve evolution. In recent years
the level set model has been widely used for image segmentation due to its satisfying performance for handling complicated topological changes and has shown good results on ground-based image segmentation. Recently
a variety of feature fusion strategies are introduced into the model framework to stretch the foreground-background contrast to improve the performance on many complicated conditions
such as high noises and several textures. However
different from the ground-based image segmentation
the underwater environment is characterized by the high scattering and strong attenuation factors. As a result
the existing image features and level set models are difficult to be applied in underwater image segmentation. In view of this fact
a region-edge level set model suitable for underwater image segmentation is proposed.
Method
2
The representation of the underwater image is often characterized by low contrast and strong noise. The factor of the low contrast makes the objects difficult to be distinguished
which likely causes the weakness among edges. Thus
the region-based and edge-based level set segmentation method degenerated under water. Moreover
the strong underwater noises make the level set model difficult to converge on the object region. To solve the problems mentioned above
our proposed method comprehensively utilizes the region features and edge features of the image to identify the object region in underwater images. First
for the region features
the proposed method introduces the underwater image saliency features into the level set model
and estimates the spatial frequency of the image to identify the object region. For the edge features
this study proposes a novel edge feature extraction method based on depth information
and then extracts the depth deviation from the image to distinguish the object and background
which helps formulate the edge constraint. In the level set function
the edge constraint term is embedded as a weight function to adaptively adjust the weight of the level set constraint to make the model stable. The edge term and the region term cooperate to construct an external energy constraint of the level set model. By fusing the region and edge features
the distance regulation term is introduced to formulate the internal energy term of the level set model
which accelerates the evolution of the level set function and standardizes the level set function to enhance the stability of the level set model. The external energy term and the internal energy term are combined to formulate the final level set function.
Result
2
To prove the performance of the proposed method for underwater image segmentation
the proposed method is applied to segment underwater images with low contrast
uneven grayscale or strong background noise
and compare our method with several advanced level set models. At the same time
our methods are compared with several saliency detection methods. The experimental results demonstrate that the underwater object edge is accurately segmented by our method. The proposed method can effectively solve the problems caused by low contrast. In addition
the proposed method is applied to underwater images with strong background noise. Results show that the underwater object and the background are successfully distinguished. Thus
the robustness of the proposed method against underwater strong background noises is proved. Based on the underwater images selected from Youtube and Bubblevision websites
the proposed method outperform several comparison methods in underwater image segmentation. Finally
this study evaluates various methods by using quantitative experiments. Results show that in contrast to the level set segmentation method local pre-fitting(LPF)
the segmentation accuracy of the proposed method is improved by at least 11.5%. At the same time
the segmentation accuracy of the proposed method is improved by approximately 6.7% compared with the saliency detection method hierarchical co-salient detection via color names(HCN). Based on the qualitative and quantitative analysis
the proposed method cannot only obtain satisfying results on segmenting underwater images with high scattering and strong attenuation
but also has good robustness against strong background noises.
Conclusion
2
In this study
a region-edge based level set model is proposed for underwater image segmentation. The region and edge features of the image are utilized comprehensively and applied to segment underwater images with high scattering and strong noise. For region features
saliency detection is used to stretch the object-background contrast and identify the object region. For the edge features
a novel method is proposed to extract the object edge information
which can solve the weak edge problem caused by the underwater environment. In addition
the regularization term makes the evolution of the level set function stable and robust. Experimental results show that the proposed level set model based on the region-edge feature fusion can well overcome several difficulties for underwater image segmentation. The proposed method can accurately segment the underwater object region and identify the object contour. In contrast to the existing methods
good segmentation results can be obtained by our method.
Achanta R, Hemami S, Estrada F and Susstrunk S. 2009. Frequency-tuned salient region detection//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA: IEEE: 1597-1604[ DOI:10.1109/CVPR.2009.5206596 http://dx.doi.org/10.1109/CVPR.2009.5206596 ]
Al-Amri S S and Kalyankar N V. 2010. Image segmentation by using threshold techniques. Journal of Computing, 2(5):83-86
Caselles V, Kimmel R and Sapiro G. 1997. Geodesic active contours. International Journal of Computer Vision, 22(1):61-79[DOI:10.1023/A:1007979827043]
Chan T F and Vese L A. 2001. Active contours without edges. IEEE Transactions on Image Processing, 10(2):266-277[DOI:10.1109/83.902291]
Chen Z, Zhang Z, Dai F Z, Bu Y and Wang H B. 2017. Monocular vision-based underwater object detection. Sensors, 17(8):1784-1796[DOI:10.3390/s17081784]
Chiang J Y and Chen Y C. 2012. Underwater image enhancement by wavelength compensation and dehazing. IEEE Transactions on Image Processing, 21(4):1756-1769[DOI:10.1109/TIP.2011.2179666]
Chopp D L. 1993. Computing minimal surfaces via level set curvature flow. Journal of Computational Physics, 106(1):77-91[DOI:10.1006/jcph.1993.1092]
Ding K Y, Xiao L F and Weng G R. 2017. Active contours driven by region-scalable fitting and optimized Laplacian of Gaussian energy for image segmentation. Signal Processing, 134:224-233[DOI:10.1016/j.sigpro.2016.12.021]
Ding K Y, Xiao L F and Weng G R. 2018. Active contours driven by local pre-fitting energy for fast image segmentation. Pattern Recognition Letters, 104:29-36[DOI:10.1016/j.patrec.2018.01.019]
Everingham M, Eslami S M A, van Gool L, Williams C K I, Winn J and Zisserman A. 2015. The Pascal visual object classes challenge:a retrospective. International Journal of Computer Vision, 111(1):98-136[DOI:10.1007/s11263-014-0733-5]
Harel J, Koch C and Perona P. 2007. Graph-based visual saliency//Proceedings of the 19th International Conference on Neural Information Processing Systems. Vancouver, Canada: MIT Press: 545-552
He K M, Sun J S and Tang X O. 2009. Single image haze removal using dark channel prior//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA: IEEE: 1956-1963[ DOI:10.1109/CVPR.2009.5206515 http://dx.doi.org/10.1109/CVPR.2009.5206515 ]
Li C M, Kao C Y, Gore J C and Ding Z H. 2007. Implicit active contours driven by local binary fitting energy//Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA: IEEE: 1-7[ DOI:10.1109/CVPR.2007.383014 http://dx.doi.org/10.1109/CVPR.2007.383014 ]
Li C M, Kao C Y, Gore J C and Ding Z H. 2008. Minimization of region-scalable fitting energy for image segmentation. IEEE Transactions on Image Processing, 17(10):1940-1949[DOI:10.1109/TIP.2008.2002304]
Li C M, Xu C Y, Gui C F and Fox M D. 2010. Distance regularized level set evolution and its application to image segmentation. IEEE Transactions on Image Processing, 19(12):3243-3254[DOI:10.1109/TIP.2010.2069690]
Li J, Levine M D, An X J, Xu X and He H G. 2013. Visual saliency based on scale-space analysis in the frequency domain. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(4):996-1010[DOI:10.1109/tpami.2012.147]
Lou J, Xu F L, Xia Q Y, Yang W K and Ren M W. 2017. Hierarchical co-salient object detection via color names//Proceedings of the 2017 Asian Conference on Pattern Recognition. Nanjing, China: IEEE: 718-724[ DOI:10.1109/ACPR.2017.91 http://dx.doi.org/10.1109/ACPR.2017.91 ]
Malladi R, Sethian J A and Vemuri B C. 1995. Shape modeling with front propagation:A level set approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(2):158-175
McInerney T and Terzopoulos D. 1995. Topologically adaptable snakes//Proceedings of 1995 IEEE International Conference on Computer Vision. Cambridge, USA: IEEE: 840-845[ DOI:10.1109/ICCV.1995.466850 http://dx.doi.org/10.1109/ICCV.1995.466850 ]
Mumford D and Shah J. 1985. Boundary detection by minimizing functionals//Proceedings of 1985 IEEE Computer Vision and Pattern Recognition Conference. San Francisco, USA: IEEE: 22-26
Osher S and Sethian A. 1988. Fronts propagating with curvature-dependent speed:algorithms based on Hamilton-Jacobi formulations. Journal of Computational Physics, 79(1):12-49[DOI:10.1016/0021-9991(88)90002-2]
Smeulders A W M, Chu D M, Cucchiara R, Calderara S, Dehghan A and Shah M. 2014. Visual tracking:an experimental survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(7):1442-1468[DOI:10.1109/TPAMI.2013.230]
Wang L F. Wu H Y and Pan C H. 2013. Region-based image segmentation with local signed difference energy. Pattern Recognition Letters, 34(6):637-645[DOI:10.1016/j.patrec.2012.12.022]
Wang B, Li J and Gao X B. 2012. An edge-and region-based level set method with shape priors for image segmentation. Chinese Journal of Computers, 35(5):1067-1072
王斌, 李洁, 高新波.2012.一种基于边缘与区域信息的先验水平集图像分割方法.计算机学报, 35(5):1067-1072
Zhang K H, Song H H and Zhang L. 2010. Active contours driven by local image fitting energy. Pattern Recognition, 43(4):1199-1206[DOI:10.1016/j.patcog.2009.10.010]
Zhang K H, Zhang L, Lam K M and Zhang D. 2016. A level set approach to image segmentation with intensity inhomogeneity. IEEE Transactions on Cybernetics, 46(2):546-557[DOI:10.1109/TCYB.2015.2409119]
Zhang Y J. 2006. Advances in Image and Video Segmentation. Hershey, PA:IRM Press
Zhou L, Yang Z H, Zhou Z T and Hu D W. 2017. Salient region detection using diffusion process on a 2-layer sparse graph. IEEE Transactions on Image Processing, 26(12):5882-5894[DOI:10.1109/tip.2017.2738839]
Zhou S P, Wang J J, Zhang S, Liang Y D and Gong Y H. 2016. Active contour model based on local and global intensity information for medical image segmentation. Neurocomputing, 186:107-118[DOI:10.1016/j.neucom.2015.12.073]
相关作者
相关机构
京公网安备11010802024621