结合Gabor滤波器和扩展LTP算子的无监督纹理图像分割
Unsupervised segmenting texture images based on Gabor filters and extended LTP operator
- 2020年25卷第3期 页码:442-455
收稿:2019-06-12,
修回:2019-9-11,
录用:2019-9-18,
纸质出版:2020-03-16
DOI: 10.11834/jig.190275
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-06-12,
修回:2019-9-11,
录用:2019-9-18,
纸质出版:2020-03-16
移动端阅览
目的
2
现实中的纹理往往具有类型多样、形态多变、结构复杂等特点,直接影响到纹理图像分割的准确性。传统的无监督纹理图像分割算法具有一定的局限性,不能很好地提取稳定的纹理特征。本文提出了基于Gabor滤波器和改进的LTP(local ternary pattern)算子的针对复杂纹理图像的纹理特征提取算法。
方法
2
利用Gabor滤波器和扩展LTP算子分别提取相同或相似纹理模式的纹理特征和纹理的差异性特征,并将这些特征融入到水平集框架中对纹理图像进行分割。
结果
2
通过实验表明,对纹理方向及尺度变化较大的图像、复杂背景下的纹理图像以及弱纹理模式的图像,本文方法整体分割结果明显优于传统的Gabor滤波器、结构张量、拓展结构张量、局部相似度因子等纹理分割方法得到的结果。同时,将本文方法与基于LTP的方法进行对比,分割结果依然更优。在量化指标方面,将本文方法与各种无监督的纹理分割方法就分割准确度进行对比,结果表明,在典型的纹理图像上,本文方法准确度达到97%以上,高于其他方法的分割准确度。
结论
2
提出了一种结合Gabor滤波器和扩展LTP算子的无监督多特征的纹理图像分割方法,能够较好地提取相似纹理模式的特征和纹理的差异性特征,且这些纹理特征可以很好地融合到水平集框架中,对真实世界复杂纹理图像能够得到良好的分割效果。
Objective
2
The texture is often characterized by various unregular types
varied shapes
and complex structures
which directly weaken the accuracy of texture image segmentation. The semantic segmentation methods based on deep learning need benchmark training sets. Constructing the training sets composed by the complex and diverse texture images is difficult. Therefore
utilizing the unsupervised image segmentation methods to solve the problem of texture segmentation is necessary. However
the traditional unsupervised texture image segmentation algorithms have limitations and cannot be used to effect tivelyextract the stable texture features.
Method
2
Based on the idea that the Gabor operator can extract the texture diversity features and the local ternary pattern (LTP) operators imply the threshold differences
combining Gabor filters with extended LTP operators is proposed to describe texture diversity features in this paper. Gabor filter is used to extract the texture features of the same or similar texture patterns. Then
the texture difference features are extracted. Compared with the traditional LTP
the main advantages of the extended LTP operator are embodied in two aspects.On the one hand
the extended size make the LTP operator effective in image segmentation based on the size features of the segmented image.On the other hand
the weights are given to each position of the extended LTP operator. The exponential weight differences are given according to the distances between each position and the central point. Finally
these extracted features are integrated into the level set frame to segment the texture image. The advantages of the proposed method are described as follows:First
the extended LTP operator can effectively extract the texture difference features of local regions. Second
the Gabor filter and extended LTP operator are complementary. The main contributions of the proposed method in this paper are elaborated in the following:1) By improving the traditional LTP operator
we propose an extended LTP operator to extract the texture difference features of pixels in complex images. 2) The Gabor filter and extended LTP operator are complementary. The extended LTP operator and Gabor filter are combined and incorporated into the level set method. The extended LTP operator extracts the texture difference information of complex images
while the Gabor method detects similar information
such as similar frequency
size
and direction of images. The two operators have obvious complementary characteristics. Therefore
the extended LTP operator and Gabor filter are combined to extract the texture features of complex images in a complementary manner. The two operators are integrated into the level set method to effectively solve the segmentation problem of the complex images.
Result
2
In the experimental results section
the proposed method is compared with the classical unsupervised texture segmentation methods
including the methods based on Gabor filter
structure tensor
extended structure tensor
and local similarity factor. By segmenting all kinds of texture images
such as the images with varied texture directions and sizes
the images with the complex background
and the images with the weak texture features
the proposed method achieved better segmentation results than that of the traditional Gabor filter
where the structure tensor was expanded with the local similarity factor. By comparing the proposed method with the LTP-based method in this study
we found that the segmentation results of the proposed method are still better than those of the LTP-based method. In the experimental results section
the segmentation results of several commonly used level set methods (including Gabor filter
structure tensor
extended structure tensor
and robust local similarity factor (RLSF)) are presented and compared with the segmentation results of the proposed method.
Fig. 8
Fig. 8
-
10
10
show the advantages of the proposed method for segmentation of three types of texture images. More intuitively
specific quantitative results of segmentation accuracy were given for comparison between the proposed method and the various unsupervised texture segmentation methods in this study. On some typical texture images
the accuracy of the proposed method is more than 97%
which is higher than that of the other methods.
Conclusion
2
An unsupervised multi-feature-based texture image segmentation algorithm is proposed in this paper. This method can be utilized to extract the features of the similar texture patterns and the texture differences by combining the Gabor filter and extended LTP operator. These texture features were integrated into the level set framework to segment the texture images accurately. Several experiments show that the proposed method can achieve desirable segmentation results for complex texture images in the real world. The advantages and disadvantages of the proposed unsupervised segmentation method were analyzed and the methods based on deep learning in the conclusion section. Compared with the segmentation methods based on deep learning
the proposed method is unsupervised
and therefore does not need prior or training information. However
the segmentation methods based on deep learning relies on training information heavily. Obtaining the training information of the complex texture images is difficult. At the same time
future research ideas are elaborated. Considering some structural relevance of texture images
our future work aims to focus on the extraction and analysis of texture structures to obtain improved segmentation effects.
Chan T F and Vese L A. 2001. Active contours without edges. IEEE Transactions on Image Processing, 10(2):266-277[DOI:10.1109/83.902291]
Chen J Q, Pappas T N, Mojsilović A and Rogowitz B E. 2005. Adaptive perceptual color-texture image segmentation. IEEE Transactions on Image Processing, 14(10):1524-1536[DOI:10.1109/TIP.2005.852204]
Deng Y and Manjunath B S. 2001. Unsupervised segmentation of color-texture regions in images and video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(8):800-810[DOI:10.1109/34.946985]
Gao X B, Wang B, Tao D C and Li X L. 2011a. A unified tensor level set method for image segmentation//Lin W S, Tao D C, Kacprzyk J, Li Z, IzquierdoE and Wang H H, eds. Multimedia Analysis, Processing and Communications. Berlin, Heidelberg: Springer: 217-238[ DOI:10.1007/978-3-642-19551-8_7 http://dx.doi.org/10.1007/978-3-642-19551-8_7 ]
Gao X B, Wang B, Tao D C and Li X L. 2011b. A relay level set method for automatic image segmentation. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 41(2):518-525[DOI:10.1109/TSMCB.2010.2065800]
Hou Y L and Yang G S. 2007. Unsupervised texture segmentation algorithm based on wavelet transform. Computer Engineering and Applications, 43(34):74-77
侯艳丽, 杨国胜. 2007.一种基于小波变换的无监督纹理分割算法.计算机工程与应用, 43(34):74-77)[DOI:10.3321/j.issn:1002-8331.2007.34.024]
Houhou N, Thiran J P and Bresson X. 2009. Fast texture segmentation based on semi-local region descriptor and active contour. Numerical Mathematics:Theory, Methods and Applications, 2(4):445-468[DOI:10.4208/nmtma.2009.m9007s]
Ilea D E and Whelan P F. 2008. CTex——an adaptive unsupervised segmentation algorithm based on color-texture coherence. IEEE Transactions on Image Processing, 17(10):1926-1939[DOI:10.1109/TIP.2008.2001047]
Li C M, Xu C Y, Gui C F and Fox M D. 2005. Level set evolution without re-initialization: a new variational formulation//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego, CA, USA: IEEE: 430-436[ DOI:10.1109/CVPR.2005.213 http://dx.doi.org/10.1109/CVPR.2005.213 ]
Li G, Li H F, Shang F X and Guo H. 2018. Noise image segmentation model with local intensity difference. Journal of Computer Applications, 38(3):842-847
李钢, 李海芳, 尚方信, 郭浩. 2018.结合局部灰度差异的噪声图像分割模型.计算机应用, 38(3):842-847)[DOI:10.11772/j.issn.1001-9081.2017082134]
Li H Q, Wang C, Ye Z F and Wang J S. 2003. An improved method for texture segmentation based on Gabor filters. Journal of Circuits and Systems, 8(6):82-86
李厚强, 王超, 叶中付, 王劲松. 2003.一种改进的基于Gabor滤波器的纹理分割方法.电路与系统学报, 8(6):82-86)[DOI:10.3969/j.issn.1007-0249.2003.06.018]
Li M and Staunton R C. 2008. Optimum Gabor filterdesign and local binary patterns for texture segmentation. Pattern Recognition Letters, 29(5):664-672[DOI:10.1016/j.patrec.2007.12.001]
Liao S C, Zhao G Y, Kellokumpu V, Pietikäinen M and Li S Z. 2010. Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, USA: IEEE: 1301-1306[ DOI:10.1109/CVPR.2010.5539817 http://dx.doi.org/10.1109/CVPR.2010.5539817 ]
Long J, Shelhamer E and Darrell T. 2015. Fully convolutional networks for semantic segmentation//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE: 3431-3440[ DOI:10.1109/CVPR.2015.7298965 http://dx.doi.org/10.1109/CVPR.2015.7298965 ]
Min H, Xia L, Han J W, Wang X F, Pan Q Q, Fu H, Wang H Z, Wang S T C and Li H. 2019. A multi-scale level set method based on local features for segmentation of images with intensity inhomogeneity. Pattern Recognition, 91:69-85[DOI:10.1016/j.patcog.2019.02.009]
Min Y Z, Cheng T D, Yin C, Yue B, Xiao B Y and Ma H F. 2017. Texture image segmentation based on GLCM and self-adaptive Gabor filter bank. Computer Engineering, 43(1):280-286
闵永智, 程天栋, 殷超, 岳彪, 肖本郁, 马宏锋. 2017.基于GLCM与自适应Gabor滤波器组的纹理图像分割.计算机工程, 43(1):280-286)[DOI:10.3969/j.issn.1000-3428.2017.01.048]
Niu S J, Chen Q, De Sisternes L, Ji Z X, Zhou Z M and Rubin D L. 2017. Robust noise region-based active contour model via local similarity factor for image segmentation. Pattern Recognition, 61:104-119[DOI:10.1016/j.patcog.2016.07.022]
Ojala T, Pietikäinen M and Harwood D. 1996. A comparative study of texture measures with classification based on featured distributions. Pattern Recognition, 29:51-59[DOI:10.1016/0031-3203(95)00067-4]
Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//Proceedings of the 18th Medical Image Computing and Computer-Assisted Intervention. Munich, Germany: Springer: 234-241[ DOI:10.1007/978-3-319-24574-4_28 http://dx.doi.org/10.1007/978-3-319-24574-4_28 ]
Sandberg B, Chan T and Vese L. 2002. A Level-set and Gabor-based Active Contour Algorithm for Segmenting Textured Images. Los Angeles, USA: UCLA Deparfment of Mathematics CAM reponf: 02-39[ DOI:10.1.1.7.3145 http://dx.doi.org/10.1.1.7.3145 ]
Tirandaz Z and Akbarizadeh G. 2016. Unsupervised texture-based SAR image segmentation using spectral regression and Gabor filter bank. Journal of the Indian Society of Remote Sensing, 44(2):177-186[DOI:10.1007/s12524-015-0490-0]
Wang X C, Shan J X, Niu Y M, Tan L W and Zhang S X. 2014. Enhanced distance regularization for re-initialization free level set evolution with application to image segmentation. Neurocomputing, 141:223-235[DOI:10.1016/j.neucom.2014.03.011]
Wang X F, Huang D S and Xu H. 2010.An efficient local Chan-Vese model for image segmentation. Pattern Recognition, 43(3):603-618[DOI:10.1016/j.patcog.2009.08.002]
Zhou L and Min H. 2019. Level set method based on local connection operator and difference operator for segmenting texture images. Journal of Image and Graphics, 24(1):39-49
周力, 闵海. 2019.基于局部连接度和差异度算子的水平集纹理图像分割.中国图象图形学报, 24(1):39-49)[DOI:10.11834/jig.180435]
相关作者
相关机构
京公网安备11010802024621