模糊相关图割的非监督层次化彩色图像分割
Unsupervised hierarchical color image segmentation through fuzzy correlation and graph cut
- 2018年23卷第9期 页码:1326-1334
收稿:2018-01-03,
修回:2018-3-9,
纸质出版:2018-09-16
DOI: 10.11834/jig.170659
移动端阅览

浏览全部资源
扫码关注微信
收稿:2018-01-03,
修回:2018-3-9,
纸质出版:2018-09-16
移动端阅览
目的
2
基于阈值的分割方法能根据像素的信息将图像划分为同类的区域,其中常用的最大模糊相关分割方法,因能利用模糊相关度量划分的适当性,得到较好的分割结果,而广受关注。然而该算法存在划分数需预先确定,阈值的分割结果存在孤立噪声,无法对彩色图像实施分割的问题。为此,提出基于模糊相关图割的非监督层次化分割策略来解决该问题。
方法
2
算法首先将图像划分为若干超像素,以提高层次化图像分割的效率;随后将快速模糊相关算法与图割结合,构成模糊相关图割2-划分算子,在确保分割效率的基础上,解决单一阈值分割存在孤立噪声的问题;最后设计了自顶向下层次化分割策略,利用构建的2-划分算子选择合适的区域及通道,迭代地对超像素实施层次化分割,直到算法收敛,划分数自动确定。
结果
2
对Berkeley分割数据库上300幅图像进行了测试,结果表明算法能有效分割彩色图像,分割精度优于Ncut、JSEG方法,运行时间较这两种方法也提高了近20%。
结论
2
本文算法为最大模糊相关算法在非监督彩色图像分割领域的应用提供指导依据,能用于目标检测和识别领域。
Objective
2
Image segmentation is a process of dividing an image into different regions such that each region is homogeneous but the union of any two adjacent regions is not. As the first step in image analysis and pattern recognition
image segmentation serves as a fundamental step in numerous computer vision applications
such as object detection
content-based image retrieval
and medical image analysis. Threshold-based methods
which subdivide the image into several homogenous regions on the basis of pixel intensities
are popular segmentation techniques. Numerous algorithms have been proposed in this direction
which include gray-level thresholding and interactive pixel classification. Among these algorithms
the frequently used maximum fuzzy correlations are widely adopted to measure the appropriateness of fuzzy two partitions for the image segmentation purpose due to the unavoidable ambiguities
fuzziness
and uncertainty of the image information. However
this method has some limitations
i.e.
the partition number needs to be preset
the results have isolated noise
and maximum fuzzy correlation approach cannot be extended to color image segmentation.
Method
2
Most existing gray-level image segmentation techniques could be extended to color image. They can be directly applied to each component of a color space
and then
the result can be combined in a certain way to obtain the final segmentation result. However
one of the problems is how to use the color information as a whole for each pixel and how to select the color representation for segmentation because each color representation has advantages and disadvantages. To address these problems
an unsupervised hierarchical color image segmentation through maximum fuzzy correlation and graph cut is proposed. First
we oversegment the color image into superpixels to improve the efficiency of hierarchical image segmentation. Then
we combine the fast fuzzy correlation with graph cut to form a bi-level segmentation operator
which can suppress the isolated noise caused by the single threshold-based approach and enforce the spatial coherence in the thresholding segmentation approach. Here
an iterative calculation scheme is presented to reduce redundant computations in fuzzy correlation evaluation. Finally
a top-down hierarchical segmentation approach has been designed. By iteratively performing this bi-level segmentation operator
multilevel image segmentation is achieved in a hierarchical manner. Starting from the input color image
our algorithm first selects the color channel that can best segment the image into two labels and then iteratively selects channels to further split each label until convergence. In practice
we partition the 3D color space and adopt the idea of k-d tree to record the segmentation process.
Result
2
The presented hierarchical segmentation is implemented in Matlab 7.0. Quantitative and qualitative evaluations are performed to compare with those from the state-of-the-art methods. To test the effectiveness of graph cut on the basis of two fuzzy correlation partitions
we compare our method with maximum fuzzy correlation. The experiment shows that our method can overcome the isolated noise and obtain satisfactory results. To demonstrate the segmentation performance of our algorithm on the color images
the Berkeley segmentation database is used
which consists of 300 natural images of diverse scene categories. We quantitatively compare the performance of our method with existing SAS
Ncut
and JSEG methods. Among these methods
SAS and Ncut are semi-supervised hierarchical superpixel-based color image segmentation methods. However
JSEG is an unsupervised color image segmentation method. By utilizing four widely used metrics
we can find that our method outperforms the Ncut and JSEG methods in terms of precision
and the running time is improved by 20%. Compared with SAS
our method obtains subpar results because it uses only pixel color information and is fully unsupervised. In comparison
the SAS approach uses high-level features
such as texture
edges
and color for segmentation.
Conclusion
2
An unsupervised hierarchical image segmentation approach is presented in this paper. The algorithm uses superpixels as segmentation primitives and iteratively partitions all superpixels using a bi-level segmentation operator
which combines fuzzy correlation and graph cut. By using this scheme
the proposed method can effectively handle color images and provide an important reference for the application of the maximum fuzzy correlation algorithm in the field of unsupervised color image segmentation. The limitation of the proposed approach is that it only segments images by using color information
which leads to suboptimal results when the objects and background have similar colors. Utilizing high-level cues in the proposed hierarchical segmentation framework while maintaining it as an unsupervised approach is a non-trivial task. We plan to study this issue as part of our future work.
Hettiarachchi R, Peters J F. Voronoï region-based adaptive unsupervised color image segmentation[J]. Pattern Recognition, 2017, 65:119-135.[DOI:10.1016/j.patcog.2016.12.011]
Shi J B, Malik J. Normalized cuts and image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8):888-905.[DOI:10.1109/34.868688]
Li Z G, Wu X M, Chang S F. Segmentation using superpixels: a bipartite graph partitioning approach[C]//Proceedings of 2012 IEEE Conference on the Computer Vision and Pattern Recognition. Providence, Rhode Island: IEEE, 2012: 789-796. [ DOI:10.1109/CVPR.2012.6247750 http://dx.doi.org/10.1109/CVPR.2012.6247750 ]
Wang X F, Tang Y X, Masnou S, et al. A global/local affinity graph for image segmentation[J]. IEEE Transactions on Image Processing, 2015, 24(4):1399-1411.[DOI:10.1109/TIP.2015.2397313]
Fang L L, Zhao W T, Li X Y, et al. A convex active contour model driven by local entropy energy with applications to infrared ship target segmentation[J]. Optics&Laser Technology, 2017, 96:166-175.[DOI:10.1016/j.optlastec.2017.05.008]
Chen N, Xu Z S, Xia M M. Correlation coefficients of hesitant fuzzy sets and their applications to clustering analysis[J]. Applied Mathematical Modelling, 2013, 37(4):2197-2211.[DOI:10.1016/j.apm.2012.04.031]
Tang Y G, Mu W W, Zhao L X, et al. An image segmentation method based on maximizing fuzzy correlation and its fast recursive algorithm[J]. Computers&Electrical Engineering, 2014, 40(3):833-843.[DOI:10.1016/j.compeleceng.2013.07.009]
Achanta R, Shaji A, Smith K, et al. SLIC superpixels compared to state-of-the-art superpixel methods[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11):2274-2282.[DOI:10.1109/TPAMI.2012.120]
Delong A, Boykov Y. A scalable graph-cut algorithm for N-D grids[C]//Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition. Anchorage, Alaska, USA: IEEE, 2008: 1-8. [ DOI:10.1109/CVPR.2008.4587464 http://dx.doi.org/10.1109/CVPR.2008.4587464 ]
Boykov Y, Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision[J]. IEEE Transactions on Pattern Analysis And Machine Intelligence, 2004, 26(9):1124-1137.[DOI:10.1109/TPAMI.2004.60]
Eldar Y C. Minimax MSE estimation of deterministic parameters with noise covariance uncertainties[J]. IEEE Transactions on Signal Processing, 2006, 54(1):138-145.[DOI:10.1109/TSP.2005.861086]
Liu J Q, Yang Y H. Multiresolution color image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994, 16(7):689-700.[DOI:10.1109/34.297949]
相关作者
相关机构
京公网安备11010802024621