多相图像分割Vese-Chan模型连续最大流方法
Continuous max-flow method for multiphase segmentation Vese-Chan model
- 2020年25卷第5期 页码:926-935
收稿:2019-08-19,
修回:2019-9-20,
录用:2019-9-27,
纸质出版:2020-05-16
DOI: 10.11834/jig.190387
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-08-19,
修回:2019-9-20,
录用:2019-9-27,
纸质出版:2020-05-16
移动端阅览
目的
2
多相图像分割是图像处理与分析的重要问题,变分图像分割的Vese-Chan模型是多相图像分割的基本模型,由于该模型使用较少的标签函数构造区域划分的特征函数,具有求解规模小的优点。图割(graph cut,GC)算法可将上述能量泛函的极值问题转化为最小割/最大流问题求解,大大提高了计算效率。连续最大流(continuous max-flow,CMF)方法是经典GC算法的连续化表达,不仅具备GC算法的高效性,且克服了经典GC算法由于离散导致的精度下降问题。本文提出基于凸松弛的多相图像分割Vese-Chan模型的连续最大流方法。
方法
2
根据划分区域编号的二进制表示构造两类特征函数,将多相图像分割转化为多个交替优化的两相图像分割问题。引入对偶变量将Vese-Chan模型转化为与最小割问题相对应的连续最大流问题,并引入Lagrange乘子设计交替方向乘子方法(alternating direction method of multipliers,ADMM),将能量泛函的优化问题转化为一系列简单的子优化问题。
结果
2
对灰度图像和彩色图像进行数值实验,从分割效果看,本文方法对于医学图像、遥感图像等复杂图像的分割效果更加精确,对分割对象和背景更好地分离;从分割效率看,本文方法减少了迭代次数和运算时间。在使用2个标签函数的分割实验中,本文方法运算时间加速比分别为6.35%、10.75%、12.39%和7.83%;在使用3个标签函数的分割实验中,运算时间加速比分别为12.32%、15.45%和14.04%;在使用4个标签函数的分割实验中,运算时间加速比分别为16.69%和20.07%。
结论
2
本文提出的多相图像分割Vese-Chan模型的连续最大流方法优化了分割效果,减少了迭代次数,从而提高了计算效率。
Objective
2
Multiphase image segmentation
an extension of two-phase image segmentation
is designed to partition images automatically into different regions according to different image features. It is a basic problem in image processing
image analysis
and computer vision. Variational image segmentation Vese-Chan model is a basic model of multiphase image segmentation that can construct characteristic functions for different phases or regions using fewer label functions
thus producing small-scale solutions. Graph cut (GC) algorithm can transform the optimization problem of energy function into the min-cut/max-flow problem
which greatly improves computational efficiency. In the spatially discrete setting
the computational results of the min-cut method are influenced by the discrete grid
resulting in measurement errors. In recent years
the continuous max-flow (CMF) method was proposed. As a continuous expression of the classical GC algorithm
CMF can keep the high efficiency of the GC algorithm and overcome measurement errors caused by the discretization of the classical GC algorithm. On the basis of the framework of variational theory
the CMF method for multiphase image segmentation Potts model and two-phase image segmentation Chan-Vese model was proposed and studied. However
a CMF method for the Vese-Chan model has not been studied. Therefore
we propose a CMF method for multiphase image segmentation Vese-Chan model based on convex relaxation and study its computational effectiveness and efficiency.
Method
2
In this study
binary label functions are used to construct different characteristic functions for different phases according to the relationship between a natural number and a binary representation of partitioned regions. The characteristic functions are divided into two parts according to the value of binary expression
i.e.
0 or 1. The characteristic functions are different. The date term of the segmentation model is also divided into two parts. Therefore
multiphase image segmentation can be transformed into two-phase image segmentation. This model can be expressed as a symmetric form of label functions
which are beneficial to interpret and realize. We introduce three dual variables
namely
source flow
sink flow
and spatial flow field. Next
we rewrite the optimization problem of energy function for the Vese-Chan model
including the above three dual variables. Flow conservation conditions are obtained by solving minimum problems of energy function. The Vese-Chan model can be transformed into a continuous max-flow problem corresponding to the min-cut problem. To improve computational efficiency in the experiments
we likewise design the alternating direction method of multipliers (ADMM) by introducing Lagrange multipliers and penalty parameters for the proposed model. The main idea of alternating optimization is to solve the optimization problem of one variable by fixing other variables. Therefore
the optimization problem of energy function can be transformed into three simple sub-problems of optimization
which can be achieved and solved more easily. For example
to solve one sub-problem on the source flow variable
the sink flow variable and spatial flow field variable should be fixed. Three dual variables must be calculated and Lagrange multipliers should be updated at each step. All of these variable need projection to satisfy the range of values. When the energy error formula is satisfied
the computational iteration stops. To represent the boundary of images after segmenting
it is necessary to threshold convex relaxed label functions into binary label functions. Finally
we can obtain segmentation results according to the binary label functions.
Result
2
Numerical experiments are performed on gray and colored images. According to the area numbers of images
numerical experiments are divided into three parts: experiments using two binary label functions
three binary label functions
and four binary label functions. Segmentation results are represented by curves of different colors. In particular
to accurately represent the segmentation effects for complicated images
we obtain the approximate segmentation results. For the segmentation effectiveness
experimental results prove that the ADMM method and our proposed method have the same segmentation effectiveness for simple synthetic images. However
compared with ADMM
our proposed method is more accurate for complex images
such as medical and remote sensing images. Moreover
our method can achieve better separation for segmented objects and background. For the computational efficiency
we use two binary label functions to compare the efficiency of four gray images
including synthetic images
a natural image
and a medical image. The acceleration ratios of computational time for our proposed method are 6.35%
10.75%
12.39%
and 7.83%
respectively. For the experiment of three binary label functions
three gray images are compared
including synthetic images and a remote sensing image are compared. The computational times of our proposed method improve by 12.32%
15.45%
and 14.04% for each image. For the experiment of four binary label functions
we compare two color images
including a natural image and a synthetic image. The computational times of our proposed method improve by 16.69% and 20.07%. In the experiments
our proposed method reduces the number of iterations and improves the convergence speed. By comparing the acceleration ratio of computational time with the increase of region phases or the complexity of the image
the advantages of the computational efficiency for our method are more evident.
Conclusion
2
Continuous max-flow method is used to solve the multiphase image segmentation Vese-Chan model. Numerical experiments are performed to demonstrate the superiority of our method in terms of computational effectiveness and efficiency for medical images
remote sensing images
and color images. Our method can be applied to multiphase segmentation for three-dimensional reconstruction of medical images in the future.
Bae E and Tai X C. 2009. Graph cut optimization for the piecewise constant level set method applied to multiphase image segmentation//Proceedings of the 2nd International Conference on Scale Space and Variational Methods in Computer Vision. Voss, Norway: Springer: 1-13[ DOI:10.1007/978-3-642-02256-2_1 http://dx.doi.org/10.1007/978-3-642-02256-2_1 ]
Bae E, Yuan J, Tai X C and Boykov Y. 2014. A fast continuous max-flow approach to non-convex multi-labeling problems//Efficient Algorithms for Global Optimization Methods in Computer Vision. Berlin, Heidelberg: Springer: 134-154[ DOI:10.1007/978-3-642-54774-4_7 http://dx.doi.org/10.1007/978-3-642-54774-4_7 ]
Baxter J S H, Rajchl M, McLeod A J, Yuan J and Peters T M. 2017. Directed acyclic graph continuous max-flow image segmentation for unconstrained label orderings. International Journal of Computer Vision, 123(3):415-434[DOI:10.1007/s11263-017-0994-x]
Boykov Y, Veksler O and Zabih R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(11):1222-1239[DOI:10.1109/34.969114]
Chan T F, Esedoglu S and Nikolova M. 2006. Algorithms for finding global minimizers of image segmentation and denoising models. SIAM Journal on Applied Mathematics, 66(5):1632-1648[DOI:10.1137/040615286]
Chan T F and Vese L A. 2001. Active contours without edges. IEEE Transactions on Image Processing, 10(2):266-277[DOI:10.1109/83.902291]
Chung G and Vese L A. 2005. Energy minimization based segmentation and denoising using a multilayer level set approach//Proceedings of the 5th International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition. St. Augustine, FL, USA: Springer: 439-455[ DOI:10.1007/11585978_29 http://dx.doi.org/10.1007/11585978_29 ]
Duan J M, Pan Z K, Yin X F, Wei W B and Wang G D. 2014. Some fast projection methods based on Chan-Vese model for image segmentation. EURASIP Journal on Image and Video Processing, 2014(1):1-7[DOI:10.1186/1687-5281-2014-7]
Goldstein T, O'Donoghue B, Setzer S and Baraniuk R. 2014. Fast alternating direction optimization methods. SIAM Journal on Imaging Sciences, 7(3):1588-1623[DOI:10.1137/120896219]
Greig D M, Porteous B T and Seheult A H. 1989. Exact maximum a posteriori estimation for binary images. Journal of the Royal Statistical Society:Series B (Methodological), 51(2):271-279[DOI:10.1111/j.2517-6161.1989.tb01764.x]
Li F, Ng M K, Zeng T Y and Shen C L. 2010. A multiphase image segmentation method based on fuzzy region competition. SIAM Journal on Imaging Sciences, 3(3):277-299[DOI:10.1137/080736752]
Li F, Osher S, Qin J and Yan M. 2016. A multiphase image segmentation based on fuzzy membership functions and L1-norm fidelity. Journal of Scientific Computing, 69(1):82-106[DOI:10.1007/s10915-016-0183-z]
Lie J, Lysaker M and Tai X C. 2006. A binary level set model and some applications to Mumford-Shah image segmentation. IEEE Transactions on Image Processing, 15(5):1171-1181[DOI:10.1109/TIP.2005.863956]
Pan Z K, Li H, Wei W B, Guo Z B and Zhang C F. 2009. A variational level set method of multiphase segmentation for 3D images. Chinese Journal of Computers, 32(12):2464-2474
潘振宽, 李华, 魏伟波, 郭振波, 张春芬. 2009.三维图像多相分割的变分水平集方法.计算机学报, 32(12):2464-2474
Potts R B. 1952. Some generalized order-disorder transformations. Mathematical Proceedings of the Cambridge Philosophical Society, 48(1):106-109[DOI:10.1017/S0305004100027419]
Samson C, Blanc-Féraud L, Aubert G and Zerubia J. 2000. A level set model for image classification. International Journal of Computer Vision, 40(3):187-197[DOI:10.1023/A:1008183109594]
Spencer J, Chen K and Duan J M. 2019. Parameter-free selective segmentation with convex variational methods. IEEE Transactions on Image Processing, 28(5):2163-2172[DOI:10.1109/TIP.2018.2883521]
Tan L, Wei W B and Pan Z K. 2015. Two fast alternating direction optimization methods for multiphase segmentation//Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition. Monte Carlo Resort, Las Vegas: IPCV: 113-121.
Vese L A and Chan T F. 2002. A multiphase level set framework for image segmentation using the Mumford and Shah model. International Journal of Computer Vision, 50(3):271-293[DOI:10.1023/A:1020874308076]
Wang Q, Pan Z K and Wei W B. 2010. Split-Bregman method and dual method for multiphase image segmentation. Journal of Computer-Aided Design and Computer Graphics, 22(9):1561-1569
王琦, 潘振宽, 魏伟波. 2010.多相图像分割的Split-Bregman方法及对偶方法.计算机辅助设计与图形学学报, 22(9):1561-1569
Wu C L and Tai X C. 2010. Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and high order models. SIAM Journal on Imaging Sciences, 3(3):300-339[DOI:10.1137/090767558]
Xiu X C, Liu W Q, Li L and Kong L C. 2019. Alternating direction method of multipliers for nonconvex fused regression problems. Computational Statistics and Data Analysis, 136:59-71[DOI:10.1016/j.csda.2019.01.002]
Yang X Y, Wang X H and Song J P. 2013. Image segmentation model and algorithm based on continuous max-flow approach. Journal of Image and Graphics, 18(11):1462-1467
杨晓艺, 王小欢, 宋锦萍. 2013.连续最大流图像分割模型及算法.中国图象图形学报, 18(11):1462-1467)[DOI:10.11834/jig.20131110]
Yuan J, Bae E and Tai X C. 2010a. A study on continuous max-flow and min-cut approaches//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE: 2217-2224[ DOI:10.1109/CVPR.2010.5539903 http://dx.doi.org/10.1109/CVPR.2010.5539903 ]
Yuan J, Bae E, Tai X C and Boykov Y. 2010b. A continuous max-flow approach to Potts model//Proceedings of the 11th European Conference on Computer Vision. Heraklion, Crete, Greece: Springer: 379-392[ DOI:10.1007/978-3-642-15567-3_28 http://dx.doi.org/10.1007/978-3-642-15567-3_28 ]
Zheng S X. 2017. Nonlocal Variational Model for Multi-classification of Data on Graph and Fast Algorithm. Qingdao:Qingdao University
郑世秀. 2017.图上数据多分类问题的非局部变分模型及其快速算法研究.青岛:青岛大学
相关文章
相关作者
相关机构
京公网安备11010802024621