Algorithm for size-constrained weakly supervised optic disc segmentation of fundus images

Zheng Lu; Dali Chen; Dingyu Xue

doi:10.11834/jig.180487

Medical Image Processing | Views : 0 下载量: 10 CSCD: 0

PDF
Export
Share
Collection
Album

Algorithm for size-constrained weakly supervised optic disc segmentation of fundus images
Vol. 24, Issue 5, Pages: 827-835(2019)
Received：27 August 2018，

Revised：2018-11-3，

Published：16 May 2019
DOI： 10.11834/jig.180487
稿件说明：

移动端阅览

DOI：

Zheng Lu, Dali Chen, Dingyu Xue. Algorithm for size-constrained weakly supervised optic disc segmentation of fundus images[J]. Journal of Image and Graphics, 2019, 24(5): 827-835. DOI： 10.11834/jig.180487.

摘要

目的

医学图像的像素级标注工作需要耗费大量的人力。针对这一问题，本文以医学图像中典型的眼底图像视盘分割为例，提出了一种带尺寸约束的弱监督眼底图像视盘分割算法。

方法

对传统卷积神经网络框架进行改进，根据视盘的结构特点设计新的卷积融合层，能够更好地提升分割性能。为了进一步提高视盘分割精度，本文对卷积神经网络的输出进行了尺寸约束，同时用一种新的损失函数对尺寸约束进行优化，所提的损失公式可以用标准随机梯度下降方法来优化。

结果

在RIM-ONE视盘数据集上展开实验，并与经典的全监督视盘分割方法进行比较。实验结果表明，本文算法在只使用图像级标签的情况下，平均准确识别率（

mAcc

）、平均精度（

mPre

）和平均交并比（

mIoU

）分别能达到0.852、0.831、0.827。

结论

本文算法不需要专家进行像素级标注就能够实现视盘的准确分割，只使用图像级标注就能够得到像素级标注的分割精度。缓解了医学图像中像素级标注难度大的问题。

Abstract

Objective

Ocular fundus image processing is one of the most popular research fields that combine medical science and computer science. Fundus images have the advantages of clear imaging

simple operation

and high efficiency

thereby enabling people to find various eye diseases as soon as possible. At present

deep learning methods provide state-of-the-art results on many tasks of image processing

including medical image segmentation and instance segmentation. A small number of objects are found in many cases of biomedical applications. Moreover

few datasets can be used. In most cases

fundus tests require a doctor to locate the optic disc and find its boundary. Therefore

retinal optic disc segmentation is an important problem in fundus image research. The success of the fully supervised learning algorithm relies on many high-quality manual comments/tags

which are often time consuming and costly to obtain. Different experts use different criteria

thereby resulting in some difficulties in medical image segmentation. If experiments with inaccurate data are conducted

not only will incorrect results be obtained but time will also be wasted. To save cost

this study proposes a constrained weakly supervised optic disc segmentation algorithm.

Method

By referring to the literature

we combine the convolution neural network (CNN) and the weak supervision method. A weak supervised learning method for sub-ocular image segmentation is proposed. First

the proposed visual CNN is pre-trained on a large auxiliary dataset

which contains approximately 1.2 million labeled training images of 1 000 classes. We can use this pre-training model to complete our own segmentation. Notably

we only use the parameters of the first five layers of the model to train our own models. Then

the top layer of the deep CNN is trained from RIM-ONE dataset. We fuse the conv3

conv4

and conv8 layers in our new model to improve the optic segmentation performance. Finally

we design a new constrained weak loss function to achieve an optimal output. The proposed loss function can optimize convolutional networks with arbitrary linear constraints on the structured output space of pixel labels. The key contribution of this study is to model a distribution over latent "pixel-wise" labels while keeping the network's output the same as the distribution. In this way

the output size is within a reasonable range. The weak loss function is used to constrain the foreground and background sizes of the target. The KL divergence and stochastic gradient descent methods are used to optimize the model.

Result

The proposed algorithm for constrained weakly supervised optic disc segmentation is evaluated with the RIM-ONE dataset. This method can effectively segment the contour of the video disc. The central part of the optic disc covered by blood vessels is well segmented. Our approach is evaluated in terms of mean accuracy

mean precision

and mean intersection over union. These three indexes are the common evaluation indexes in the field of image segmentation. We calculate the results prior to convolutional layer fusion and after convolutional layer fusion. Obviously

the latter results are better than the former ones. The latter results show that the mean accuracy in this work can reach 0.852

the mean precision can reach 0.831

and the mean intersection over union can reach 0.827; these findings are close to current state-of-the-art result. We only use image-level tags without any pixel-level mask. Overall

our algorithm for constrained weakly supervised optic disc segmentation achieves 90% of the performance of the fully supervised approach

which uses orders of magnitude without annotation. With the model trained on the server

each image takes only a few seconds to predict. This prediction is faster than that of the method in the same type of some weakly supervised segmentation articles.

Conclusion

A new method to segment optic discs is proposed

and an end-to-end framework under deep weak supervision for image-to-image segmentation for medical images is developed. To preferably learn video disc information

we develop deep weak supervision for our formulation. Size constraints are also introduced naturally to seek for additional weakly supervised information. This work is the first to use image-level tags to conduct optic disc segmentation. The proposed models obtain more competitive results than the fully supervised method does. Experiments demonstrate that our methods achieve state-of-the-art results on weakly supervised medical images. The results can be applied to a wide range of medical imaging and computer vision applications. The research area on weakly supervised medical image processing has a broad prospect. An increasing number of people are expected to prefer the weak supervision method over the fully supervised method; even unsupervised learning is likely to cause a boom among scholars. These options can improve work efficiency and reduce labor costs. Experimental results also prove the effectiveness of our weakly supervised optic disc segmentation method.

关键词

Keywords

references

Maninis K K, Pont-Tuset J, Arbeláez P, et al. Deep retinal image understanding[C ] //Proceedings of the 19th International Conference on Medical Image Computing and Computer-Assisted Intervention. Athens, Greece: Springer, 2016: 140-148.[ DOI:10.1007/978-3-319-46723-8_17 http://dx.doi.org/10.1007/978-3-319-46723-8_17 ]

Joshi G D, Sivaswamy J, Krishnadas S R. Optic disk and cup segmentation from monocular color retinal images for glaucoma assessment[J]. IEEE Transactions on Medical Imaging, 2011, 30(6):1192-1205.[DOI:10.1109/TMI.2011.2106509]

Mittapalli P S, Kande G B. Segmentation of optic disk and optic cup from digital fundus images for the assessment of glaucoma[J]. Biomedical Signal Processing and Control, 2016, 24:34-46.[DOI:10.1016/j.bspc.2015.09.003]

Salazar-Gonzalez A, Kaba D, Li Y M, et al. Segmentation of the blood vessels and optic disk in retinal images[J]. IEEE Journal of Biomedical and Health Informatics, 2014, 18(6):1874-1886.[DOI:10.1109/JBHI.2014.2302749]

Mookiah M R K, Acharya U R, Chua C K, et al. Automated detection of optic disk in retinal fundus images using intuitionistic fuzzy histon segmentation[J]. Proceedings of the Institution of Mechanical Engineers, Part H:Journal of Engineering in Medicine, 2013, 227(1):37-49.[DOI:10.1177/0954411912458740]

Zou B J, Zhang S J, Zhu C Z. Automatic localization and segmentation of optic disk in color fundus image[J]. Optics and Precision Engineering, 2015, 23(4):1187-1195.

邹北骥, 张思剑, 朱承璋.彩色眼底图像视盘自动定位与分割[J].光学精密工程, 2015, 23(4):1187-1195. [DOI:10.3788/ope.20152304.1187]

Yu H, Barriga E S, Agurto C, et al. Fast localization and segmentation of optic disk in retinal images using directional matched filtering and level sets[J]. IEEE Transactions on Information Technology in Biomedicine, 2012, 16(4):644-657.[DOI:10.1109/TITB.2012.2198668]

Badrinarayanan V, Kendall A, Cipolla R. SegNet:a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12):2481-2495.[DOI:10.1109/TPAMI.2016.2644615]

Chen L C, Papandreou G, Kokkinos I, et al. Semantic image segmentation with deep convolutional nets and fully connected CRFs[J]. arXiv preprint arXiv: 1412.7062, 2014.

Farabet C, Couprie C, Najman L, et al. Learning hierarchical features for scene labeling[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(8):1915-1929.[DOI:10.1109/TPAMI.2012.231]

Song H O, Girshick R, Jegelka S, et al. On learning to localize objects with minimal supervision[J]. arXiv preprint arXiv: 1403.1024, 2014.

Li D, Huang J B, Li Y L, et al. Weakly supervised object localization with progressive domain adaptation[C ] //Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE, 2016: 3512-3520.[ DOI: 10.1109/CVPR.2016.382 http://dx.doi.org/10.1109/CVPR.2016.382 ]

Wang C, Ren W Q, Huang K Q, et al. Weakly supervised object localization with latent category learning[C ] //Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 431-445.[ DOI: 10.1007/978-3-319-10599-4_28 http://dx.doi.org/10.1007/978-3-319-10599-4_28 ]

Singh S, Gupta A, Efros A A. Unsupervised discovery of mid-level discriminative patches[C ] //Proceedings of the 12th European Conference on Computer Vision. Florence, Italy: Springer, 2012: 73-86.[ DOI: 10.1007/978-3-642-33709-3_6 http://dx.doi.org/10.1007/978-3-642-33709-3_6 ]

Pathak D, Shelhamer E, Long J, et al. Fully convolutional multi-class multiple instance learning[J]. arXiv preprint arXiv: 1412.7144, 2014.

Papandreou G, Chen L C, Murphy K P, et al. Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation[C ] //Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 1742-1750.[ DOI: 10.1109/ICCV.2015.203 http://dx.doi.org/10.1109/ICCV.2015.203 ]

Pathak D, Krähenbühl P, Darrell T. Constrained convolutional neural networks for weakly supervised segmentation[C ] //Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 1796-1804.[ DOI: 10.1109/ICCV.2015.209 http://dx.doi.org/10.1109/ICCV.2015.209 ]

Jie Z Q, Wei Y C, Jin X J, et al. Deep self-taught learning for weakly supervised object localiza tion[C ] //Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE, 2017.[ DOI: 10.1109/CVPR.2017.457 http://dx.doi.org/10.1109/CVPR.2017.457 ]

Wei Y C, Liang X D, Chen Y P, et al. STC:a simple to complex framework for weakly-supervised semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(11):2314-2320.[DOI:10.1109/TPAMI.2016.2636150]

Wei Y, Feng J, Liang X, et al. Object region mining with adversarial erasing: a simple classification to semantic segmentation approach[C ] //Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE, 2017: 6488-6496.[ DOI: 10.1109/CVPR.2017.687 http://dx.doi.org/10.1109/CVPR.2017.687 ]

Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv: 1409.1556, 2014.

Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4):640-651.[DOI:10.1109/TPAMI.2016.2572683]

Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, Nevada: Curran Associates Inc., 2012: 1097-1105.

Sevastopolsky A. Optic disc and cup segmentationmethods for glaucoma detection with modification of U-Net convolutional neural network[J]. Pattern Recognition and Image Analysis, 2017, 27(3):618-624.[DOI:10.1134/S1054661817030269]

Alert me when the article has been cited

提交

Face forgery detection with image patch comparison and residual map estimation

Domain-adaptive-learning based diabetic retinopathy grading diagnosis

The review of optic disc and optic cup segmentation applications in computer-aided glaucoma diagnosis

Multi-branch deep feature fusion method for traditional Chinese medicine intervened human cerebral stroke aided diagnosis

Optic disc detection based on visual saliency in fundus image