浏览全部资源
扫码关注微信
Received：05 June 2023，
Revised：2023-11-09，
Published：16 March 2024
移动端阅览
目的
2
有丝分裂细胞核计数是乳腺癌诊断和组织学分级的3个重要评分指标之一，基于深度学习的自动检测方法，可以有效辅助医生进行乳腺病理图像有丝分裂细胞核识别和计数。而当前研究中的公开数据集多为竞赛所用，由举办方联合数据提供者挑选而来，与医院临床应用中所使用的数据存在较大的差异，不利于模型性能及泛化能力的测试验证。针对以上问题，本文发布了来自中国赣州市立医院临床环境的数据集GZMH（Ganzhou municipal hospital）。
方法
2
整理并公开发布的数据集GZMH包含55幅全视野数字切片（whole slide images， WSIs）临床乳腺癌病理图像，提供了用于有丝分裂细胞核目标检测和语义分割研究的两种标注，并由2名高年资医师对3名初级病理医师的标注进行了复核。5种主流目标检测方法和5种经典分割方法在GZMH数据集上进行了训练和测试，检验它们在临床数据集GZMH上的性能。
结果
2
目标检测方法实验结果比较中，SSD（single shot multibox detector）模型取得了最佳的效果，F1分数为0.511；分割方法实验结果比较中，R2U-Net（recurrent rsidual convolutional neural network based on U-Net）性能最佳，F1分数为0.430。所有方法在面对较大规模的临床数据集GZMH时体现的性能都明显低于它们在一些公开数据集上的性能。
结论
2
本文所提出的GZMH数据集能够用于有丝分裂目标检测与语义分割研究任务，且此数据集中的图像更加接近实际的应用场景，在推动乳腺病理图像有丝分裂细胞核分割的研究和临床应用方面具有较大的价值。数据集的在线发布地址为：
https://doi.org/10.57760/sciencedb.08547
https://doi.org/10.57760/sciencedb.08547
。
Objective
2
Mitosis nuclei count is one of the three important scoring indexes in the diagnosis and histological grading of breast cancer because this index is used to evaluate the aggressiveness of tumors and to provide markedly comprehensive and reliable information for accurate diagnosis and treatment. In current clinical practice， hematoxylin and eosin staining （H&E） staining is mostly used for pathological sections. Histopathological images stained with H&E can intuitively display cell components and tissue structures. For deep learning-based automated mitosis detection studies， pathologists need to manually label observed mitotic cells at high power field （HPF）， which is an extremely tedious and time-consuming task requiring extensive experience and professional equipment. However， computer-assisted automatic detection， especially the introduction of deep learning methods， has attracted increasing attention from researchers in recent years because it helps reduce doctors’ workload and improve diagnostic efficiency. Multiple competitions （e.g.， ICPR Mitosis Detection Challenge in 2012， AMIDA13 competition at MICCAI 2013） have been held internationally to study the specific application of deep learning methods in the mitosis detection of breast cancer. These competitions have attracted many researchers to participate， and numerous excellent methods based on these datasets have emerged. However， most public datasets in the current research are selected by organizers and data providers， which are relatively different from data used in a clinical environment and not conducive to the test and verification of model performance and generalization ability. Given the preceding problems， this research published a GZMH dataset from the clinical environment of Ganzhou Municipal Hospital in China.
Method
2
The published GZMH dataset contains 55 clinical breast cancer pathological images of whole slide images （WSIs）， which provides two types of annotations for mitosis nuclei target detection and semantic segmentation research. Moreover， annotations from three primary pathologists are checked by two senior doctors. The GZMH dataset contains 1 534 RGB channel electronic images with a resolution of 2 084 × 2 084 pixels and 2 355 mitotic regions. First， the dataset selects 55 WSIs from 109 finely labeled WSIs as the original data of GZMH. Second， the dataset uses sliding window to cut the corresponding area’s HPF in the XML file on WSI； HPF is cut only once when the center of the circumscribed rectangle of the nucleus is within the current HPF range. To avoid numerous nuclear fragments， we only keep the grid where the center of the circumscribed rectangle of the nucleus is located. After the preceding data processing， mitosis nuclei is labeled， in which the pixel level is labeled as a black-and-white binary label， and the target detection label is the minimum circumscribed rectangular coordinates and centroid coordinates of the nuclear fission image area. Eventually， a large-scale dataset is formed. Five mainstream object detection methods and five classical segmentation methods are trained and tested on the GZMH dataset to assess their performance on the GZMH dataset.
Result
2
This study uses five mainstream object detection models （i.e.， Faster RCNN， FSAF， RetinaNet， YOLOv3， and SSD） and five classical segmentation models （i.e.， U-Net， SegNet， R2U-Net， LinkNet34， and DeepLabV3+） to organize the experiments. In the comparison of experimental results of the object detection methods， the SSD model achieved the best performance， and the F1-score achieved 0.511. In the comparison of experimental results of the segmentation methods， R2U-Net achieved the best performance， and the F1-score is 0.430. The performance of all methods in terms of the large-scale GZMH clinical dataset is evidently lower than their performance results on some public datasets.
Conclusion
2
We published a dataset for mitotic nuclei detection， which is characterized by numerous case data and rich types， and the data characteristics approximate the actual application scenarios. In addition， the problems of memory bottleneck and nuclear fragmentation are solved through data processing. We evaluate 10 representative methods of target detection and semantic segmentation on this new dataset and review the challenging problems of various algorithms. The proposed GZMH dataset can meet the research tasks of mitosis nuclei detection and semantic segmentation. Moreover， images in this dataset approximate the actual application scenarios， which invaluable in promoting the research progress and clinical application of mitosis nuclei segmentation in breast pathological images. The proposed dataset is available at：
https://doi.org/10.57760/sciencedb.08547
https://doi.org/10.57760/sciencedb.08547
.
Alom Z ， Aspiras T ， Taha T M ， Bowen T and Asari V K . 2020 . MitosisNet： end-to-end mitotic cell detection by multi-task learning . IEEE Access ， 8 ： 68695 - 6871 ［ DOI： 10.1109/ACCESS.2020.2983995 http://dx.doi.org/10.1109/ACCESS.2020.2983995 ］
Alom Z ， Hasan M ， Yakopcic C ， Taha T M and Asari V K . 2018 . Recurrent residual convolutional neural network based on U-Net （R2U-Net） for medical image segmentation ［EB/OL］. ［ 2023-06-05 ］. https://arxiv.org/pdf/1802.06955.pdf https://arxiv.org/pdf/1802.06955.pdf
Aubreville M ， Stathonikos N ， Bertram C A ， Klopfleisch R ， Ter Hoeve N ， Ciompi F ， Wilm F ， Marzahl C ， Donovan T A ， Maier A ， Breen J ， Ravikumar N ， Chung Y ， Park J ， Nateghi R ， Pourakpour F ， Fick R H J ， Ben Hadj S ， Jahanifar M ， Shephard A ， Dexl J ， Wittenberg T ， Kondo S ， Lafarge M W ， Koelzer V H ， Liang J T ， Wang Y B ， Long X ， Liu J X ， Razavi S ， Khademi A ， Yang S ， Wang X Y ， Erber R ， Klang A ， Lipnik K ， Bolfa P ， Dark M J ， Wasinger G ， Veta M and Breininger K . 2023 . Mitosis domain generalization in histopathology images——The MIDOG challenge . Medical Image Analysis ， 84 ： # 102699 ［ DOI： 10.1016/j.media.2022.102699 http://dx.doi.org/10.1016/j.media.2022.102699 ］
Badrinarayanan V ， Kendall A and Cipolla R . 2017 . SegNet： a deep convolutional encoder-decoder architecture for image segmentation . IEEE Transactions on Pattern Analysis and Machine Intelligence ， 39 （ 12 ）： 2481 - 2495 ［ DOI： 10.1109/TPAMI.2016.2644615 http://dx.doi.org/10.1109/TPAMI.2016.2644615 ］
Bertram C A ， Aubreville M ， Marzahl C ， Maier A and Klopfleisch R . 2019 . A large-scale dataset for mitotic figure assessment on whole slide images of canine cutaneous mast cell tumor . Scientific Data ， 6 （ 1 ）： # 274 ［ DOI： 10.1038/s41597-019-0290-4 http://dx.doi.org/10.1038/s41597-019-0290-4 ］
Chaurasia A and Culurciello E . 2017 . LinkNet： exploiting encoder representations for efficient semantic segmentation // Proceedings of 2017 IEEE Visual Communications and Image Processing . St. Petersburg， USA ： IEEE： 1 - 4 ［ DOI： 10.1109/VCIP.2017.8305148 http://dx.doi.org/10.1109/VCIP.2017.8305148 ］
Chen H ， Dou Q ， Wang X ， Qin J and Heng P . 2016 . Mitosis detection in breast cancer histology images via deep cascaded networks // Proceedings of the 30th AAAI Conference on Artificial Intelligence . Phoenix， USA ： AAAI Press： 1160 - 1166 ［ DOI： 10.1609/aaai.v30i1.10140 http://dx.doi.org/10.1609/aaai.v30i1.10140 ］
Chen L C ， Zhu Y K ， Papandreou G ， Schroff F and Adam H . 2018 . Encoder-decoder with atrous separable convolution for semantic image segmentation // Proceedings of the 15th European Conference on Computer Vision . Munich， Germany ： Springer： 833 - 851 ［ DOI： 10.1007/978-3-030-01234-2_49 http://dx.doi.org/10.1007/978-3-030-01234-2_49 ］
Frédérique Capron . MITOS-ATYPIA-14 . 2014 . Mitos-atypia-14-dataset［EB/OL］. ［ 2023-06-05 ］. https://mitos-atypia-14.grand-challenge.org/ https://mitos-atypia-14.grand-challenge.org/
Han J X ， Wang X G and Liu W Y . 2021 . Contextual prior constrained deep networks for mitosis detection with point annotations . IEEE Access ， 9 ： 71954 - 71967 ［ DOI： 10.1109/ACCESS.2021.3079215 http://dx.doi.org/10.1109/ACCESS.2021.3079215 ］
Li C ， Wang X G ， Liu W Y and Latecki L J . 2018 . DeepMitosis： mitosis detection via deep detection， verification and segmentation networks . Medical Image Analysis ， 45 ： 121 - 133 ［ DOI： 10.1016/j.media.2017.12.002 http://dx.doi.org/10.1016/j.media.2017.12.002 ］
Li C ， Wang X G ， Liu W Y ， Latecki L J ， Wang B and Huang J Z . 2019 . Weakly supervised mitosis detection in breast histopathology images using concentric loss . Medical Image Analysis ， 53 ： 165 - 178 ［ DOI： 10.1016/j.media.2019.01.013 http://dx.doi.org/10.1016/j.media.2019.01.013 ］
Lin T Y ， Goyal P ， Girshick R ， He K M and Dollr P . 2017 . Focal loss for dense object detection // Proceedings of 2017 IEEE International Conference on Computer Vision . Venice， Italy ： IEEE： 2980 - 2988 ［ DOI： 10.1109/ICCV.2017.324 http://dx.doi.org/10.1109/ICCV.2017.324 ］
Litjens G ， Kooi T ， Bejnordi B E ， Setio A A A ， Ciompi F ， Ghafoorian M ， van der Laak J A W M ， van Ginneken B and Snchez C I . 2017 . A survey on deep learning in medical image analysis . Medical Image Analysis ， 42 ： 60 - 88 ［ DOI： 10.1016/j.media.2017.07.005 http://dx.doi.org/10.1016/j.media.2017.07.005 ］
Liu W ， Anguelov D ， Erhan D ， Szegedy C ， Reed S ， Fu C Y and Berg A C . 2016 . SSD： single shot MultiBox detector // Proceedings of the 14th European Conference on Computer Vision . Amsterdam， the Netherlands ： Springer： 21 - 37 ［ DOI： 10.1007/978-3-319-46448-0_2 http://dx.doi.org/10.1007/978-3-319-46448-0_2 ］
Piansaddhayanaon C ， Santisukwongchote S ， Shuangshoti S ， Tao Q Y ， Sriswasdi S and Chuangsuwanich E . 2023 . ReCasNet： improving consistency within the two-stage mitosis detection framework . Artificial Intelligence in Medicine ， 135 ： # 102462 ［ DOI： 10.1016/j.artmed.2022.102462 http://dx.doi.org/10.1016/j.artmed.2022.102462 ］
Redmon J and Farhadi A . 2018 . YOLOv3： an incremental improvement ［EB/OL］. ［ 2023-06-05 ］. https://arxiv.org/pdf/1804.02767.pdf https://arxiv.org/pdf/1804.02767.pdf
Ren S Q ， He K M ， Girshick R and Sun J . 2017 . Faster R-CNN： towards real-time object detection with region proposal networks . IEEE Transactions on Pattern Analysis and Machine Intelligence ， 39 （ 6 ）： 1137 - 1149 ［ DOI： 10.1109/TPAMI.2016.2577031 http://dx.doi.org/10.1109/TPAMI.2016.2577031 ］
Ronneberger O ， Fischer P and Brox T . 2015 . U-Net： convolutional networks for biomedical image segmentation // Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention . Munich， Germany ： Springer： 234 - 241 ［ DOI： 10.1007/978-3-319-24574-4_28 http://dx.doi.org/10.1007/978-3-319-24574-4_28 ］
Roux L ， Racoceanui D ， Loménie N ， Kulikova M ， Irshad H ， Klossa J ， Capron F ， Genestie C ， Le Naour G and Gurcan M N . 2013 . Mitosis detection in breast cancer histological images An ICPR 2012 contest . Journal of Pathology Informatics ， 4 （ 1 ）： # 8 ［ DOI： 10.4103/2153-3539.112693 http://dx.doi.org/10.4103/2153-3539.112693 ］
Russakovsky O ， Deng J ， Su H ， Krause J ， Satheesh S ， Ma S A ， Huang Z H ， Karpathy A ， Khosla A ， Bernstein M ， Berg A C and Li F F . 2015 . Imagenet large scale visual recognition challenge . International Journal of Computer Vision ， 115 （ 3 ）： 211 - 252 ［ DOI： 10.1007/s11263-015-0816-y http://dx.doi.org/10.1007/s11263-015-0816-y ］
Sebai M ， Wang T J and Al-Fadhli S A . 2020a . PartMitosis： a partially supervised deep learning framework for mitosis detection in breast cancer histopathology images . IEEE Access ， 8 ： 45133 - 45147 ［ DOI： 10.1109/ACCESS.2020.2978754 http://dx.doi.org/10.1109/ACCESS.2020.2978754 ］
Sebai M ， Wang X G and Wang T J . 2020b . MaskMitosis： a deep learning framework for fully supervised， weakly supervised， and unsupervised mitosis detection in histopathology images . Medical and Biological Engineering and Computing ， 58 （ 7 ）： 1603 - 1623 ［ DOI： 10.1007/s11517-020-02175-z http://dx.doi.org/10.1007/s11517-020-02175-z ］
Veta M ， Heng Y J ， Stathonikos N ， Bejnordi B E ， Beca F ， Wollmann T ， Rohr K ， Shah M A ， Wang D Y ， Rousson M ， Hedlund M ， Tellez D ， Ciompi F ， Zerhouni E ， Lanyi D ， Viana M ， Kovalev V ， Liauchuk V ， Phoulady H A ， Qaiser T ， Graham S ， Rajpoot N ， Sjöblom E ， Molin J ， Paeng K ， Hwang S ， Park S ， Jia Z ， Chang E I ， Xu Y ， Beck A H ， van Diest P J and Pluim J P W . 2019 . Predicting breast tumor proliferation from whole-slide images： the TUPAC16 challenge . Medical Image Analysis ， 54 ： 111 - 121 ［ DOI： 10.1016/j.media.2019.02.012 http://dx.doi.org/10.1016/j.media.2019.02.012 ］
Veta M ， van Diest P J ， Willems S M ， Wang H B ， Madabhushi A ， Cruz-Roa A ， Gonzalez F ， Larsen A B L ， Vestergaard J S ， Dahl A B ， Cireşan D C ， Schmidhuber J ， Giusti A ， Gambardella L M ， Tek F B ， Walter T ， Wang C W ， Kondo S ， Matuszewski B J ， Precioso F ， Snell V ， Kittler J ， de Campos T E ， Khan A M ， Rajpoot N M ， Arkoumani E ， Lacle M M ， Viergever M A and Pluim J P W . 2015 . Assessment of algorithms for mitosis detection in breast cancer histopathology images . Medical Image Analysis ， 20 （ 1 ）： 237 - 248 ［ DOI： 10.1016/j.media.2014.11.010 http://dx.doi.org/10.1016/j.media.2014.11.010 ］
Wang H D ， Xu H ， Li B B ， Pan X P ， Zeng L Q ， Lan R S and Luo X N . 2024 . A novel dataset and a two-stage mitosis nuclei detection method based on hybrid anchor branch . Biomedical Signal Processing and Control ， 87 ： # 105374 ［ DOI： 10.1016/j.bspc.2023.105374 http://dx.doi.org/10.1016/j.bspc.2023.105374 ］
Wang X Y ， Zhang J ， Yang S ， Xiang J X ， Luo F ， Wang M H ， Zhang J ， Yang W ， Huang J Z and Han X . 2023 . A generalizable and robust deep learning algorithm for mitosis detection in multicenter breast histopathological images . Medical image analysis ， 84 ： # 102703 ［ DOI： 10.1016/j.media.2022.102703 http://dx.doi.org/10.1016/j.media.2022.102703 ］
Zhu C C ， He Y H and Savvides M . 2019 . Feature selective anchor-free module for single-shot object detection // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach， USA ： IEEE： 840 - 849 ［ DOI： 10.1109/CVPR.2019.00093 http://dx.doi.org/10.1109/CVPR.2019.00093 ］
相关文章
相关作者
相关机构
京公网安备11010802024621
