Multilabel chest X-ray disease classification based on a dense squeeze-and-excitation network

Zhirui Zhang; Qiang Li; Xin Guan

doi:10.11834/jig.200232

Research and Application | Views : 0 下载量: 144 CSCD: 11

PDF
Export
Share
Collection
Album

Multilabel chest X-ray disease classification based on a dense squeeze-and-excitation network
Vol. 25, Issue 10, Pages: 2238-2248(2020)
Received：30 May 2020，

Revised：2020-7-16，

Accepted：23 July 2020，

Published：2020-10
DOI： 10.11834/jig.200232
稿件说明：

移动端阅览

DOI：

Zhirui Zhang, Qiang Li, Xin Guan. Multilabel chest X-ray disease classification based on a dense squeeze-and-excitation network[J]. Journal of Image and Graphics, 2020, 25(10): 2238-2248. DOI： 10.11834/jig.200232.

摘要

目的

X射线光片是用于诊断多种胸部疾病常用且经济的方法。然而，不同疾病的位置及病灶区域大小在X光片上差异较大且纹理表现存在多样性，是胸部疾病分类任务面临的主要挑战。此外，样本数据类别不平衡进一步增加了任务的困难。针对以上挑战以及目前算法识别精度有待提升的问题，本文采用深度学习方法提出一种基于密集挤压激励网络的多标签胸部疾病分类算法。

方法

将挤压激励模块同样以密集连接的方式加入密集连接网络中作为特征通道高度注意模块，以增强对于网络正确判断疾病有用信息的传递同时抑制无用信息的传递；使用非对称卷积块增强网络的特征提取能力；采用焦点损失函数，增加难识别疾病的损失权重而减小易识别疾病的损失权重，以增强网络对难识别样本的学习。

结果

在ChestX-ray14数据集上的实验结果表明，本文算法对14种胸部疾病的分类精度较目前3种经典及先进算法有所提升，平均AUC（area under ROC curve）值达到0.802。另外本文将算法模型在诊断时依据的病灶区域进行可视化，其结果进一步证明了模型的有效性。

结论

本文提出的基于密集挤压激励网络的多标签分类算法，在胸部疾病识别上的平均AUC值较高，适用于胸部X光片的疾病分类。

Abstract

Objective

The task of classification of chest diseases is an important part in the field of medical image processing. Its purpose is to assist professional doctors to make accurate diagnosis and treatment through a computer automatic recognition system

which has important significance and role in clinical medicine. Medical image technologies play an important role in the recognition of chest diseases. They can provide doctors with clear internal textural and structural information. X-ray is a common and economical method for the diagnosis of various chest diseases. However

the main challenges in chest disease classification are that the location and size of the focus area of various diseases are different on X-ray films and the texture performance is diverse. The imbalance of sample data categories increases the task difficulty. Visual fatigue and other problems caused by long-term work

even for trained professional doctors

missed diagnosis

and misdiagnosis are also inevitable. Therefore

determining how to classify chest diseases automatically and accurately has become a popular topic in the field of medical image processing. At present

researchers mainly use the deep learning method to train a convolutional neural network to identify chest diseases automatically

but the overall recognition accuracy is inadequately high. Most methods cannot utilize the information on the feature channel. In view of the abovementioned challenges and the necessity to improve the recognition accuracy of current algorithms

this paper proposes a multilabel classification algorithm for chest diseases based on a dense squeeze-and-excitation network by using the deep learning method.

Method

First

to utilize the information on the channel of the feature map

we add a squeeze-and-excitation module to DenseNet densely as the high-attention module of the feature channel; hence

the network can fully consider the feature information of each disease. In the process of network propagation

the network can enhance the transmission of useful information for the correct judgment of disease types and inhibit the transmission of useless information. Second

given that the parameters on the convolution kernel skeleton

i.e.

the central cross position

are important and the ordinary square convolution kernel is random at the time of initialization

the ordinary square convolution kernel may be optimized in a direction that is not to strengthen the skeleton parameters. We use an asymmetric convolution block to replace the ordinary square convolution kernel

highlight the role of the parameters on the central cross position of the convolution kernel

and improve the feature extraction capability of the entire network. Lastly

considering that each disease sample data in the data set is relatively different and the learning difficulty also differs

this paper adopts the focal loss function to increase the loss weight of difficult-to-identify diseases and reduce the loss weight of easy-to-identify diseases. The network will pay more attention to the learning of the difficult-to-identify samples by using the focal loss function to improve the learning capability of the network for the types of difficult-to-identify diseases

improve the overall recognition accuracy of the network for chest diseases

and reduce the accuracy differences.

Result

We conduct experiments on the large multilabel dataset ChestX-ray14

which was published by National Institutes of Health(NIH). The experimental results show that the average recognition accuracy of the proposed algorithm for 14 chest diseases is higher than that of three existing classic and advanced algorithms

and the average area under ROC curve(AUC) value is 0.802. Meanwhile

the recognition accuracy of this algorithm is improved to some extent for some difficult-to-identify chest diseases. In accordance with the gradient-weighted class activation mapping algorithm

we can generate the heat map of the focus area and visualize the focus area of the chest disease classification algorithm model in the process of disease diagnosis. Comparison demonstrates that the positioning of the focus area in the hot map is basically consistent with the marking frame given by professional doctors. This finding proves the validity of the model

provides a visual explanation for disease diagnosis

and helps gain the trust of professional doctors for auxiliary diagnosis.

Conclusion

In this paper

a multilabel classification algorithm based on a dense squeeze-and-excitation network is proposed for the recognition and classification of chest diseases. The experimental results show that our model is superior to several state-of-the-art approaches

with a higher average AUC value and stronger ability to diagnose some diseases that are difficult to identify. Our model is suitable for the classification of diseases and the recognition of chest X-ray images.

关键词

Keywords

references

Baemani M J, Monadjemi A and Moallem P. 2008. Detection of respiratory abnormalities using artificial neural networks. Journal of Computer Science, 4(8):663-667[DOI:10.3844/jcssp.2008.663.667]

Chen H, Shen C Y, Qin J, Ni D, Shi L, Cheng J C Y and HengP A. 2015. Automatic localization and identification of vertebrae in spine CT via a joint learning model with deep neural networks//Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich, Germany: Springer: 515-522[ DOI:10.1007/978-3-319-24553-9_63 http://dx.doi.org/10.1007/978-3-319-24553-9_63 ]

Deng J, Dong W, Socher R, Li L J, Li K and Li F F. 2009. ImageNet: a large-scale hierarchical image database//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA: IEEE: 248-255[ DOI:10.1109/CVPR.2009.5206848 http://dx.doi.org/10.1109/CVPR.2009.5206848 ]

Ding X H, Guo Y C, Ding G G and Han J G. 2019. ACNet: strengthening the kernel skeletons for powerful CNN via asymmetric convolution blocks[EB/OL].[2020-05-01] . https://arxiv.org/pdf/1908.03930.pdf https://arxiv.org/pdf/1908.03930.pdf [ DOI:10.1109/ICCV.2019.00200 http://dx.doi.org/10.1109/ICCV.2019.00200 ].

Doshi D, Shenoy A, Sidhpura D and Gharpure P. 2016. Diabetic retinopathy detection using deep convolutional neural networks//Proceedings of 2016 International Conference on Computing, Analytics and Security Trends. Pune: IEEE: 261-266[ DOI:10.1109/CAST.2016.7914977 http://dx.doi.org/10.1109/CAST.2016.7914977 ]

Fischbach F, Knollmann F, Griesshaber V, Freund T, Akkol E and Felix R. 2003. Detection of pulmonary nodules by multislice computed tomography:improved detection rate with reduced slice thickness. European Radiology, 13(10):2378-2383[DOI:10.1007/s00330-003-1915-7]

Guan Q J and Huang Y P. 2018. Multi-label chest X-ray image classification via category-wise residual attention learning. Pattern Recognition Letters, 130:259-266[DOI:10.1016/j.patrec.2018.10.027]

He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE: 770-778[ DOI:10.1109/CVPR.2016.90 http://dx.doi.org/10.1109/CVPR.2016.90 ]

Hu J, Shen L and Sun G. 2018. Squeeze-and-excitation networks//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE: 7132-7141[ DOI:10.1109/CVPR.2018.00745 http://dx.doi.org/10.1109/CVPR.2018.00745 ]

Huang G, Liu Z, van der Maaten L and Weinberger K Q. 2017. Densely connected convolutional networks//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE: 2261-2269[ DOI:10.1109/CVPR.2017.243 http://dx.doi.org/10.1109/CVPR.2017.243 ]

Ker J, Wang L P, Rao J and Lim T. 2018. Deep learning applications in medical image analysis. IEEE Access, 6:9375-9389[DOI:10.1109/ACCESS.2017.2788044]

Khobragade S, Tiwari A, Patil C Y and Narke V. 2016. Automatic detection of major lung diseases using chest Radiographs and classification by feed-forward artificial neural network//Proceedings of the 1st IEEE International Conference on Power Electronics, Intelligent Control and Energy Systems. Delhi: IEEE: 1-5[ DOI:10.1109/ICPEICES.2016.7853683 http://dx.doi.org/10.1109/ICPEICES.2016.7853683 ]

Kiymet S, Aslankaya M Y, Taskiran M and Bolat B. 2019. Breast cancer detection from thermography based on deep neural networks//Proceedings of 2019 Innovations in Intelligent Systems and Applications Conference. Izmir: IEEE: 1-5[ DOI:10.1109/ASYU48272.2019.8946367 http://dx.doi.org/10.1109/ASYU48272.2019.8946367 ]

Lin T Y, Goyal P, Girshick R, He K M and Dollár P. 2020. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(2):318-327[DOI:10.1109/TPAMI.2018.2858826]

Ma Y B, Zhou Q H, Chen X S, Lu H H and Zhao Y. 2019. Multi-attention network for thoracic disease classification and localization//Proceedings of 2019 IEEE International Conference on Acoustics, Speech, and Signal Processing. Brighton: IEEE: 1378-1382[ DOI:10.1109/ICASSP.2019.8682952 http://dx.doi.org/10.1109/ICASSP.2019.8682952 ]

Ren L, Li Q, Guan X and Ma J. 2018. Three-dimensional segmentation of brain tumors in magnetic resonance imaging based on improved continuous max-flow. Laser and Optoelectronics Progress, 55(11):111011

任璐, 李锵, 关欣, 马杰. 2018.改进的连续型最大流算法脑肿瘤磁核共振成像三维分割.激光与光电子学进展, 55(11):111011)[DOI:10.3788/LOP55.111011]

Ruuskanen O, Lahti E, Jennings L C and Murdoch D R. 2011. Viral pneumonia. The Lancet, 377(9773):1264-1275[DOI:10.1016/S0140-6736(10)61459-6]

Shen D G, Wu G R, and Suk H I. 2017. Deep learning in medical image analysis. Annual Review of Biomedical Engineering, 19:221-248[DOI:10.1146/annurev-bioeng-071516-044442]

Wang X S, Peng Y F, Lu L, Lu Z Y, Bagheri M and Summers R M. 2017. Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE: 3462-3471[ DOI:10.1109/CVPR.2017.369 http://dx.doi.org/10.1109/CVPR.2017.369 ]

Winkels M and Cohen T S. 2019. Pulmonary nodule detection in CT scans with equivariant CNNs. Medical Image Analysis, 55:15-26[DOI:10.1016/j.media.2019.03.010]

Wu Y. 2019. Deep convolutional neural network based on densely connected squeeze-and-excitation blocks. AIP Advances, 9(6):#065016[DOI:10.1063/1.5100577]

Yao L, Poblenz E, Dagunts D, Covington B, Bernard D and Lyman K. 2017. Learning to diagnose from scratch by exploiting dependencies among labels[EB/OL].[2020-05-19] . https://arxiv.org/pdf/1710.10501.pdf https://arxiv.org/pdf/1710.10501.pdf

Yao L, Prosky J, Poblenz E, Covington B and Lyman K. 2018. Weakly supervised medical diagnosis and localization from multiple resolutions[EB/OL].[2020-05-19] . https://arxiv.org/pdf/1803.07703.pdf https://arxiv.org/pdf/1803.07703.pdf

Alert me when the article has been cited

提交

Class activation map replay and minimum entropy sampling-based multilabel class-incremental learning

Colonoscopy polyp image segmentation method with boundary self-knowledge distillation

Lightweight high-resolution human pose estimation combined with densely connected network

Edge-distribution-guided high-resolution network for colorectal polyp segmentation

SA-TF-UNet： a Transformer and spatial attention mechanisms based hippocampus segmentation network