超级计算支撑的新冠肺炎CT影像综合分析辅助系统应用
Supercomputing-supported COVID-19 CT image comprehensive analysis assistant system
- 2020年25卷第10期 页码:2142-2150
纸质出版日期: 2020-10-16 ,
录用日期: 2020-07-19
DOI: 10.11834/jig.200239
移动端阅览
浏览全部资源
扫码关注微信
纸质出版日期: 2020-10-16 ,
录用日期: 2020-07-19
移动端阅览
康波, 郭佳, 王帅, 徐波, 孟祥飞. 超级计算支撑的新冠肺炎CT影像综合分析辅助系统应用[J]. 中国图象图形学报, 2020,25(10):2142-2150.
Bo Kang, Jia Guo, Shuai Wang, Bo Xu, Xiangfei Meng. Supercomputing-supported COVID-19 CT image comprehensive analysis assistant system[J]. Journal of Image and Graphics, 2020,25(10):2142-2150.
目的
2
新冠肺炎(COVID-19)已经成为全球大流行疾病,在全球范围数百万人确诊。基于计算机断层扫描(computed tomography,CT)数据的影像学分析是临床诊断的重要手段。为了实现快速高效高精度地检测,提出了一种超级计算支撑的新冠肺炎CT影像综合分析辅助系统构建方法。
方法
2
系统整个处理流程依次包括输入处理模块、预处理模块、影像学分析子系统和人工智能(artifiaial intelligence,AI)分析子系统4部分。其中影像学分析子系统通过分析肺实变、磨玻璃影和铺路石等影像学典型特征检测是否有肺炎和典型新冠肺炎特征,给出肺炎影像分析结论;AI分析子系统通过构建深度学习模型来区分普通病毒肺炎与新冠肺炎,增加肺炎的筛查甄别能力。
结果
2
系统发布以来,持续稳定地为国内外超过三十家医院与一百多家科研机构提供了新冠肺炎辅助诊断服务和科研支撑,为抗击疫情提供重要支撑。
结论
2
本文提出的超级计算支撑的新冠肺炎CT影像综合分析辅助系统构建方法,取得了应用效果,是一种有效实现快速部署服务、对突发疫情提供高效支撑的服务方式。
Objective
2
The Coronavirus Disease 2019 (COVID-19) has become a global pandemic
causing millions of people to be infected worldwide. Imaging analysis based on computed tomography (CT) data is an important means of clinical diagnosis. A supercomputing-supported method is proposed for the construction of a new comprehensive CT analysis auxiliary system dealing with pneumonia.
Method
2
The system consists of four parts: input processing module
preprocessing module
imaging analysis subsystem
and artificial intelligence(AI) analysis subsystem. Among the four parts
the imaging analysis subsystem detects the pneumonia features
distinguishes typical new coronary pneumonia by analyzing the typical imaging features
such as lung consolidation
ground-glass opacities
and crazy-paving pattern
and then comes to a conclusion of pneumonia. The AI analysis subsystem uses a deep learning model to classify typical viral pneumonia and COVID-19
which enhances the screening ability of pneumonia. Convolutional neural network is widely used as an effective algorithm for medical image analysis
particularly in image classification. It is also widely utilized in the CT image screening and has achieved good results
which has attracted the attention of domestic and foreign scholars and industry. The seasonable result derived from deep learning relies largely on the number and quality of training samples. Given the lack of training samples
the system selects transfer learning as the technical direction for model construction. Considering the quick response to the epidemic
the quality of easy maintenance and dynamic system updating is required. Thus
after comparing and analyzing the performance and classification effect indexes of many common image classification models
we build a transfer learning neural network model on the basis of inception. The entire neural network can be roughly divided into two parts: the first part uses a pre-trained inception network; the role of which is to convert image data into a one-dimensional feature vector. The second part uses a fully connected network to improve classification prediction. The imaging analysis method analyzes the image features of COVID-19
extracts the pneumonia feature areas
and carries out semantic analysis to achieve the delineation of the pneumonia target area. Simultaneously
the typical imaging characteristics of COVID-19 (such as ground glass shadow
infiltration shadow
and lung consolidation) are targeted. With regard to the pneumonia target area
a multi-level dynamic threshold segmentation is first used to determine the minimum lung tissue area (rectangular region of interest (ROI)). The extraction of the lung tissue area is designed as a normal workflow. For each ROI
pixel statistics
threshold segmentation
regional dissolution and expansion
and abnormal proofreading are used to obtain the pneumonia target area. Aiming at the relationship between the sizes of the pneumonia target area
a logical filter is established to detect the segmented distribution features and spatial relationship with the outer contour of the lung. Then
based on the characteristic relationship of typical new coronary pneumonia
the typical characteristics of new coronary pneumonia are outlined. The entire comprehensive analysis platform is built on the basis of the Tianhe artificial intelligence innovation-integrated platform. The Tianhe artificial intelligence innovation-integrated platform is based on the hardware fusion supporting the environment of Tianhe supercomputing
cloud computing
and big data
upon which realizes the existing mainstream deep learning framework. It is highly encapsulated with the processing model algorithm
forming a visual interactive template development environment covering multiple links such as data loading
model construction
training
verification
and solidified deployment. As a service on this supporting platform
CT image comprehensive analysis AI auxiliary system has access to the computing resources
data resources
and external service capabilities of the platform and finally achieves the rapid integration and dynamic update of the system during the pandemic.
Result
2
After its release
the system has continuously and steadily provided new COVID-19 auxiliary diagnostic services and scientific research support for more than 30 hospitals and more than 100 scientific research institutions at home and abroad
providing important support for combating the epidemic.
Conclusion
2
The supercomputing-supported new coronary pneumonia CT image comprehensive analysis auxiliary system construction method proposed in this paper has achieved important application on diagnosis and research. It is an effective way to achieve rapid deployment services and provide efficient support for emergencies. The system applies artificial intelligence technology using CT imaging to screen for COVID-19. By applying artificial intelligence to the screening of COVID-19 with pneumonia and giving reference opinions for auxiliary diagnosis
the marking and area statistics of the inflammatory regions are improved. The system achieves the combination of artificial intelligence traditional machine vision and deep learning technology to distinguish COVID-19 by using CT images. The combined route of viral pneumonitis feature extraction based on traditional machine vision and the COVID-19 image classification based on artificial intelligence technology has achieved a comprehensive analysis of medical image features and COVID-19 screening. The fast implementation mode of the fusion platform scenario is based on computing power and data support. Relying on the Tianhe artificial intelligence innovation-integrated service platform
the platform supports intelligent frontier innovation on the basis of computing power and data
implements an open model of simultaneous research and application
and has a multi-industry training resource model library and large-scale distributed training sources. With regard to rapid deployment and other service capabilities
this comprehensive analysis system is also the first public COVID-19 AI-assisted diagnostic system deployed online. Analysis based directly on digital imaging and communications in medicine(DICOM) data and video data will effectively improve the analysis efficiency
but it will involve data ethics and security-related issues; however
it is the developing direction that needs to be resolved in the future.
新冠肺炎(COVID-19)CT影像辅助诊断人工智能超级计算
Coronavirus Disease 2019(COVID-19)computed tomography(CT) imagingauxiliary diagnosisartificial intelligence(AI)supercomputing
Ai T, Yang Z L, Hou H Y, Zhan C A, Chen C, Lv W Z, Tao Q, Sun Z Y and Xia L M. 2020. Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China:a report of 1014 cases. Radiology, 296(2):E32-E40[DOI:10.1148/radiol.2020200642]
Brown M S, Wilson L S, Doust B D, Gill R W and Sun C M. 1998. Knowledge-based method for segmentation and analysis of lung boundaries in chest X-Ray images. Computerized Medical Imaging and Graphics, 22(6):463-477[DOI:10.1016/s0895-6111(98)00051-2]
Han Z Y, Wei B Z, Hong Y F, Li T Y, Cong J Y, Zhu X, Wei H F and Zhang W. 2020. Accurate screening of COVID-19 using attention based deep 3D multiple instance learning. IEEE Transactions on Medical Imaging, 39(8):2584-2594[DOI:10.1109/TMI.2020.2996256]
Kang H Y, Xia L M, Yan F H, Wan Z B, Shi F, Yuan H, Jiang H T, Wu D J, Sui H, Zhang C Q and Shen D G. 2020. Diagnosis of coronavirus disease 2019 (COVID-19) with structured latent multi-view representation learning. IEEE Transactions on Medical Imaging, 39(8):2606-2614[DOI:10.1109/TMI.2020.2992546]
Li L, Qin L X, XuZ G, Yin Y B, Wang X, Kong B, Bai J J, Lu Y, Fang Z H, Song Q, Cao K L, Liu D L, Wang G S, Xu Q Z, Fang X S, Zhang S Q, Xia J and Xia J. 2020. Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT:evaluation of the diagnostic accuracy. Radiology, 296(2):E65-E71[DOI:10.1148/radiol.2020200905]
Ronneberger O, Fischer P and Brox T. 2015. U-Net: Convolutional networks for biomedical image segmentation//Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin: Springer: 234-241.[DOI: 10.1007/978-3-319-24574-4_28http://dx.doi.org/10.1007/978-3-319-24574-4_28]
Shen C, Yu N, Cai S B, Zhou J, Sheng J X, Liu K, Zhou H P, Guo Y M and Niu G. 2020. Quantitative computed tomography analysis for stratifying the severity of coronavirus disease 2019. Journal of Pharmaceutical Analysis, 10(2):123-129[DOI:10.1016/j.jpha.2020.03.004]
Song Y, Zheng S J, Li L, Zhang X, Zhang X D, Huang Z W, Chen J W, Zhao H Y, Jie Y S, Wang R X, Chong Y T, Shen J, Zha Y F and Yang Y D. 2020. Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images. medRxiv[DOI: 10.1101/2020.02.23.20026930http://dx.doi.org/10.1101/2020.02.23.20026930]
Wang S, Kang B, Ma J L, Zeng X J, Xiao M M, Guo J, Cai M J, Yang J Y, Li Y D, Meng X F and Xu B. 2020. A deep learning algorithm using CT images to screen for corona virus disease (COVID-19)[EB/OL].[2020-05-15].https://www.medrxiv.org/content/10.1101/2020.02.14.20023028v5https://www.medrxiv.org/content/10.1101/2020.02.14.20023028v5
Zhao Y Q, Gui W H, Chen Z C, Tang J T and Li L Y. 2005. Medical images edge detection based on mathematical morphology//Proceedings of 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference. Shanghai: IEEE: 6492-6495[DOI: 10.1109/IEMBS.2005.1615986http://dx.doi.org/10.1109/IEMBS.2005.1615986]
Zheng C S, Deng X B, Fu Q, Zhou Q, Feng J P, Ma H, Liu W Y and Wang X G. 2020. Deep learning-based detection for COVID-19 from chest CT using weak label[EB/OL].[2020-05-15].https://www.medrxiv.org/coneent110.1101/2020.03.12.20027185v2https://www.medrxiv.org/coneent110.1101/2020.03.12.20027185v2
相关文章
相关作者
相关机构