Current Issue Cover
沉浸式立体显示技术在临床医学领域中的应用

邰永航1,2, 石俊生1,2(1.云南省光电信息技术重点实验室, 云南师范大学, 昆明 650500;2.云南师范大学, 物理与电子信息学院, 昆明 650500)

摘 要
随着现代科学技术的快速发展,立体显示技术为临床医生的双眼视觉功能和临床应用场景,提供了现实模拟度更高的载体,并成为当前计算机视觉和临床医学领域共同研究的热点。在微创手术术前,与传统的平面显示技术相比,沉浸式立体显示技术能够提供更生动、准确的3维人体生理和病理影像,使医生更易于判断病变的层次、形状和血管等复杂结构及解剖关系;同时虚拟现实能够为医学培训及手术预演提供沉浸式的手术情境模拟,帮助医生高效地掌握手术技巧,提高医学术前诊断效率,从而进一步降低手术风险。在微创手术术中,基于增强现实的三维成像导航技术,能够将微创手术过程立体、直观地展现在医生面前,使术区各组织及其与手术器械间的位置关系和距离更加容易判断,同时通过叠加相同区域的术前检查影像,为手术提供实时的路径导航,实现精准微创手术。此外,在临床医疗资源共享中占据重要比重的远程诊疗领域,立体显示技术能够为远程诊断、线上会诊以及机器人手术等提供更为精确的深度信息,以及更多维度的图像信息,使医学数据的远程显示结果更具有真实性和实用性。现阶段立体显示技术在临床医学领域中也存在显示模式转换不舒适、三维重建图像信息缺失以及立体显示软、硬件系统带来的视觉疲劳等问题,但该技术在医学领域已经展露头角,在未来的临床医学进步中会成为不可或缺的一部分。本文详细分析了沉浸式立体显示技术在临床医学中的代表性应用,介绍了微创外科手术以及远程诊疗领域国内外的研究现状,从影像诊断、手术训练、规划与导航、治疗和教育培训4个方面,总结了立体显示技术在临床医学领域中的研究进展。
关键词
Application of immersive 3D imaging technology in the clinic medical field

Tai Yonghang1,2, Shi Junsheng1,2(1.Yunnan Key Laboratory of Optoelectronic Information Technology, Yunnan Normal University, Kunming 650500, China;2.School of Physics and Electronic Information, Yunnan Normal University, Kunming 650500, China)

Abstract
With the development of modern imaging 3D reconstruction, haptic interaction and three-dimensional (3D) printing technology, the traditional concept of tumor surgery is undergoing unprecedented revolutionary changes. The tumor treatment is not limited to traditional open surgery, large-area radiotherapy, chemotherapy, and other extensive treatment methods. The popularization of individualized precision surgery planning means that “precision medicine” is gradually applied to clinical surgery, and “precision medicine” mode will also make the treatment of tumor enter a new research area. The physiological anatomy and pathological changes of various organs of the human body are presented as a three-dimensional shape, while medical teaching images, diagnostic medical images, and various endoscopic surgery images are mostly plane images. However, how to interpret them often depends on the professional experience of doctors. This plane display mode limits the effect of medical training, the accuracy of interpretation of diagnostic images and the efficiency of surgical operation. Modern science and technology, stereo display technology provides a carrier with a higher realistic simulation degree for binocular vision function and training and has become a joint research hotspot in the field of computer vision and clinical medicine. Before minimally invasive surgery (MIS), compared with the traditional planar display technology, the immersive stereoscopic display technology can provide more vivid and accurate 3D human physiological and pathological images, making it easier for doctors to judge the layers, shapes, blood vessels and other complex structures and anatomical relations of lesions. At the same time, it can also provide immersive surgical situation simulation for medical training, help doctors quickly master surgical skills, further improve the efficiency of medical diagnosis and reduce the risk of surgery. In the process of minimally invasive surgery, the three-dimensional imaging navigation technology for augmented reality can not only make it easier for doctors to judge the position relationship and distance between the tissues in the surgical area and the surgical instruments, but also provide surgical navigation by superposing the preoperative examination images of the same location. Which is also achieved the accurate minimally invasive surgery. Besides, in the field of remote diagnosis and treatment, which occupies a significant proportion in the sharing of clinical medical resources, stereo display technology can provide the more accurate depth information and more dimensional image information for remote diagnosis, online consultation, and robotic surgery, so that the remote display results of medical data are more authentic and practical. Although at the present stage, the unadaptability of display mode conversion, partial information loss of 3D reconstruction images. Furthermore, the visual fatigue of users is still a problem that needs to be overcome in the field of clinical medicine. The three-dimensional display technology still has a broad space for development in medical science and is a new driving force to promote medical progress in the future. This article comprehensively analyzes the stereo display technology in clinical medicine; the application of minimally invasive surgery is summarized. The research status at home and abroad in remote diagnosis and treatment, from the image diagnosis and surgery training, planning and navigation, the training and education from four aspects, summarizes the stereo display technology research progress in the field of clinical medicine. This article fully analyzes the stereo display technology in the application of clinical medicine, provides an introduction to the field of minimally invasive surgery and remote diagnosis and research status at home and abroad, from the image diagnosis and surgery training, planning and navigation, the training and education from four aspects, summarizes the stereo display technology research progress in the field of clinical medicine. Clinical medicine in the future, with the aid of a 3D image technology, mixed reality technology, interactive technology, and a series of cutting-edge computer technology, can be more intuitive, accurately make the mixed reality device presents visualization of three-dimensional graphics, and provide a series of digital simulation tools, the surgeon can be based on the data communication with others, better-making operation plan. The extended reality technology can be used in the teaching of medical anatomy so that medical students can more intuitively understand the structure of human organs and their spatial position relationship with adjacent organs and tissues. Simultaneously, as an essential achievement to expand the combination of fundamental technology and medical research, virtual surgery is also one of the hot issues in medical research.
Keywords

订阅号|日报