高分辨率深度生成网络的缺失牙体形态设计
Morphological design of missing tooth driven by high-resolution deep generation network
- 2020年25卷第10期 页码:2249-2258
收稿:2020-06-01,
修回:2020-6-29,
录用:2020-7-5,
纸质出版:2020-10
DOI: 10.11834/jig.200252
移动端阅览

浏览全部资源
扫码关注微信
收稿:2020-06-01,
修回:2020-6-29,
录用:2020-7-5,
纸质出版:2020-10
移动端阅览
目的
2
针对口腔修复体设计中采用标准牙数据库进行再设计时未考虑缺失牙多样性以及个性化程度不足的问题,提出基于高分辨生成式对抗网络(high resolution generative adversarial network,HRGAN)的缺失牙冠个性化设计方法。
方法
2
首先,利用图像熵的多方向正交投影方法计算牙体的深度距离值,并构建出咬合面、舌侧面和颊侧面的具有像素值增强的高分辨率深度图像数据集;其次,通过构建的HRGAN模型合成具有高分辨率的缺失牙深度图像,并采用像素—距离的映射关系得到缺失牙齿的3维点云数据;最后,采用点云配准技术和网格重建方法完成3组点云的拼接及3维牙冠形态重建。
结果
2
实验采用500副牙冠模型进行训练和测试,通过设置不同损失条件的实验,与不同方法进行比较分析设计牙冠与目标牙冠的偏差。与计算机辅助设计(computer aided design,CAD)方法和基于生成模型的设计方法对比得出,本文构建的HRGAN模型生成的牙冠形态的标准偏差相比前两者分别降低了21.2%和7%,均方根值(root mean square,RMS)分别下降了43.8%和9.8%,并且牙冠咬合面形态与专家设计牙冠形态最为接近。
结论
2
本文提出的基于高分辨率生成网络的牙体设计方法能够有效地完成缺失牙体的形态设计,设计的牙冠具有天然牙解剖形态特征。
Objective
2
Dental defect is a common problem in oral restoration treatment. For the symptoms of severe tooth loss
the traditional clinical treatment method is porcelain tooth restoration. This method primarily relies on the experience and technology of physicians and experts. Given the long time
this method leads to restoration precision is not easy to control. The current restoration method is to use the dental restoration computer aided design/computer aided manufacturing(CAD/CAM) system for restoration treatment. For example
in the CAD design of full-crown restorations
most methods use the standard tooth model in the standard database as the initial model to replace the defective tooth. A series of algorithms are used to properly deform the crown mesh model to reconstruct the target full-crown restoration model. This method uses the standard tooth model
lacks personalization
and requires a large number of man-machines in the design process. With regard to the interactive operation
the operator's technical experience is required
and the design contains a large degree of subjectivity. A personalized design method for the missing tooth crown based on the generative adversarial networks (HRGAN) is proposed to solve the personalized design of complex tooth morphology.
Method
2
Given the powerful processing ability of the HRGAN on the image
the three-dimensional model is reduced to a two-dimensional image
and the network can learn it. First
the depth distance of the tooth is calculated by using the multi-direction orthogonal projection method
and the high-resolution depth images of the occlusal surface
lingual side
and buccal side were constructed. The quality of the tooth image is optimized by the method of pixel value enhancement to subsequently use the generative confrontation network and better fit the morphological distribution of the crown. Image entropy describes the richness of the information carried by the image. Image entropy is used to evaluate the constructed depth image and construct a batch of learning data sets suitable for deep convolutional networks. Then
based on the multi-scale generative and discriminant models
the structure of the missing tooth restoration network model is constructed. The generative model generates the crown data by capturing the distribution of the crown data. The discriminant model is used to determine whether a sample is from expert design data rather than generated data. The two models are trained alternately and iteratively
playing with each other and constantly optimizing. The network merges a feature-matching loss on the basis of the discriminator to better fit the morphological features of the teeth and adds a perceptual loss to enhance network's ability to reconstruct the shape of the occlusal surface of the tooth. Finally
the point cloud data of the crown are calculated on the basis of the gray value and distance value mapping
and the rough registration is performed according to the information of the missing crown in the adjacent tooth. The iterative closest point algorithm is used to precisely register the generated crown point cloud with the original point cloud and achieve the reconstruction of the missing tooth model.
Result
2
We have constructed 500 sets of tooth depth map data
of which 400 sets are used as training sets and 100 sets are used as verification sets. The quality of the network-generated image is evaluated by the similarity between the tooth image synthesized from the HRGAN and the image obtained from the expert-designed tooth under experiments with different loss conditions. By calculating the peak signal to noise ratio(PSNR) and structrual similarity(SSIM) values of the two groups of images
the similarity between the images generated by the network and the image designed by the expert is improved after adding the loss of feature matching and perception
and the reconstructed occlusal surface of the crown has rich features of tooth pits and sulcus. The deviation analysis of the reconstructed occlusal surface and its corresponding expert design crown is carried out. The results show that compared with the CAD design method and the generative model-based design method
the standard deviation of the crown shape generated by the method in this paper is 21.2% and 7% lower than the former two methods
and the root mean square(RMS) value is 43.8% and 9.8% lower
respectively
and the shape of the occlusal surface of the crown is the closest to the shape of the expert-designed crown.
Conclusion
2
The experimental results show that the tooth design method based on the high-resolution generation network proposed in this paper can effectively complete the morphological design of the missing tooth
and the designed crown has enough natural tooth anatomical morphological characteristics.
Besl P J and McKay N D. 1992. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239-256[DOI:10.1109/34.121791]
Goodfellow I J, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A and Bengio Y. 2014. Generative adversarial nets//Proceedings of the 27th International Conference on Neural Information Processing Systems. Montreal: MIT Press: 2672-2680
Isola P, Zhu J Y, Zhou T H and Efros A A. 2017. Image-to-image translation with conditional adversarial networks//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE: 1125-1134[ DOI:10.1109/CVPR.2017.632 http://dx.doi.org/10.1109/CVPR.2017.632 ]
Jiang X T, Dai N, Cheng X S, Wang J, Peng Q J, Liu H and Cheng C. 2016. Robust tooth surface reconstruction by iterative deformation. Computers in Biology and Medicine, 68:90-100[DOI:10.1016/j.compbiomed.2015.11.001]
Miki Y, Muramatsu C, Hayashi T, Zhou X R, Hara T, Katsumata A and Fujita H. 2017. Classification of teeth in cone-beam CT using deep convolutional neural network. Computers in Biology and Medicine, 80:24-29[DOI:10.1016/j.compbiomed.2016.11.003]
Prajapati S A, Nagaraj R and Mitra S. 2017. Classification of dental diseases using CNN and transfer learning//Proceedings of the 5th International Symposium on Computational and Business Intelligence. Dubai: IEEE: 70-74[ DOI:10.1109/ISCBI.2017.8053547 http://dx.doi.org/10.1109/ISCBI.2017.8053547 ]
Tian S K, Dai N, Zhang B, Yuan F L, Yu Q and Cheng X S. 2019. Automatic classification and segmentation of teeth on 3D dental model using hierarchical deep learning networks. IEEE Access, 7:84817-84828[DOI:10.1109/ACCESS.2019.2924262]
Wang T C, Liu M Y, Zhu J Y, Tao A, Kautz J and Catanzaro B. 2018. High-resolution image synthesis and semantic manipulation with conditional GANs//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE: 8798-8807[ DOI:10.1109/CVPR.2018.00917 http://dx.doi.org/10.1109/CVPR.2018.00917 ]
Wang Z,Bovik A C, Sheikh H R and Simoncelli E P. 2004. Image quality assessment:from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600-612[DOI:10.1109/TIP.2003.819861]
Xu X J, Liu C and Zheng Y Y. 2019.3D tooth segmentation and labeling using deep convolutional neural networks. IEEE Transactions on Visualization and Computer Graphics, 25(7):2336-2348[DOI:10.1109/TVCG.2018.2839685]
Yu X L, Cheng X S, Dai N, Chen H, Yu C J and Sun Y C. 2018. Study on digital teeth selection and virtual teeth arrangement for complete denture. Computer Methods and Programs in Biomedicine, 155:53-60[DOI:10.1016/j.cmpb.2017.11.022]
Yuan F L, Dai N, Tian S K, Zhang B, Sun Y C, Yu Qing and Liu H. 2019. A full crown restoration approach for defect teeth based on CGAN. Journal of Computer-Aided Design and Computer Graphics, 31(12):2113-2120
袁福来, 戴宁, 田素坤, 张贝, 孙玉春, 俞青, 刘浩. 2019.采用条件生成式对抗网络的缺损牙全冠修复技术.计算机辅助设计与图形学学报, 31(12):2113-2120)[DOI:10.3724/SP.J.1089.2019.17774]
Zhang B, Dai N, Tian S K, Yuan F L and Yu Q. 2019. The extraction method of tooth preparation margin line based on S-Octree CNN. International Journal for Numerical Methods in Biomedical Engineering, 35(10):e3241[DOI:10.1002/cnm.3241]
Zhang C D, Dai N, Liao W H, Yan G D, Sun Y C, Wang Y and Lyu P J. 2012. Partially missing dental occlusion surface adaptive reconstruction algorithm. Chinese Journal of Biomedical Engineering, 31(2):203-210
张长东, 戴宁, 廖文和, 闫国栋, 孙玉春, 王勇, 吕培军. 2012.部分缺失牙齿咬合面自适应重建算法.中国生物医学工程学报, 31(2):203-210)[DOI:10.3969/j.issn.0258-8021.2012.02.007]
Zhang C D, Liu T T, Liao W H, Yang T and Jiang L Y. 2017. Computer-aided design of dental inlay restoration based on dual-factor constrained deformation. Advances in Engineering Software, 114:71-84[DOI:10.1016/j.advengsoft.2017.06.005]
Zheng S X, Li J and Sun Q F. 2011.3D deformation design method for prosthetic dental surface based on feature mapping. Journal of Mechanical Engineering, 47(3):129-134
郑淑贤, 李佳, 孙庆丰. 2011.基于特征映射的义齿表面3维变形设计方法.机械工程学报, 47(3):129-134)[DOI:10.3901/JME.2011.03.129]
相关作者
相关机构
京公网安备11010802024621