同态滤波下RGB-D点云配准方法
RGB-D point cloud registration method via homomorphic filtering
- 2019年24卷第11期 页码:1985-1997
收稿:2019-01-14,
修回:2019-6-3,
录用:2019-6-9,
纸质出版:2019-11-16
DOI: 10.11834/jig.190011
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-01-14,
修回:2019-6-3,
录用:2019-6-9,
纸质出版:2019-11-16
移动端阅览
目的
2
为了提高彩色物体配准的精度,针对3维点云颜色信息易受光照条件影响的问题,提出一种基于光照补偿的RGB-D(RGB Depth)点云配准方法。
方法
2
引入同态滤波算法,并将模型对象的3维点云转化成线性点序列,从而对颜色信息进行光照补偿,以提高颜色信息的一致性;获取模型的颜色和几何特征并加权组合成混合特征,以此定义源点云的特征点,并运用K近邻算法搜索其对应点;用奇异值分解(SVD)得到配准的刚性变换矩阵。
结果
2
进行传统的迭代最近点法(ICP)算法、深度信息与色调相结合的算法以及本文算法在不同的光照强度组合的模型配准对比实验,结果显示,在网面凹凸均匀的大卫模型上,配准时间及特征点匹配平均误差方面均约减少到对比方法的1/2;在网面光滑的barrel模型和网面凹凸不一致的阿基米德模型上,特征点匹配平均误差约分别减少到对比方法的1/6和1/8。此外,与Super 4-Points Congruent Set(Super 4PCS)、彩色点云配准算法在不同组合光照强度下进行对比实验,针对4种不同的网面结构模型,本文算法的SIFT特征点距离平均误差全距约减少到对比方法的1/5。
结论
2
利用同态滤波算法抑制光照影响,提高了颜色信息的一致性,在一定效果上消除了光照强度不均匀对3维点云配准精度的干扰。
Objective
2
Digital restoration of historical cultural relics
simulation of medical equipment and human organs
and virtual teaching reflect that 3D reconstruction technology plays an extremely important role in the development level of human society. However
in 3Dreconstruction
geometric data in the RGB-D (RGB Depth) data collected by a depth camera have low quality and high noise. In 3D point cloud registration
the features of geometric data obtained from such low-quality and high-noise data are the only means to obtain an accurate registration result of the point cloud. However
the point cloud registration effect is not particularly obvious. Given that point cloud noise interference is relatively large and geometric information is unclear
which has a non-negligible effect on the registration accuracy. Color information is introduced to increase the feature information of the model. However
when the model data are collected by as canning device
the color is greatly affected by a change in illumination
and the model surface is affected by changes in illumination intensity and angle of view. These effects lead to an obvious color change and inevitable interference. In this study
an RGB-D point cloud registration method based on illumination compensation is proposed that considers 3D point cloud color information as susceptible to illumination conditions.
Method
2
The color data of the model surface consist of the product of illumination and reflection components. The illuminance component varies with spatial position and displays low-frequency information
where as the reflected component has various texture details visible to the human eye and expresses high-frequency information. The brightness of low-frequency information of color is suppressed when combined with homomorphic filtering
the amount of high-frequency information is enhanced
the influence of color changes by illumination is eliminated
and the consistency of color information is improved. RGB-D data acquired by a Kinect device must be sorted to form a linear point sequence. The color and geometric features of the model are acquired and weighted into a mixed feature to define the feature points of the source point cloud
and the K-nearest neighbor algorithm is used to search for the corresponding points. The singular value decomposition algorithm is used to obtain a rigid transformation matrix.
Result
2
Through experiments
data are collected from four models at different light intensities using Kinect scanning equipment. The experimental categories comprise three sets
namely
strong light and low light
left light and right light
and strong light and side light. Our method is compared with the traditional iterative closest point (ICP)
super four-point congruent set(Super 4PCS)
4D ICP (hue + ICP) combined with hue and geometry information
and blending of geometric and color information. In the course of the experiments
the iteration running time
number of iterations
and average distance error of scale-invariant feature transform (SIFT) feature points are used as the evaluation criteria for the registration experiment results. The effects of different light intensity models after registration by each algorithm are also shown for comparison. Results according to the traditional ICP algorithm
the combination of depth information and hue
and the model registration experiment of different light intensity combinations on the David model with uniform mesh surface show that the times are relatively flat; the average running times are 8.920 s
8.796 s
and 5.191 s; and the average errors of feature point matching are 3.677
3.102
and 1.029
respectively. Registration time and average error of feature point matching are improved by approximately 50%. On the Archimedes model with inconsistent mesh surface irregularities
the number of iterations is undistinguishable. The average running times of the registration are 6.926 s
3.955 s and 3.853 s
and the average errors of feature point matching are 26.718
27.653
and 28.843
respectively. On the barrel model with smooth mesh surface
the average running times of registration are 0.509 s
1.937 s and 0.691 s
and the average errors of feature point matching are 23.830
22.820
and 3.931
respectively. On the barrel model with smooth mesh surface and the Archimedes model with inconsistent mesh surface irregularities
the average error of feature point matching is reduced to one-sixth and one-eighth of the comparison method. This study also compares the Super 4PCS and color point cloud registration algorithms under different combined illumination intensities. Of the four mesh structure models
the average distance error of SIFT feature points of the proposed algorithm is the lowest. The full-distance reduction is reduced to one-fifth of the comparison method
which proves that the proposed algorithm has stability in the model registration of different illumination intensities. This study further conducts correlation experiments on the missing point cloud model and proves that the algorithm can deal with the problem of point cloud registration with missing points. When the overlap rate of two point clouds is approximately 40%
the algorithm registration in this study can achieve better results.
Conclusion
2
Homomorphic filtering algorithm is used to suppress the influence of illumination changes
and the consistency of color information is improved. The interference of uneven illumination intensity on 3D point cloud registration accuracy is eliminated. The registration method is verified by comparing it with other correlation registration algorithms. The method has obvious advantages in algorithm stability and registration accuracy.
Yang H, Qian K, Dai X Z, et al. Kinect-based 3D indoor environment map building for mobile robot[J]. Journal of Southeast University:Natural Science Edition, 2013, 43(S1):183-187.
杨鸿, 钱堃, 戴先中, 等.基于Kinect传感器的移动机器人室内环境三维地图创建[J].东南大学学报:自然科学版, 2013, 43(S1):183-187.
Wang F J, Xi X H, Wan Y P, et al. Analysis on digitization and 3D-reconstruction of large building based on terrestrial laser scanning data[J]. Remote Sensing Technology and Application, 2014, 29(1):144-150.
王方建, 习晓环, 万怡平, 等.大型建筑物数字化及三维建模关键技术分析[J].遥感技术与应用, 2014, 29(1):144-150. [DOI:10.11873/j.issn.1004\-0323.2014.1.0144]
Ta L, Li S B, Li L Y. Preliminary study on 3D data collection and application of Tibetan cultural relics in Inner Mongolia museum[J]. Chinese Museum, 2012(1):32-35.
塔拉, 李少兵, 李丽雅.内蒙古博物院馆藏文物三维数据采集及成果应用初探[J].中国博物馆, 2012(1):32-35.
Zhang X P, Zhang X Y, Wang J Z. Three-dimensional reconstruction and deformation simulation of human organbased on web[J]. Journal of Clinical Rehabilitative Tissue Engineering Research, 2011, 15(13):2376-2380.
张小萍, 张小勇, 王君泽.网络环境下人体器官的三维重建及变形仿真[J].中国组织工程研究与临床康复, 2011, 15(13):2376-2380. [DOI; 10.3969/j.issn.1673-8225.2011.13.023]
Besl P J, McKay N D. A method for registration of 3-D shapes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2):239-256.[DOI:10.1109/34.121791]
Su B Y, Ma J Y, Peng Y S, et al. Fast point cloud registration based on RGB-D data[J]. Journal of Image and Graphics, 2017, 22(5):643-655.
苏本跃, 马金宇, 彭玉升, 等.面向RGB-D深度数据的快速点云配准方法[J].中国图象图形学报, 2017, 22(5):643-655. [DOI:10.11834/jig.160602]
Mellado N, Aiger D, Mitra N J. Super 4PCS fast global pointcloud registration via smart indexing[J]. Computer Graphics Forum, 2014, 33(5):205-215.[DOI:10.1111/cgf.12446]
Aiger D, Mitra N J, Cohen-Or D. 4-points congruent sets for robust pairwise surface registration[J]. ACM Transactions on Graphics, 2008, 27(3):#85.[DOI:10.1145/1360612.1360684]
Park J, Zhou Q Y, Koltun V. Colored point cloud registration revisited[C]//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 143-152.[ DOI: 10.1109/ICCV.2017.25 http://dx.doi.org/10.1109/ICCV.2017.25 ]
Douadi L, Aldon M J, Crosnier A. Pair-wise registration of 3D/color data sets with ICP[C]//Proceedings of 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems. Beijing, China: IEEE, 2006: 663-668.[ DOI: 10.1109/IROS.2006.282551 http://dx.doi.org/10.1109/IROS.2006.282551 ]
Druon S, Aldon M J, Crosnier A. Color constrained ICP for registration of large unstructured 3D color data sets[C]//Proceedings of 2006 IEEE International Conference on Information Acquisition. Weihai: IEEE, 2007: 249-255.[ DOI: 10.1109/ICIA.2006.306004 http://dx.doi.org/10.1109/ICIA.2006.306004 ]
Tong L J, Ying X. 3D point cloud initial registration using surface curvature and SURF matching[J]. 3D Research, 2018, 9(3):41.[DOI:10.1007/s13319-018-0193-8]
Song H B, Qu W F, Wang D D, et al. Shadow removal method of apples based on illumination invariant image[J]. Transactions of the Chinese Society of Agricultural Engineering, 2014, 30(24):168-176.
宋怀波, 屈卫锋, 王丹丹, 等.基于光照无关图理论的苹果表面阴影去除方法[J].农业工程学报, 2014, 30(24):168-176. [DOI:10.3969/j.issn.1002-6819.2014.24.020]
Finlayson G D, Hordley S D, Lu C, et al. On the removal of shadows from images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(1):59-68.[DOI:10.1109/TPAMI.2006.18]
Xiong J T, Zou X J, Wang H J, et al. Recognition of ripe litchi in different illumination conditions based on Retinex image enhancement[J]. Transactions of the Chinese Society of Agricultural Engineering, 2013, 29(12):170-178.
熊俊涛, 邹湘军, 王红军, 等.基于Retinex图像增强的不同光照条件下的成熟荔枝识别[J].农业工程学报, 2013, 29(12):170-178. [DOI:10.3969/j.issn.1002-6819.2013.12.022]
Men H, Gebre B, Pochiraju K. Color point cloud registration with 4D ICP algorithm[C]//Proceedings of 2011 IEEE International Conference on Robotics and Automation. Shanghai, China: IEEE, 2011: 1511-1516.[ DOI: 10.1109/ICRA.2011.5980407 http://dx.doi.org/10.1109/ICRA.2011.5980407 ]
Su B Y, Han W, Peng Y S, et al. 4D-ICP point cloud registration method for RGB-D data[J]. Journal of Nanjing University:Natural Science, 2018, 54(4):829-838.
苏本跃, 韩韦, 彭玉升, 等.面向RGB-D数据的4D-ICP点云配准方法[J].南京大学学报:自然科学, 2018, 54(4):829-838. [DOI:10.13232/j.cnki.jnju.2018.04.019]
Fan Y C, Li Y C, Han Y, et al. Weakening of smoke for homomorphic filtering[J]. Journal of Image and Graphics, 2012, 17(5):635-640.
范有臣, 李迎春, 韩意, 等.提升小波的同态滤波在图像烟雾弱化中的应用[J].中国图象图形学报, 2012, 17(5):635-640.[DOI:10.11834/jig.20120505]
Hu D M, Zhao H S, Li Y C, et al. A new approach to infrared image enhancement based on homomorphic filter[J]. Infrared Technology, 2012, 34(4):224-228.
胡窦明, 赵海生, 李云川, 等.一种基于同态滤波的红外图像增强新方法[J].红外技术, 2012, 34(4):224-228. [DOI:10.3969/j.issn.1001-8891.2012.04.009]
Xu L M, Lü J D. Bayberry image segmentation based on homomorphic filtering and K-means clustering algorithm[J]. Transactions of the Chinese Society of Agricultural Engineering, 2015, 31(14):202-208.
徐黎明, 吕继东.基于同态滤波和K均值聚类算法的杨梅图像分割[J].农业工程学报, 2015, 31(14):202-208. [DOI:10.11975/j.issn.1002-6819.2015.14.028]
相关作者
相关机构
京公网安备11010802024621