图匹配算法激光扫描点云树干分割
Tree stem segmentation of laser scanning point clouds based on graph matching algorithm
- 2021年26卷第5期 页码:1095-1104
纸质出版日期: 2021-05-16 ,
录用日期: 2020-07-25
DOI: 10.11834/jig.200296
移动端阅览
浏览全部资源
扫码关注微信
纸质出版日期: 2021-05-16 ,
录用日期: 2020-07-25
移动端阅览
徐姗姗. 图匹配算法激光扫描点云树干分割[J]. 中国图象图形学报, 2021,26(5):1095-1104.
Shanshan Xu. Tree stem segmentation of laser scanning point clouds based on graph matching algorithm[J]. Journal of Image and Graphics, 2021,26(5):1095-1104.
目的
2
移动激光扫描系统能够成功采集丰富的城市行道树侧边信息,然而由于点云数据规模大、密度欠均匀和噪声多等原因,导致行道树的提取精度和效率偏低。为此,本文提出一种基于层次聚类的算法从移动激光扫描点云中提取树干。
方法
2
采用自下而上的聚类策略合并目标区域,基于点云间欧氏距离和点云的局部主方向计算聚类所需的邻近矩阵,通过构造能量函数评估不同的簇合并方案,将能量函数最小化问题转换为计算二分图匹配问题,求解二分图的最小代价完美匹配获得全局最优的层次聚类。
结果
2
实验在公开的巴黎场景数据集与自采集的南京黄埔路场景数据集上进行测试,本文提出的自下向上的聚类算法成功地从点云中提取出树干和主要树枝点,其中提取树干的平均正确率、完整率和F-score分别为98.5%、94.8%和0.97,与其他算法中最好的实验结果对比,分别提高了1.0%、0.6%和0.02。
结论
2
实验结果表明,本文算法通过优化层次聚类中的簇合并,可以有效减少聚类中的“过分割”和“欠分割”,提高点云中树干的分割精度与效率。
Objective
2
Street trees have played a key role in the urban forest resource inventory. Traditional methods of street tree detection and survey are based on 2D satellite images
which have low resolution and lack 3D information. At present
mobile laser scanner systems have been used to successfully collect the 3D side information of urban street trees at a low cost and high efficiency. Hence
this study uses a hierarchical clustering approach to extract street tree stems from mobile laser radar (LiDAR) point clouds. This study proposes a bottom-up hierarchical clustering method to extract urban street trees from mobile laser scanner point clouds. The proposed algorithm calculates the cost of different cluster combination and optimizes the cluster merging.
Method
2
There are three main steps in the proposed tree stem extraction. The first preprocessing step is to filter noise and ground points to reduce the calculation complexity. The noise point filtering is based on the mean
μ
and standard deviation
σ
of
K
-nearest neighbor points. A point is considered to be an outlier if the average distance to its
K
-nearest neighbors is above the specified threshold. Points that fall out of the range between
μ
-
σ
and
μ
+
σ
are regarded as noise points. To remove ground points
we analyze the elevation histogram of points. The second step is to group points from the same tree into one unit based on the clustering approach. Each cluster contains one unique point. The proximity matrix is calculated iteratively. If the cluster set is converged (i.e.
the number of clusters is stable)
the algorithm will output the clustering results; otherwise
the algorithm goes to the proximity matrix calculation and repeats the above-mentioned steps. The third step is the refinement of results. Given that pole-like objects tend to be regarded as tree stems
we analyze the point distribution. The method is based on the kurtosis of point in the vertical direction. If the kurtosis of a candidate tree cluster falls in
μ
k
-1.5
σ
k
and
μ
k
+ 1.5
σ
k
this cluster will be regarded as a tree; otherwise
this cluster will be regarded as a false tree.
μ
k
and
σ
k
are the mean and standard deviation kurtosis of a candidate tree cluster
respectively. The proximity matrix required for the hierarchical clustering to measure the difference between clusters is based on the Euclidean distances and the principal direction of local points. The main contribution is to minimize the cluster combination cost by solving the matching problem in graphs.
Result
2
To evaluate the tree stem clustering
the proposed algorithm is used on two urban scenes. The first scene is from an open benchmark located in Paris
the collection system is mobile laser scanning(MLS)
and the date is in January 2013. The second scene is collected by a wearable laser scanning (WLS) system. The WLS device used to perform the study was the ZEB-REVO lightweight mobile laser scanner by GeoSLAM. The proposed algorithm succeeds in extracting 85 out of 96 tree stems from the first dataset and 118 out of 118 tree stems from the second dataset. In the urban scene
if the tree is close to the LiDAR sensor (< 10 m)
tree stems and branches will be extracted effectively. However
if trees are far from sensors (> 30 m)
the extraction results will contain the main stems and branches only due to the sparse tree points. In the two experimental scenes
the proposed algorithm effectively extracts trees within 50 m
which means that the algorithm works well in an urban street scene. The main contribution is to minimize the cluster combination cost by solving the matching problem in graphs. The proposed bottom-up clustering strategy succeeds in extracting points from the stem regions and achieves the completeness of 94.8%
correctness of 98.5%
and F-score of 0.97 on urban road environments. Given that the proposed results are based on the optimal cluster combination
the robustness of the segmentation of scatter points will be higher than others. The segment of stems is based on the principal direction; therefore
the results will not be affected by the holes or incomplete regions. Moreover
the proposed stem cluster does not rely on a fitting approach. Therefore
the proposed method works for different tree models or structures.
Conclusion
2
The proposed tree stem clustering does not require any prior knowledge of trees (e.g.
the number of trees
the location
and geometric shape information). The proposed method is based on the Euclidean distance and principal direction to formulate the proximity matrix and uses the perfect matching in a bipartite graph to optimize the cluster combination. Experiments show that the proposed method succeeds in clustering stems from two complex urban street scenes and is proved to be suitable for various tree structures. The calculation of the optimal cluster combination is effective to reduce the "over-segmentation" and "under-segmentation" in the tree stem detection
improving the clustering accuracy and robustness from 3D point clouds.
3维数据处理计算机视觉图匹配层次聚类点云数据城市行道树
3D data processingcomputer visiongraph matchinghierarchical clusteringpoint cloud dataurban street tree
Arachchige Hetti N. 2013. Automatic tree stem detection——a geometric feature based approach for MLS point clouds. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, (2): 109-114[DOI:10.5194/isprsannals-Ⅱ-5-W2-109-2013]
Chen L, Cai Y and Zhang J S. 2017. Adaptive K-means clustering simplification of scattered point cloud. Journal of Image and Graphics, 22(8): 1089-1097
陈龙, 蔡勇, 张建生. 2017. 自适应K-means聚类的散乱点云精简. 中国图象图形学报, 22(8): 1089-1097[DOI:10.11834/jig.160582]
Edson C and Wing M G. 2011. Airborne light detection and ranging (LiDAR) for individual tree stem location, height, and biomass measurements. Remote Sensing, 3(11): 2494-2528[DOI:10.3390/rs3112494]
Korpela I, Ørka H O, Maltamo M, Tokola T and Hyyppä J. 2010. Tree species classification using airborne LiDAR——effects of stand and tree parameters, downsizing of training set, intensity normalization, and sensor type. Silva Fennica, 44(2): 319-339[DOI:10.14214/sf.156]
Lehtomäki M, Jaakkola A, Hyyppä J, Kukko A and Kaartinen H. 2010. Detection of vertical pole-like objects in a road environment using vehicle-based laser scanning data. Remote Sensing, 2(3): 641-664[DOI:10.3390/rs2030641]
Li C H, Li Z J and Gao Y. 2017. Application of spectrum and Kuhn-Munkres algorithm in graph matching. Computer Engineering and Science, 39(10): 1896-1900
李昌华, 李智杰, 高阳. 2017. 图谱和Kuhn-Munkres算法在图匹配中的应用研究. 计算机工程与科学, 39(10): 1896-1900[DOI:10.3969/j.issn.1007-130X.2017.10.018]
Liang X L, Hyyppä J, Kukko A, Kaartinen H, Jaakkola A and Yu X W. 2014. The use of a mobile laser scanning system for mapping large forest plots. IEEE Geoscience and Remote Sensing Letters, 11(9): 1504-1508[DOI:10.1109/LGRS.2013.2297418]
Lu X C, Guo Q H, Li W K and Flanagan J. 2014. A bottom-up approach to segment individual deciduous trees using leaf-off lidar point cloud data. ISPRS Journal of Photogrammetry and Remote Sensing, 94: 1-12[DOI:10.1016/j.isprsjprs.2014.03.014]
Matsuki T, Yokoya N and Iwasaki A. 2015. Hyperspectral tree species classification of Japanese complex mixed forest with the aid of LiDAR data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(5): 2177-2187[DOI:10.1109/JSTARS.2015.2417859]
Rusu R B, Marton Z C, Blodow N, Dolha M and Beetz M. 2008. Towards 3D point cloud based object maps for household environments. Robotics and Autonomous Systems, 56(11): 927-941[DOI:10.1016/j.robot.2008.08.005]
Vallet B, Brédif M, Serna A, Marcotegui B and Paparoditis N. 2015. TerraMobilita/iQmulus urban point cloud analysis benchmark. Computers and Graphics, 49: 126-133[DOI:10.1016/j.cag.2015.03.004]
Xia N, Shu Q, Zhao Q and Yi J. 2016. A path planning method for water surface mobile sink based on Voronoi diagram and bipartite graph. Acta Automatica Sinica, 42(8): 1185-1197
夏娜, 束强, 赵青, 伊君. 2016. 基于维诺图和二分图的水面移动基站路径规划方法. 自动化学报, 42(8): 1185-1197[DOI:10.16383/j.aas.2016.c150794]
Xia S B, Wang C, Pan F F, Xi X H, Zeng H C and Liu H. 2015. Detecting stems in dense and homogeneous forest using single-scan TLS. Forests, 6(11): 3923-3945[DOI:10.3390/f6113923]
Xu S, Wang R S, Wang H and Zheng H. 2020. An optimal hierarchical clustering approach to mobile LiDAR point clouds. IEEE Transactions on Intelligent Transportation Systems, 21(7): 2765-2776[DOI:10.1109/TITS.2019.2912455]
Xu S, Xu S S, Ye N and Zhu F. 2018. Individual stem detection in residential environments with MLS data. Remote Sensing Letters, 9(1): 51-60[DOI:10.1080/2150704X.2017.1384588]
Xu S S, Yan C and Gao L M. 2019. Lake extraction algorithm based on three-dimensional convolutional neural network. Journal of Computer Applications, 39(12): 3450-3455
徐姗姗, 颜超, 高琳明. 2019. 基于3维卷积神经网络的湖泊提取算法. 计算机应用, 39(12): 3450-3455[DOI:10.11772/j.issn.1001-9081.2019081436]
Yao W, Krzystek P and Heurich M. 2012. Tree species classification and estimation of stem volume and DBH based on single tree extraction by exploiting airborne full-waveform LiDAR data. Remote Sensing of Environment, 123: 368-380[DOI:10.1016/j.rse.2012.03.027]
Yun T, An F, Li W Z, Sun Y, Cao L and Xue L F. 2016. A novel approach for retrieving tree leaf area from ground-based LiDAR. Remote Sensing, 8(11): #942[DOI:10.3390/rs8110942]
Zhong L S, Cheng L, Xu H, Wu Y, Chen Y M and Li M C. 2017. Segmentation of individual trees from TLS and MLS data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 10(2): 774-787[DOI:10.1109/JSTARS.2016.2565519]
Zhu Q H. 2019. A batch extraction method of rod type objects based on octree vehicle-borne laser point cloud. Bulletin of Surveying and Mapping, (S2): 110-111, 116
朱清海. 2019. 一种基于八叉树车载激光点云的杆式地物批量提取方法. 测绘通报, (S2): 110-111, 116[DOI:10.13474/j.cnki.11-2246.2019.0601]
相关作者
相关机构