浏览全部资源
扫码关注微信
Received：27 July 2020，
Revised：2020-9-22，
Accepted：29 September 2020，
Published：16 December 2021
移动端阅览
目的
2
符合曼哈顿假设的结构化场景简称曼哈顿世界，具有丰富的场景结构特征。消失点作为直线的潜在观测，是一种全局信息，可以显式地体现载体坐标系与世界坐标系之间的姿态关系。为更加准确地估计消失点，本文针对单目图像，同时考虑实时性和准确性，提出了具有更高精度的基于非线性优化的消失点估计算法。
方法
2
分析目前性能最优的基于随机采样一致性（random sample consistency，RANSAC）的消失点估计方法，通过对直线单参数化、利用正交性约束生成候选假设以及RANSAC过程的重点分析与改进，更加快速准确地得到消失点估计，为后续优化提供初值。利用直线分类时计算的误差度量构建最小二乘优化模型，采用非线性优化方法迭代求解，并采用鲁棒核函数保证迭代的精确性和结果的最优性。
结果
2
通过仿真实验和基于公共数据集的实验对本文提出算法与目前性能最优算法进行比较。仿真实验中，相比于RCM（R3_CM1）及RCMI（R3_CM1_Iter），本文算法结果在轴角形式下的角度偏差减小了24.6%；有先验信息约束时，角度偏差降低一个数量级，仅为0.06°，精度大幅提高。在YUD（York urban city databbase）数据集中，本文算法相较于RCM和RCMI，角度偏差分别减小了27.2%和23.8%，并且80%的消失点估计结果角度偏差小于1.5°，性能明显提升且更具稳定性。此外，本文算法在仿真实验对每一图像帧的平均优化耗时为0.008 s，可保证整体的实时性。
结论
2
本文提出的消失点估计算法，对基于RANSAC的方法进行了改进，在不影响实时性的基础上，估计结果更加准确、鲁棒，并且更具稳定性。
Objective
2
Manhattan world has been an abbreviation for structured scenes that satisfy the Manhattan world assumption
such as artificial indoor and outdoor scenes. It has a strong structural regularity and is in accordance with the Cartesian coordinate system. Manhattan world can be derived that the three dominant directions correspond to the three orthogonal vanishing points. The vanishing point
as a structural feature in the Manhattan world
can explicitly reflect the attitude relationship between the camera coordinate and the world coordinate. In order to use this characteristic of vanishing points to assist visual self-localization
3D reconstruction and scene recognition
it is of optical importance to accurately estimate vanishing points. A novel and more accurate vanishing points estimation algorithm based on monocular images and nonlinear optimization has been issued.
Method
2
First
the current state of the art vanishing point estimation has been analyzed based on random sample consistency (RANSAC). Next
through the analysis and improvement of the single parameterization of straight lines
candidate hypotheses generated using the orthogonality constraints and the RANSAC process
the vanishing point estimates can be obtained more quickly and accurately as the initial value for subsequent operations. At last
the error measurement calculated during line classification has been reused to construct the least squares optimization problem
and non-linear optimization is used to solve it. In order to ensure the accuracy of the iteration and the optimality of the results
a robust kernel function has been used as well.
Result
2
the proposed algorithm has been compared with the state of the art RANSAC based method via simulation experiments and experiments based on public database. In the simulation experiment
the angular deviation has been reduced about 24.6% in the form of axial angle compared with RCM (R3_CM1) and RCMI (R3_CM1_Iter) method. When there is a prior information constraint
the angular deviation is only 0.06 degree
decreased by an order of magnitude
which means the accuracy is greatly improved. In the public York urban city database (YUD)
the performance of the proposed algorithm has been improved compared with the RCM method and RCMI method. The angular deviation has been reduced by 27.2% and 23.8%. The statistical results have shown that the angular deviation of 80% of the vanishing point estimation results is less than 1.5 degree. In addition
a statistical analysis of the running time has been performed in the simulation experiment. The average optimization time for each image frame is 0.008 s
which can ensure the overall real-time performance.
Conclusion
2
The vanishing point estimation algorithm proposed has been more qualified than the RANSAC-based method. The estimation results have shown its superiority in terms of both accuracy and robustness
with no effect on the real-time performance.
Bazin J C and Pollefeys M. 2012. 3-line RANSAC for orthogonal vanishing point detection//Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. Vilamoura-Algarve, Portugal: IEEE: 4282-4287[ DOI:10.1109/IROS.2012.6385802 http://dx.doi.org/10.1109/IROS.2012.6385802 ]
Bazin J C, Seo Y, Demonceaux C, Vasseur P, Ikeuchi K, Kweon I and Pollefeys M. 2012. Globally optimal line clustering and vanishing point estimation in Manhattan world//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, USA: IEEE: 638-645[ DOI:10.1109/CVPR.2012.6247731 http://dx.doi.org/10.1109/CVPR.2012.6247731 ]
Collins R T and Weiss R S. 1990. Vanishing point calculation as a statistical inference on the unit sphere//Proceedings of the 3rd International Conference on Computer Vision. Osaka, Japan: IEEE: 400-403[ DOI:10.1109/ICCV.1990.139560 http://dx.doi.org/10.1109/ICCV.1990.139560 ]
Coughlan J M and Yuille A L. 2002. Manhattan world: compass direction from a single image by Bayesian inference//Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra, Greece: IEEE: 941-947[ DOI:10.1109/ICCV.1999.790349 http://dx.doi.org/10.1109/ICCV.1999.790349 ]
Dempster A P, Laird N M and Rubin D B. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1): 1-22[DOI: 10.1111/j.2517-6161.1977.tb01600.x]
Denis P, Elder J H and Estrada F J. 2008. Efficient edge-based methods for estimating Manhattan frames in urban imagery//Proceedings of the 10th European Conference on Computer Vision. Marseille, France: Springer: 197-210[ DOI:10.1007/978-3-540-88688-4_15 http://dx.doi.org/10.1007/978-3-540-88688-4_15 ]
Hough V and Paul C. 1962. Method and means for recognizing complex patterns. U.S., No. 3, 069, 654
Kong X L. 2017. The Researchabout Methods of INS/Stereo-Vision Integrated Navigation Based on Multiple View Geometry. Changsha: National University of Defense Technology
孔祥龙. 2017. 基于多视图几何的惯性/立体视觉组合导航方法研究. 长沙: 国防科技大学
Mirzaei F M and Roumeliotis S I. 2011. Optimal estimation of vanishing points in a Manhattan world//Proceedings of 2011 International Conference on Computer Vision. Barcelona, Spain: IEEE: 2454-2461[ DOI:10.1109/ICCV.2011.6126530 http://dx.doi.org/10.1109/ICCV.2011.6126530 ]
Rother C. 2002. A new approach to vanishing point detection in architectural environments. Image and Vision Computing, 20(9/10): 647-655[DOI: 10.1016/S0262-8856(02)00054-9]
Solà J, Vidal-Calleja T, Civera J and Montiel J M M. 2012. Impact of landmark parametrization on monocular EKF-SLAM with points and lines. International Journal of Computer Vision, 97(3): 339-368[DOI: 10.1007/s11263-011-0492-5]
Tardif J P. 2009. Non-iterative approach for fast and accurate vanishing point detection//Proceedings of the 12th International Conference on Computer Vision. Kyoto, Japan: IEEE: 1250-1257[ DOI:10.1109/ICCV.2009.5459328 http://dx.doi.org/10.1109/ICCV.2009.5459328 ]
Wildenauer H and Hanbury A. 2012. Robust camera self-calibration from monocular images of Manhattan worlds//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, USA: IEEE: 2831-2838[ DOI:10.1109/CVPR.2012.6248008 http://dx.doi.org/10.1109/CVPR.2012.6248008 ]
Wildenauer H and Vincze M. 2007. Vanishing point detection in complex man-made worlds//Proceedings of the 14th International Conference on Image Analysis and Processing. Modena, Italy: IEEE: 615-622[ DOI:10.1109/ICIAP.2007.4362845 http://dx.doi.org/10.1109/ICIAP.2007.4362845 ]
Yu Q H, Xiao J H, Lu H M and Zheng Z Q. 2018. Hybrid-residual-based RGBD visual odometry. IEEE Access, 6: 28540-28551[DOI: 10.1109/ACCESS.2018.2836928]
Zhang L L, Lu H M, Hu X P and Koch R. 2016. Vanishing point estimation and line classification in a Manhattan world with a unifying camera model. International Journal of Computer Vision, 117(2): 111-130[DOI:10.1007/s11263-015-0854-5]
相关作者
相关机构
京公网安备11010802024621
