车路视觉协同的高速公路防碰撞预警算法
Freeway anti-collision warning algorithm based on vehicle-road visual collaboration
- 2020年25卷第8期 页码:1649-1657
收稿:2019-12-05,
修回:2020-1-19,
录用:2020-1-26,
纸质出版:2020-08-16
DOI: 10.11834/jig.190633
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-12-05,
修回:2020-1-19,
录用:2020-1-26,
纸质出版:2020-08-16
移动端阅览
目的
2
基于视觉的前车防碰撞预警技术是汽车主动安全领域的一个重要研究方向,其中对前车进行快速准确检测并建立稳定可靠的安全距离模型是该技术亟待解决的两个难点。为此,本文提出车路视觉协同的高速公路防碰撞预警算法。
方法
2
将通过图像处理技术检测出来的视频图像中的车道线和自车的行驶速度作为输入,运用安全区实时计算算法构建安全距离模型,在当前车辆前方形成一块预警安全区域。采用深度神经网络YOLOv3(you only look once v3)对前车进行实时检测,得到车辆的位置信息。根据图像中前车的位置和构建的安全距离模型,对可能发生的追尾碰撞事故进行预测。
结果
2
实验结果表明,重新训练的YOLOv3算法车辆检测准确率为98.04%,提出算法与马自达CX-4的FOW(forward obstruction warning)前方碰撞预警系统相比,能够侧向和前向预警,并提前0.8 s发出警报。
结论
2
本文方法与传统的车载超声波、雷达或激光测距的防碰撞预警方法相比,具有较强的适用性和稳定性,预警准确率高,可以帮助提高司机在高速公路上的行车安全性。
Objective
2
The unceasing progress in China's economy and urbanization has caused the increase in internal expressway mileage and automobiles
and this situation leads to concern on traffic jam among Chinese people. In view of the increasing requirements for safe driving by operators
autonomous driving techniques have attracted widespread attention from domestic and foreign scholars. However
automotive active safety techniques remain in the stage of R & D and testing in China. Many problems
such as few practical products
low-precision safety distance model (SDM)
difficulty in obtaining key parameters
and disregarding drivers' characteristics
exist. Corresponding research is accordingly necessary. The vehicle-road visual collaboration technology
which is the core technology for the field of automotive active safety
is applied reasonably to anti-collision early warning systems. Compared with ultrasound
laser
and radar
the technology has the following advantages:the collected vehicle-road parameter information is more abundant
no perceived blind zone exists
the state of dangerous vehicles is dynamically predicted
it is not restricted by view block
and it is more affordable and suitable for the human eye's information capture habits. The rapid and accurate detection of preceding vehicles and the establishment of a stable and reliable SDM are two difficulties. To overcome these problems
a freeway anti-collision-warning algorithm based on vehicle-road visual collaboration was proposed.
Method
2
The environment was sensed through the driving recorder. The road lane line
the vehicle speed
and the position of the vehicle in front were combined to realize the anti-collision warning. The algorithm mainly includes three parts
namely
the construction of an SDM
the lane detection based on you only look once v3(YOLOv3)
and the anti-collision-warning algorithm based on the visual collaboration of the road. A real-time calculation method for the safety zone was proposed to construct an SDM between the current and preceding vehicles. The lateral distance of the safety zone was obtained by detecting and fitting the mathematical model of the lane line. A speed detection algorithm was proposed to calculate the current vehicle's driving speed based on video images. The longitudinal distance of the safety zone was obtained through the current vehicle's driving speed and the driver's behavioral and perceptual response characteristics. The early warning area of the safety zone was constituted through the horizontal and vertical distances between lane lines. SDM was built using the safe area real-time calculation algorithm to form an early warning safety zone in front of the current vehicle. The deep neural network YOLOv3 was used to detect preceding vehicles in real time for obtaining the location information of the vehicle. After the input image was detected with YOLOv3
the category where the object belongs to and the coordinate information of the object were predicted. The lower-right (or lower-left) coordinates of the bounding box of the vehicle was used to improve the accuracy of the early warning. The real-time calculation technology of the safety zone and the results of lane-line tracking were combined through the vehicle-road visual collaborative algorithm to build a safety early warning area on the road that changes with the vehicle speed in real time. The coordinate information of the vehicle in a video was obtained using YOLOv3. Different tips depending on where the vehicle was in the video were given through the anti-collision-warning algorithm based on vehicle-road visual collaboration.
Result
2
The proposed method was tested and evaluated on the video captured by a driving recorder
which was acquired from a passenger transportation company in Huai'an. The sequence of the test video was Test_1 to Test_20
and these video sequences contained different highway driving environments that can effectively verify the pros and cons of the algorithm. Vehicle detection experiments were performed on a desktop computer with an NVIDIA GeForce GTX 1070TI GPU. The collision-warning experiment was performed on a Mazda CX-4 with millimeter-wave radar and a laser rangefinder. The test section was Changshen Expressway. The experiments showed that the vehicle detection accuracy of the retrained YOLOv3 algorithm is up to 98.04%. Compared with the forward obstruction warning system of Mazda CX-4
the proposed algorithm can achieve side and forward warning
and an alarm is issued 0.8 s in advance. Although the proposed method demonstrates a good result in terms of detection speed
accuracy
and collision early warning
the construction of SDM can still be further improved compared with other algorithms because the research on the lane-line detection is limited on a good weather. Further research will be conducted in the case of poor visibility
such as rain
fog
and night.
Conclusion
2
Compared with the traditional anti-collision-warning method based on vehicle ultrasound
radar
or laser ranging
the proposed method can effectively improve the accuracy of early warning and better guarantee the driving safety on expressways. The algorithm has four advantages. First
progressive probabilistic Hough transform combined with morphological filtering
which had good robustness to interference noise and high detection accuracy
was proposed to detect lane lines. Second
real-time computing technology of safety zone
which considered the behavioral and intuitive response characteristics of drivers and was in line with the real driving situation
was proposed to construct SDM. Third
theYOLOv3 target detection algorithm was used to realize single-category detection
which further improved the video frames to reach 43 frame per second with guaranteed accuracy. Finally
the vehicle position information and road SDM were considered
and an anti-collision warning algorithm based on vehicle-road vision coordination was proposed. This advantage effectively improved the accuracy of vehicle warning and ensured the driving safety of drivers.
Avinash R, Niresh J, Kumar H V and Neelakrishnan S. 2017. Investigation of pedestrian collision avoidance with auto brake//Proceedings of 2017 Recent Developments in Control, Automation and Power Engineering. Noida, India: IEEE: 477-481[ DOI: 10.1109/RDCAPE.2017.8358318 http://dx.doi.org/10.1109/RDCAPE.2017.8358318 ]
Chen J Y, Ruan Y D and Chen Q M. 2018. A precise information extraction algorithm for lane lines. China Communications, 15(10):210-219[DOI:10.1109/CC.2018.8485482]
Choudhury S, Chattopadhyay S P and Hazra T K. 2017. Vehicle detection and counting using haar feature-based classifier//Proceedings of the 8th Annual Industrial Automation and Electromechanical Engineering Conference. Bangkok, Thailand: IEEE: 106-109[ DOI: 10.1109/IEMECON.2017.8079571 http://dx.doi.org/10.1109/IEMECON.2017.8079571 ]
Filho C M, Terra M H and Wolf D F. 2017. Safe optimization of highway traffic with robust model predictive control-based cooperative adaptive cruise control. IEEE Transactions on Intelligent Transportation Systems, 18(11):3193-3203[DOI:10.1109/TITS.2017.2679098]
Geiger A, Lenz P and Urtasun R. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE: 3354-3361[ DOI: 10.1109/CVPR.2012.6248074 http://dx.doi.org/10.1109/CVPR.2012.6248074 ]
Haque M F, Lim H Y and Kang D S. 2019. Object detection based on VGG with ResNet network//Proceedings of 2019 International Conference on Electronics, Information, and Communication. Auckland, New Zealand: IEEE: 1-3[ DOI: 10.23919/ELINFOCOM.2019.8706476 http://dx.doi.org/10.23919/ELINFOCOM.2019.8706476 ]
Hiraoka T and Takada S. 2018. Improvement of evaluation indices for rear-end collision risk. IEEE Transactions on Human-Machine Systems, 18(1):102-109[DOI:10.1109/THMS.2017.2751556]
Hong H. 2016. Research on Technology of Vehicle Anti-collision Warning System Based on Vision. Liaoning:Liaoning University of Technology
洪浩. 2016.基于视觉的车辆防碰撞预警系统算法研究.辽宁:辽宁工业大学
Lang H, Ding S, Lu J and Ma X L. 2019. Traffic video significance foreground target extraction in complex scenes. Journal of Image and Graphics, 24(1):50-63
郎洪, 丁朔, 陆键, 马晓丽. 2019.复杂场景下的交通视频显著性前景目标提取.中国图象图形学报, 24(1):50-63[DOI:10.11834/jig.180313]
Li H Q, Zhang Z H, Zhao X Y and He M Z. 2017. Two-stage hough transform algorithm for lane detection system based on TMS320DM6437//Proceedings of 2017 IEEE International Conference on Imaging Systems and Techniques. Beijing, China: IEEE: 1-5[ DOI: 10.1109/IST.2017.8261489 http://dx.doi.org/10.1109/IST.2017.8261489 ]
Nguyen V Q, Seo C, Kim H and Boo K. 2017. A study on detection method of vehicle based on lane detection for a driver assistance system using a camera on highway//Proceedings of the 2017 11th Asian Control Conference. Gold Coast, QLD, Australia: IEEE: 424-429[ DOI: 10.1109/ASCC.2017.8287207 http://dx.doi.org/10.1109/ASCC.2017.8287207 ]
Pandey R K and Mathurkar S S. 2017. Implementation of parallel morphological filter with different structuring elements//Proceedings of 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering. Chennai, India: IEEE: 1450-1455[ DOI: 10.1109/ICPCSI.2017.8391952 http://dx.doi.org/10.1109/ICPCSI.2017.8391952 ]
Raj M and Chandan S. 2018. Real-time vehicle and pedestrian detection through SSD in Indian traffic conditions//Proceedings of 2018 International Conference on Computing, Power and Communication Technologies. Greater Noida, Uttar Pradesh, India: IEEE: 439-444[ DOI: 10.1109/GUCON.2018.8675105 http://dx.doi.org/10.1109/GUCON.2018.8675105 ]
Redmon J and Farhadi A. 2017. YOLO9000: better, faster, stronger//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE: 6517-6525[ DOI: 10.1109/CVPR.2017.690 http://dx.doi.org/10.1109/CVPR.2017.690 ]
Redmon J and Farhadi A. 2018. YOLOv3: an incremental improvement[EB/OL].[2019-11-20] . https://arxiv.org/pdf/1804.02767.pdf https://arxiv.org/pdf/1804.02767.pdf
Shi K J, Bao H and Ma N. 2017. Forward vehicle detection based on incremental learning and Fast R-CNN//Proceedings of the 2017 13th International Conference on Computational Intelligence and Security. Hong Kong, China: IEEE: 73-76[ DOI: 10.1109/CIS.2017.00024 http://dx.doi.org/10.1109/CIS.2017.00024 ]
Shomron G and Weiser U. 2019. Spatial correlation and value prediction in convolutional neural networks. IEEE Computer Architecture Letters, 18(1):10-13[DOI:10.1109/LCA.2018.2890236]
Suh J, Chae H and Yi K. 2018. Stochastic model-predictive control for lane change decision of automated driving vehicles. IEEE Transactions on Vehicular Technology, 67(6):4771-4782[DOI:10.1109/TVT.2018.2804891]
Szegedy C, Liu W, Jia Y Q, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V and Rabinovich A. 2015. Going deeper with convolutions//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE: 1-9[ DOI: 10.1109/CVPR.2015.7298594 http://dx.doi.org/10.1109/CVPR.2015.7298594 ]
Yang L, Ma J R, Zhao X M, Mu K N and Ma J Y. 2017. A vehicle collision warning model in expressway scenario based on vehicle-infrastructure cooperation. Journal of Highway and Transportation Research and Development, 34(9):123-129
杨澜, 马佳荣, 赵祥模, 穆柯楠, 马峻岩. 2017.基于车路协同的高速公路车辆碰撞预警模型.公路交通科技, 34(9):123-129[DOI:10.3969/j.issn.1002-0268.2017.09.017]
Yu X F. 2018. Adaptive canny operator based digital image processing scheme for Photoshop filter plugin unit//Proceedings of 2018 International Conference on Intelligent Transportation, Big Data and Smart City. Xiamen, China: IEEE: 613-616[ DOI: 10.1109/ICITBS.2018.00160 http://dx.doi.org/10.1109/ICITBS.2018.00160 ]
京公网安备11010802024621