浏览全部资源
扫码关注微信
Received：21 April 2021，
Revised：2021-9-16，
Accepted：23 September 2021，
Published：16 October 2022
移动端阅览
目的
2
基于视觉的车辆行驶安全性预警分析技术是目前车辆辅助驾驶的一个重要研究方向，对前方多车道快速行驶的车辆进行精准的跟踪定位并建立稳定可靠的安全距离预警模型是当前研究难点。为此，提出面向高速公路场景的车路视觉协同行车安全预警算法。
方法
2
首先提出一种深度卷积神经网络SF_YOLOv4(single feature you look only once v4)对前方车辆进行精准的检测跟踪；然后提出一种安全距离模型对车辆刹车距离进行计算，并根据单目视觉原理计算车辆间距离；最后提出多车道预警模型对自车行驶过程的安全性进行分析，并对司机给予相应安全提示。
结果
2
实验结果表明，提出的SF_YOLOv4算法对车辆检测的准确率为93.55%，检测速度(25帧/s)领先对比算法，有效降低了算法的时间和空间复杂度；提出的安全距离模型计算的不同类型车辆的刹车距离误差小于0.1 m，与交通法建议的距离相比，本文方法计算的安全距离精确度明显提升；提出的多车道安全预警模型与马自达6(ATENZA)自带的前方碰撞系统相比，能对相邻车道车辆进行预警，并提前0.7 s对前方变道车辆发出预警。
结论
2
提出的多车道预警模型充分考虑高速公路上相邻车道中的车辆位置变化发生的碰撞事故；本文方法与传统方法相比，具有较高实用性，其预警效果更加客观，预警范围更广，可以有效提高高速公路上的行车安全。
Objective
2
Vehicles motion are prone to traffic accidents on the expressway due to their high speed
which mainly include rear-end collisions
punctures
scratches
side collisions
etc. Among them
high-speed rear-end collisions
overtaking and lane changing accounted for t the most losses of them. Therefore
it is essential to analyze the driving safety and reduce the occurrence of accidents. Thanks to the development of deep learning
vision-based vehicle driving safety early warning analysis technology is currently an important research direction for vehicle aided driving.We propose an early warning algorithm for vehicle-road visual collaborative driving safety in expressway scenes.
Method
2
The vehicles motion safety early warning algorithm in synchronized vehicles-road visual expressway scenarios is facilitated. First
we illustrated a vehicle motion recorder to monitor and combine vehicle target recognition and positioning
a safe distance model
and analyzes driving safety based on a multi-lane early warning algorithm. It is composed of three parts like vehicle target recognition and positioning technology
safety distance model and multi-lanes warning algorithm. The image processing technology is as the input to detect the distance between the vehicle ahead and the vehicle body. A safe distance model early warning fusion algorithm is
performed to safety analysis on the motion of the vehicle. Our deep convolutional neural network of single feature you look only once v4(SF_YOLOv4)detects and tracks the vehicle ahead accurately. Then
the range of the vehicles is calculated in terms of the perspective transformation principle combined with the vehicle position information. Finally
a safe distance model and fusion algorithm are proposed to analyze the vehicle safety. In the target detection part
our method is improved on the basis of YOLOv4. The backbone network is replaced by CSPDarknet53 with a smaller layer of cross stage paritial Darknet17(CSPDarknet17) network
which reduces the number of model parameters and calculations
improves the speed of target detection
and the accuracy of target detection for a single scene less affected. Our four-feature pyramid network(F-FPN) is illustrated to construct a feature pyramid
and the 104×104 scale feature map is added to the feature network. It can improve the detection effect of small targets effectively. In the distance calculation part
the monocular vision calculation principle is used to perform perspective transformation on the selected area. The corresponding equations are fitted in the horizontal and vertical directions to calculate the distance via the referenced lane and lane line data. In the part of the safety distance
the braking loss of the vehicle motion is ignored according to the energy change of the vehicle during braking. During the braking process
the kinetic energy is converted into work to overcome friction
work to overcome wind resistance
and work to overcome inertia. The safety distance model calculates the safety zone in the multiple lanes ahead. In the part of the safety warning model
a multi-lanes forward safety warning scheme is proposed. The corresponding warning is given in according with the corresponding position of the vehicle in the adjacent lane ahead
which can effectively avoid collision accidents caused by rear-end collisions and abnormal lane changes.
Result
2
We use mean average precision(mAP)
frames per second(FPS)
recall
model parameters
model calculations to evaluate the target detection network. At the same time
different algorithms are used to carry out comparative experiments on self-built data sets. The safety distance is verified by selecting different vehicle data. a real video data set of vehicles motion on express way is established by simulating the actual high-speed vehicle motion environment. According to the experimental analysis
the main potentials of the algorithm are as follows: 1) a single-stage feature neural network (SF_YOLOv4) is proposed to detect vehicle targets in a single scene quickly. The detection speed is greatly improved through achieving precise positioning of the vehicle in front
improving the detection effect of small targets
and ensuring the accuracy in the case of unclear change. Our experiments show that the SF_YOLOv4 can detect the vehicle ahead in real time with 93.55% accuracy
and the detection speed is 25 frames per second; 2) Our safe distance model is melted the momentum and energy conservation of the vehicle in motion
and the mechanical features of the vehicle are in consistency under actual driving conditions. Our verified safety distance model calculates the braking distance error of different types of vehicles is less than 0.1 m; 3) A multi-lanes safety warning algorithm is illustrated to construct a safety warning area for adjacent vehicles in front of the vehicle.
Conclusion
2
Our SF_YOLOv4 target detection model can achieve a perfect match between detection speed and accuracy. The proposed early warning model of safety fusion realize the changes of vehicle positions on adjacent lanes of expressways
and can predict the impact of rear-end collisions
overtaking and lane changes. Once the vehicle is outside the multi-lane safety warning zone ahead
the safety distance will be displayed in real time
and the target vehicle will be marked
and the driver will be reminded to drive safely; when the vehicle enters the warning zone
in addition to the real-time display of the safety distance
the mark will also be calculated. The distance between the vehicle and the workshop is displayed to the driver in real time
and the driver is reminded to avoid a collision once a vehicle in the corresponding lane
and a reminder is issued through voice and other means. Compared to the traditional method
the early warning effect is more objective
the warning range is wider
and the safety of highway driving can be improvedeffectively.
Alom M Z, Hasan M, Yakopcic C, Taha T M and Asari V K. 2021. Inception recurrent convolutional neural network for object recognition. Machine Vision and Applications, 32(1): #28 [DOI: 10.1007/s00138-020-01157-3]
Bochkovskiy A, Wang C Y and Liao H Y M. 2020. YOLOv4: optimal speed and accuracy of object detection [EB/OL]. [2021-04-21] . https://arxiv.org/pdf/2004.10934.pdf https://arxiv.org/pdf/2004.10934.pdf
Cai C X, Gao S B, Zhou J and Huang Z H. 2020. Freeway anti-collision warning algorithm based on vehicle-road visual collaboration. Journal of Image and Graphics, 25(8): 1649-1657
蔡创新, 高尚兵, 周君, 黄子赫. 2020. 车路视觉协同的高速公路防碰撞预警算法. 中国图象图形学报, 25(8): 1649-1657 [DOI: 10.11834/jig.190633]
Haque M F, Lim H Y and Kang D S. 2019. Object detection based on VGG with ResNet network//Proceedings of 2019 International Conference on Electronics, Information, and Communication. Auckland, New Zealand: IEEE: 1-3 [ DOI:10.23919/ELINFOCOM.2019.8706476 http://dx.doi.org/10.23919/ELINFOCOM.2019.8706476 ]
Hong H. 2016. Research on Technology of Vehicle Anti-Collision Warning System Based on Vision. Jinzhou: Liaoning University of Technology
洪浩. 2016. 基于视觉的车辆防碰撞预警系统算法研究. 锦州: 辽宁工业大学
Hu X, Chu L Y, Pei J, Liu W Q and Bian J. 2021. Model complexity of deep learning: a survey [EB/OL]. [2021-04-21] . https://arxiv.org/pdf/2103.05127.pdf https://arxiv.org/pdf/2103.05127.pdf
Li G F, Yang Y F, Zhang T R, Qu X D, Cao D P, Cheng B and Li K Q. 2021a. Risk assessment based collision avoidance decision-making for autonomous vehicles in multi-scenarios. Transportation Research Part C: Emerging Technologies, 122: #102820 [DOI: 10.1016/j.trc.2020.102820]
Li W, Feng X S, Zha K W, Li S N and Zhu H S. 2021b. Summary of target detection algorithms. Journal of Physics: Conference Series, 1757(1): #012003 [DOI: 10.1088/1742-6596/1757/1/012003]
Lian X H, Pang Y W, Han J G and Pan J. 2021. Cascaded hierarchical atrous spatial pyramid pooling module for semantic segmentation. Pattern Recognition, 110: #107622 [DOI: 10.1016/j.patcog.2020.107622]
Liu K, Jia J, Liu C and Ando R. 2018. Warning effectiveness of vehicle-to-infrastructure cooperative crossing collision prevention system at non-signal controlled intersection. China Journal of Highway and Transport, 31(4): 222-230
刘锴, 贾洁, 刘超, 安藤良辅. 2018. 车路协同环境下道路无信号交叉口防碰撞系统警示效果. 中国公路学报, 31(4): 222-230 [DOI: 10.19721/j.cnki.1001-7372.2018.04.026]
Liu S, Qi L, Qin H F, Shi J P and Jia J Y. 2018. Path aggregation network for instance segmentation//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE: 8759-8768 [ DOI:10.1109/CVPR.2018.00913 http://dx.doi.org/10.1109/CVPR.2018.00913 ]
Raj M and Chandan S. 2018. Real-time vehicle and pedestrian detection through SSD in Indian traffic conditions//Proceedings of 2018 International Conference on Computing, Power and Communication Technologies. Greater Noida, India: IEEE: 439-444 [ DOI:10.1109/GUCON.2018.8675105 http://dx.doi.org/10.1109/GUCON.2018.8675105 ]
Redmon J, Divvala S, Girshick R and Farhadi A. 2016. You only look once: unified, real-time object detection//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE: 779-788 [ DOI:10.1109/CVPR.2016.91 http://dx.doi.org/10.1109/CVPR.2016.91 ]
Redmon J and Farhadi A. 2018. YOLOv3: an incremental improvement[EB/OL]. [2021-04-21] . https://arxiv.org/pdf/1804.02767.pdf https://arxiv.org/pdf/1804.02767.pdf
Shipway N J, Huthwaite P, Lowe M J S and Barden T J. 2021. Using ResNets to perform automated defect detection for Fluorescent Penetrant Inspection. NDT&E International, 119: #102400 [DOI: 10.1016/j.ndteint.2020.102400]
Shomron G and Weiser U. 2019. Spatial correlation and value prediction in convolutional neural networks. IEEE Computer Architecture Letters, 18(1): 10-13 [DOI: 10.1109/LCA.2018.2890236]
Wan S H and Goudos S. 2020. Faster R-CNN for multi-class fruit detection using a robotic vision system. Computer Networks, 168: #107036 [DOI: 10.1016/j.comnet.2019.107036]
Wang T, Huang J Q, Zhang H W and Sun Q R. 2020. Visual commonsense R-CNN//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, USA: IEEE: 10757-10767 [ DOI:10.1109/cvpr42600.2020.01077 http://dx.doi.org/10.1109/cvpr42600.2020.01077 ]
Yang L, Ma J R, Zhao X M, Mu K N and Ma J Y. 2017. A vehicle collision warning model in expressway scenario based on vehicle-infrastructure cooperation. Journal of Highway and Transportation Research and Development, 34(9): 123-129
杨澜, 马佳荣, 赵祥模, 穆柯楠, 马峻岩. 2017. 基于车路协同的高速公路车辆碰撞预警模型. 公路交通科技, 34(9): 123-129 [DOI: 10.3969/j.issn.1002-0268.2017.09.017]
Yang W K, Li Z Y, Wang Cand Li J. 2020. A multi-task Faster R-CNN method for 3D vehicle detection based on a single image. Applied Soft Computing, 95: #106533 [DOI: 10.1016/j.asoc.2020.106533]
Zhang L J, Huang L Y and Meng D J. 2019. Trajectory prediction and fuzzy pattern recognition-based warning for commercial vehicle with blind spots. Journal of Tongji University (Natural Science), 47(S1): 207-212
张立军, 黄露莹, 孟德建. 2019. 基于轨迹预测和模糊分析的商用车盲区防碰撞预警. 同济大学学报(自然科学版), 47(S1): 207-212
Zheng Z H, Wang P, Liu W, Li J Z, Ye R G and Ren D W. 2020. Distance-IoU loss: faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, 34(7): 12993-13000 [DOI: 10.1609/aaai.v34i07.6999]
Zou Z X, Shi Z W, Guo Y H and Ye J P. 2019. Object detection in 20 years: a survey [EB/OL]. [2021-04-21] . https://arxiv.org/pdf/1905.05055.pdf https://arxiv.org/pdf/1905.05055.pdf
相关文章
相关作者
相关机构
京公网安备11010802024621
