浏览全部资源
扫码关注微信
收稿：2022-01-25，
修回：2022-06-29，
纸质出版：2023-10-16
移动端阅览
目的
2
车辆多目标跟踪是智能交通领域关键技术，其性能对车辆轨迹分析和异常行为鉴别有显著影响。然而，车辆多目标跟踪常受外部光照、道路环境因素影响，车辆远近尺度变化以及相互遮挡等干扰，导致远处车辆漏检或车辆身份切换（ID switch， IDs）问题。本文提出短时记忆与CenterTrack的车辆多目标跟踪，提升车辆多目标跟踪准确度（multiple object tracking accuracy， MOTA），改善算法的适应性。
方法
2
利用小样本扩增增加远处小目标车辆训练样本数；通过增加的样本重新训练CenterTrack确定车辆位置及车辆在相邻帧之间的中心位移量；当待关联轨迹与检测目标匹配失败时通过轨迹运动信息预测将来的位置；利用短时记忆将待关联轨迹按丢失时间长短分级与待匹配检测关联以减少跟踪车辆IDs。
结果
2
在交通监控车辆多目标跟踪数据集UA-DETRAC（University at Albany detection and tracking）构建的5个测试序列数据中，本文方法在维持CenterTrack优势的同时，对其表现不佳的场景获得近30%的提升，与YOLOv4-DeepSort（you only look once—simple online and realtime tracking with deep association metric）相比，4种场景均获得近10%的提升，效果显著。Sherbrooke数据集的测试结果，本文方法同样获得了性能提升。
结论
2
本文扩增了远处小目标车辆训练样本，缓解了远处小目标与近处大目标存在的样本不均衡，提高了算法对远处小目标车辆的检测能力，同时短时记忆维持关联失败的轨迹运动信息并分级匹配检测目标，降低了算法对跟踪车辆的IDs，综合提高了MOTA。
Objective
2
The task of multi-object tracking is often focused on estimating the number， location or other related properties of objects in the scene. Specifically， it is required to be estimated accurately and consistently over a period of time. Vehicle-related multi-target tracking can be as a key technique for such domain like intelligent transportation， and its performance has a significant impact on vehicle trajectory analysis and abnormal behavior identification to some extent. Vehicle-related multi-target tracking is also recognized as a key branch of multi-target tracking and a potential technique for autonomous driving and intelligent traffic surveillance systems. For vehicle-related multi-target tracking， temporal-based motion status of vehicles in traffic scenes can be automatically obtained， which is beneficial to analyze traffic conditions and implement decisions-making quickly for transportation administrations， as well as the automatic driving system. However， to resolve missed detection of distant vehicles or vehicle ID switch （IDs） problems， such factors are often to be dealt with in relevance to external illumination， road environment factors， changes in the scale of the vehicle near and far， and mutual occlusion. We develop an integrated short-term memory and CenterTrack ability to improve the vehicle multi-target tracking accuracy （multiple object tracking accuracy （MOTA））， and its adaptability of the algorithm can be optimized further.
Method
2
From the analysis of a large number of traffic monitoring video data， it can be seen the reasons for the unbalanced samples in the training samples. On the one hand， due to the fast speed of the captured vehicle target， the identified distant small target vehicle can be preserved temperorily， and it lacks of more consistent frames. On the other hand， the amount of apparent feature information is lower derived from small target vehicle itself， and the amount of neural network-extracted feature information is disappeared quickly many times. The relative number of distant small targets in the field of view is relatively small. After downsampling as a training sample， the feature quantity is disappeared very fast， resulting in an extensive reduction in the number of effective training samples， which is actually penetrated into the network. The small target vehicles cannot be detected after that. The small sample expansion method is proposed and adopted to increase the number of training samples， especially for small target vehicles in the distance. The CenterTrack is retrained with the increased samples， and the position of the vehicle can be determined where the vehicle is near or far in the image sequence and the center displacement between adjacent frames that is learnt from the CenterTrack. Due to it is assumed that a uniform linear motion is performed when the trajectory fails in matching the new detection in the short time， location of the trajectory in the current frame can be predicted through memorizing the short-term historical motion information of the trajectory when the new detection target-associated trajectory is failed. However， for the short-term memory method， it is challenged that there may be multiple trajectories competing for the same new detection target and it made a degradation of MOTA. To resolve trajectory competition and matching-derived performance degradation， we classify the trajectories further according to the length of the loss times with detection， and less loss， higher priority. The higher-level trajectories are preferred to match all new detection. This method can be used to preserve the integrity of the vehicle trajectory through reducing the missed far small vehicle and the false match between the trajectories and the detection， It can reduce the number of tracked vehicle IDs as well.
Result
2
To verify the effectiveness of the proposed algorithm in multiple scenarios， we extract data from two different datasets for testing. First， five sort of test sequences are extracted from such of multi-target tracking dataset like University at Albany detection and tracking （UA-DETRAC）， the traffic surveillance scenery. The results demonstrate that our method proposed can maintain the advantages of CenterTrack and achieve nearly 30% improvement compared with CenterTrack in the scenes where CenterTrack performs not well. Compared to you only look once—simple online and realtime tracking with deep association metric （YOLOv4-DeepSort）， it has achieved nearly 10% significant improvement in all four scenarios. The experimental results in Sherbrooke， as another traffic monitoring dataset， illustrate that short-term memory module and the remote small target vehicle expansion module can be used well compared to the original CenterTrack， and the proposed MOTA has a large performance improvement as well.
Conclusion
2
We analyze the challenges for detecting distant small target vehicles and vehicle tracking IDs in the vehicle multi-target tracking for the traffic monitoring scene. We resolve the imbalance in the number of samples between the distant small target vehicle and the nearby large target vehicle in the training sample in terms of expansion of the training samples of the small target vehicle in the distance as well， and the algorithm is improved for small target vehicle in the distance. At the same time， short-time trajectory memory module can be used to memorize the historical motion information of the failed trajectory to maintain the integrity of the trajectories when the losed detection appears again. Furthermore， the IDs can be reduced for tracking vehicles and the MOTA is improved in terms of the trajectories classification. Our CenterTrack-based algorithm proposed has been improving for such certain traffic video surveillance scene， and the experiments are carried out to validate the effectiveness of our algorithm proposed as well. Vehicle-related multi-target tracking technique has its potentials for developing the implementation for optimizing intelligent transportation and smart city strategies to a certain extent.
Bernardin K and Stiefelhagen R . 2008 . Evaluating multiple object tracking performance： the CLEAR MOT metrics . EURASIP Journal on Image and Video Processing ， 2008 ： # 246309 ［ DOI： 10.1155/2008/246309 http://dx.doi.org/10.1155/2008/246309 ］
Bewley A ， Ge Z Y ， Ott L ， Ramov F and Upcroft B . 2016 . Simple online and realtime tracking // Proceedings of 2016 IEEE International Conference on Image Processing . Phoenix， USA ： IEEE： 3464 - 3468 ［ DOI： 10.1109/ICIP.2016.7533003 http://dx.doi.org/10.1109/ICIP.2016.7533003 ］
Bochkovskiy A ， Wang C Y and Liao H Y M . 2020 . YOLOv4： optimal speed and accuracy of object detection ［EB/OL］. ［ 2022-01-25 ］. https://arxiv.org/pdf/2004.10934.pdf https://arxiv.org/pdf/2004.10934.pdf
Cai Z W ， Saberian M and Vasconcelos N . 2015 . Learning complexity-aware cascades for deep pedestrian detection // Proceedings of 2015 IEEE International Conference on Computer Vision . Santiago， Chile ： IEEE： 3361 - 3369 ［ DOI： 10.1109/ICCV.2015.384 http://dx.doi.org/10.1109/ICCV.2015.384 ］
Cao J L ， Li Y L ， Sun H Q ， Xie J ， Huang K Q and Pang Y W . 2022 . A survey on deep learning based visual object detection . Journal of Image and Graphics ， 27 （ 6 ）： 1697 - 1722
曹家乐 ， 李亚利 ， 孙汉卿 ， 谢今 ， 黄凯奇 ， 庞彦伟 . 2022 . 基于深度学习的视觉目标检测技术综述 . 中国图象图形学报 ， 27 （ 6 ）： 1697 - 1722 ［ DOI： 10.11834/jig.220069 http://dx.doi.org/10.11834/jig.220069 ］
Chen S Y and Shao C H . 2021 . Efficient online tracking-by-detection with Kalman filter . IEEE Access ， 9 ： 147570 - 147578 ［ DOI： 10.1109/ACCESS.2021.3124705 http://dx.doi.org/10.1109/ACCESS.2021.3124705 ］
Girshick R ， Donahue J ， Darrell T and Malik J . 2014 . Rich feature hierarchies for accurate object detection and semantic segmentation // Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition . Columbus， USA ： IEEE： 580 - 587 ［ DOI： 10.1109/CVPR.2014.81 http://dx.doi.org/10.1109/CVPR.2014.81 ］
Jodoin J P ， Bilodeau G A and Saunier N . 2014 . Urban tracker： multiple object tracking in urban mixed traffic // Proceedings of 2014 IEEE Winter Conference on Applications of Computer Vision . Steamboat Springs， USA ： IEEE： 885 - 892 ［ DOI： 10.1109/WACV.2014.6836010 http://dx.doi.org/10.1109/WACV.2014.6836010 ］
Law H and Deng J . 2018 . CornerNet： detecting objects as paired keypoints // Proceedings of the 15th European Conference on Computer Vision . Munich， Germany ： Springer： 765 - 781 ［ DOI： 10.1007/978-3-030-01264-9_45 http://dx.doi.org/10.1007/978-3-030-01264-9_45 ］
Liu W ， Anguelov D ， Erhan D ， Szegedy C ， Reed S ， Fu C Y and Berg AC . 2016 . SSD： single shot multibox detector // Proceedings of the 14th European Conference on Computer Vision . Amsterdam， the Netherlands ： Springer： 21 - 37 ［ DOI： 10.1007/978-3-319-46448-0_2 http://dx.doi.org/10.1007/978-3-319-46448-0_2 ］
Redmon J ， Divvala S ， Girshick R and Farhadi A . 2016 . You only look once： unified， real-time object detection // Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas， USA ： IEEE： 779 - 788 ［ DOI： 10.1109/CVPR.2016.91 http://dx.doi.org/10.1109/CVPR.2016.91 ］
Redmon J and Farhadi A . 2018 . YOLOv3： an incremental improvement ［EB/OL］. ［ 2022-01-25 ］. https://arxiv.org/pdf/1804.02767.pdf https://arxiv.org/pdf/1804.02767.pdf
Ren S Q ， He K M ， Girshick R and Sun J . 2017 . Faster R-CNN： towards real-time object detection with region proposal networks . IEEE Transactions on Pattern Analysis and Machine Intelligence ， 39 （ 6 ）： 1137 - 1149 ［ DOI： 10.1109/TPAMI.2016.2577031 http://dx.doi.org/10.1109/TPAMI.2016.2577031 ］
Ristani E ， Solera F ， Zou R ， Cucchiara R and Tomasi C . 2016 . Performance measures and a data set for multi-target， multi-camera tracking // Proceedings of 2016 European Conference on Computer Vision . Amsterdam， the Netherlands ： Springer： 17 - 35 ［ DOI： 10.1007/978-3-319-48881-3_2 http://dx.doi.org/10.1007/978-3-319-48881-3_2 ］
Wang Z D ， Zheng L ， Liu Y X ， Li Y L and Wang S J . 2020 . Towards real-time multi-object tracking // Proceedings of the 16th European Conference on Computer Vision . Glasgow， UK ： Springer： 107 - 122 ［ DOI： 10.1007/978-3-030-58621-8_7 http://dx.doi.org/10.1007/978-3-030-58621-8_7 ］
Wen L Y ， Du D W ， Cai Z W ， Lei Z ， Chang M C ， Qi H G ， Lim J ， Yang M H and Lyu S . 2020 . UA-DETRAC： a new benchmark and protocol for multi-object detection and tracking . Computer Vision and Image Understanding ， 193 ： # 102907 ［ DOI： 10.1016/j.cviu.2020.102907 http://dx.doi.org/10.1016/j.cviu.2020.102907 ］
Wojke N ， Bewley A and Paulus D . 2017 . Simple online and realtime tracking with a deep association metric // Proceedings of 2017 IEEE International Conference on Image Processing . Beijing， China ： IEEE： 3645 - 3649 ［ DOI： 10.1109/ICIP.2017.8296962 http://dx.doi.org/10.1109/ICIP.2017.8296962 ］
Zhang Y F ， Wang C Y ， Wang X G ， Zeng W J and Liu W Y . 2021 . FairMOT： on the fairness of detection and re-identification in multiple object tracking . International Journal of Computer Vision ， 129 （ 11 ）： 3069 - 3087 ［ DOI： 10.1007/s11263-021-01513-4 http://dx.doi.org/10.1007/s11263-021-01513-4 ］
Zhao Y ， Tian Y H ， Dang J W ， Fu S J ， Wang H Y ， Wan J ， An G Y ， Du Z R ， Liao L X and Wei S K . 2021 . Frontiers of transportation video structural analysis in the smart city . Journal of Image and Graphics ， 26 （ 6 ）： 1227 - 1253
赵耀 ， 田永鸿 ， 党建武 ， 付树军 ， 王恒友 ， 万军 ， 安高云 ， 杜卓然 ， 廖理心 ， 韦世奎 . 2021 . 面向智慧城市的交通视频结构化分析前沿进展 . 中国图象图形学报 ， 26 （ 6 ）： 1227 - 1253 ［ DOI： 10.11834/jig.210035 http://dx.doi.org/10.11834/jig.210035 ］
Zhou X Y ， Koltun V and Krähenbühl P . 2020 . Tracking objects as points // Proceedings of the 16th European Conference on Computer Vision . Glasgow， UK ： Springer： 474 - 490 ［ DOI： 10.1007/978-3-030-58548-8_28 http://dx.doi.org/10.1007/978-3-030-58548-8_28 ］
Zhou X Y ， Wang D Q and Krähenbühl P . 2019 . Objects as points ［EB/OL］. ［ 2022-01-25 ］. https://arxiv.org/pdf/1904.07850.pdf https://arxiv.org/pdf/1904.07850.pdf
相关作者
相关机构
京公网安备11010802024621
