Multilevel relocation tracking algorithm under occlusion decision

Wentao Jiang; Yan Jin; Wanjun Liu

doi:10.11834/jig.200033

Image Analysis and Recognition | Views : 0 下载量: 105 CSCD: 0

PDF
Export
Share
Collection
Album

Multilevel relocation tracking algorithm under occlusion decision
Vol. 26, Issue 2, Pages: 378-390(2021)
Received：21 January 2020，

Revised：2020-4-14，

Accepted：21 April 2020，

Published：16 February 2021
DOI： 10.11834/jig.200033
稿件说明：

移动端阅览

DOI：

Wentao Jiang, Yan Jin, Wanjun Liu. Multilevel relocation tracking algorithm under occlusion decision[J]. Journal of Image and Graphics, 2021, 26(2): 378-390. DOI： 10.11834/jig.200033.

摘要

目的

目标遮挡一直是限制跟踪算法精确度和稳定性的问题之一，针对该问题，提出一种抗遮挡的多层次重定位目标跟踪算法。

方法

通过平均峰值相关能量动态分配特征权重，将梯度特征与颜色直方图特征动态地结合起来进行目标跟踪。利用多峰值检测和峰值波动情况进行目标状态判定，若目标状态不理想，则停止模板更新，避免逐帧更新导致目标漂移，继续跟踪目标；若判定目标遮挡，则提取对应特征点，使用最邻近距离比进行特征匹配和筛选，丢弃负样本的最邻近样本作为二次筛选，利用广义霍夫变换进行第3次筛选并重定位目标，对目标继续跟踪。

结果

在标准数据集OTB（object tracking benchmark）100和LaSOT（large-scale single object tracking）上的实验结果显示，本文算法的精确率分别为0.885和0.301，相较于Staple算法分别提升了13.5%和30.3%。

结论

在目标发生遮挡的场景中，本文方法能够重定位目标并且继续跟踪，优化后的模板更新策略提高了算法速度。目标状态的判定有效估计了目标遮挡问题，可以及时采取应对策略，提高算法在复杂环境下的稳定性。

Abstract

Objective

As one of the important research directions in the field of computer vision

target tracking has a wide range of applications in the fields of video surveillance

human computer interaction

and behavior analysis. A tracking algorithm analyzes target location information in real time in a subsequent sequence of video images by giving the target information (i.e.

location and size) in the first frame. At present

target tracking technology has achieved considerable progress

but the robustness of real-time tracking algorithms is still affected by factors

such as target occlusion

illumination change

scale change

fast motion

and background interference. Among these issues

the occlusion problem is the most prominent. A complementary learning correlation filter tracking algorithm updates the template frame by frame. The reliability of the sample is not discriminated during template update

and the sample is not filtered. When background information is complex

particularly when the target is occluded

the template update result will gradually deviate from the target to be tracked. In particular

the color feature is more susceptible to complex environmental factors

aggravating target drift

and thus

template update leads to target drift and occlusion.

Method

The problem of losing the target persists. The occlusion problem has always limited the accuracy and stability of tracking algorithms. To address this problem

an anti-occlusion multilevel retargeting target tracking algorithm is proposed. This algorithm has three innovations.1) By using the average peak correlation energy

the gradient and color histogram features are dynamically combined to distribute weight reasonably. 2) The target state is determined in real time through peak responses and fluctuations

and the template update strategy is optimized. 3) To address the occlusion problem during the tracking process

a multilevel target relocation strategy is proposed and multilevel filtered feature points are used in the target relocation operation. Feature weight is determined on the basis of the dynamically changing average peak correlation energy

and it is used to combine the gradient and color histogram features for target tracking. After the current frame identifies the target position

target state determination is performed using multi-peak detection and the peak fluctuation condition. If the target state is not ideal

then template update is stopped. Frame-by-frame update is avoided

causing the target to drift

and then target tracking is continued. If target occlusion is determined

then the oriented fast and rotated brief feature of the target is extracted. The nearest neighbor distance ratio of the feature points is matched and filtered

and the nearest neighbor of the negative sample is discarded as secondary screening. Third screening is performed via the generalized Hough transform

the target is relocated

and tracking the target is continued.

Result

To objectively verify the advantages and disadvantages of the proposed algorithm

10 groups of image sequences

namely

Basketball

Bird2

CarDark

CarScale

DragonBaby

Girl

Human5

Human8

Singer1

and Walking2

are selected. Nine algorithms

including the proposed algorithm

are selected for the tracking experiments. The eight other algorithms are as follows: kernel correlation filters

discriminative scale space tracking

staple

background-aware correlation filter

spatially regularized correlation filter

scale adaptive multiple features

efficient convolution operators

and spatiotemporal regularized correlation filter. Experimental results for the standard datasets OTB(object tracking benchmark)100 and LaSOT(large-scale single object tracking) show that the accuracy of the algorithm proposed in this study is 0.885 and 0.301

which are 13.5% and 30.3% higher than the original algorithm

respectively.

Conclusion

In the scenario where in the target is occluded

the target can be repositioned and tracking continues. The optimized template update strategy increases the speed of the algorithm. The determination of the target state effectively estimates the target occlusion problem and can adopt a timely coping strategy to improve the stability of the algorithm in a complex environment.

关键词

Keywords

references

Bao C L, Wu Y, Ling H B and Ji H. 2012. Real time robust L1 tracker using accelerated proximal gradient approach//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, USA: IEEE: 1830-1837[ DOI: 10.1109/CVPR.2012.6247881 http://dx.doi.org/10.1109/CVPR.2012.6247881 ]

Bertinetto L, Valmadre J, Golodetz S, Miksik O and Torr P H S. 2016a. Staple: complementary learners for real-time tracking//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE: 1401-1409[ DOI: 10.1109/CVPR.2016.156 http://dx.doi.org/10.1109/CVPR.2016.156 ]

Bertinetto L, Valmadre J, Henriques J F, Vedaldi A and Torr P H S. 2016b. Fully-convolutional siamese networks for object tracking//Proceedings of the 14th ECCV Workshops. Amsterdam, The Netherlands: Springer: 850-865[ DOI: 10.1007/978-3-319-48881-3_56 http://dx.doi.org/10.1007/978-3-319-48881-3_56 ]

Bolme D S, Beveridge J R, Draper B A and Lui Y M. 2010. Visual object tracking using adaptive correlation filters//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE: 2544-2550[ DOI: 10.1109/CVPR.2010.5539960 http://dx.doi.org/10.1109/CVPR.2010.5539960 ]

Danelljan M, Bhat G, Khan F S and Felsberg M. 2017. ECO: efficient convolution operators for tracking//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE: 6931-6939[ DOI: 10.1109/CVPR.2017.733 http://dx.doi.org/10.1109/CVPR.2017.733 ]

Danelljan M, Häger G, Khan F S and Felsberg M. 2015. Learning spatially regularized correlation filters for visual tracking//Proceedings of 2015 IEEE International Conference on Computer Vision.Santiago, Chile: IEEE: 4310-4318[ DOI: 10.1109/ICCV.2015.490 http://dx.doi.org/10.1109/ICCV.2015.490 ]

Danelljan M, Häger G, Khan F S and Felsberg M. 2016. Discriminative scale space tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(8): 1561-1575[DOI: 10.1109/TPAMI.2016.2609928]

Fan H and Ling H B. 2017. SANet: Structure-aware network for visual tracking//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognitio Workshops. Honolulu, USA: IEEE: 2217-2224[ DOI: 10.1109/CVPRW.2017.275 http://dx.doi.org/10.1109/CVPRW.2017.275 ]

Fan H, Lin L T, Yang F, Chu P, Deng G, Yu S J, Bai H X, Xu Y, Liao C Y and Ling H B. 2019. LaSOT: a high-quality benchmark for large-scale single object tracking//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE: #00552[ DOI:10.1109/CVPR.2019.00552 http://dx.doi.org/10.1109/CVPR.2019.00552 ]

Galoogahi H K, Fagg A and Lucey S. 2017. Learning background-aware correlation filters for visual tracking//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE: 1144-1152[ DOI: 10.1109/ICCV.2017.129 http://dx.doi.org/10.1109/ICCV.2017.129 ]

Guo W, You S S, Gao J Y, Yang X S, Zhang T Z and Xu C S. 2018. Deep relative metric learning for visual tracking. Scientia Sinica Informations, 48(1): 60-78

郭文, 游思思, 高君宇, 杨小汕, 张天柱, 徐常胜. 2018.深度相对度量学习的视觉跟踪.中国科学:信息科学, 48(1): 60-78)[DOI: 10.1360/N112017-00124]

Henriques J F, Caseiro R, Martins P and Batista J. 2012. Exploiting the circulant structure of tracking-by-detection with kernels//Proceedings of the 12th European Conference on Computer Vision. Berlin, Germany: Springer: 702-715[ DOI: 10.1007/978-3-642-33765-9_50 http://dx.doi.org/10.1007/978-3-642-33765-9_50 ]

Henriques J F, Caseiro R, Martins P and Batista J. 2014. High- speed tracking with kernelized correlation filters. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(3): 583-596[DOI: 10.1109/TPAMI.2014.2345390]

Li B, Wu W, Wang Q, Zhang F Y, Xing J L and Yan J J. 2019. SiamRPN++: evolution of Siamese visual tracking with very deep networks//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE: 4282-4291[ DOI: 10.1109/CVPR.2019.00441 http://dx.doi.org/10.1109/CVPR.2019.00441 ]

Li F, Tian C, Zuo W M, Zhang L and Yang M H. 2018. Learning spatial-temporal regularized correlation filters for visual tracking//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE: 4904-4913[ DOI: 10.1109/CVPR.2018.00515 http://dx.doi.org/10.1109/CVPR.2018.00515 ]

Li Y and Zhu J K. 2014. A scale adaptive kernel correlation filter tracker with feature integration//Proceedings of 2014 European Conference on Computer Vision. Zurich, Switzerland: Springer: 254-265[ DOI: 10.1007/978-3-319-16181-5_18 http://dx.doi.org/10.1007/978-3-319-16181-5_18 ]

Lowe D G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2): 91-110[DOI:10.1023/B:VISI.0000029664.99615.94]

Lu H C, Li P X and Wang D. 2018. Visual object tracking: a survey. Pattern Recognition and Artificial Intelligence, 31(1): 61-67

卢湖川, 李佩霞, 王栋. 2018.目标跟踪算法综述.模式识别与人工智能, 31(1): 61-76)[DOI: 10.16451/j.cnki.issn1003-6059.201801006]

Lukežic A, Vojír T, Zajc L C, Matas J and Kristan M. 2017. Discriminative correlation filter with channel and spatial reliability//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE: 4847-4856[ DOI: 10.1109/CVPR.2017.515 http://dx.doi.org/10.1109/CVPR.2017.515 ]

Wang M M, Liu Y and Huang Z Y. 2017. Large margin object tracking with circulant feature maps//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE: 4800-4808[ DOI: 10.1109/CVPR.2017.510 http://dx.doi.org/10.1109/CVPR.2017.510 ]

Wang Q, Teng Z, Xing J L, Gao J, Hu W M and Maybank S. 2018. Learning attentions: residual attentional siamese network for high performance online visual tracking//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE: 4854-4863[ DOI: 10.1109/CVPR.2018.00510 http://dx.doi.org/10.1109/CVPR.2018.00510 ]

Wu Y, Lim J and Yang M H. 2013. Online object tracking: a benchmark//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA: IEEE: 2411-2418[ DOI: 10.1109/CVPR.2013.312 http://dx.doi.org/10.1109/CVPR.2013.312 ]

Zhang T Z, Xu C S and Yang M H. 2017. Multi-task correlation particle filter for robust object tracking//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE: 4819-4827[ DOI: 10.1109/CVPR.2017.512 http://dx.doi.org/10.1109/CVPR.2017.512 ]

Zhang W and Kang B S. 2017. Recent advances in correlation filter-based object tracking: a review. Journal of Image and Graphics, 22(8): 1017-1033

张微, 康宝生. 2017.相关滤波目标跟踪进展综述.中国图象图形学报, 22(8): 1017-1033)[DOI: 10.11834/jig.170092]

Zhou Y, Bai X, Liu W Y and Latecki L J. 2016. Similarity fusion for visual tracking. International Journal of Computer Vision, 118(3): 337-363[DOI: 10.1007/s11263-015-0879-9]

Zhu S G, Du J P and Ren N. 2017. A novel simple visual tracking algorithm based on hashing and deep learning. Chinese Journal of Electronics, 26(5): 1073-1078[DOI: 10.1049/cje.2016.06.026]

Alert me when the article has been cited

提交

Background and direction-aware correlation filter tracking

Kernel correlation filtering algorithm based on a dual-feature model

Multi-scale correlation filter tracking algorithm based on occlusion discrimination

Robust correlation filtering-based tracking by multifeature hierarchical fusion

Fuse image enhancement with a regularized correlation filter for target tracking of UAVs