Long-term target tracking based on perceptual model

Bo Zhang; Feibo Jiang; Gang Liu

doi:10.11834/jig.190059

Image Analysis and Recognition | Views : 0 下载量: 17 CSCD: 1

PDF
Export
Share
Collection
Album

Long-term target tracking based on perceptual model
Vol. 24, Issue 11, Pages: 1906-1917(2019)
Received：01 March 2019，

Revised：2019-6-5，

Accepted：12 June 2019，

Published：16 November 2019
DOI： 10.11834/jig.190059
稿件说明：

移动端阅览

DOI：

Bo Zhang, Feibo Jiang, Gang Liu. Long-term target tracking based on perceptual model[J]. Journal of Image and Graphics, 2019, 24(11): 1906-1917. DOI： 10.11834/jig.190059.

摘要

目的

传统相关滤波目标跟踪算法存在两个问题，其一，使用循环移位产生的虚假负样本训练分类器，导致分类器分类能力受到限制；其二，当目标被严重遮挡时，由遮挡引起的一些不正确的样本（预测的目标图像）用于更新分类器，随着遮挡时间的增加，分类器将包含较多噪声信息并逐渐失去判别力，使得跟踪失败。针对上述问题，提出一种基于感知模型的长期目标跟踪算法，通过引入背景感知策略解决传统相关滤波器缺乏真实负样本问题，通过引入遮挡感知策略来有效跟踪被遮挡的目标。

方法

首先，所提算法通过扩大采样区域，增加所产生训练样本数量，并引入裁剪矩阵，裁取移位后的样本以获得完整有效的样本，同时克服了由循环移位产生样本导致的边界效应问题；然后，利用无遮挡情况下一定帧数目标图像各自对应的分类器构建分类池；最后，在严重遮挡情况下利用最小化能量函数从分类池中选择最佳分类器进行重检测，以实现长期目标跟踪。

结果

使用公开数据集对所提算法进行性能评估，结果表明，所提算法成功率为0.990，精确度为0.988。其较背景感知相关滤波（BACF）算法分别提升2.7%和2.5%。

结论

所提算法在目标被遮挡、形变、尺度变化以及复杂背景下仍能较准确跟踪目标，具备较高的精确度和鲁棒性。

Abstract

Objective

Visual target tracking is an important issue in machine vision. Its core tasks are to locate the target in a continuous video sequence and estimate the target's motion trajectory. This method has been widely used in many fields

such as human-computer interaction

security monitoring

automatic driving

navigation

and positioning. Through extensive research by domestic and foreign experts in recent years

visual target-tracking technology has gradually matured. However

tracking targets accurately in complex scenes

such as intense illumination change

occlusion

deformation

scale change

and background clutter

remains a challenging task. Visual target-tracking algorithms can be divided into two categories

namely

generative and discriminative tracking methods. Generative tracking converts the tracking problem into the nearest neighbor search task of the target model

constructs the target model by using a template or sparse representation in the subspace

and achieves target tracking by searching for the most similar region in the target model. Discriminant tracking treats the tracking problem as a binary classification problem.The target is separated from the background by training the classifier to achieve target tracking. Given that the generated visual target-tracking algorithm needs to construct a complex target appearance model

its computational complexity is high

and its algorithm has poor real-time performance. Discriminant tracking algorithm uses samples of the target and surrounding background to train a classifier online and achieves target tracking by detecting and tracking. Its classifier obtains considerable background information during training. Thus

this method can distinguish foreground and background better and its performance is generally better than that of the generative tracking method. Correlation-filtering algorithm is an algorithm with better performance than discriminant tracking algorithm. The traditional correlation-filtering algorithm introduces the concept of dense sampling and uses cyclically shifted samples of the base samples as training samples

which greatly improve the classification ability of the filter. The introduction of kernel strategy maps the linear regression problem of the ridge to the nonlinear space and uses the discrete Fourier transform to transform the time-domain calculation into the frequency-domain calculation

which greatly reduces algorithm complexity. Although traditional correlation-filtering algorithm has many advantages

it also has shortcomings.

Method

First

this algorithm uses false negative samples generated by the cyclic shift to train a classifier

which limits the classifier's classification ability. Second

several incorrect samples (predicted target images) caused by occlusion are used to update the classifier when the target is seriously occluded. With an increase in occlusion time

the classifier will contain considerable noise information and gradually lose discrimination

which causes tracking failure.Aiming to address the above problems

this study proposes a long-term target-tracking algorithm based on a perceptual model. The algorithm introduces the background perceptual strategy to solve the problem of traditional correlation filtering lacking real negative samples and the occlusion-sensing strategy to effectively track the occluded target. The proposed algorithm first increases the number of training samples by enlarging the sampling area. A cropping matrix is then introduced into the algorithm to crop shifted samples and obtain complete and valid samples.This method overcomes the boundary effect problem caused by cyclically shifted samples. A classification pool is subsequently constructed by using the corresponding classifiers of a certain number of frames in the case of no occlusion. In the case of severe occlusion

the optimal classifier is finally selected from the classification pool by minimizing the energy function for redetection to achieve long-term target tracking.

Result

The performance of the proposed algorithm is evaluated by using a public data set. The proposed algorithm has a success rate of 0.990 and an accuracy of 0.988. These values are respectively 2.7% and 2.5% higher than those of the background-aware correlation filter algorithm. The overall success rate and accuracy of the proposed algorithm are considerably higher than those of other algorithms because of the introduction of background and occlusion perception strategies. The tracking accuracy for a single sequence is also higher. However

other algorithms have certain advantages in specific scenarios

and the proposed algorithm does not rank first in the accuracy and success rate of each sequence. The time complexity of the algorithm is slightly higher and the real-time performance is insufficient because of the introduction of perception module.

Conclusion

Experiments show that the proposed algorithm can accurately track a target under complex conditions

such as severe occlusion

scale change

and target deformation and has certain research value.

关键词

Keywords

references

Gültekın O, Günsel B. Robust object tracking by variable rate kernel particle filter[C]//Proceedings of the 26th Signal Processing and Communications Applications Conference. Izmir, Turkey: IEEE, 2018: 1-4.[ DOI: 10.1109/SIU.2018.8404479 http://dx.doi.org/10.1109/SIU.2018.8404479 ]

Gao M F, Zhang X X. Scale adaptive kernel correlation filtering for target tracking[J]. Laser&Optoelectronics Progress, 2018, 55(4):041501.

高美凤, 张晓玄.尺度自适应核相关滤波目标跟踪[J].激光与光电子学进展, 2018, 55(4):041501.[DOI:10.3788/LOP55.041501]

Nai K, Li Z Y, Li G J, et al. Robust object tracking via local sparse appearance model[J]. IEEE Transactions on Image Processing, 2018, 27(10):4958-4970.[DOI:10.1109/TIP.2018.2848465]

Qi Y K, Qin L, Zhang J, et al. Structure-aware local sparse coding for visual tracking[J]. IEEE Transactions on Image Processing, 2018, 27(8):3857-3869.[DOI:10.1109/TIP.2018.2797482]

Li Z T, Zhang J, Zhang K H, et al. Visual tracking with weighted adaptive local sparse appearance model via spatio-temporal context learning[J]. IEEE Transactions on Image Processing, 2018, 27(9):4478-4489.[DOI:10.1109/TIP.2018.2839916]

Chen Z H, Guo Q, Wang L, et al. Background-suppressed correlation filters for visual tracking[C]//Proceedings of 2018 IEEE International Conference on Multimedia and Expo. San Diego, CA, USA: IEEE, 2018: 1-6.[ DOI: 10.1109/ICME.2018.8486453 http://dx.doi.org/10.1109/ICME.2018.8486453 ]

Li Z K, Wan C S. Visual tracking with re-detection based on feature combination[C]//Proceedings of the 10th International Conference on Advanced Computational Intelligence. Xiamen, China: IEEE, 2018: 655-660.[ DOI: 10.1109/ICACI.2018.8377537 http://dx.doi.org/10.1109/ICACI.2018.8377537 ]

Xiao Y F, Li J, Chang J, et al. Correlation filter tracking with multiscale spatial view[C]//Proceedings of 2018 International Joint Conference on Neural Networks. Rio de Janeiro, Brazil: IEEE, 2018: 1-6.[ DOI: 10.1109/IJCNN.2018.8489278 http://dx.doi.org/10.1109/IJCNN.2018.8489278 ]

Li J W, Zhou X L, Chan S X, et al. Robust object tracking via large margin and scale-adaptive correlation filter[J]. IEEE Access, 2018, 6:12642-12655.[DOI:10.1109/ACCESS.2017.2778740]

Xu T Y, Wu X J, Feng F. Fast visual object tracking via correlation filter and binary descriptors[C]//Proceedings of 2017 International Smart Cities Conference. Wuxi, China: IEEE, 2017: 1-4.[ DOI: 10.1109/ISC2.2017.8090855 http://dx.doi.org/10.1109/ISC2.2017.8090855 ]

Bolme D S, Beveridge J R, Draper B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, CA, USA: IEEE, 2010: 2544-2550.[ DOI: 10.1109/CVPR.2010.5539960 http://dx.doi.org/10.1109/CVPR.2010.5539960 ]

Henriques J F, Caseiro R, Martins P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3):583-596.[DOI:10.1109/TPAMI.2014.2345390]

Li Y, Zhu J K. A scale adaptive kernel correlation filter tracker with feature integration[C]//Proceedings of European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 254-265.[ DOI: 10.1007/978-3-319-16181-5_18 http://dx.doi.org/10.1007/978-3-319-16181-5_18 ]

Zhang H Y, Li C F. Compressive tracking algorithm combining online feature selection with covariance matrix[J]. Optics and Precision Engineering, 2017, 25(4):519-527.

张红颖, 李灿锋.结合特征在线选择与协方差矩阵的压缩跟踪算法[J].光学精密工程, 2017, 25(4):519-527.[DOI:10.3788/OPE.20172504.1051]

Ma C, Yang X K, Zhang C Y, et al. Long-term correlation tracking[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE, 2015: 5388-5396.[ DOI: 10.1109/CVPR.2015.7299177 http://dx.doi.org/10.1109/CVPR.2015.7299177 ]

Choi J, Chang H J, Jeong J, et al. Visual tracking using attention-modulated disintegration and integration[C]//Proceedings of 2016 IEEE Conference on Computer Visionand Pattern Recognition. Las Vegas, USA: IEEE, 2016: 4321-4330.[ DOI: 10.1109/CVPR.2016.468 http://dx.doi.org/10.1109/CVPR.2016.468 ] http://www.researchgate.net/publication/311609512_Visual_Tracking_Using_Attention-Modulated_Disintegration_and_Integration .

Ge B Y, Zuo X Z, Hu Y J. Long-term object tracking based on feature fusion[J]. Acta Optica Sinica, 2018, 38(11):1115002.

葛宝义, 左宪章, 胡永江.基于特征融合的长时目标跟踪算法[J].光学学报, 2018, 38(11):1115002.[DOI:10.3788/AOS201838.1115002]

Danelljan M, Häger G, Khan F S, et al. Accurate scale estimation for robust visual tracking[C]//Proceedings of the British Machine Vision Conference. Nottingham, UK: BMVC, 2014: 1-11.[ DOI: 10.5244/C.28.65 http://dx.doi.org/10.5244/C.28.65 ]

Danelljan M, Häger G, Khan F S, Felsberg M. Learning spatially regularized correlation filters for visual tracking[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 4310-4318.[ DOI: 10.1109/ICCV.2015.490 http://dx.doi.org/10.1109/ICCV.2015.490 ]

Galoogahi H K, Fagg A, Lucey S. Learning background-aware correlation filters for visual tracking[C]//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 1144-1152.[ DOI: 10.1109/ICCV.2017.129 http://dx.doi.org/10.1109/ICCV.2017.129 ]

Zhang J M, Ma S G, Sclaroff S. MEEM: robust tracking via multiple experts using entropy minimization[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 188-203.[ DOI: 10.1007/978-3-319-10599-4_13 http://dx.doi.org/10.1007/978-3-319-10599-4_13 ]

Bertinetto L, Valmadre J, Golodetz S, et al. Staple: complementary learners for real-time tracking[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE, 2016: 1401-1409.[ DOI: 10.1109/CVPR.2016.156 http://dx.doi.org/10.1109/CVPR.2016.156 ]

Hong Z B, Chen Z, Wang C H, et al. Multi-store tracker (MUSTer): a cognitive psychology inspired approach to object tracking[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition.Boston, MA, USA: IEEE, 2015: 749-758.[ DOI: 10.1109/CVPR.2015.7298675 http://dx.doi.org/10.1109/CVPR.2015.7298675 ]

Alert me when the article has been cited

提交

Fuse image enhancement with a regularized correlation filter for target tracking of UAVs

Infrared target tracking algorithm based on attention mechanism enhancement and target model update

Background and direction-aware correlation filter tracking

Target tracking system based on the Siamese guided anchor region proposal network

Multilevel relocation tracking algorithm under occlusion decision