浏览全部资源
扫码关注微信
Received：28 August 2017，
Revised：2017-12-8，
Published：16 May 2018
移动端阅览
目的
2
为提高目标跟踪的鲁棒性，针对相关滤波跟踪中的多特征融合问题，提出了一种多特征分层融合的相关滤波鲁棒跟踪算法。
方法
2
采用多通道相关滤波跟踪算法进行目标跟踪时，从目标和周围背景区域分别提取HOG（histogram of oriented gradient）、CN（color names）和颜色直方图3种特征。提出的分层融合算法首先采用自适应加权融合策略进行HOG和CN特征的特征响应图融合，通过计算特征响应图的平滑约束性和峰值旁瓣比两个指标得到融合权重。将该层融合结果与基于颜色直方图特征获得的特征响应图进行第2层融合时，采用固定系数融合策略进行特征响应图的融合。最后基于融合后的响应图估计目标的位置，并采用尺度估计算法估计得到目标更准确的包围盒。
结果
2
采用OTB-2013（object tracking benchmark 2013）和VOT-2014（visual object tracking 2014）公开测试集验证所提跟踪算法的性能，在对多特征分层融合参数进行分析的基础上，与5种主流基于相关滤波的目标跟踪算法进行了对比分析。实验结果表明，本文算法的目标跟踪精度有所提高，其跟踪精度典型值比Staple算法提高了5.9%（0.840 vs 0.781），同时由于有效地融合了3种特征，在多种场景下目标跟踪的鲁棒性优于其他算法。
结论
2
提出的多特征分层融合跟踪算法在保证跟踪准确率的前提下，跟踪鲁棒性优于其他算法。当相关滤波跟踪算法采用了多个不同类型特征时，本文提出的分层融合策略具有一定的借鉴性。
Objective
2
A robust correlation filtering-based visual tracking algorithm based on multifeature hierarchical fusion is proposed to improve the robustness of target tracking after summarizing the main multifeature fusion strategies to solve the multifeature fusion problem in correlation filtering-based tracking.
Method
2
Three features
including histogram of oriented gradient (HOG)
color name (CN)
and color histogram
are extracted from the target area and its surroundings to depict the appearances of the target and background when the multichannel correlation filtering algorithm is used to track the target. Two fusion layers are used in the proposed hierarchical fusion scheme to combine the response maps of the three features. The HOG and CN features
which describe the gradient and color information of the target
respectively
have a strong discrimination capability and are a pair of complementary features. Given that the saliency of the HOG and CN features is different under different tracking scenarios
the adaptive weighted fusion strategy
which can adaptively adjust fusion weights according to scene change
can be used to combine the responses of the HOG and CN features. Therefore
the adaptive weighted fusion strategy is used to combine the response maps of the HOG and CN features at the first fusion layer
where fusion weights are computed by calculating the smooth constraint and peak-to-sidelobe ratio of the feature response maps. Color histogram is a global statistical feature
and it can handle the case of deformation because the position information is discarded during computation of the color histogram. However
the tracking algorithm has a low accuracy when using the color histogram only because it is susceptible to the interference of similar-colored backgrounds. Thus
the color histogram feature is used as an additional feature in the proposed algorithm. The fixed-coefficient fusion strategy is adopted to combine the feature response maps of the first fusion layer and the feature response maps of the second fusion layer based on the color histogram. Finally
the position of the target is estimated based on the final response map
and the maximum of the final response map corresponds to the target position. The scale estimation algorithm
which uses a 1D scale-dependent filter to estimate the target scale rapidly
is adopted to obtain an accurate bounding box of the target. The model update procedure using a fixed learning factor at each frame is performed to adapt to appearance changes.
Result
2
The performance of the proposed tracking algorithm is verified using two public datasets
i.e.
OTB-2013 and VOT-2014
for the evaluation of the visual tracking algorithm. The OTB-2013 dataset contains 51 test sequences
of which 35 are color video sequences. The distance precision and success rate curves are selected as performance metrics for the OTB-2013 dataset
and the one-pass evaluation assessment method is used to compute these metrics. The VOT-2014 dataset contains 25 color test sequences
and the accuracy and robustness metrics are used to analyze the performance for the VOT-2014 dataset. The experiments are divided into two parts
i.e.
performance analysis of different parameters on the proposed algorithm and comparison with five mainstream correlation-filtering-based tracking algorithms
to analyze the performance of the proposed algorithm fully. The parameters of the proposed multifeature hierarchical fusion scheme
including fusion methods
target features
and fusion parameters
are analyzed using 35 sequences of the OTB-2013 dataset. Experimental results indicate that the proposed adaptive weighted fusion strategy is better than multiplicative fusion strategy
and the HOG
CN
color histogram features can improve the performance of the tracking algorithm. Second
the performance of our algorithm and five mainstream tracking algorithms are compared and analyzed. The six tracking algorithms are initially tested on all sequences and subsequently tested on 10 different individual attribute sequences. Experimental results indicate that the tracking performance is improved
where the precision score of the proposed algorithm is higher than that of the Staple algorithm by 5.9% (0.840 vs 0.781). Meanwhile
the robustness of the proposed algorithm is superior to that of other algorithms in most scenarios because of the effective integration of the CN
HOG
and color histogram features
and the highest success rate is achieved on out-of-plane rotation
occlusion
and fast motion sequences.
Conclusion
2
The robustness of the proposed multifeature hierarchical fusion tracking algorithm is superior to that of other algorithms based on correlation filtering under the premise of ensuring the tracking accuracy. The proposed hierarchical fusion strategy can be used and expanded when different types of features are adopted in the correlation filtering-based tracking algorithm.
Huang K Q, Chen X T, Kang Y F, et al. Intelligent visual surveillance:a review[J]. Chinese Journal of Computers, 2015, 38(6):1093-1118.
黄凯奇, 陈晓棠, 康运锋, 等.智能视频监控技术综述[J].计算机学报, 2015, 38(6):1093-1118. [DOI:10.11897/SP.J.1016.2015.01093]
Smeulders A W M, Chu D M, Cucchiara R, et al. Visual tracking:an experimental survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(7):1442-1468.[DOI:10.1109/TPAMI.2013.230]
Kristan M, Matas J, Leonardis A, et al. The visual object tracking VOT2015 challenge results[C]//Proceedings of 2015 IEEE International Conference on Computer Vision Workshop. Santiago, Chile: IEEE, 2016: 564-586. [ DOI: 10.1109/ICCVW.2015.79 http://dx.doi.org/10.1109/ICCVW.2015.79 ]
Kristan M, Pflugfelder R, Leonardis A, et al. The visual object tracking VOT2014 challenge results[C]//Proceedings of European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 191-217. [ DOI: 10.1007/978-3-319-16181-5_14 http://dx.doi.org/10.1007/978-3-319-16181-5_14 ]
Bolme D S, Beveridge J R, Draper B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, CA, USA: IEEE, 2010: 2544-2550. [ DOI: 10.1109/CVPR.2010.5539960 http://dx.doi.org/10.1109/CVPR.2010.5539960 ]
Henriques J F, Caseiro R, Martins P, et al. Exploiting the circulant structure of tracking-by-detection with kernels[C]//Proceedings of the 12th European Conference on Computer Vision. Florence, Italy: Springer-Verlag, 2012: 702-715. [ DOI: 10.1007/978-3-642-33765-9_50 http://dx.doi.org/10.1007/978-3-642-33765-9_50 ]
Henriques J F, Caseiro R, Martins P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3):583-596.[DOI:10.1109/TPAMI.2014.2345390]
Danelljan M, Khan F S, Felsberg M, et al. Adaptive color attributes for real-time visual tracking[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA: IEEE, 2014: 1090-1097. [ DOI: 10.1109/CVPR.2014.143 http://dx.doi.org/10.1109/CVPR.2014.143 ]
Danelljan M, Häger G, Khan F S, et al. Accurate scale estimation for robust visual tracking[C]//Proceedings of British Machine Vision Conference 2014. Nottingham, UK: BMVA Press, 2014: 1-11. [ DOI: 10.5244/C.28.65 http://dx.doi.org/10.5244/C.28.65 ]
Li Y, Zhu J K. A scale adaptive kernel correlationfilter tracker with feature integration[C]//Proceedings of European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 254-265. [ DOI: 10.1007/978-3-319-16181-5_18 http://dx.doi.org/10.1007/978-3-319-16181-5_18 ]
Felzenszwalb P F, Girshick R, McAllester D, et al. Object detection with discriminatively trained part-based models[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(9):1627-1645.[DOI:10.1109/TPAMI.2009.167]
Van De Weijer J, Schmid C, Verbeek J, et al. Learning color names for real-world applications[J]. IEEE Transactions on Image Processing, 2009, 18(7):1512-1523.[DOI:10.1109/TIP.2009.2019809]
Xu Y L, Wang J B, Li Y, et al. Scale adaptive correlation tracking combined with color features[J]. Application Research of Computers, 2017, 34(3):945-948.
徐玉龙, 王家宝, 李阳, 等.融合颜色特征的尺度自适应相关跟踪[J].计算机应用研究, 2017, 34(3):945-948.[DOI:10.3969/j.issn.1001-3695.2017.03.071]
Shen Q, Yan X L, Liu L F, et al. Multi-scale correlation filtering tracker based on adaptive feature selection[J]. Acta Optica Sinica, 2017, 37(5):#515001.
沈秋, 严小乐, 刘霖枫, 等.基于自适应特征选择的多尺度相关滤波跟踪[J].光学学报, 2017, 37(5):#515001. [DOI:10.3788/aos201737.0515001]
Wang W, Wang C P, Li J, et al. Correlation filter tracking based on feature fusing and model adaptive updating[J]. Optics and Precision Engineering, 2016, 24(8):2059-2066.
王暐, 王春平, 李军, 等.特征融合和模型自适应更新相结合的相关滤波目标跟踪[J].光学 精密工程, 2016, 24(8):2059-2066. [DOI:10.3788/OPE.20162408.2059]
Ma C, Huang J B, Yang X K, et al. Hierarchical convolutional features for visual tracking[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 3074-3082. [ DOI: 10.1109/ICCV.2015.352 http://dx.doi.org/10.1109/ICCV.2015.352 ]
Bertinetto L, Valmadre J, Golodetz S, et al. Staple: complementary learners for real-time tracking[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE, 2016: 1401-1409. [ DOI: 10.1109/CVPR.2016.156 http://dx.doi.org/10.1109/CVPR.2016.156 ]
Wu Y, Lim J, Yang M H. Online object tracking: a benchmark[C]//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, OR, USA: IEEE, 2013: 2411-2418. [ DOI: 10.1109/CVPR.2013.312 http://dx.doi.org/10.1109/CVPR.2013.312 ]
Comaniciu D, Ramesh V, Meer P, et al. Kernel-based object tracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(5):564-577.[DOI:10.1109/TPAMI.2003.1195991]
Isard M, Blake A. CONDENSATION-conditional density propagation for visual tracking[J]. International Journal of Computer Vision, 1998, 29(1):5-28.[DOI:10.1023/A:1008078328650]
Liu T, Wang G, Yang Q X. Real-time part-based visual tracking via adaptive correlation filters[C]//Proceedings of 2015 IEEE Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 4902-4912. [ DOI: 10.1109/CVPR.2015.7299124 http://dx.doi.org/10.1109/CVPR.2015.7299124 ]
相关文章
相关作者
相关机构
京公网安备11010802024621
