Person re-identification based on multi-feature fusion and alternating direction method of multipliers

Meibin Qi; Cichun Wang; Jianguo Jiang; Ji Li

doi:10.11834/jig.170507

Image Analysis and Recognition | Views : 0 下载量: 4 CSCD: 6

PDF
Export
Share
Collection
Album

Person re-identification based on multi-feature fusion and alternating direction method of multipliers
Vol. 23, Issue 6, Pages: 827-836(2018)
Received：02 March 2018，

Revised：2018-3-5，

Published：16 June 2018
DOI： 10.11834/jig.170507
稿件说明：

移动端阅览

DOI：

Meibin Qi, Cichun Wang, Jianguo Jiang, Ji Li. Person re-identification based on multi-feature fusion and alternating direction method of multipliers[J]. Journal of Image and Graphics, 2018, 23(6): 827-836. DOI： 10.11834/jig.170507.

摘要

目的

由于行人图像分辨率差异、光照差异、行人姿态差异以及摄像机视角和成像质量差异等原因，导致同一行人在不同监控视频中的外观区别很大，给行人再识别带来了巨大挑战。为提高行人再识别的准确率，针对以上问题，提出一种基于多特征融合与交替方向乘子法的行人再识别算法。

方法

首先利用图像增强算法对所有行人图像进行处理，减少因光照变化产生的影响，然后把处理后的图像进行非均匀分割，同时使用特定区域均值法提取行人图像的HSV和LAB颜色特征以及SILTP（scale invariant local ternary pattern）纹理特征和HOG（histogram of oriented gradient）特征，融合多种特征得到行人图像对的整体与局部相似度度量函数并结合产生相似度函数，最后使用交替方向乘子优化算法更新出最优的测度矩阵实现行人再识别。

结果

在VIPeR、CUHK01、CUHK03和GRID这4个数据集上进行实验，其中VIPeR、CUHK01和GRID 3个数据集Rank1（排名第1的搜索结果即为待查询人的比率）分别达到51.5%、48.7%和21.4%，CUHK03手动裁剪和检测器检测数据集Rank1分别达到62.40%和55.05%，识别率有了显著提高，具有实际应用价值。

结论

提出的多特征融合与交替方向乘子优化算法，能够很好地描述行人特征，迭代更新出来的测度矩阵能够很好地表达行人之间的距离信息，较大幅度地提高了识别率。该方法适用于大多数应用场景下的行人再识别。尤其是针对复杂场景下静态图像行人再识别问题，在存在局部遮挡、光照差异和姿态差异的情况下也能保持较高的识别正确率。

Abstract

Objective

Person re-identification is an extremely challenging problem and has practical application value. It plays an important role in video surveillance systems because it can reduce human efforts in searching for a target from a large number of videos. This topic has gained increasing interest in computer vision. Nowadays

person re-identification algorithms have been applied in criminal investigation

where the interference of passers-by can be eliminated to help the police find final suspects. However

differences in color

illumination

posture

imaging quality

as well as low-resolution of the captured frames cause large appearance variance across multiple cameras; thus

person re-identification remains a significant problem. An algorithm for person re-identification

which is based on multi-feature fusion and alternating direction method of multipliers

is proposed to improve the accuracy of person re-identification.

Method

First

the original images are processed by the image enhancement algorithm to reduce the impact of illumination changes. This enhancement algorithm is committed to provide an image that is close to human visual characteristics. Then

the method of non-uniform segmentation that processes images is used. The method uses a sub-window size of 10-by-10 pixels with 5-pixel overlapping steps to obtain the local information of the pedestrian image. Meanwhile

the method uses the specific region mean method to divide the pedestrian image into five blocks. Specifically

depending on the difference of the expression ability of the legs and torso

these parts are divided into three blocks and two blocks

respectively. Then

the second and third blocks take the maximum operation

whereas the other blocks perform the mean operation because the second and third blocks are less affected by ambient noise compared with the other blocks. We also extract the HSV and LAB color features of the processed images

a texture feature of scale-invariant local ternary pattern and a shape feature of histogram of oriented gradient. The existing pedestrian re-identification algorithms generally consider the matching between local regions to eliminate the gap information between blocks. The combination of the global and local methods can effectively solve this problem. The proposed algorithm uses the multi-feature fusion method to combine the global and local information

which combines the global and local similarity measurement function of the related person

to obtain the final similarity function. Finally

the optimal distance measurement matrix is updated by the alternating direction method of multipliers

and the final similarities between each pair are obtained to conduct the re-identification.

Result

The proposed method is demonstrated on four public benchmark datasets including VIPeR

CUHK01

CUHK03

and GRID. Each dataset has its own characteristics. The proposed method achieves a 51.5% rank 1 (represents the accurately matched pair) on VIPeR benchmark and 48.7% and 21.4% on CUHK01 and GRID benchmarks

respectively. Rank 5 (represents the expectation of the matches at rank 5) is more than 80% on the VIPeR datasets and more than 70% on the CUHK01 datasets. The proposed method achieved 62.40% and 55.05% rank 1 identification rates with the labeled bounding boxes and automatically detected bounding boxes

respectively

thereby indicating that the method outperforms that of local maximal occurrence with an improvement of 10.2% for the labeled setting and 8.8% for the detected setting. The proposed method significantly improves the recognition rate and has a practical application value.

Conclusion

The experimental results show that the proposed method can express the image information of pedestrians effectively. Furthermore

the effectiveness of our algorithm stems from the non-uniform segmentation and the specific mean method

which reduces the influence of ambient noise

increases robustness to occlusion

and is more flexible in handling pose variation. The updated distance measure matrix can express the information of the distance between pedestrians and improve the recognition rate effectively. This method is applicable to person re-identification in most scenarios

especially for static image-based person re-identification in complex scenes. This method can maintain high recognition accuracy even in the presence of local occlusion

illumination difference

and pose or viewpoint difference.

关键词

Keywords

references

Yi D, Lei Z, Liao S C, et al. Deep metric learning for person re-identification[C]//Proceedings of the 22nd International Conference on Pattern Recognition. Stockholm, Sweden: IEEE, 2014: 34-39. [ DOI:10.1109/ICPR.2014.16 http://dx.doi.org/10.1109/ICPR.2014.16 ]

Li W, Zhao R, Xiao T, et al. DeepReID: deep filter pairing neural network for person re-identification[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA: IEEE, 2014: 152-159. [ DOI:10.1109/CVPR.2014.27 http://dx.doi.org/10.1109/CVPR.2014.27 ]

Schroff F, Kalenichenko D, Philbin J. FaceNet: a unified embedding for face recognition and clustering[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 815-823. [ DOI:10.1109/CVPR.2015.7298682 http://dx.doi.org/10.1109/CVPR.2015.7298682 ]

Köstinger M, Hirzer M, Wohlhart P, et al. Large scale metric learning from equivalence constraints[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012: 2288-2295. [ DOI:10.1109/CVPR.2012.6247939 http://dx.doi.org/10.1109/CVPR.2012.6247939 ]

Chen Y, Huo Z H. Person re-identification based on multi-directional saliency metric learning[J]. Journal of Image and Graphics, 2015, 20(12):1674-1683.

陈莹, 霍中花.多方向显著性权值学习的行人再识别[J].中国图象图形学报, 2015, 20(12):1674-1683. [DOI:10.11834/jig.20151212]

Qi M B, Tan S S, Wang Y X, et al. Multi-feature subspace and kernel learning for person re-identification[J]. Acta Automatica Sinica, 2016, 42(2):299-308.

齐美彬, 檀胜顺, 王运侠, 等.基于多特征子空间与核学习的行人再识别[J].自动化学报, 2016, 42(2):299-308. [DOI:10.16383/j.aas.2016.c150344]

Qi M B, Hu L F, Jiang J G, et al. Person re-identification basedon multi-features fusion and independent metric learning[J]. Journal of Image and Graphics, 2016, 21(11):1464-1472.

齐美彬, 胡龙飞, 蒋建国, 等.多特征融合与独立测度学习的行人再识别[J].中国图象图形学报, 2016, 21(11):1464-1472. [DOI:10.11834/jig.20161106]

Jobson D J, Rahman Z, Woodell G A. A multiscale retinex for bridging the gap between color images and the human observation of scenes[J]. IEEE Transactions on image Processing, 1997, 6(7):965-976.[DOI:10.1109/83.597272]

Chen D P, Yuan Z J, Hua G, et al. Similarity learning on an explicit polynomial kernel feature map for person re-identification[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 1565-1573. [ DOI:10.1109/CVPR.2015.7298764 http://dx.doi.org/10.1109/CVPR.2015.7298764 ]

Liao S C, Hu Y, Zhu X Y, et al. Person re-identification by local maximal occurrence representation and metric learning[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 2197-2206. [ DOI:10.1109/CVPR.2015.7298832 http://dx.doi.org/10.1109/CVPR.2015.7298832 ]

Gabay D, Mercier B. A dual algorithm for the solution of nonlinear variational problems via finite element approximation[J]. Computers&Mathematics with Applications, 1976, 2(1):17-40.[DOI:10.1016/0898-1221(76)90003-1]

Wang H B, Lu C, Zhou J, et al. Orthogonal projection non-negative matrix factorization using alternating direction method of multipliers[J]. Journal of Image and Graphics, 2017, 22(4):463-471.

王华彬, 路成, 周健, 等.正交投影非负矩阵的交替方向乘子分解方法[J].中国图象图形学报, 2017, 22(4):463-471. [DOI:10.11834/jig.20170406]

Gray D, Tao H. Viewpoint invariant pedestrian recognition with an ensemble of localized features[C]//Proceedings of the 10th European Conference on Computer Vision. Marseille, France: Springer, 2008: 262-275. [ DOI:10.1007/978-3-540-88682-2_21 http://dx.doi.org/10.1007/978-3-540-88682-2_21 ]

Loy C, Xiang T, Gong S G. Multi-camera activity correlation analysis[C]//Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, FL, USA: IEEE, 2009: 1988-1995. [ DOI:10.1109/CVPR.2009.5206827 http://dx.doi.org/10.1109/CVPR.2009.5206827 ]

Zhao R, Ouyang W L, Wang X G. Learning mid-level filters for person re-identification[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA: IEEE, 2014: 144-151. [ DOI:10.1109/CVPR.2014.26 http://dx.doi.org/10.1109/CVPR.2014.26 ]

Xiong F, Gou M R, Camps O, et al. Person re-identification using kernel-based metric learning methods[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 1-16. [ DOI:10.1007/978-3-319-10584-0_1 http://dx.doi.org/10.1007/978-3-319-10584-0_1 ]

Ahmed E, Jones M, Marks T K. An improved deep learning architecture for person re-identification[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 3908-3916. [ DOI:10.1109/CVPR.2015.7299016 http://dx.doi.org/10.1109/CVPR.2015.7299016 ]

Loy C C, Liu C X, Gong S G. Person re-identification by manifold ranking[C]//Proceedings of the 2013 IEEE International Conference on Image Processing. Melbourne, VIC, Australia: IEEE, 2013: 3567-3571. [ DOI:10.1109/ICIP.2013.6738736 http://dx.doi.org/10.1109/ICIP.2013.6738736 ]

Alert me when the article has been cited

提交

Person re-identification based on multi-features fusion and independent metric learning

View-aware feature learning for person re-identification

Region enhancement and multi-feature fusion for contraband recognition in X-ray images

Semantic segmentation of airborne LiDAR point cloud based on multi-feature fusion and geometric convolution

Point cloud semantic segmentation method based on multi-feature fusion and residual optimization