Current Issue Cover
姿态特征结合2维傅里叶变换的步态识别

王新年1, 胡丹丹1, 张涛2, 白桂欣1(1.大连海事大学, 大连 116026;2.辽宁师范大学, 大连 116029)

摘 要
目的 针对现有步态识别方法易受携带物品、衣服变化等影响的问题,提出了将无肩姿态能量图、步态参数等姿态特征与步态参数的2维傅里叶变换相结合的步态识别算法。方法 基于姿态关节点序列提出忽略肩膀宽度信息的无肩姿态能量图,用以减弱衣服变化的影响;由于下肢受衣物及背包影响较小,提取3个或3个以上的下肢关节点局部结构参数,即提取中臀点与左右膝关节点、中臀点与左右踝关节点构成的两个三角形面积以及所有下肢关节点构成的多边形面积作为步态参数,增强下肢参数在步态识别中的作用;人在行走时,单肢体的运动具有一定的周期性,且肢体之间运动具有一定的协调性,用步态参数的2维幅度谱来表示单肢体运动的周期性与肢体之间运动的协调性,以提高步态参数的可区别性;在现有典型步态特征的基础上,融合本文提出的无肩姿态能量图、步态参数及其2维傅里叶变换幅度谱,采用多特征表示步态的方法,充分利用各特征的优点,提出加权平均与最大池化相结合的两层分数融合策略进行步态识别,提高了步态识别算法在携带物品、衣服变化和跨视角等条件下的正确率。结果 实验结果表明,在中国科学院自动化研究所发布的步态数据集CASIA-B上,本文方法在相同视角条件下,正常状态、背包状态和穿大衣状态的平均识别率分别为99.56%、99.23%和94.25%;在跨视角条件下,正常状态、背包状态和穿大衣状态的平均识别率分别为91.32%、85.34%和69.51%。与典型算法相比,穿大衣状态的识别率有显著提升。结论 本文方法采用加权平均与最大池化相结合的两层分数融合策略,综合利用各特征的优点及其适用场景,有效提高了步态识别的准确率,特别是减弱了衣服厚度、样式等变化对步态识别的影响。
关键词
Gait recognition using pose features and 2D Fourier transform

Wang Xinnian1, Hu Dandan1, Zhang Tao2, Bai Guixin1(1.Dalian Maritime University, Dalian 116026, China;2.Liaoning Normal University, Dalian 116029, China)

Abstract
Objective Gait recognition aims to identify and verify individuals on the basis of walking postures. The performance of existing gait recognition methods is easily influenced by factors such as viewing variances, clothing changes, and types of objects carried by a person. Furthermore, none of these methods consider that the coordination and periodicity of human walking are also important features for gait recognition. Therefore, we propose the pose energy map without considering shoulders (PEMoS) to reduce the effect of clothing changes and 2D Fourier transform magnitude spectrum of gait parameters (2DFoMS) to enhance the effect of the coordination and periodicity of human movements. As these features have a close relationship with the human pose, we call them pose features. Moreover, the proposed pose features are fused together with other excellent features such as GaitSet to improve the overall performance of gait recognition. Method Clothing changes can affect the detected positions of body joints, especially the shoulder joints. Therefore, we propose PEMoS, which ignores the shoulder width, to reduce the effect of clothing changes. The construction process of PEMoS is as follows:First, body joints in each frame are detected by pose estimation methods. Second, six upper limb joints, namely, RShoulder(right shoulder), RElbow(right elbow), RWrist(right wrist), LShoulder(loft shoulder), LElbow(left elbow), and LWrist(left wrist), are horizontally shifted with the displacement between the neck joint and the right or left shoulder joint, whereas the rest remain unchanged. Third, the pose binary map is formatted by connecting the corrected joints in a predefined order and width. Then, it is resized to 128×88 pixels centering on the MidHip joint. Fourth, PEMoS is computed by averaging pose binary maps within a period that include at least one complete gait cycle. Finally, PEMoS is activated by gamma transformation to improve the performance. 2DFoMS uses the coordination between human movements and the periodicity of one single movement to enhance the gait recognition performance. As the lower limbs are less affected by clothing or bags, three new gait parameters computed from the lower limbs are proposed, which include the area of the triangle formed by MidHip(middle hip), LKnee(left knee), and RKnee(right knee); the area of the triangle formed by MidHip, LAnkle(left ankle), and RAnkle(right ankle); and the area of the polygon enclosed by all the lower limb joints. Unlike the existing gait parameters that only consider the relationship between two joints, the proposed area parameters consider the local structural relationship of more than three points, which can enhance the effect of lower limb joints to the gait. The proposed three parameters are concatenated with the other 16 gait parameters extracted by regular methods to form a gait parameter column vector in each frame. The gait parameter column vectors of successive frames over time form a two-dimensional gait parameter matrix. As the gait parameters vary with time, they should be aligned to facilitate training and matching. On the basis of the observation that the width between two ankles varies with time much more regularly than other gait parameters, we propose to use the peak value position of the ankle width curve as base points to align all other gait parameters. 2DFoMS is computed by applying 2D Fourier transform on the registered gait parameter matrix. To fully utilize the advantages of the proposed features and the state-of-the-art features, such as GaitSet, two-level score fusion based on weighted average-max pooling is proposed to compute the matching score. The first level is the weighted average scores of multiple features. At this level, three groups of weights applicable to three different scenarios are proposed to compute the scores. At the second level, the max pooling of the first level scores is used as the final matching score. Result We evaluate the proposed method in terms of four aspects:overall performance, performance under different walking conditions, performance under cross-view conditions, and ablation study. In CASIA Gait Database B, the first 62 subjects are used for training, and the remaining 62 subjects are used for testing. The experimental results show that the proposed method achieves average accuracies of 99.56%, 99.23%, and 94.25% under walking normally, walking with a bag, and walking with a different coat, respectively, when the views of the probe sequence and its counterpart in the gallery set are the same. For cross-view recognition, the proposed method achieves average accuracies of 91.32%, 85.34%, and 69.51% under walking normally, walking with a bag, and walking with a different coat, respectively. Compared with the state-of-the-art methods, the average accuracy of the proposed method increases by about 6.98% under clothing changing conditions. Ablation study shows that PEMoS and 2DFoMS are effective in improving the gait recognition accuracy. Conclusion The proposed PEMoS, which ignores the shoulder width, can increase the robustness and accuracy of gait recognition under clothing changing conditions. The proposed local structure gait parameters can enhance the effect of lower limb points to the gait, which are more robust to clothing or bag changes than the upper limb parameters. 2DFoMS can emphasize the effect of coordination between human movements and the periodicity of one single moment on the performance of gait recognition. The experimental results show that the proposed algorithm has achieved state-of-the-art performance, especially under clothing or bag changing conditions.
Keywords

订阅号|日报