Abstract: gait recognition has significant potential for remote human identification, but it is easily influenced by identity-unrelated factors such as clothing, carrying conditions, and view angles. Many gait templates have been presented that can effectively represent gait features. Each gait template has its advantages and can represent different prominent information. In this paper, gait template fusion is proposed to improve the classical representative gait template (such as a gait energy image) which represents incomplete information that is sensitive to changes in contour. We also present a partition method to reflect the different gait habits of different body parts of each pedestrian. The fused template is cropped into three parts (head, trunk, and leg regions) depending on the human body, and the three parts are then sent into the convolutional neural network to learn merged features. We present an extensive empirical evaluation of the CASIA-B dataset and compare the proposed method with existing ones. The results show good accuracy and robustness of the proposed method for gait recognition.

一种基于分块步态模板的鲁棒性步态识别方法

[1]Bashir K, Xiang T, Gong SG, 2010a. Cross-view gait recognition using correlation strength. Proc British Machine Vision Conf, p.1-11.

[2]Bashir K, Xiang T, Gong SG, 2010b. Gait recognition without subject cooperation. Patt Recogn Lett, 31(13):2052-2060.

[3]Ben XY, Gong C, Zhang P, et al., 2019a. Coupled patch alignment for matching cross-view gaits. IEEE Trans Image Process, 28(6):3142-3157.

[4]Ben XY, Zhang P, Lai ZH, et al., 2019b. A general tensor representation framework for cross-view gait recognition. Patt Recogn, 90:87-98.

[5]Ben XY, Gong C, Zhang P, et al., 2020. Coupled bilinear discriminant projection for cross-view gait recognition. IEEE Trans Circ Syst Video Technol, 30(3):734-747.

[6]Chao HQ, He YW, Zhang JP, et al., 2019. GaitSet: regarding gait as a set for cross-view gait recognition. Proc AAAI Conf on Artificial Intelligence, p.8126-8133.

[7]Fan C, Peng YJ, Cao CS, et al., 2020. GaitPart: temporal part-based model for gait recognition. Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition, p.14213-14221.

[8]Goodfellow IJ, Pouget-Abadie J, Mirza M, et al., 2014. Generative adversarial nets. Proc 27^th Int Conf on Neural Information Processing Systems, p.2672-2680.

[9]Han J, Bhanu B, 2006. Individual recognition using gait energy image. IEEE Trans Patt Anal Mach Intell, 28(2):316-323.

[10]He YW, Zhang JP, Shan HM, et al., 2019. Multi-task GANs for view-specific feature learning in gait recognition. IEEE Trans Inform Forens Secur, 14(1):102-113.

[11]Hossain A, Makihara Y, Wang JQ, et al., 2010. Clothing-invariant gait identification using part-based clothing categorization and adaptive weight control. Patt Recogn, 43(6):2281-2291.

[12]Iwama H, Muramatsu D, Makihara Y, et al., 2013. Gait verification system for criminal investigation. IPSJ Trans Comput Vis Appl, 5:163-175.

[13]Kusakunniran W, Wu Q, Zhang J, et al., 2012. Gait recognition under various viewing angles based on correlated motion regression. IEEE Trans Circ Syst Video Technol, 22(6):966-980.

[14]Li C, Min X, Sun SQ, et al., 2017. DeepGait: a learning deep convolutional representation for view-invariant gait recognition using joint Bayesian. Appl Sci, 7(3):210.

[15]Li X, Makihara Y, Xu C, et al., 2020. Gait recognition invariant to carried objects using alpha blending generative adversarial networks. Patt Recogn, 105:107376.

[16]Lv ZW, Xing XL, Wang KJ, et al., 2015. Class energy image analysis for video sensor-based gait recognition: a review. Sensors, 15(1):932-964.

[17]Makihara Y, Sagawa R, Mukaigawa Y, et al., 2006. Gait recognition using a view transformation model in the frequency domain. Proc European Conf on Computer Vision, p.151-163.

[18]Muramatsu D, Makihara Y, Yagi Y, 2016. View transformation model incorporating quality measures for cross-view gait recognition. IEEE Trans Cybern, 46(7):1602-1615.

[19]Phillips PJ, 2002. Human identification technical challenges. Proc Int Conf on Image Processing, p.49-52.

[20]Rida I, Almaadeed N, Almaadeed S, 2019. Robust gait recognition: a comprehensive survey. IET Biometr, 8(1):14-28.

[21]Sarkar S, Phillips PJ, Liu Z, et al., 2005. The humanid gait challenge problem: data sets, performance, and analysis. IEEE Trans Patt Anal Mach Intell, 27(2):162-177.

[22]Shiraga K, Makihara Y, Muramatsu D, et al., 2016. GEINet: view-invariant gait recognition using a convolutional neural network. Proc Int Conf on Biometrics, p.1-8.

[23]Song CF, Huang YZ, Huang Y, et al., 2019. GaitNet: an end-to-end network for gait based human identification. Patt Recogn, 96:106988.

[24]Wang C, Zhang JP, Wang L, et al., 2012. Human identification using temporal information preserving gait template. IEEE Trans Patt Anal Mach Intell, 34(11):2164-2176.

[25]Wang KJ, Xing XL, Yan T, et al., 2014. Couple metric learning based on separable criteria with its application in cross-view gait recognition. Proc 9^th Chinese Conf on Biometric Recognition, p.347-356.

[26]Wang YY, Song CF, Huang Y, et al., 2019. Learning view invariant gait features with Two-Stream GAN. Neurocomputing, 339:245-254.

[27]Wu ZF, Huang YZ, Wang L, 2015. Learning representative deep features for image set analysis. IEEE Trans Multim, 17(11):1960-1968.

[28]Wu ZF, Huang YZ, Wang L, et al., 2017. A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Trans Patt Anal Mach Intell, 39(2):209-226.

[29]Xing XL, Wang KJ, Yan T, et al., 2016. Complete canonical correlation analysis with application to multi-view gait recognition. Patt Recogn, 50:107-117.

[30]Yu SQ, Tan DL, Tan TN, 2006. A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. Proc 18^th Int Conf on Pattern Recognition, p.441-444.

[31]Yu SQ, Chen HF, Reyes EBG, et al., 2017a. GaitGAN: invariant gait feature extraction using generative adversarial networks. Proc IEEE Conf on Computer Vision and Pattern Recognition Workshops, p.532-539.

[32]Yu SQ, Chen HF, Wang Q, et al., 2017b. Invariant feature extraction for gait recognition using only one uniform model. Neurocomputing, 239:81-93.

[33]Zhang EH, Zhao YW, Xiong W, 2010. Active energy image plus 2DLPP for gait recognition. Signal Process, 90(7):2295-2302.

[34]Zhang P, Wu Q, Xu JS, 2019. VN-GAN: identity-preserved variation normalizing GAN for gait recognition. Proc Int Joint Conf on Neural Networks, p.1-8.