Predicting Three-Dimensional Gait Parameters with a Single Camera Video Sequence

Regular Paper
  • 4 Downloads

Abstract

Human gait reflects biomedical conditions and thus can potentially be used for identification. With the increasing utility of CCTVs for surveillance, there have been various attempts to recognize persons using gait image sequences from a single camera. We investigated the accuracy of estimating body segment lengths and joint angles during gait calculated from a video sequence using a gait database. We recruited 30 subjects and collected motion capture data during walking and extracted the trajectories of 17 body points. Principal component analysis (PCA) was applied to the collected gait. We implemented full gait cycle-based (FGC) PCA and gait-phase-specific (GPS) PCA. Three-dimensional poses were estimated from gait event frames using FGC-PCA and GPS-PCA. The estimated poses in discrete gait event frames were interpolated to estimate motion during a full gait cycle. The body pose from GPSPCA was less sensitive to camera angles and smaller errors compared to FGC-PCA. The segment lengths of the upper arm (r=0.79), lower arm (r=0.63), upper leg (r=0.86), and lower leg (r=0.81) were highly correlated with the lengths obtained from the motion capture data. Three-dimensionally reconstructed human motion can reveal personal biometric information and has the potential to be used for human identification.

Keywords

Gait recognition Segment length Three-dimensional pose estimation Video surveillance 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Jain, A. K., Ross, A., and Prabhakar, S., “An Introduction to Biometric Recognition,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 14, no. 1, pp. 4–20, 2004.CrossRefGoogle Scholar
  2. 2.
    Purevsuren, T., Kim, K., Nha, K. W., and Kim, Y. H. “Evaluation of Compressive and Shear Joint Forces on Medial and Lateral Compartments in Knee Joint during Walking Before and after Medial Open-Wedge High Tibial Osteotomy,” International Journal of Precision Engineering and Manufacturing, vol. 17, no. 10, pp. 1365–1370, 2016.CrossRefGoogle Scholar
  3. 3.
    Ko, C. Y., Ko, J., Kim, H. J., and Lim, D., “New Wearable Exoskeleton for Gait Rehabilitation Assistance Integrated with Mobility System,” International Journal of Precision Engineering and Manufacturing, vol. 17, no. 7, pp. 957–964, 2016.CrossRefGoogle Scholar
  4. 4.
    Jeong, J. Y. and Shin, C. S., “The Effect of Gender and Foot Landing Type on Lower Extremity Biomechanics during Single-Leg Landing,” Journal of the Korean Society for Precision Enginering, vol. 35, no. 1, pp. 33–39, 2018.CrossRefGoogle Scholar
  5. 5.
    Kim, J. W., Kwon, Y. R., and Eom, G. M., “Analysis of Dynamic Balance Against Perturbation in Young and Elderly Subjects,” Journal of the Korean Society for Precision Enginering, vol. 35, no. 1, pp. 47–51, 2018.CrossRefGoogle Scholar
  6. 6.
    Sarkar, S., Phillips, P. J., Liu, Z., Vega, I. R., Grother, P., and Bowyer, K. W., “The Humanid Gait Challenge Problem: Data Sets, Performance, and Analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 162–177, 2005.CrossRefGoogle Scholar
  7. 7.
    Wang, L., Tan, T., Ning, H., and Hu, W., “Silhouette Analysis-Based Gait Recognition for Human Identification,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1505–1518, 2003.CrossRefGoogle Scholar
  8. 8.
    Lee, L. and Grimson, W. E. L., “Gait Analysis for Recognition and Classification,” Proc. of 5th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 155–162, 2002.CrossRefGoogle Scholar
  9. 9.
    Kale, A., Sundaresan, A., Rajagopalan, A., Cuntoor, N. P., Roy-Chowdhury, A. K., et al., “Identification of Humans Using Gait,” IEEE Transactions on Image Processing, vol. 13, no. 9, pp. 1163–1173, 2004.CrossRefGoogle Scholar
  10. 10.
    Collins, R. T., Gross, R., and Shi, J., “Silhouette-Based Human Identification from Body Shape and Gait,” Proc. of 5th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 366–371, 2002.CrossRefGoogle Scholar
  11. 11.
    Wang, L., Tan, T., Hu, W., and Ning, H., “Automatic Gait Recognition Based on Statistical Shape Analysis,” IEEE Transactions on Image Processing, vol. 12, no. 9, pp. 1120–1131, 2003.MathSciNetCrossRefGoogle Scholar
  12. 12.
    Liu, Z. and Sarkar, S., “Simplest Representation Yet for Gait Recognition: Averaged Silhouette,” Proc. of 17th International Conference on Pattern Recognition, pp. 211–214, 2004.Google Scholar
  13. 13.
    Han, J. and Bhanu, B., “Statistical Feature Fusion for Gait-Based Human Recognition,” Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 842–847, 2004.Google Scholar
  14. 14.
    Cunado, D., Nixon, M. S., and Carter, J. N., “Automatic Extraction and Description of Human Gait Models for Recognition Purposes,” Computer Vision and Image Understanding, vol. 90, no. 1, pp. 1–41, 2003.CrossRefGoogle Scholar
  15. 15.
    Bobick, A. F. and Johnson, A. Y., “Gait Recognition Using Static, Activity-Specific Parameters,” Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 423–430, 2001.Google Scholar
  16. 16.
    Tanawongsuwan, R. and Bobick, A., “Gait Recognition from Time-Normalized Joint-Angle Trajectories in the Walking Plane,” Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 726–731, 2001.Google Scholar
  17. 17.
    Lynnerup, N. and Vedel, J., “Person Identification by Gait Analysis and Photogrammetry,” Journal of Forensic Science, Vol. 50, No. 1, pp. JFS2004054-2004057, 2005.Google Scholar
  18. 18.
    Bouchrika, I., Goffredo, M., Carter, J., and Nixon, M., “On Using Gait in Forensic Biometrics,” Journal of Forensic Sciences, vol. 56, no. 4, pp. 882–889, 2011.CrossRefGoogle Scholar
  19. 19.
    Simo-Serra, E., Ramisa, A., Alenyà, G., Torras, C., and Moreno-Noguer, F., “Single Image 3D Human Pose Estimation from Noisy Observations,” Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2673–2680, 2012.Google Scholar
  20. 20.
    Wang, C., Wang, Y., Lin, Z., Yuille, A. L., and Gao, W., “Robust Estimation of 3D Human Poses from a Single Image,” Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2361–2368, 2014.Google Scholar
  21. 21.
    Ramakrishna, V., Kanade, T., and Sheikh, Y., “Reconstructing 3D Human Pose from 2D Image Landmarks,” Proc. of European Conference on Computer Vision, pp. 573–586, 2012.Google Scholar
  22. 22.
    Chen, Y.-L. and Chai, J., “3D Reconstruction of Human Motion and Skeleton from Uncalibrated Monocular Video,” Proc. of Asian Conference on Computer Vision, pp. 71–82, 2009.Google Scholar
  23. 23.
    Wandt, B., Ackermann, H., and Rosenhahn, B., “3D Reconstruction of Human Motion from Monocular Image Sequences,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 8, pp. 1505–1516, 2016.CrossRefGoogle Scholar
  24. 24.
    Gotardo, P. F. and Martinez, A. M., “Non-Rigid Structure from Motion with Complementary Rank-3 Spaces,” Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3065–3072, 2011.Google Scholar
  25. 25.
    Park, H. S., Shiratori, T., Matthews, I., and Sheikh, Y., “3D Reconstruction of a Moving Point from a Series of 2D Projections,” Proc. of European Conference on Computer Vision, pp. 158–171, 2010.Google Scholar
  26. 26.
    Kim, C. Y., Hong, J. S., and Chun, K. J., “Validation of Feasibility of Two Depth Sensor-Based Microsoft Kinect Cameras for Human Abduction-Adduction Motion Analysis,” International Journal of Precision Engineering and Manufacturing, Vol. 17, No. 9, 1209–1214, 2016.CrossRefGoogle Scholar
  27. 27.
    Tomasi, C. and Kanade, T., “Shape and Motion from Image Streams under Orthography: A Factorization Method,” International Journal of Computer Vision, vol. 9, no. 2, pp. 137–154, 1992.CrossRefGoogle Scholar
  28. 28.
    Goffredo, M., Carter, J. N., and Nixon, M. S., “Front-View Gait Recognition,” Proc. of 2nd IEEE International Conference on Biometrics: Theory, Applications and Systems, pp. 1–6, 2008.Google Scholar
  29. 29.
    Winter, D. A., “Human Balance and Posture Control during Standing and Walking,” Gait & Posture, vol. 3, no. 4, pp. 193–214, 1995.CrossRefGoogle Scholar
  30. 30.
    Ge, Q. J. and Ravani, B., “Geometric Construction of Bézier Motions,” Journal of Mechanical Design, vol. 116, no. 3, pp. 749–755, 1994.CrossRefGoogle Scholar
  31. 31.
    Meredith, M. and Maddock, S., “Motion Capture File Formats Explained,” Department of Computer Science, University of Sheffield, vol. 211, pp. 241–244, 2001.Google Scholar
  32. 32.
    Shoemake, K., “Animating Rotation with Quaternion Curves,” Proc. of the 12th Annual Conference on Computer Graphics and Interactive Techniques, pp. 245–254, 1985.Google Scholar

Copyright information

© Korean Society for Precision Engineering and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Mechanical EngineeringChung-Ang UniversitySeoulRepublic of Korea

Personalised recommendations