Designing a Posture Analysis System with Hardware Implementation

  • J. G. F. CoutinhoEmail author
  • M. P. T. Juvonen
  • J. L. Wang
  • B. L. Lo
  • W. Luk
  • O. Mencer
  • G. Z. Yang


Posture analysis is an active research area in computer vision for applications such as home care and security monitoring. This paper describes the design of a system for posture analysis with hardware acceleration, addressing the following four aspects: (a) a design workflow for posture analysis based on radial shape and projection histogram representations; (b) the implementation of different architectures based on a high-level hardware design approach with support for automating transformations to improve parallelism and resource optimisation; (c) accuracy evaluation of the proposed posture analysis system, and (d) performance evaluation for the derived designs. One of the designs, which targets a Xilinx XC2V6000 FPGA at 90.2 MHz, is able to perform posture analysis at a rate of 1,164 frames per second with a frame size of 320 by 240 pixels. It represents 3.5 times speedup over optimised software running on a 2.4 GHz AMD Athlon 64 3700+ computer. The frame rate is well above that of real-time video, which enables the sharing of the FPGA among multiple video sources.


posture analysis gait analysis hardware compilation FPGA ubiquitous sensor networks 



The support of DTI Next Wave Programme, Fundação para a Ciência e Tecnologia (Grant number SFRH/BD/3354/2000), UK Engineering and Physical Sciences Research Council (Grant number EP/C 509625/1 and EP/C 549481/1), Celoxica Limited and Xilinx, Inc. is gratefully acknowledged. Furthermore, we thank the reviewers for their useful suggestions.


  1. 1.
    Advanced Micro Devices (AMD) Inc.,
  2. 2.
    A. Azarbayejani, C. Wren, and A. Pentland, “Real-time 3D Tracking of the Human Body,” in Proc. of IMAGE’COM 96, 1996.Google Scholar
  3. 3.
    T. Boult, “Frame-rate Multibody Tracking for Surveillance,” in Proc. of DARPA Image Understanding Workshop, 1998.Google Scholar
  4. 4.
  5. 5.
    C. C. Cheung, W. Luk, and P. Y. K. Cheung, “Reconfigurable Elliptic Curve Cryptosystem on a Chip,” in Proc. Int. Conf. on Design Automation and Test in Europe (DATE), vol. 1, 2005, pp. 24–29.Google Scholar
  6. 6.
    J. G. F. Coutinho, J. Jiang, and W. Luk, “Interleaving Behavioural and Cycle-accurate Descriptions for Reconfigurable Hardware Compilation,” in IEEE Symposium on Field-Programmable Custom Computing Machines, 2005.Google Scholar
  7. 7.
    D. M. Gavrila, “The Visual Analysis of Human Movement: A Survey,” Comput. Vis. Image Underst., vol. 73, no. 1, 1999, pp. 82–98.zbMATHCrossRefGoogle Scholar
  8. 8.
    S. Ghiasi, H. J. Moon, A. Nahapetian, and M. Sarrafzadeh, “Collaborative and Reconfigurable Object Tracking,” J. Supercomput., vol. 30, 2004, pp. 213–238.CrossRefGoogle Scholar
  9. 9.
    E. Grimson and C. Stauffer, “Adaptive Background Mixture Models for Real Time Tracking,” in Proc. of the Computer Vision and Pattern Recognition Conference, 1999.Google Scholar
  10. 10.
    I. Haritaoglu, D. Harwood, and L. S. Davis, “W4: Real-time Surveillance of People and their Activities,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, 2000, pp. 809–830.CrossRefGoogle Scholar
  11. 11.
    Intel Corporation,
  12. 12.
    M. P. T. Juvonen, J. G. F. Coutinho, J. L. Wang, B. L. Lo, W. Luk, O. Mencer, and G. Z. Yang, “Custom Hardware Architectures for Posture Analysis,” in IEEE International Conference on Field Prog. Tech., 2005.Google Scholar
  13. 13.
    A. Lipton, H. Fujiyoshi, and H. Patil, “Moving Target Detection and Classification from Real-time Video,” in Proc. of the IEEE Workshop Application of Computer Vision, 1998.Google Scholar
  14. 14.
    B. Lo, J. L. Wang, and G. Z. Yang, “From Imaging Networks to Behavior Profiling: Ubiquitous Sensing for Managed Homecare of the Elderly,” in Adjunct Proc. of the 3rd International Conference on Pervasive Computing, May 2005.Google Scholar
  15. 15.
    W. Luk, T. K. Lee, J. R. Rice, P. Y. K. Cheung, and N. Shirazi, “Reconfigurable Computing for Augmented Reality,” in Proc. of the IEEE Symposium on Field-Programmable Custom Computing Machines, 1999, pp. 136–145.Google Scholar
  16. 16.
    O. Mencer and W. Luk, “Parameterized High Throughput Function Evaluation for FPGAs,” J. VLSI Signal Process., vol. 36, no. 1, 2004, pp. 17–25.CrossRefGoogle Scholar
  17. 17.
    T. Olson and F. Brill, “Moving Object Detection and Event Recognition Algorithms for Smart Cameras,” in Proc. of DARPA Image Understanding Workshop, 1997, pp. 159–175.Google Scholar
  18. 18.
    J. M. Rehg, M. Loughlin, and K. Waters, “Vision for a Smart Kiosk,” in IEEE Conference Computer Vision and Pattern Recognition, 1997.Google Scholar
  19. 19.
    G. Stitt, F. Vahid, and S. Nematbakhsh, “Energy Savings and Speedups from Partitioning Critical Software Loops to Hardware in Embedded Systems,” in ACM Trans. on Embedded Computing Systems, vol. 3, no. 1, 2004, pp. 218–232.CrossRefGoogle Scholar
  20. 20.
    TriMedia TM1300,
  21. 21.
    J. Verghese et al., “Abnormality of Gait as Predictor of Non-Alzheimer’s Dementia,” N. Engl. J. Med., vol. 347, no. 22, 2002, pp. 1761–1768.CrossRefGoogle Scholar
  22. 22.
    J. Villasenor, B. Schoner, K. Chia, and C. Zapata, “Configurable Computing Solutions for Automatic Target Recognition,” in Proc. IEEE Symposium on FPGAs for Custom Computing Machines, 1996, pp. 70–79.Google Scholar
  23. 23.
    L. Wang, W. Hu, and T. Tan, “Recent Developments in Human Motion Analysis,” Pattern Recogn., vol. 36, no. 3, 2003, pp. 585–601.CrossRefGoogle Scholar
  24. 24.
    C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, “Pfinder: Real-time Tracking of the Human Body,” in Pfinder: Real-time Tracking of the Human Body, vol. 19, no. 7, 1997, pp. 780–785.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • J. G. F. Coutinho
    • 1
    Email author
  • M. P. T. Juvonen
    • 1
  • J. L. Wang
    • 1
  • B. L. Lo
    • 1
  • W. Luk
    • 1
  • O. Mencer
    • 1
  • G. Z. Yang
    • 1
  1. 1.Department of ComputingImperial College LondonLondonUK

Personalised recommendations