Artificial Life and Robotics

, Volume 22, Issue 4, pp 457–463 | Cite as

Non-contact video-based estimation of heart rate variability spectrogram from hemoglobin composition

  • Munenori Fukunishi
  • Kouki Kurita
  • Shoji Yamamoto
  • Norimichi Tsumura
Original Article


Non-contact HR measurement is becoming an active research area. Recently, remote photoplethysmography (rPPG) measurement based on simple skin optics model has been proposed and shown to be effective. In this paper, we propose an accurate remote observation of the heart rate (HR) and heart rate variability (HRV) based on hemoglobin component estimation which is based on a detailed skin optics model. We perform experiments to measure subjects at rest and under cognitive stress with the proposed method putting a polarized filter in front of the camera to evaluate the principle of the framework. From the results of the experiments, the proposed method shows a high correlation with the electrocardiograph (ECG) which is assumed as the ground truth. We also evaluate the proposed method without putting any polarized filter and confirm the usefulness for the remote observation of HRV which requires accurate detection of HR.


Heart rate Heart rate variability Non-contact measurement 


  1. 1.
    Verkruysse W, Svaasand LO, Nelson JS (2008) Remote plethysmographic imaging using ambient light. Opt Express 16(26):21434–21445CrossRefGoogle Scholar
  2. 2.
    Poh M-Z, McDuff DJ, Picard RW (2010) Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt Express 18(10):10762–10774CrossRefGoogle Scholar
  3. 3.
    De Haan G, Jeanne V (2013) Robust pulse rate from chrominance-based rPPG. IEEE Trans Biomed Eng 60(10):2878–2886CrossRefGoogle Scholar
  4. 4.
    Pagani M, Furlan R, Pizzinelli P, Crivellaro W, Cerutti S, Malliani A (1989) Spectral analysis of R–R and arterial pressure variabilities to assess sympatho-vagal interaction during mental stress in humans. J Hypertens 7(Suppl):S14–S15CrossRefGoogle Scholar
  5. 5.
    Akselrod S, Gordon D, Ubel FA, Shannon DC, Berger A, Cohen RJ (1981) Power spectrum analysis of heart rate fluctuation: a quantitative probe of beat-to-beat cardiovascular control. Science 213(4504):220–222CrossRefGoogle Scholar
  6. 6.
    McDuff D, Gontarek S, Picard RW (2014) Improvements in remote cardio-pulmonary measurement using a five band digital camera. IEEE Trans Biomed Eng 61(10):2593–2601CrossRefGoogle Scholar
  7. 7.
    Monno Y, Tanaka M, Okutomi M (2012) Multispectral demosaicking using guided filter. In: IS&T/SPIE electronic imaging. International society for optics and photonics, pp 82990O–82990OGoogle Scholar
  8. 8.
    MonnoY Kikuchi S, Tanaka M, Okutomi M (2015) A practical one-shot multispectral imaging system using a single image Sensor. IEEE Trans Image Process 24(10):3048–3059CrossRefMathSciNetGoogle Scholar
  9. 9.
    Tsumura N, Ojima N, Sato K, Shiraishi M, Shimizu H, Nabeshima H, Akazaki S, Hori K, Miyake Y (2003) Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin. ACM Trans Graphics 22(3):770–779CrossRefGoogle Scholar
  10. 10.
    Hiroka M, Firbank M, Essenpreis M, Cope M, Arrige SR, Zee PVD, Delpy DT (1993) A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. Phys Med Biol 38:1859–1876CrossRefGoogle Scholar
  11. 11.
    Martinez B, Valstar MF, Binefa X, Pantic M (2013) Local evidence aggregation for regression-based facial point detection. IEEE Trans Pattern Anal Mach Intell 35(5):1149–1163CrossRefGoogle Scholar
  12. 12.
    Tarvainen MP, Ranta-aho PO, Karjalainen PA (2002) An advanced detrending method with application to HRV analysis. IEEE Trans Biomed Eng 49(2):172–175CrossRefGoogle Scholar
  13. 13.
    Scargle JD (1982) Studies in astronomical time series analysis II—statistical aspects of spectral analysis of unevenly spaced data. Astrophys J 1:835–853CrossRefGoogle Scholar
  14. 14.
    Press William H, Rybicki George B (1989) Fast Algorithm for Spectral Analysis of Unevenly Sampled Data. Astrophys J 338:277–280CrossRefGoogle Scholar

Copyright information

© ISAROB 2017

Authors and Affiliations

  • Munenori Fukunishi
    • 1
  • Kouki Kurita
    • 1
  • Shoji Yamamoto
    • 2
  • Norimichi Tsumura
    • 1
  1. 1.Graduate School of Advanced Integration ScienceChiba UniversityChibaJapan
  2. 2.Tokyo Metropolitan College of Industrial TechnologyTokyoJapan

Personalised recommendations