Skip to main content
SpringerLink
Log in

Non-contact video-based estimation of heart rate variability spectrogram from hemoglobin composition

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

Non-contact HR measurement is becoming an active research area. Recently, remote photoplethysmography (rPPG) measurement based on simple skin optics model has been proposed and shown to be effective. In this paper, we propose an accurate remote observation of the heart rate (HR) and heart rate variability (HRV) based on hemoglobin component estimation which is based on a detailed skin optics model. We perform experiments to measure subjects at rest and under cognitive stress with the proposed method putting a polarized filter in front of the camera to evaluate the principle of the framework. From the results of the experiments, the proposed method shows a high correlation with the electrocardiograph (ECG) which is assumed as the ground truth. We also evaluate the proposed method without putting any polarized filter and confirm the usefulness for the remote observation of HRV which requires accurate detection of HR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Verkruysse W, Svaasand LO, Nelson JS (2008) Remote plethysmographic imaging using ambient light. Opt Express 16(26):21434–21445

    Article  Google Scholar 

  2. Poh M-Z, McDuff DJ, Picard RW (2010) Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt Express 18(10):10762–10774

    Article  Google Scholar 

  3. De Haan G, Jeanne V (2013) Robust pulse rate from chrominance-based rPPG. IEEE Trans Biomed Eng 60(10):2878–2886

    Article  Google Scholar 

  4. Pagani M, Furlan R, Pizzinelli P, Crivellaro W, Cerutti S, Malliani A (1989) Spectral analysis of R–R and arterial pressure variabilities to assess sympatho-vagal interaction during mental stress in humans. J Hypertens 7(Suppl):S14–S15

    Article  Google Scholar 

  5. Akselrod S, Gordon D, Ubel FA, Shannon DC, Berger A, Cohen RJ (1981) Power spectrum analysis of heart rate fluctuation: a quantitative probe of beat-to-beat cardiovascular control. Science 213(4504):220–222

    Article  Google Scholar 

  6. McDuff D, Gontarek S, Picard RW (2014) Improvements in remote cardio-pulmonary measurement using a five band digital camera. IEEE Trans Biomed Eng 61(10):2593–2601

    Article  Google Scholar 

  7. Monno Y, Tanaka M, Okutomi M (2012) Multispectral demosaicking using guided filter. In: IS&T/SPIE electronic imaging. International society for optics and photonics, pp 82990O–82990O

  8. MonnoY Kikuchi S, Tanaka M, Okutomi M (2015) A practical one-shot multispectral imaging system using a single image Sensor. IEEE Trans Image Process 24(10):3048–3059

    Article  MathSciNet  Google Scholar 

  9. Tsumura N, Ojima N, Sato K, Shiraishi M, Shimizu H, Nabeshima H, Akazaki S, Hori K, Miyake Y (2003) Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin. ACM Trans Graphics 22(3):770–779

    Article  Google Scholar 

  10. Hiroka M, Firbank M, Essenpreis M, Cope M, Arrige SR, Zee PVD, Delpy DT (1993) A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. Phys Med Biol 38:1859–1876

    Article  Google Scholar 

  11. Martinez B, Valstar MF, Binefa X, Pantic M (2013) Local evidence aggregation for regression-based facial point detection. IEEE Trans Pattern Anal Mach Intell 35(5):1149–1163

    Article  Google Scholar 

  12. Tarvainen MP, Ranta-aho PO, Karjalainen PA (2002) An advanced detrending method with application to HRV analysis. IEEE Trans Biomed Eng 49(2):172–175

    Article  Google Scholar 

  13. Scargle JD (1982) Studies in astronomical time series analysis II—statistical aspects of spectral analysis of unevenly spaced data. Astrophys J 1:835–853

    Article  Google Scholar 

  14. Press William H, Rybicki George B (1989) Fast Algorithm for Spectral Analysis of Unevenly Sampled Data. Astrophys J 338:277–280

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Advanced Integration Science, Chiba University, 1-33 Yayoi-cho, Inage-Ku, Chiba, 263-8522, Japan

    Munenori Fukunishi, Kouki Kurita & Norimichi Tsumura

  2. Tokyo Metropolitan College of Industrial Technology, 8-17-1 Minami-Senjyu, Arakawa-ku, Tokyo, 116-0003, Japan

    Shoji Yamamoto

Authors
  1. Munenori Fukunishi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kouki Kurita
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shoji Yamamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Norimichi Tsumura
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Munenori Fukunishi.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fukunishi, M., Kurita, K., Yamamoto, S. et al. Non-contact video-based estimation of heart rate variability spectrogram from hemoglobin composition. Artif Life Robotics 22, 457–463 (2017). https://doi.org/10.1007/s10015-017-0382-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-017-0382-1

Keywords

Search

Navigation