SpringerLink
Log in

Non-contact heart rate measurement using low-cost RGB camera under complex light conditions

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A non-contact heart rate measurement method using low-cost RGB video is proposed in this study. Only an RGB video of a human wrist is required as input for the proposed method. The method consists of spatial processing, gray value compensation, temporal processing, and heart rate measurement. Spatial processing runs firstly for preliminary image noise reduction. Gray value compensation is then used to compensate for the impact of ambient light changes. Temporal processing is used for pixel-by-pixel bandpass filtering. The filtered data is used at last for heart rate measurement. Experiments under various camera-wrist distances and light intensities are conducted to verify the effectiveness of the proposed method. Results show that the average measurement accuracy improves by 2.2 % and 1.9 % respectively by the gray value compensation algorithm under different camera-wrist distances and light intensities. High measurement accuracy can be obtained when the camera-wrist distance is within 10 cm and the light intensity is more than 400 lux.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price includes VAT (Thailand)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Algorithm 2
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availibility Statement

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Bansal P, Malik M, Kundu R (2018) Smart heart rate monitoring system. 2018 IEEMA Engineer Infinite Conference (eTechNxT) pp 1–4. https://doi.org/10.1109/ETECHNXT.2018.8385347

  2. Luo J, Yan Z, Guo S et al (2021) Recent Advances in Atherosclerotic Disease Screening Using Pervasive Healthcare. IEEE Rev Biomed Eng 15:293–308. https://doi.org/10.1109/RBME.2021.3081180

    Article  Google Scholar 

  3. Lakshmi Devi R, Kalaivani V, Velammal B L (2021) Adaptive neuro-fuzzy inference healthcare system for cardiac arrhythmia detection using heart rate variability features. Advances in Automation, Signal Processing, Instrumentation, and Control. Springer, Singapore. 2167–2174. https://springer.longhoe.net/chapter/10.1007%2F978-981-15-8221-9_201

  4. Georgiou Konstantinos et al (2018) Can wearable devices accurately measure heart rate variability? A systematic review. Folia Med 60(1):7–20. https://doi.org/10.2478/folmed-2018-0012

    Article  Google Scholar 

  5. Lambert K, Merci B, Gryspeert C et al (2021) Search & rescue operations during interior firefighting: A study into crawling speeds. Fire Safety J 121:103269. https://doi.org/10.1016/j.firesaf.2020.103269

  6. Levin E, Zarnowski A, McCarty JL, Bialas J, Banaszek A (2016) Feasibility study of inexpensive thermal sensors and small UAS deployment for living human detection in rescue missions application scenarios. Remote Sens Spat Inf Sci 8:99–103. https://doi.org/10.5194/isprs-archives-XLI-B8-99-2016

    Article  Google Scholar 

  7. Li C, Peng Z, Huang TY et al (2017) A review on recent progress of portable short-range noncontact microwave radar systems. IEEE T Microw Theory 65(5):1692–1706. https://doi.org/10.1109/TMTT.2017.2650911

    Article  Google Scholar 

  8. Chen S, Wu N, Ma L et al (2018) Noncontact heartbeat and respiration monitoring based on a hollow microstructured self-powered pressure sensor. Acs Appl Mater Inter 10(4):3660–3667. https://doi.org/10.1021/acsami.7b17723

    Article  Google Scholar 

  9. Chen X, Cheng J, Song R et al (2018) Video-based heart rate measurement: Recent advances and future prospects. IEEE T Instrum Meas 68(10):3600–3615. https://doi.org/10.1109/TIM.2018.2879706

    Article  Google Scholar 

  10. Nowara EM, Marks TK, Mansour H et al (2020) Near-infrared imaging photoplethysmography during driving. IEEE T Intell Transp 1–12. https://doi.org/10.1109/TITS.2020.3038317

  11. Ren L, Kong L, Foroughian F et al (2017) Comparison study of noncontact vital signs detection using a Doppler stepped-frequency continuous-wave radar and camera-based imaging photoplethysmography. IEEE T Microw Theory 65(9):3519–3529. https://doi.org/10.1109/TMTT.2017.2658567

    Article  Google Scholar 

  12. Rouast PV, Adam MTP, Chiong R et al (2018) Remote heart rate measurement using low-cost RGB face video: a technical literature review. Front Comput SCI-chi 12(5):858–872. https://doi.org/10.1007/s11704-016-6243-6

    Article  Google Scholar 

  13. Sanyal S, Nundy KK (2018) Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face. IEEE J Transl Eng He 6:1–11. https://doi.org/10.1109/JTEHM.2018.2818687

    Article  Google Scholar 

  14. Chen X, Cheng J, Song R et al (2018) Video-based heart rate measurement: Recent advances and future prospects. IEEE T Instrum Meas 68(10):3600–3615. https://doi.org/10.1109/TIM.2018.2879706

    Article  Google Scholar 

  15. Zaunseder S, Vehkaoja A, Fleischhauer V (2022) Signal-to-noise ratio is more important than sampling rate in beat-to-beat interval estimation from optical sensors. Biomed Signal Proces 74:103538. https://doi.org/10.1016/j.bspc.2022.103538

  16. Matsumura K, Toda S, Kato Y (2020) RGB and near-infrared light reflectance/transmittance photoplethysmography for measuring heart rate during motion. IEEE Access 8:80233–80242. https://doi.org/10.1109/ACCESS.2020.2990438

    Article  Google Scholar 

  17. Lin YC, Lin YH (2017) A study of color illumination effect on the SNR of rPPG signals. 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE 4301–4304. https://doi.org/10.1109/EMBC.2017.8037807

  18. Verkruysse W, Svaasand LO, Nelson JS (2008) Remote plethysmographic imaging using ambient light. Opt Express 16:21434–21445. https://doi.org/10.1364/OE.16.021434

    Article  Google Scholar 

  19. Scherpf M, Ernst H, Misera L, et al (2021) Skin Segmentation for Imaging Photoplethysmography Using a Specialized Deep Learning Approach. 2021 Computing in Cardiology (CinC) 48:1–4. https://doi.org/10.23919/CinC53138.2021.9662682

  20. Woyczyk A, Fleischhauer V, Zaunseder S (2020) Skin segmentation using active contours and gaussian mixture models for heart rate detection in videos. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 312–313. https://doi.org/10.1109/CVPRW50498.2020.00164

  21. Kamshilin AA, Zaytsev VV, Mamontov OV (2017) Novel contactless approach for assessment of venous occlusion plethysmography by video recordings at the green illumination. Sci Rep 7(1):1–9. https://doi.org/10.1038/s41598-017-00552-7

    Article  Google Scholar 

  22. Iakovlev D, Hu S, Dwyer V (2018) Frame registration for motion compensation in imaging photoplethysmography. Sensors 18(12):4340. https://doi.org/10.3390/s18124340

    Article  Google Scholar 

  23. Poh MZ, McDuff DJ, Picard RW (2010) Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Optics Express 18(10):10762–10774. https://doi.org/10.1364/OE.18.010762

    Article  Google Scholar 

  24. Lewandowska M, Nowak J (2012) Measuring pulse rate with a webcam. J Med Imag Health 2(1):87–92. https://doi.org/10.1166/jmihi.2012.1064

    Article  Google Scholar 

  25. Qi H, Guo Z, Chen X (2017) Video-based human heart rate measurement using joint blind source separation. Biomed Signal Proces 31:309–320. https://doi.org/10.1016/j.bspc.2016.08.020

    Article  Google Scholar 

  26. Macwan R, Benezeth Y, Mansouri A (2018) Remote photoplethysmography with constrained ICA using periodicity and chrominance constraints. Biomed Eng Online 17(1):1–22. https://doi.org/10.1186/s12938-018-0450-3

    Article  Google Scholar 

  27. Pai A, Veeraraghavan A, Sabharwal A (2021) HRVCam: robust camera-based measurement of heart rate variability. J Biomed Opt 26(2):022707. https://doi.org/10.1117/1.JBO.26.2.022707

    Article  Google Scholar 

  28. De Haan G, Van Leest A (2014) Improved motion robustness of remote-PPG by using the blood volume pulse signature. Physiol Meas 35(9):1913. https://doi.org/10.1088/0967-3334/35/9/1913

    Article  Google Scholar 

  29. Huang RY, Dung LR (2015) A motion-robust contactless photoplethysmography using chrominance and adaptive filtering. IEEE Biomed Circ Syst Conf (BioCAS) 1–4. https://doi.org/10.1109/BioCAS.2015.7348451

  30. Cheng J, Chen X, Xu L et al (2016) Illumination variation-resistant video-based heart rate measurement using joint blind source separation and ensemble empirical mode decomposition. IEEE J Biomed Health 21(5):1422–1433. https://doi.org/10.1109/JBHI.2016.2615472

    Article  Google Scholar 

  31. Yue H, Li X, Cai K et al (2020) Non-contact heart rate detection by combining empirical mode decomposition and permutation entropy under non-cooperative face shake. Neurocomputing 392:142–152. https://doi.org/10.1016/j.neucom.2018.09.100

    Article  Google Scholar 

  32. Li S, Wang H, Wang S et al (2020) Life detection and non-contact respiratory rate measurement in cluttered environments. Multimed Tools Appl 79(43):32065–32077. https://doi.org/10.1007/s11042-020-09510-4

    Article  Google Scholar 

  33. Sommer LW, Teutsch M, Schuchert T et al (2016) A survey on moving object detection for wide area motion imagery. 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) pp 1–9. https://doi.org/10.1109/WACV.2016.7477573

  34. Kumdee O, Ritthipravat P (2015) Repetitive motion detection for human behavior understanding from video images. IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Abu Dhabi pp 484–489. https://doi.org/10.1109/ISSPIT.2015.7394384

Download references

Acknowledgements

This work was supported in part by the Natural science Research Foundation of JCET [grant number GYKY/2023/1] and Jiangsu natural science research project [grant number 23KJD410001].

Author information

Authors and Affiliations

  1. School of intelligent manufacturing, Jiangsu College of Engineering and Technology, Nantong, 226000, China

    Haipeng Wang

  2. Center for Psychological Sciences, Zhejiang University, Hangzhou, 310058, China

    Shuai Zhang

Authors
  1. Haipeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuai Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haipeng Wang.

Ethics declarations

Conflict of Interests/Competing Interests

The authors declare that they have no conflict/competing of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, H., Zhang, S. Non-contact heart rate measurement using low-cost RGB camera under complex light conditions. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-19115-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-19115-w

Keywords

Search

Navigation