Heart Rate (HR) is one of the most important Physiological parameter and a vital indicator of people’s physiological state and is therefore important to monitor. Monitoring of HR often involves high costs and complex application of sensors and sensor systems. Research progressing during last decade focuses more on noncontact based systems which are simple, low-cost and comfortable to use. Still most of the noncontact based systems are fit for lab environments in offline situation but needs to progress considerably before they can be applied in real time applications. This paper presents a real time HR monitoring method using a webcam of a laptop computer. The heart rate is obtained through facial skin color variation caused by blood circulation. Three different signal processing methods such as Fast Fourier Transform (FFT), Independent Component Analysis (ICA) and Principal Component Analysis (PCA) have been applied on the color channels in video recordings and the blood volume pulse (BVP) is extracted from the facial regions. HR is subsequently quantified and compared to corresponding reference measurements. The obtained results show that there is a high degrees of agreement between the proposed experiments and reference measurements. This technology has significant potential for advancing personal health care and telemedicine. Further improvements of the proposed algorithm considering environmental illumination and movement can be very useful in many real time applications such as driver monitoring.
[1] G. D. Costa, “Optical remote sensing of heartbeats,” Optics Communications, vol. 117, pp. 395-398, 6/15/ 1995.
[2] C. Puri, J. Levine, L. Olson, I. Pavlidis, and J. Starren, “StressCam: Non-contact Measurement of Users’ Emotional States through Thermal Imaging,” presented at the Extended Abstracts Proceedings of the 2005 Conference on Human Factors in Computing Systems, CHI 2005, Portland, Oregon, USA, 2005.
[3] C. Takano and Y. Ohta, “Heart rate measurement based on a time-lapse image,” Medical Engineering& Physics, vol. 29, pp. 853-857, 10// 2007.
[4] M. Garbey, S. Nanfei, A. Merla, and I. Pavlidis, “Contact-Free Measurement of Cardiac Pulse Based
on the Analysis of Thermal Imagery,” Biomedical Engineering, IEEE Transactions on, vol. 54, pp. 1418-1426, 2007.
[5] K. Humphreys, T. Ward, and C. Markham,“Noncontact simultaneous dual wavelength photoplethysmography: a further step toward noncontact pulse oximetry,” Rev Sci Instrum, vol. 78, p. 044304, Apr 2007.
[6] W. Verkruysse, L. O. Svaasand, and J. S. Nelson, “Remote plethysmographic imaging using ambient light,” Optics express, vol. 16, pp. 21434-21445, 2008.
[7] S. Suzuki, T. Matsui, S. Gotoh, Y. Mori, B. Takase, and M. Ishihara, “Development of Non-contact Monitoring System of Heart Rate Variability (HRV) - An Approach of Remote Sensing for Ubiquitous Technology,” in Ergonomics and
Health Aspects of Work with Computers. vol. 5624, B.-T. Karsh, Ed., ed: Springer Berlin Heidelberg, 2009, pp. 195-203.
[8] J. Wen Jun, G. Shi Chao, P. Wittek, and Z. Li, “Real-time quantifying heart beat rate from facial video recording on a smart phone using Kalman
filters,” in e-Health Networking, Applications and Services (Healthcom), 2014 IEEE 16th
International Conference on, 2014, pp. 393-396.
[9] T. I. Papon, I. Ahmad, N. Saquib, and A. Rahman, “Non-invasive heart rate measuring smartphone applications using on-board cameras: A short survey,” in Networking Systems and Security (NSysS), 2015 International Conference on, 2015,
pp. 1-6.
[10] R. C. Peng, X. L. Zhou, W. H. Lin, and Y. T. Zhang, “Extraction of heart rate variability from smartphone photoplethysmograms,” Computational and Mathematical Methods in Medicine, vol. 2015, pp. 1-11, 2015.
[11] P. Ming-Zher, D. J. McDuff, and R. W. Picard, “Advancements in Noncontact, Multiparameter
Physiological Measurements Using a Webcam,” Biomedical Engineering, IEEE Transactions on, vol. 58, pp. 7-11, 2011.
[12] L. Xiaobai, C. Jie, Z. Guoying, and M. Pietikainen, “Remote Heart Rate Measurement from Face Videos under Realistic Situations,” in Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, 2014, pp. 4264-4271.
[13] M. Lewandowska, J. Ruminski, T. Kocejko, and J. Nowak, “Measuring pulse rate with a webcam- a non-contact method for evaluating cardiac activity,” in Computer Science and Information Systems (FedCSIS), 2011 Federated Conference on, 2011,
pp. 405-410.
[14] D. Shao, C. Liu, F. Tsow, Y. Yang, Z. Du, R. Iriya, et al., “Noncontact Monitoring of Blood Oxygen Saturation Using Camera and Dual-Wavelength Imaging System,” Biomedical Engineering, IEEE Transactions on, vol. PP, pp. 1-1, 2015.
[15] A. Parnandi and R. Gutierrez-Osuna, “Contactless Measurement of Heart Rate Variability from Pupillary Fluctuations,” in Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on, 2013, pp. 191-196.
[16] D. Datcu, M. Cidota, S. Lukosch, and L. Rothkrantz, “Noncontact automatic heart rate analysis in visible spectrum by specific face regions,” presented at the Proceedings of the 14th International Conference on Computer Systems and Technologies, Ruse, Bulgaria, 2013.
[17] V. Foteinos, D. Kelaidonis, G. Poulios, P. Vlacheas, V. Stavroulaki, and P. Demestichas, “Cognitive Management for the Internet of Things: A Framework for Enabling Autonomous Applications,” Vehicular Technology Magazine, IEEE, vol. 8, pp. 90-99, 2013.
[18] J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami, “Internet of Things (IoT): A vision, architectural elements, and future directions,” Future Generation Computer Systems, vol. 29, pp. 1645-1660, 9// 2013.
[19] L. F. Jimenez, A. Parnandi, and R. Gutierrez-Osuna, “Extracting Heart Rate and Respiration rate using cell phone Camera,” 2013.
[20] A. M. Mzahm, M. S. Ahmad, and A. Y. C. Tang, “Agents of Things (AoT): An intelligent operational concept of the Internet of Things (IoT),” in Intelligent Systems Design and Applications (ISDA), 2013 13th International Conference on, 2013, pp. 159-164.
[21] F. Zhao, M. Li, Y. Qian, and J. Z. Tsien, “Remote Measurements of Heart and Respiration Rates for Telemedicine,” PLoS ONE, vol. 8, p. e71384, 2013.
[22] Z. Qi, X. Guo-qing, W. Ming, Z. Yimin, and F. Wei, “Webcam based non-contact real-time monitoring for the physiological parameters of drivers,” in Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), 2014 IEEE 4th Annual International Conference on, 2014, pp. 648-652.
[23] G. Zhenyu, Z. J. Wang, and S. Zhiqi, “Physiological parameter monitoring of drivers based on video data and independent vector analysis," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on, 2014, pp. 4374-4378.
[24] F. Bousefsaf, C. Maaoui, and A. Pruski, “Remote assessment of physiological parameters by noncontact technologies to quantify and detect mental stress states,” in Control, Decision and Information Technologies (CoDIT), 2014 International Conference on, 2014, pp. 719-723.
[25] M. Gerla, L. Eun-Kyu, G. Pau, and L. Uichin, “Internet of vehicles: From intelligent grid to autonomous cars and vehicular clouds,” in Internet of Things (WF-IoT), 2014 IEEE World Forum on, 2014, pp. 241-246.
[26] W. Karlen, A. Garde, D. Myers, C. Scheffer, J. M. Ansermino, and G. A. Dumont, “Respiratory rate assessment from photoplethysmographic imaging,” in Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, 2014, pp. 5397-5400.
[27] A. Khelil and D. Soldani, “On the suitability of Device-to-Device communications for road traffic safety,” in Internet of Things (WF-IoT), 2014 IEEE World Forum on, 2014, pp. 224-229.
[28] J. Kranjec, S. Beguš, G. Geršak, and J. Drnovšek, “Non-contact heart rate and heart rate variability measurements: A review,” Biomedical Signal Processing and Control, vol. 13, pp. 102-112, 2014.
[29] P. P. Ray, “Home Health Hub Internet of Things (H<sup>3</sup>IoT): An architectural framework for monitoring health of elderly people,” in Science Engineering and Management Research (ICSEMR), 2014 International Conference on, 2014, pp. 1-3.
[30] T. Smilkstein, M. Buenrostro, A. Kenyon, M. Lienemann, and G. Larson, “Heart rate monitoring using Kinect and color amplification," in Healthcare Innovation Conference (HIC), 2014 IEEE, 2014, pp. 60-62.
[31] H. Xiaochuan, R. A. Goubran, and X. P. Liu, “Using Eulerian video magnification framework to measure pulse transit time,” in Medical Measurements and Applications (MeMeA), 2014 IEEE International Symposium on, 2014, pp. 1-4.
[32] H. Rahman, M. U. Ahmed, and S. Begum, “Noncontact Physiological Parameters Extraction using Camera,” in The 1st Workshop on Embedded Sensor Systems for Health through Internet of Things (ESS-H IoT), Oct., 2015.
[33] P. Comon, “Independent Component Analysis, a new Concept,” Signal Process., vol. 36, pp. 287–314, 1994.
[34] J. F. Cardoso and A. Souloumiac, “Blind beamforming for non-Gaussian signals,” Radar and Signal Processing, IEE Proceedings F, vol. 140, pp. 362-370, 1993.
[35] M. A. Kramer, “Nonlinear principal component analysis using autoassociative neural networks,” AIChE Journal, vol. 37, pp. 233-243, 1991.
[36] H. Buijs, A. Pomerleau, M. Fournier, and W. Tam, “Implementation of a fast Fourier transform (FFT) for image processing applications,” Acoustics, Speech and Signal Processing, IEEE Transactions on, vol. 22, pp. 420-424, 1974.
[37] T. M. Liu, H. J. Zhang, and F. H. Qi, “A novel video key frame extraction algorithm,” in Circuits and Systems, 2002. ISCAS 2002. IEEE International Symposium on, 2002, pp. IV-149-IV-152 vol.4.
[38] P. Viola and M. Jones, “Robust real-time face detection,” in Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on, 2001, pp. 747-747.
[39] Z. Deng-feng, Y. Shui-sheng, and H. Shao-hua, “Research on Application of Region-of-Interest in Face Detection,” in Intelligent Information Technology and Security Informatics (IITSI), 2010 Third International Symposium on, 2010, pp. 192-194.
[40] G. Akti and D. Goularas, “Frequency component extraction from color images for specific sound transformation and analysis,” in Image Processing Theory, Tools and Applications (IPTA), 2012 3rd International Conference on, 2012, pp. 253-258.
[41] M. P. Tarvainen, P. O. Ranta-aho, and P. A. Karjalainen, “An advanced detrending method with application to HRV analysis,” Biomedical Engineering, IEEE Transactions on, vol. 49, pp. 172-175, 2002.
[42] K. K. Sundaram and V. Ramachandran, “Analysis of the coefficients of generalized bilinear transformation in the design of 2-D band-pass and band-stop filters and an application in image processing,” in Electrical and Computer Engineering, 2005. Canadian Conference on, 2005, pp. 1233-1236.
[43] D. Cochran, “A consequence of signal normalization in spectrum analysis,” in Acoustics, Speech, and Signal Processing, 1988. ICASSP-88., 1988 International Conference on, 1988, pp. 2388-2391 vol.4.
[44] H. Rahman, S. Barua, and S. Begum, “Intelligent Driver Monitoring Based on Physiological Sensor Signals: Application Using Camera,” in Intelligent Transportation Systems (ITSC), 2015 IEEE 18th International Conference on, 2015, pp. 2637-2642.
[45] H. Rahman, S. Begum, and M. U. Ahmed, “Driver Monitoring in the Context of Autonomous Vehicle,” in 13th Scandinavian Conf. on Artificial Intelligence, Halmstad, Sweden, 2015.
[46] S. Begum, S. Barua, and M. U. Ahmed, “Physiological Sensor Signals Classification for Healthcare using Sensor Data Fusion and Case-Based Reasoning,” Sensors (Special Issue on Sensors Data Fusion for Healthcare), vol. 7, Jul. 2014.
