Abstract
Robust eye state classification in real-time is very crucial for automatic driver drowsiness detection to avoid road accidents. In this paper, we propose partial least squares (PLS) analysis based eye state classification method and its real-time implementation on resource constraint digital video processor platform, to monitor the eye state during all time driving conditions. The drowsiness is detected using percentage of eye closure (PERCLOS) metric. In this approach, face in the infrared (IR) image is detected using Haar features based cascaded classifier and within the face, eye is detected. For binary eye state classification, PLS analysis is applied to obtain the low dimensional discriminative subspace, within which simple PLS regression score based classifier is used to classify test vector into open and closed. We compared our algorithm to recent methods on challenging test sequences and the result shows superior performance. The results obtained during on-vehicle testing show that the proposed system achieves significant improvement in classification accuracy at nearly 3 frames per second.
Similar content being viewed by others
References
2014 Traffic safety culture index (2015). AAA Foundation for Traffic Safety, Washington.
Liu, C., & Subramanian, R. (2009). Factors related to fatal single-vehicle run-off-road crashes. National Highway Traffic Safety Administration, DOT HS, 811, 232.
Gupta, S., Kar., S., & Routray, A. (2010). Fatigue in human drivers: A study using ocular, psychometric, physiological signals. Proceedings of IEEE. Students Technology Symposium, 234–240..
Liu, C., Hosking, S. G., & Lenn, M. G. (2009). Predicting driver drowsiness using vehicle measures: recent insights and future challenges. Journal of Safety Research, 40(4), 239–245.
Patel, M., Lal, S. L., Kavanagh, D., & Rossitier, P. (2011). Applying neural network analysis on heart rate variability data to assess driver fatigue. Journal of Expert Systems with Applications, 38(6), 7235–7242.
Tran, Y., Craig, A., Wijesuriya, N., & Nguyen, H. (2010). Improving classification rates for use in fatigue countermeasure devices using brain activity. In Proceedings of IEEE international conference on engineering in medicine and biology society (pp. 1887–1892).
Shuyan, H., & Gangtie, Z. (2009). Driver drowsiness detection with eyelid related parameters by support vector machine. Journal of Expert Systems with Applications, 36(4), 7651–7658.
Rongben, W., Lie, G., Bingliang, T., & Lisheng, J. (2004). Monitoring mouth movement for driver fatigue or distraction with one camera. In Proceedings of IEEE international conference on intelligent transportation systems (pp. 314–319).
Vural, E., Cetin, M., Ercil, A., Littlewort, G., Bartlett, M., & Movellan, J. (2007). Drowsy driver detection through facial movement analysis. Lecture Notes in Computer Science, 4796, 6–18.
Dongwook, L., Seungwon, O., Seongkook, H., & Minsoo, H. (2008). Drowsy driving detection based on the driver’s head movement using infrared sensors (pp. 231–236). Communication: International Symposium on Universal.
Dasgupta, A., George, A., Happy ,& S. L., Routray, A. (2013). A vision-based system for monitoring loss of attention in automotive drivers. IEEE Transactions on Intelligent Transportation Systems, 14(4), 1825–1838.
Jo, J., Lee, S. J., Park, K. R., Kim, I., & Kim, J. (2014). Detection driver drowsiness using feature-level fusion and user-specific classification. Journal of Expert Systems with Applications, 41(4), 1139–1152.
Jo, J., Lee, S. J., Jung, H. G., Park, K. R., Kim, I., & Kim, J. (2011). A vision-based method for detecting driver’s drowsiness and distraction in driver monitoring system. Optical Engineering, 50(11), 1–24.
Kisacanin, B., & Nikolic, Z. (2010). Algorithmic and software techniques for embedded vision on programmable processors. Signal Processing: Image Communication, 25(5), 352–362.
Yang, M. H., Kriegman, D. J., & Ahuja, N. (2002). Detecting faces in images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), 34–58.
Zhang, C., & Zhang, Z. Y. (2010). A survey in recent advances in face detection. Technical Report, 66, Microsoft Research.
Rowley, H. A., Balija, S., & Kanade., T. (1998). Neural network based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(1), 23–38.
Chai, D., & Ngan, K. N. (1999). Face segmentation using skin color map in videophone applications. IEEE Trans. On Circuits and Systems for Video Technology, 9(4), 551–564.
Viola, P., & Jones, M. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.
Wang, Q., Wu, J., Long, C., & Li, B. (2013). P-FAD: real time face detection scheme on embedded smart cameras. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 3(2), 210–222.
Zhiwei, Z., & Qiang, J. (2005). Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Computer Vision and Image Understanding, 98(1), 124–154.
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary pattern. IEEE Trans. On Pattern Analysis and Machine Intelligence, 24(7), 971–987.
Vapnik, V. (1999). An overview of statistical learning theory. IEEE Transactions on Neural Networks, 10(5), 988–999.
Schwartz, W. R., Kembavi, A., Harwood, D., & Davis, L. S. (2009). Human detection using partial least squares analysis. In Proceedings of international conference on computer vision (pp. 24–31).
Kembhavi, A., Harwood, D., & Davis, L. S. (2011). Vehicle detection using partial least squares. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(6), 1250–1265.
Wang, Q., Chen, F., Xu, W., & Yang, M. (2012). Object tracking via partial least squares analysis. IEEE Transactions on Image Processing, 21(10), 4454–4465.
William, R. S., Huimin, G., Jonghyun, C., & Larry, S. D. (2012). Face identification using large feature sets. IEEE Transactions on Image Processing, 21(4), 2245–2255.
SPRAAI7B (2008). Understanding the DaVinci Resizer. Texas Instruments.
Castrillon, M., Deniz, O., Guerra, C., & Hernandez, M. (2007). ENCARA2: real-time detection of multiple faces at different resolutions in video streams. Journal of Visual Communication and Image Representation, 18(2), 130–140.
Ahonen, T., Hadid, A., & Pietikainen, M. (2006). Face description with local binary patterns: application to face recognition. IEEE Trans. On Pattern Analysis and Machine Intelligence, 28(12), 2037–2041.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Selvakumar, K., Jerome, J., Rajamani, K. et al. Real-Time Vision Based Driver Drowsiness Detection Using Partial Least Squares Analysis. J Sign Process Syst 85, 263–274 (2016). https://doi.org/10.1007/s11265-015-1075-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-015-1075-4