Abstract
This paper proposes a novel approach for open-eye detection that can be used in driver drowsiness analysis based on computer vision techniques. The proposed method captures the driver video using a low-resolution camera. The proposed drowsiness detection system has three main stages. The first stage is face detection using elliptical approximation and template matching techniques. In the second stage, the open eye is detected using the proposed iris–sclera pattern analysis method. In the third stage, the drowsiness state of the driver is determined using PERcentage of eye CLOSure (PERCLOS) measure. The entire system is designed to be independent of any specific data sets for face or eye detection. The proposed method for open-eye detection uses basic image processing concepts of morphological and laplacian operations. The proposed system was evaluated with real-life images and videos. Open-eye detection accuracy of 93% was achieved.
References
Klauer S G, Dingus T A, Neale V L, Sudweeks J D and Ramsey D J 2006 The impact of driver inattention on near-crash/crash risk: an analysis using the 100-car naturalistic driving study data. Washington, DC: U.S. Department of Transportation, National Highway Traffic Safety Administration, https://vtechworks.lib.vt.edu/bitstream/handle/10919/55090/DriverInattention.pdf?sequence=1. Report No. DOT HS 810 594
Akerstedt T, Kecklund G and Hörte L G 2001 Night driving, season, and the risk of highway accidents. Sleep 24: 401–406. https://www.ncbi.nlm.nih.gov/pubmed/11403524
Connor J, Norton R, Ameratunga S, Robinson E, Civil I, Dunn R, Bailey J and Jackson R 2002 Driver sleepiness and risk of serious injury to car occupants: population based control study. Br. Med. J. 324: 1125–1129
Horne J and Reyner L 1999 Vehicle accidents related to sleep: a review. Occup. Environ. Med. 56: 189–294
May J F and Baldwin C L 2009 Driver fatigue: the importance of identifying causal factors of fatigue when considering detection and countermeasure technologies. Transp. Res. Part F: Traf. Psychol. Behav. 12(3): 218–224
Wright N, Stone B, Horberry T and Reed N 2007 A review of in-vehicle sleepiness detection devices. Published Project Report PPR157, TRL Limited
Bergasa L M, Nuevo J, Sotelo M Á, Barea R and Guillén M E L 2006 Real-time system for monitoring driver vigilance. IEEE Trans. Intell. Transp. Syst. 7(1): 63–77
Oron-Gilad T, Ronen A and Shinar D 2008 Alertness maintaining tasks (AMTs) while driving. Accid. Anal. Prev. 40(3): 851–860
Papadelis C, Chen Z, Kourtidou-Papadeli C, Bamidis P, Chouvarda I, Bekiaris E and Maglaveras N 2007 Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents. Clin. Neurophysiol. 118(9): 1906–1922
Faber J 2004 Detection of different levels of vigilance by EEG pseudospectra. Neural Netw. World 14(3–4): 285–290
Lin C T, Chang C J, Lin B S, Hung S H, Chao C F and Wang I J 2010 A real-time wireless brain–computer interface system for drowsiness detection. IEEE Trans. Biomed. Circuits Syst. 4(4): 214–222
Wakita T, Ozawa K, Miyajima C, Igarashi K, Itou K, Takeda K and Itakura F 2006 Driver identification using driving behavior signals. IEICE Trans. E89-D(3): 1188–1194
Takei Y and Furukawa Y 2005 Estimate of drivers fatigue through steering motion. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1765–1770
McCall J C, Trivedi M M, Wipf D and Rao B 2005 Lane change intent analysis using robust operators and sparse bayesian learning. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05). Washington, DC, USA: IEEE Computer Society, p. 59
Chang T H, Hsu C S, Wang C and Yang L K 2008 Onboard measurement and warning module for irregular vehicle behavior. IEEE Trans. Intell. Transp. Syst. 9(3): 501–513
D’Orazio T, Leo M, Guaragnella C and Distante A 2007 A visual approach for driver inattention detection. Pattern Recogn. 40(8): 2341–2355
Suzuki M, Yamamoto N, Yamamoto O, Nakano T and Yamamoto S 2006 Measurement of driver’s consciousness by image processing – a method for presuming driver’s drowsiness by eye-blinks co** with individual differences. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 2891–2896
Ji Q and Yang X J 2002 Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imag. 8(5): 357–377
Bretzner L and Krantz M 2005 Towards low-cost systems for measuring visual cues of driver fatigue and inattention in automotive applications. In: Proceedings of the IEEE International Conference on Vehicular Electronics and Safety, pp. 161–164
Heinzmann J, Tate D and Scott R 2008 Using technology to eliminate drowsy driving. In: Proceedings of the SPE International Conference on Health, Safety, and Environment in Oil and Gas Exploration and Production
Yang M, Kriegman J and Ahuja N 2002 Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1): 34–58
Dowall J, Pavlidis I and Bebis G 2001 Face detection in the near-IR spectrum. Image Vis. Comput. 21: 565–578
Zhu Z and Ji Q 2005 Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Comput. Vis. Image Und. 98: 124–154
Perez C A, González G D, Medina L E and Galdames F J 2005 Linear vs. nonlinear neural modeling for 2-D pattern recognition. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 35(6): 955–964
Rowley H, Baluja S and Kanade T 1998 Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1): 23–38
Rowley H, Baluja S and Kanade T 1998 Rotation invariant neural network based face detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, pp. 38–44
Jones M and Rehg J 2002 Statistical color models with application to skin detection. Int. J. Comput. Vis. 46: 81–96
Wang J G and Sung E 2002 Study on eye gaze estimation. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 32(3): 332–350
Chen Y W and Kubo K 2007 A robust eye detection and tracking technique using Gabor filters. In: Proceedings of the Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing, vol. 1, pp. 109–112
Ji Q 2002 3D face pose estimation and tracking from a monocular camera. Image Vis. Comput. 20(7): 499–511
Li Y, Qi X and Wang Y 2001 Eye detection by using fuzzy template matching and feature-parameter-based judgement. Pattern Recogn. Lett. 22(10): 1111–1124
Maio D and Maltoni D 2000 Real-time face location on gray-scale static images. Pattern Recogn. 33: 1525–1539
Viola P and Jones M 2001 Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I-511–I-518
Saradadevi M and Bajaj P 2008 Driver fatigue detection using mouth and yawning analysis. Int. J. Comput. Sci. Netw. Secur. 8: 183–188
Perez C A, Lazcano V A and Estévez P A 2007 Real-time iris detection on coronal-axis-rotated faces. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 37(5): 971–978
Liu D, Sun P, **ao Y and Yin Y 2010 Drowsiness detection based on eyelid movement. In: Proceedings of the Second International Workshop on Education Technology and Computer Science, vol. 2, pp. 49–52
Tabrizi P R and Zoroofi R A 2008 Open/closed eye analysis for drowsiness detection. In: Proceedings of the First Workshops on Image Processing Theory, Tools and Applications, pp. 1–7
Flores M J, Armingol J M and de la Escalera A 2010 Real-time warning system for driver drowsiness detection using visual information. J. Intell. Robot. Syst. 59(2): 103–125
Donahue M J and Rokhlin S I 1993 On the use of level curves in image analysis. In: Image understanding, vol. 57, pp. 185–203
Gonzalez R C and Woods R E 2009 In: Digital image processing. 3rd Ed, Prentice Hall
Otsu N A 1998 Threshold selection method from gray-level histograms. In: IEEE Trans. Syst. Man Cybern. 9(1): 62–66
Dinges D F and Grace R 1998 PERCLOS: a valid psychophysiological measure of alertness as assessed psychometer vigilance. In: US Department of Transportation: Federal Highway Administration
Acknowledgements
The authors would like to thank the experts from Tata Elxsi, Technopark, Trivandrum, India, for the support and guidance.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Panicker, A.D., Nair, M.S. Open-eye detection using iris–sclera pattern analysis for driver drowsiness detection. Sādhanā 42, 1835–1849 (2017). https://doi.org/10.1007/s12046-017-0728-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12046-017-0728-3