This article is part of the series Image and Video Processing for Disability.

Open Access Research Article

Automatic Eye Winks Interpretation System for Human-Machine Interface

Che Wei-Gang1*, Chung-Lin Huang1,2 and Wen-Liang Hwang3

Author Affiliations

1 Department of Electrical Engineering, National Tsing-Hua University, Hsin-Chu, Taiwan

2 Department of Informatics, Fo-Guang University, I-Lan, Taiwan

3 Institute of Information Science, Academic Sinica, Taipei, Taiwan

For all author emails, please log on.

EURASIP Journal on Image and Video Processing 2007, 2007:065184 doi:10.1155/2007/65184


The electronic version of this article is the complete one and can be found online at: http://jivp.eurasipjournals.com/content/2007/1/065184


Received:2 January 2007
Revisions received:30 April 2007
Accepted:21 August 2007
Published:8 October 2007

© 2007 Wei-Gang et al.

This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This paper proposes an automatic eye-wink interpretation system for human-machine interface to benefit the severely handicapped people. Our system consists of (1) applying the support vector machine (SVM) to detect the eyes, (2) using the template matching algorithm to track the eyes, (3) using SVM classifier to verify the open or closed eyes and convert the eye winks into a sequence of codes (0 or 1), and (4) applying the dynamic programming to translate the code sequence to a certain valid command. Different from the previous eye-gaze tracking methods, our system identifies the open or closed eye, and then interprets the eye winking as certain commands for human-machine interface. In the experiments, our system demonstrates better performance as well as higher accuracy.

References

  1. PW Hallinan, Recognizing human eyes. Geometric Methods in Computer Vision, July 1991, San Diego, Calif, USA, Proceedings of SPIE 1570, 214–226

  2. S Amarnag, RS Kumaran, JN Gowdy, Real time eye tracking for human computer interfaces. Proceedings of the International Conference on Multimedia and Expo (ICME '03), July 2003, Baltimore, Md, USA 3, 557–560

  3. Q Ji, X Yang, Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imaging 8(5), 357–377 (2002). Publisher Full Text OpenURL

  4. P Smith, M Shah, N da Vitoria Lobo, Monitoring head/eye motion for driver alertness with one camera. Proceedings of the 15th International Conference on Pattern Recognition (ICPR '00), September 2000, Barcelona, Spain 4, 636–642

  5. T D'Orazio, M Leo, P Spagnolo, C Guaragnella, A neural system for eye detection in a driver vigilance application. Proceedings of the 7th International IEEE Conference on Intelligent Transportation Systems (ITS '04), October 2004, Washington, DC, USA, 320–325

  6. KF Van Orden, T-P Jung, S Makeig, Combined eye activity measures accurately estimate changes in sustained visual task performance. Biological Psychology 52(3), 221–240 (2000). PubMed Abstract | Publisher Full Text OpenURL

  7. R Shaw, E Crisman, A Loomis, Z Laszewski, The eye wink control interface: using the computer to provide the severely disabled with increased flexibility and comfort. Proceedings of the 3rd Annual IEEE Symposium on Computer-Based Medical Systems (CBMS '90), June 1990, Chapel Hill, NC, USA, 105–111

  8. L Gan, B Cui, W Wang, Driver fatigue detection based on eye tracking. Proceedings of the 6th World Congress on Intelligent Control and Automation (WCICA '06), June 2006, Dalian, China 2, 5341–5344

  9. A Haro, Flickner, I Essa, Detecting and tracking eyes by using their physiological properties, dynamics, and appearance. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), June 2000, Hilton Head Island, SC, USA 1, 163–168

  10. A Iijima, M Haida, N Ishikawa, H Minamitani, Y Shinohara, Head mounted goggle system with liquid crystal display for evaluation of eye tracking functions on neurological disease patients. Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '03), September 2003, Cancun, Mexico 4, 3225–3228

  11. I Fasel, B Fortenberry, J Movellan, A generative framework for real time object detection and classification. Computer Vision and Image Understanding 98(1), 182–210 (2005). Publisher Full Text OpenURL

  12. Z Zhu, Q Ji, Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Computer Vision and Image Understanding 98(1), 124–154 (2005). Publisher Full Text OpenURL

  13. CH Morimoto, M Flickner, Real-time multiple face detection using active illumination. Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG '00), March 2000, Grenoble, France, 8–13

  14. X Liu, F Xu, K Fujimura, Real-time eye detection and tracking for driver observation under various light conditions. Proceedings of the IEEE Intelligent Vehicle Symposium (IV '02), June 2002, Versailles, France 2, 344–351

  15. DW Hansen, AEC Pece, Eye tracking in the wild. Computer Vision and Image Understanding 98(1), 155–181 (2005). Publisher Full Text OpenURL

  16. D Chai, KN Ngan, Face segmentation using skin-color map in videophone applications. IEEE Transactions on Circuits and Systems for Video Technology 9(4), 551–564 (1999). Publisher Full Text OpenURL

  17. D Chai, SL Phung, A Bouzerdoum, Skin color detection for face localization in human-machine communications. Proceedings of the 6th International, Symposium on Signal Processing and Its Applications (ISSPA '01), August 2001, Kuala Lumpur, Malaysia 1, 343–346

  18. VN Vapnik, The Nature of Statistical Learning Theory (Springer, New York, NY, USA, 1995)

  19. N Otsu, A threshold selection method from gray-level histograms. IEEE Transcations on Systems, Man, and Cybernetics 9(1), 62–66 (1979). Publisher Full Text OpenURL