Recognizing Cognitive Activities Through Eye Tracking | SpringerLink
Skip to main content
Springer Nature Link
Log in

Recognizing Cognitive Activities Through Eye Tracking

  • Conference paper
  • First Online:
Understanding the Brain Function and Emotions (IWINAC 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11486))

Abstract

Eye detection and tracking is usually performed by using specific devices that allow to determine the pupil position in many different situations. We propose to use these techniques for recognizing cognitive activities that a potential user is carrying out in front of a computer. We use the images captured by a conventional web camera located over the computer display. Those image are processed and, after the face and facial landmarks are found, the user gaze is analyzed and the ethogram and several statistics associated to the eyes and gaze destination are computed. They are used for determining what is doing the user from a set of predefined activities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 5719
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 7149
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Hof, R.: How do you Google? New eye tracking study reveals huge changes. https://www.forbes.com/sites/roberthof/2015/03/03/how-do-you-google-new-eye-tracking-study-reveals-huge-changes/. Accessed 11 Feb 2019

  2. Tsai, M.-J., Hou, H.-T., Lai, M.-L., Liu, W.-Y., Yang, F.-Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58, 375–385 (2012)

    Article  Google Scholar 

  3. Weigel, P., Raab, M., Wollny, R.: Tactical decision making in team sports: a model of cognitive processes. Int. J. Sports Sci. 5(49), 128–138 (2015)

    Google Scholar 

  4. Gidlöf, K., Wallin, A., Dewhurst, R., Holmqvist, K.: Using eye tracking to trace a cognitive process: Gaze behaviour during decision making in a natural environment. J. Eye Mov. Res. 6(1), 1–14 (2013)

    Google Scholar 

  5. Al-Rahayfeh, A., Faezipour, M.: Eye tracking and head movement detection: a state-of-art survey. IEEE J. Transl. Eng. Health Med. 1, 1–12 (2013)

    Article  Google Scholar 

  6. Krafka, K., et al.: Eye tracking for everyone. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2176–2184 (2016)

    Google Scholar 

  7. Ferhat, O., Vilariño, F.: Low cost eye tracking: the current panorama. Comput. Intell. Neurosci. 2016, 1–14 (2016)

    Article  Google Scholar 

  8. Obaidellah, U., Al Haek, M., Cheng, P.C.-H.: A survey on the usage of eye-tracking in computer programming. ACM Comput. Surv. 51(1), 1–58 (2018)

    Article  Google Scholar 

  9. Baluja, S., Pomerleau, D.: Non-intrusive gaze tracking using artificial neural networks. Technical report CMU-CS-94-102. Carnegie Mellon University. Pittsburgh, Pennsylvania (1994)

    Google Scholar 

  10. Sewell, W., Komogortsev, O.: Real-time eye gaze tracking with anunmodified commodity webcam employing a neural network. In: ACM CHI Conference Human Factors in Computing Systems, pp. 3739–3744. Atlanta, Georgia (2010)

    Google Scholar 

  11. Vora, S., Rangesh, A., Trivedi, M.M.: On generalizing driver gaze zone estimation using convolutional neural networks. In: IEEE Intelligent Vehicles Symposium, pp. 849–854. Redondo Beach, California (2017)

    Google Scholar 

  12. Naqvi, R.A., Arsalan, M., Batchuluun, G., Yoon, H.S., Park, K.R.: Deep learning-based gaze detection systems for automobile drivers using a NIR camera sensor. Sensors 18, 1–34 (2018)

    Article  Google Scholar 

  13. Blakley, B.W., Chan, L.: Methods considerations for nystagmography. J. Otolaryngol. Head Neck Surg. 44, 25 (2015)

    Article  Google Scholar 

  14. Cassin, B., Solomon, S.: Dictionary of Eye Terminology. Triad Publishing Company, Gainesville (1990)

    Google Scholar 

  15. Dalal, N., Triggs, B.: Histogram of Oriented Gradients for Human Detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 886–893 (2005)

    Google Scholar 

  16. Kazemi, V., Sullivan, J.: One millisecond face alignment with anensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874. Ohio, USA (2014)

    Google Scholar 

  17. Soukupová, T., Čech, J.: Real-time eye blink detection using facial landmarks. In: 21st Computer Vision Winter Workshop (2016)

    Google Scholar 

  18. Anderson, D.J., Perona, P.: Toward a science of computational ethology. Neuron 84, 18–31 (2014)

    Article  Google Scholar 

Download references

Acknowledgments

This work has been partially supported by FEDER funds through MINECO project TIN2017-85827-P.

Author information

Authors and Affiliations

  1. Computational Cognitive Robotics Group, Department of Artificial Intelligence, Universidad Politécnica de Madrid (UPM), Madrid, Spain

    Sara Moraleda & Javier de Lope Asiain

  2. Computational Intelligence Group, University of the Basque Country (UPV/EHU), San Sebastián, Spain

    Manuel Graña

Authors
  1. Sara Moraleda
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Javier de Lope Asiain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Manuel Graña
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Javier de Lope Asiain .

Editor information

Editors and Affiliations

  1. Universidad Politécnica de Cartagena, Cartagena, Spain

    José Manuel Ferrández Vicente

  2. Universidad Nacional de Educación a Distancia, Madrid, Spain

    José Ramón Álvarez-Sánchez

  3. Universidad Nacional de Educación a Distancia, Madrid, Madrid, Spain

    Félix de la Paz López

  4. Universidad Politécnica de Cartagena, Cartagena, Spain

    Javier Toledo Moreo

  5. The Ohio State University, Columbus, OH, USA

    Hojjat Adeli

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moraleda, S., de Lope Asiain, J., Graña, M. (2019). Recognizing Cognitive Activities Through Eye Tracking. In: Ferrández Vicente, J., Álvarez-Sánchez, J., de la Paz López, F., Toledo Moreo, J., Adeli, H. (eds) Understanding the Brain Function and Emotions. IWINAC 2019. Lecture Notes in Computer Science(), vol 11486. Springer, Cham. https://doi.org/10.1007/978-3-030-19591-5_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-19591-5_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-19590-8

  • Online ISBN: 978-3-030-19591-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation