AutoMyDe: A Detector for Pupil Dilation in Cognitive Load Measurement

  • Davide Maria Calandra
  • Francesco Cutugno
Conference paper
Part of the Lecture Notes in Information Systems and Organisation book series (LNISO, volume 7)


Pupil dilation is known to reflect the emotional arousal. Pleasure, effort and fear are examples of stimuli inducing the nervous system to cause dilation mydriasis. The work proposes a tool to automatically quantify the mydriasis in order to evaluate mental effort in HCI. The system uses a feature-based approach and monitors the pupil behavior during a given task. As mydriasis is entailed by various reasons, our system distinguishes the cause-effect relationships by synchronizing monitoring and test, dividing the monitoring in fixed intervals and retrieving a survey of the mydriatic events for each determined period of time. We present a case of study analyzing users resolving arithmetical tasks, viewing pictures and using a mobile application. In each scenario, tests intend to impose gradually increasing reactions to the users. The paper will present different techniques for pupil dilation measurements and related results of mental effort evaluation.


Affective computing Mental effort Pupil dilation 



Work supported by the European Community and the Italian Ministry of University and Research and EU under the PON OR.C.HE.S.T.R.A. project.


  1. 1.
    Andreassi, J.: Pupillary response and behavior. Psychophysiology: Human Behavior & Physiological Response. 4th ed. pp. 218–233. Lawrence Erlbaum Associates, Publishers (2000)Google Scholar
  2. 2.
    Hess, E.H., Polt, J.M.: Pupil size as related to interest value of visual stimuli. Science 349–350 (1960)Google Scholar
  3. 3.
    Kahneman, D.: Attention and Effort (Experimental Psychology), p. 0130505188. Englewood Cliffs, Prentice-Hall (1973)Google Scholar
  4. 4.
    Polson, P.G., Lewis, C., Rieman, J., Wharton, C.: Cognitive walkthroughs: a method for theory-based evaluation of user interfaces, p. 5. Academic Press Ltd., Int. J. Man-Mach. Stud. 36, 741–773 (1992)Google Scholar
  5. 5.
    Paas, F., Renkl, A., Sweller, J.: Cognitive load theory and instructional design: recent developments. Educ. Psychol. 38 (1), 1–4Google Scholar
  6. 6.
    Fernandes, T.: Global Interface Design: A Guide to Designing International User Interfaces. Academic Press Professional, Inc., San Diego. 0-12-253790-4 (1995)Google Scholar
  7. 7.
    Marcus, A., Gould, E.: Crosscurrents: cultural dimensions and global web user-interface design. West. pp. 32–46, 1072–5520. ACM interactions, New York (2000)Google Scholar
  8. 8.
    Furlong, M.S., Kearsley, G.: Computers for Kids Over 60. Senior Net, 1993. 9780962670039Google Scholar
  9. 9.
    Druin, A., Inkpen, K.: When Are Personal Technologies for Children? p. 3. Springer, London, Personal Ubiquitous Comput. 5, 191–194. 1617–4909Google Scholar
  10. 10.
    Edwards, A.D.N.: Extra-ordinary Human-computer Interaction: Interfaces for Users with Disabilities, p. 9780521434133. Cambridge University Press, Cambridge (1995)Google Scholar
  11. 11.
    Paciello, M.G.: Web Accessibility for People with Disabilities, p. 9781929629084. Taylor & Francis, London (2000)Google Scholar
  12. 12.
    Wickens, C.D., Hollands, J.G.: Engineering Psychology and Human Performance, p. 9780321047113. Prentice Hall PTR, Upper Saddle River (2000)Google Scholar
  13. 13.
    Ashcraft, M.H.: Cognition, 3rd edn. Prentice Hall, New York (2002). 9780130307293Google Scholar
  14. 14.
    Kühnel, C., Westermann, T., Weiss, B., Möller, S.: Evaluating Multimodal Systems: A Comparison of Established Questionnaires and Interaction Parameters. Reykjavik, pp. 286–294. ACM, Iceland 2010. 978-1-60558-934-3Google Scholar
  15. 15.
    Bias, R.G., Mayhew, D.J.: Cost-Justifying Usability: An Update for an Internet Age, p. 9780120958115. Morgan Kaufman, San Francisco (2005)Google Scholar
  16. 16.
    Andreassi, J.L., Fichera, L.V.: Cardiovascular reactivity during public speaking as a function of personality variables, p. 3, Int J Psychophysiol, 37, 267–273. 0167-8760 (2000)Google Scholar
  17. 17.
    Schuller, B., Batliner, A., Steidl, A., Seppi, D.: Recognising realistic emotions and affect in speech: State of art and lessons learnt from the first challenge. Speech Commun. 1062–1087Google Scholar
  18. 18.
    Marshall, S.P.: The Index of Cognitive Activity: Measuring cognitive workload. 2002. In: Proceedings of the 7th IEEE Conference on Human Factors and Power PlantsGoogle Scholar
  19. 19.
    Calandra, D.M., Caso, A., Cutugno, F., Origlia, A., Rossi, S.: CoWME: a general framework to evaluate cognitive workload during multimodal interaction. Proceedings of ICMI (2013)Google Scholar
  20. 20.
    Hansen, D.W., Ji, Q.: In the eye of the beholder: a survey of models for eyes and gaze. 3, 2010, IEEE Trans. Pattern Anal. Mach. Intell. 32 Google Scholar
  21. 21.
    Aylward, J.J., Erwann, R., Stephen, R.: Automatic quantification of pupil dilation under stress. 2004Google Scholar
  22. 22.
    Duda, R.O., Hart, P.E.: Use of the hough transformation to detect lines and curves in pictures. p. 1, ACM, Commun. ACM, 15, 11–15 (1972). 0001-0782 Google Scholar
  23. 23.
    Shanbezadeh, J., Asadifard, M.,: Automatic adaptive center of pupil detection using face detection and CDF analysis. In: Proceedings of the International MultiConference of Engineers and Computer Scientists, vol. I (2010)Google Scholar
  24. 24.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001. vol. 1, pp. 1063–6919 (2001)Google Scholar
  25. 25.
    Baggio, D.L., Emami, S., Escrivá, D.M., Ievgen, K., Mahmood, N., Saragih, J., Shilkrot, S.: Mastering OpenCV with Practical Computer Vision Projects. Packt Publishing, Limited (2012). 9781849517829Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.DIETIUniversity of Naples, Federico IINapoliItaly

Personalised recommendations