• S. Thiyagarajan
  • S.N. Rosli
  • M.K.M. Amin
  • S. Wibirama Universitas Gadjah Mada
Keywords: Eye Tracking, Pupil Dilation


This article presents an exploration and investigation of the eye movement features to track the eye-mind relationship through eye tracking device during video clips of positive emotional stimulation. The relationship of eyes gazing behavior with human mind is a challenging topic. Many parameters of the eyes gazing behavior is yet to be explored namely pupil size and pupil dilation. Since pupil size is one of the indicators of the brain’s activity studies on eye-mind relationship can be beneficial and added value in learning human behavior. Prior studies have suggested that the cognitive processing and affective information affect the size of pupils in humans. Significantly, this study focus on the behavior of positive emotion by using eye tracking technique to observe the eye-mind relation. It is hypothesized from this observation that the visual attention of the gazing behavior will affect the pupil dilation and will further provide evidence of the human mind triggered emotion. Ten subjects’ pupil responses were measured while watching interesting and amusing emotional clips. The results showed that the fixation duration and pupil dilation significantly different between each video stimulation. These results suggest that the measurement of eye fixation is a potential computer input for detecting emotional state.


Download data is not yet available.

Author Biography

S. Wibirama, Universitas Gadjah Mada

2Department of Electrical Engineering and Information Technology,

Faculty of Engineering, Universitas Gadjah Mada,

Yogyakarta 55281, Indonesia.


[1] C. Izard, S. Fine, D.Schultz, A. Mostow, B. Ackerman and E.Youngstrom, “Emotion knowledge as a predictor of social behavior and academic competence in children at risk”, Psychological Science, vol. 12, no. 1, pp. 18–23, 2001.

[2] L. Yan, X. Wen, L. Zhang, and Y. Son, “The application of unascertained measure to the video emotion type recognition,” in 2nd International Conference on Signal Processing Systems, Dalian, China, 2010, pp. V2-447-V2-451.

[3] P. Rosa, “What do your eyes say? Bridging eye movements to consumer behavior”, International Journal of Psychological Research, vol. 8, no. 2, pp. 90-103, 2015.

[4] H. Zamani, A. Abas and M. K. M.Amin, “Eye Tracking Application on Emotion Analysis for Marketing Strategy”, Journal of Telecommunication, Electronic and Computer Engineering, vol. 8, no. 11, pp. 87-91, 2016.

[5] G. L. Lohse and E. J. Johnson, “A comparison of two process tracing methods for choice tasks,” Organizational Behavior and Human Decision Processes, vol. 68, no. 1, pp. 28-43, 1996.

[6] C. Zong and M. Chetouani, “Hilbert-Huang transform based physiological signals analysis for emotion recognition,” in International Symposium on Signal Processing and Information Technology, Ajman, United Arab Emirates, 2009, pp. 334–339.

[7] S. Alghowinem, M. AlShehri, R. Goecke, and M. Wagner, “Exploring eye activity as an indication of emotional states using an eye-tracking sensor,” in Intelligent systems for science and information, Studies in Computational Intelligence, vol. 542, S. Alghowinem, M. AlShehri, R. Goecke and M. Wagner, Switzerland AG: Springer International Publishing, 2014, pp. 261-276.

[8] T. Partala, M. Jokiniemi, and V. Surakka, “Pupillary responses to emotionally provocative stimuli,” in the Proceedings of the Symposium on Eye Tracking Research and Applications, Florida, USA, 2000, pp. 123–129.

[9] C. Sharma and S. K. Dubey, “Analysis of eye tracking techniques in usability and HCI perspective,” in International Conference on Computing for Sustainable Global Development, New Delhi, India, 2014, pp. 607-612

[10] P. Binda, M. Pereverzeva, and S. O. Murray,” Pupil size reflects the focus of feature-based attention”, Journal of Neurophysiology, vol. 112, no. 12, pp. 3046-3052, 2014.

[11] J. Scheirer, R. Fernandez, J. Klein, and R. W. Picard, “Frustrating the user on purpose: a step toward building an affective computer,” Interacting with computers, vol. 14, no. 2, pp. 93-118, 2002.

[12] T. Partala and V. Surakka, “Pupil size variation as an indication of affective processing,” International Journal of Human-Computer Studies, vol. 59, no. 1, pp. 185-198, 2003.

[13] S. Mathôt and S. Van der Stigchel, “New Light on the Mind’s Eye: The Pupillary Light Response as Active Vision”, Current Directions in Psychological Science, vol. 24, no. 5, pp. 374-378, 2015.

[14] J.F. Rauthmann, C.T. Seubert, P. Sachse and M.R. Furtner,”Eyes as windows to the soul: Gazing behavior is related to personality”, Journal of Research in Personality, vol. 46, no. 2, pp. 147-156, 2012.

[15] M. M. Bradley, L. Miccoli, M. A. Escrig, and P. J. Lang, “The pupil as a measure of emotional arousal and autonomic activation,” Psychophysiology, vol. 45, no. 4, pp. 602-607, 2008.

[16] S. Amemiya and K. Ohtomo,” Effect of the observed pupil size on the amygdala of the beholders”, Social Cognitive and Affective Neuroscience, vol. 7, no. 3, pp. 332-341, 2012.

[17] S. M. Berends, S. M. Brouwer and S. A. Sprenger, “Eye-Tracking and the Visual World Paradigm”, in Designing Research on Bilingual Development, Behavioral and Neurolinguistic Experiments, M.S. Schmid, S.M. Berends, C. Bergmann, S.M. Brouwer, N. Meulman, B. Seton, S. Sprenger and L. Stowe, Switzerland AG: Springer International Publishing, 2016, pp. 55-80.
How to Cite
Thiyagarajan, S., Rosli, S., Amin, M., & Wibirama, S. (2019). TRACKING THE EYE-MIND RELATIONSHIP OF POSITIVE EMOTION USING EYE TRACKING TECHNIQUE. Journal of Advanced Manufacturing Technology (JAMT), 13(2(2). Retrieved from

Most read articles by the same author(s)