APPLYING EYE TRACKING DEVICE ON THE GAZING BEHAVIOUR AND ITS EFFECTS ON EMOTIONS ATTRIBUTES
Keywords:
Eye Tracking, Emotions, Gaze Behavior, Pupil Dilation, Fixation
Abstract
Recent eye-tracking technology has grown popularity in various field of research and industry. However, it has been a challenge to identify human emotional states using eye tracking method. The purpose of this study is an empirical attempt to apply the eye tracking device and method to investigate the relationship between human emotions and eye-gaze behaviors. In order to achieve this purpose, nine emotional video stimuli such as Amusement, Joy, Neutral, Sad and Fear are used to stimulate two types of emotions which are positive and negative. These stimuli are displayed and emotions are measured using eye- tracker, Tobii TX 300. Fifteen students from Malaysian-Japan International Institute of Technology (MJIIT) are randomly chosen for the study. The results obtained are in the form of fixation duration and pupil dilation. The results are filtered and tabulated to analyze the related behavior. Mean fixation duration and pupil dilation are calculated to identify the video stimuli with the highest count. ANOVA analysis shows that the significance, p-value is 0.43 for fixation duration. Whereas, p-value 0.003 for pupil dilation indicating there is a significant relationship between eye-gaze behavior and emotion. This study might be favorable in usability issues in human-computer interaction (HCI) contexts.
Downloads
Download data is not yet available.
References
[1] R.W. Picard, "Affective computing: challenges," International Journal of Human-Computer Studies, vol. 59, no. 1-2, pp. 55-64, 2003.
[2] W.L. Zheng, B.N. Dong and B.L. Lu, "Multimodal emotion recognition using EEG and eye tracking data," in 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, USA, 2014, pp. 5040-5043.
[3] M. Alshehri and S. Alghowinem, "An exploratory study of detecting emotion states using eye-tracking technology," in Science and Information Conference, Heathrow, UK, 2013, pp. 428-433.
[4] V. Raudonis, G. Dervinis, A. Vilkauskas, A. Paulauskaite-Taraseviciene, and G. Kersulyte-Raudone, "Evaluation of human emotion from eye motions," International Journal of Advanced Computer Science and Applications, vol. 4, no. 8, pp. 79-84, 2013.
[5] K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. Van de Weijer, Eye tracking: A comprehensive guide to methods and measures. Oxford, UK: Oxford University Press, 2011.
[6] B. Park, L. Knörzer, J. L. Plass, and R. Brünken, "Emotional design and positive emotions in multimedia learning: An eye tracking study on the use of anthropomorphisms," Computers & Education, vol. 86, pp. 30-42, 2015.
[7] H. Drewes, "Eye gaze tracking for human computer interaction," Thesis Dissertation, Faculty of Mathematics, Computer Science and Statistics, LMU Munchen, Germany, 2010.
[8] C.P. Niemic, "Studies of emotion: a theoretical and empirical review of psychophysiological studies of emotion,” Journal of Undergraduate Research, vol. 1, pp. 15-18, 2002.
[9] K. Humphrey, G. Underwood and T. Lambert, “Salience of the lambs: A test of the saliency map hypothesis with pictures of emotive objects,” Journal of Vision, vol. 12, no. 1, pp. 1-15, 2012.
[10] Y. Niu, R. Todd and A.K. Anderson, “Affective salience can reverse the effects of stimulus-driven salience on eye movements in complex scenes”, Frontiers in Psychology, vol. 3, no. 336, pp. 1-11, 2012.
[11] K. Kaspar, T.M. Hloucal, J. Kriz, S. Canzler, R.R. Gameiro, V. Krapp, and P. König, “Emotions' impact on viewing behavior under natural conditions”, PloS One, vol. 8, no. 1, pp. 1-14, 2013.
[12] J. Pilarczyk and M. Kuniecki, “Emotional content of an image attracts attention more than visually salient features in various signal-to-noise ratio conditions”, Journal of Vision, vol. 14, no. 12, pp. 1-19, 2014.
[13] L. Nummenmaa, J. Hyönä and M.G. Calvo, “Eye movement assessment of selective attentional capture by emotional pictures”, Emotion, vol. 6, no. 2, pp. 257-268, 2006.
[14] S.Y. Chipchase and P. Chapman, “Trade-offs in visual attention and the enhancement of memory specificity for positive and negative emotional stimuli”, The Quarterly Journal of Experimental Psychology, vol. 66, no. 2, pp. 277-298, 2003.
[15] L. Humphreys, G. Underwood and P. Chapman, “Enhanced memory for emotional pictures: A product of increased attention to affective stimuli?”, European Journal of Cognitive Psychology, vol. 22, no. 8, pp. 1235-1247, 2010.
[16] M.M. Bradley, “Natural selective attention: Orienting and emotion”, Psychophysiology, vol. 46, no. 1, pp. 1-11, 2009.
[17] R.R. Henderson, M.M. Bradley and P.J. Lang, “Modulation of the initial light reflex during affective picture viewing”, Psychophysiology, vol. 51, no. 9, pp. 815-818, 2014.
[18] M. Kret, J. Stekelenburg, K. Roelofs and B. De Gelder, “Perception of face and body expressions using electromyography, pupillometry and gaze measures”, Frontiers in Psychology, vol. 4, no. 28, pp. 1-12, 2013.
[19] M.E. Kret, K. Roelofs, J. Stekelenburg and B. De Gelder, “Emotional signals from faces, bodies and scenes influence observers' face expressions, fixations and pupil-size”, Frontiers in Human Neuroscience, vol. 7, no. 810, pp. 1-9, 2013.
[20] T. Partala and V. Surakka, “Pupil size variation as an indication of affective processing”, International Journal of Human-Computer Studies, vol. 59, no. 1-2, pp. 185-198, 2003.
[21] R.K. Snowden, K.R. O'Farrell, D. Burley, J.T. Erichsen, N.V. Newton and N.S. Gray, “The pupil's response to affective pictures: Role of image duration, habituation, and viewing mode”, Psychophysiology, vol. 53, no. 8, pp. 1217-1223, 2016.
[22] T. Kawai, H. Takano and K. Nakamura, “Pupil diameter variation in positive and negative emotions with visual stimulus”, in IEEE International Conference on Systems, Man, and Cybernetics, Manchester, UK, 2013, pp. 4179-4183.
[23] A. Babiker, I. Faye and A. Malik, “Pupillary behavior in positive and negative emotions”, in IEEE International Conference on Signal and Image Processing Applications, Melaka, Malaysia, 2013, pp. 379-383
[24] A. Viktorin, P. Lichtenstein, M.E. Thase, H. Larsson, C. Lundholm, P.K. Magnusson and M. Landén, "The risk of switch to mania in patients with bipolar disorder during treatment with an antidepressant alone and in combination with a mood stabilizer," American Journal of Psychiatry, vol. 171, no. 10, pp. 1067-1073, 2014.
[25] E.H. Hess, "Attitude and pupil size," Scientific American, vol. 212, no. 4, pp. 46-55, 1965.
[2] W.L. Zheng, B.N. Dong and B.L. Lu, "Multimodal emotion recognition using EEG and eye tracking data," in 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, USA, 2014, pp. 5040-5043.
[3] M. Alshehri and S. Alghowinem, "An exploratory study of detecting emotion states using eye-tracking technology," in Science and Information Conference, Heathrow, UK, 2013, pp. 428-433.
[4] V. Raudonis, G. Dervinis, A. Vilkauskas, A. Paulauskaite-Taraseviciene, and G. Kersulyte-Raudone, "Evaluation of human emotion from eye motions," International Journal of Advanced Computer Science and Applications, vol. 4, no. 8, pp. 79-84, 2013.
[5] K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. Van de Weijer, Eye tracking: A comprehensive guide to methods and measures. Oxford, UK: Oxford University Press, 2011.
[6] B. Park, L. Knörzer, J. L. Plass, and R. Brünken, "Emotional design and positive emotions in multimedia learning: An eye tracking study on the use of anthropomorphisms," Computers & Education, vol. 86, pp. 30-42, 2015.
[7] H. Drewes, "Eye gaze tracking for human computer interaction," Thesis Dissertation, Faculty of Mathematics, Computer Science and Statistics, LMU Munchen, Germany, 2010.
[8] C.P. Niemic, "Studies of emotion: a theoretical and empirical review of psychophysiological studies of emotion,” Journal of Undergraduate Research, vol. 1, pp. 15-18, 2002.
[9] K. Humphrey, G. Underwood and T. Lambert, “Salience of the lambs: A test of the saliency map hypothesis with pictures of emotive objects,” Journal of Vision, vol. 12, no. 1, pp. 1-15, 2012.
[10] Y. Niu, R. Todd and A.K. Anderson, “Affective salience can reverse the effects of stimulus-driven salience on eye movements in complex scenes”, Frontiers in Psychology, vol. 3, no. 336, pp. 1-11, 2012.
[11] K. Kaspar, T.M. Hloucal, J. Kriz, S. Canzler, R.R. Gameiro, V. Krapp, and P. König, “Emotions' impact on viewing behavior under natural conditions”, PloS One, vol. 8, no. 1, pp. 1-14, 2013.
[12] J. Pilarczyk and M. Kuniecki, “Emotional content of an image attracts attention more than visually salient features in various signal-to-noise ratio conditions”, Journal of Vision, vol. 14, no. 12, pp. 1-19, 2014.
[13] L. Nummenmaa, J. Hyönä and M.G. Calvo, “Eye movement assessment of selective attentional capture by emotional pictures”, Emotion, vol. 6, no. 2, pp. 257-268, 2006.
[14] S.Y. Chipchase and P. Chapman, “Trade-offs in visual attention and the enhancement of memory specificity for positive and negative emotional stimuli”, The Quarterly Journal of Experimental Psychology, vol. 66, no. 2, pp. 277-298, 2003.
[15] L. Humphreys, G. Underwood and P. Chapman, “Enhanced memory for emotional pictures: A product of increased attention to affective stimuli?”, European Journal of Cognitive Psychology, vol. 22, no. 8, pp. 1235-1247, 2010.
[16] M.M. Bradley, “Natural selective attention: Orienting and emotion”, Psychophysiology, vol. 46, no. 1, pp. 1-11, 2009.
[17] R.R. Henderson, M.M. Bradley and P.J. Lang, “Modulation of the initial light reflex during affective picture viewing”, Psychophysiology, vol. 51, no. 9, pp. 815-818, 2014.
[18] M. Kret, J. Stekelenburg, K. Roelofs and B. De Gelder, “Perception of face and body expressions using electromyography, pupillometry and gaze measures”, Frontiers in Psychology, vol. 4, no. 28, pp. 1-12, 2013.
[19] M.E. Kret, K. Roelofs, J. Stekelenburg and B. De Gelder, “Emotional signals from faces, bodies and scenes influence observers' face expressions, fixations and pupil-size”, Frontiers in Human Neuroscience, vol. 7, no. 810, pp. 1-9, 2013.
[20] T. Partala and V. Surakka, “Pupil size variation as an indication of affective processing”, International Journal of Human-Computer Studies, vol. 59, no. 1-2, pp. 185-198, 2003.
[21] R.K. Snowden, K.R. O'Farrell, D. Burley, J.T. Erichsen, N.V. Newton and N.S. Gray, “The pupil's response to affective pictures: Role of image duration, habituation, and viewing mode”, Psychophysiology, vol. 53, no. 8, pp. 1217-1223, 2016.
[22] T. Kawai, H. Takano and K. Nakamura, “Pupil diameter variation in positive and negative emotions with visual stimulus”, in IEEE International Conference on Systems, Man, and Cybernetics, Manchester, UK, 2013, pp. 4179-4183.
[23] A. Babiker, I. Faye and A. Malik, “Pupillary behavior in positive and negative emotions”, in IEEE International Conference on Signal and Image Processing Applications, Melaka, Malaysia, 2013, pp. 379-383
[24] A. Viktorin, P. Lichtenstein, M.E. Thase, H. Larsson, C. Lundholm, P.K. Magnusson and M. Landén, "The risk of switch to mania in patients with bipolar disorder during treatment with an antidepressant alone and in combination with a mood stabilizer," American Journal of Psychiatry, vol. 171, no. 10, pp. 1067-1073, 2014.
[25] E.H. Hess, "Attitude and pupil size," Scientific American, vol. 212, no. 4, pp. 46-55, 1965.
Published
2019-12-29
How to Cite
Thiyagarajan, S., Amin, M., Wibirama, S., & Mikami, O. (2019). APPLYING EYE TRACKING DEVICE ON THE GAZING BEHAVIOUR AND ITS EFFECTS ON EMOTIONS ATTRIBUTES. Journal of Advanced Manufacturing Technology (JAMT), 13(2(2). Retrieved from https://jamt.utem.edu.my/jamt/article/view/5722
Issue
Section
Articles
Authors who publish with this journal agree to the following terms:
- Authors transfer copyright to the publisher as part of a journal publishing agreement with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after the manuscript is accepted, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
