Look where I look! Real time Eye Movement Modeling Examples in the Classroom
Main Article Content
Abstract
Classrooms are becoming increasingly digital. One novel digital technology that might enter classrooms soon is eye tracking. This is a method to estimate a person’s gaze direction and infer the point of visual attention. This technology has already provided insights into how students process computer-based instructional material. Moreover, it has been used to enhance pre-recorded video instruction, by showing learners where the teacher is looking, which made it easier for learners to follow and learn from the teacher (i.e., eye movement modeling examples). Thus far, this was only implemented in pre-recorded videos. In the current paper, we present a proof-of-concept, with a focus on the technical set-up, that shows how this approach can also be used in real time, during teaching. We recorded the eye movements of a teacher giving a PowerPoint presentation and displayed his eye-movements in real-time to students who were present in the same classroom. Students saw one of three different versions of the presentation: The PowerPoint only (1), the PowerPoint with an overlay of the teacher’s eye movements as a circle (2) or as an inversed blurring of the material (3). Eye movement displays significantly affected how closely students followed the teacher’s gaze, but had no impact on learning. We discuss open research questions and possible future applications in educational practice.
Article Details
FLR adopts the Attribution-NonCommercial-NoDerivs Creative Common License (BY-NC-ND). That is, Copyright for articles published in this journal is retained by the authors with, however, first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.
References
Alemdag, E., & Cagiltay, K. (2018). A systematic review of eye tracking research on multimedia learning. Computers & Education, 125, 413–428. https://doi.org/10.1016/j.compedu.2018.06.023
Bandura, A. (1977). Social learning theory. Prentice-Hall.
Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10(4), 433–436. https://doi.org/10.1163/156856897X00357
Brams, S., Ziv, G., Hooge, I. T., Levin, O., Verschakelen, J., Mark Williams, A., Wagemans, J., & Helsen, W. F. (2021). Training focal lung pathology detection using an eye movement modeling example. Journal of Medical Imaging, 8(02). https://doi.org/10.1117/1.JMI.8.2.025501
Coskun, A., & Cagiltay, K. (2022). A systematic review of EYE‐TRACKING‐BASED research on animated multimedia learning. Journal of Computer Assisted Learning, 38(2), 581–598. https://doi.org/10.1111/jcal.12629
de Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2009). Attention guidance in learning from a complex animation: Seeing is understanding? Learning and Instruction, in press.
Emhardt, S. N., Jarodzka, H., Brand-Gruwel, S., Drumm, C., Niehorster, D. C., & van Gog, T. (2022). What is my teacher talking about? Effects of displaying the teacher’s gaze and mouse cursor cues in video lectures on students’ learning. Journal of Cognitive Psychology, 1–19. https://doi.org/10.1080/20445911.2022.2080831
Emhardt, S. N., Kok, E., van Gog, T., Brandt-Gruwel, S., van Marlen, T., & Jarodzka, H. (2023). Visualizing a Task Performer’s Gaze to Foster Observers’ Performance and Learning—A Systematic Literature Review on Eye Movement Modeling Examples. Educational Psychology Review, 35(1), 23. https://doi.org/10.1007/s10648-023-09731-7
Gegenfurtner, A., Lehtinen, E., & Säljö, R. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Educational Psychology Review, 23(4), 523–552. https://doi.org/10.1007/s10648-011-9174-7
Grant, E. R., & Spivey, M. J. (2003). Eye Movements and Problem Solving: Guiding Attention Guides Thought. Psychological Science, 14(5), 462–466. https://doi.org/10.1111/1467-9280.02454
Hessels, R. S., Niehorster, D. C., Kemner, C., & Hooge, I. T. C. (2017). Noise-robust fixation detection in eye movement data: Identification by two-means clustering (I2MC). Behavior Research Methods, 49(5), 1802–1823. https://doi.org/10.3758/s13428-016-0822-1
Hooge, I., & Camps, G. (2013). Scan path entropy and arrow plots: Capturing scanning behavior of multiple observers. Frontiers in Psychology, 4. https://doi.org/10.3389/fpsyg.2013.00996
Jarodzka, H., Balslev, T., Holmqvist, K., Nyström, M., Scheiter, K., Gerjets, P., & Eika, B. (2012). Conveying clinical reasoning based on visual observation via eye-movement modelling examples. Instructional Science, 40(5), 813–827. https://doi.org/10.1007/s11251-012-9218-5
Jarodzka, H., Holmqvist, K., & Gruber, H. (2017). Eye tracking in educational science: Theoretical frameworks and research agendas. Journal of Eye Movement Research, 10(1), 1–18. https://doi.org/10.16910/jemr.10.1.3
Jarodzka, H., Scheiter, K., Gerjets, P., & Van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20(2), 146–154. https://doi.org/10.1016/j.learninstruc.2009.02.019
Jarodzka, H., Van Gog, T., Dorr, M., Scheiter, K., & Gerjets, P. (2013). Learning to see: Guiding students’ attention via a Model’s eye movements fosters learning. Learning and Instruction, 25, 62–70. https://doi.org/10.1016/j.learninstruc.2012.11.004
Kleiner, M., Brainard, D. H., Pelli, D., Ingling, A., Murray, R., & Broussard, C. (2007). What’s new in psychtoolbox-3. Perception, 36(14), 1–16.
Krebs, M.-C., Schüler, A., & Scheiter, K. (2019). Just follow my eyes: The influence of model-observer similarity on Eye Movement Modeling Examples. Learning and Instruction, 61, 126–137. https://doi.org/10.1016/j.learninstruc.2018.10.005
Krebs, M.-C., Schüler, A., & Scheiter, K. (2021). Do prior knowledge, model-observer similarity and social comparison influence the effectiveness of eye movement modeling examples for supporting multimedia learning? Instructional Science, 49(5), 607–635. https://doi.org/10.1007/s11251-021-09552-7
Lai, M.-L., Tsai, M.-J., Yang, F.-Y., Hsu, C.-Y., Liu, T.-C., Lee, S. W.-Y., Lee, M.-H., Chiou, G.-L., Liang, J.-C., & Tsai, C.-C. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, 90–115. https://doi.org/10.1016/j.edurev.2013.10.001
Litchfield, D., Ball, L. J., Donovan, T., Manning, D. J., & Crawford, T. (2010). Viewing another person’s eye movements improves identification of pulmonary nodules in chest x-ray inspection. Journal of Experimental Psychology: Applied, 16(3), 251–262. https://doi.org/10.1037/a0020082
Lowe, R., & Boucheix, J.-M. (2011). Cueing complex animations: Does direction of attention foster learning processes? Learning and Instruction, 21(5), 650–663. https://doi.org/10.1016/j.learninstruc.2011.02.002
Mautone, P. D., & Mayer, R. E. (2001). Signaling as a cognitive guide in multimedia learning. Journal of Educational Psychology, 93, 377–389.
Meltzoff, A. N., & Moore, M. K. (1977). Imitation of facial and manual gestures by human neonates. Science, 198(4312), 75–78. https://doi.org/10.1126/science.198.4312.75
Niehorster, D. C., Andersson, R., & Nyström, M. (2020). Titta: A toolbox for creating PsychToolbox and Psychopy experiments with Tobii eye trackers. Behavior Research Methods, 52(5), 1970–1979. https://doi.org/10.3758/s13428-020-01358-8
Niehorster, D. C., Cornelissen, T., Holmqvist, K., & Hooge, I. (2019). Searching with and against each other: Spatiotemporal coordination of visual search behavior in collaborative and competitive settings. Attention, Perception, & Psychophysics, 81(3), 666–683. https://doi.org/10.3758/s13414-018-01640-0
Niehorster, D. C., Gullberg, M., & Nyström, M. (2024). Behavioral science labs: How to solve the multi-user problem. Behavior Research Methods, 56, 8238-8258. https://doi.org/10.3758/s13428-024-02467-4
Niehorster, D. C., & Nyström, M. (2025). A toolbox for creating networked eye-tracking experiments in Python and MATLAB with Tobii eye trackers. Behavior Research Methods, 57, 8 pages. https://doi.org/10.3758/s13428-025-02714-2
Nyström, M., & Holmqvist, K. (2008). Semantic Override of Low-level Features in Image Viewing – Both Initially and Overall. Journal of Eye Movement Research, 2, 1–11.
Nyström, M., Niehorster, D. C., Cornelissen, T., & Garde, H. (2017). Real-time sharing of gaze data between multiple eye trackers–evaluation, tools, and advice. Behavior Research Methods, 49(4), 1310–1322. https://doi.org/10.3758/s13428-016-0806-1
Olsson, P. (2007). Real-time and Offline Filters for Eye Tracking. Master thesis, KTH, Sweden.
Pelli, D. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437–442.
Rayner, K. (Ed.). (1992). Eye Movements and Visual Cognition: Scene Perception and Reading. Springer New York. https://doi.org/10.1007/978-1-4612-2852-3
Rayner, K. (2009). The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology, 62(8), 1457–1506. https://doi.org/10.1080/17470210902816461
Sheridan, H., & Reingold, E. M. (2017). The holistic processing account of visual expertise in medical image perception: A review. Frontiers in Psychology, 8, 1620. https://doi.org/10.3389/fpsyg.2017.01620
Špakov, O. (2012). Comparison of eye movement filters used in HCI. Proceedings of the Symposium on Eye Tracking Research and Applications, 281–284. https://doi.org/10.1145/2168556.2168616
Špakov, O., Istance, H., Räihä, K.-J., Viitanen, T., & Siirtola, H. (2019). Eye gaze and head gaze in collaborative games. Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, 1–9. https://doi.org/10.1145/3317959.3321489
Strohmaier, A. R., MacKay, K. J., Obersteiner, A., & Reiss, K. M. (2020). Eye-tracking methodology in mathematics education research: A systematic literature review. Educational Studies in Mathematics, 104(2), 147–200. https://doi.org/10.1007/s10649-020-09948-1
Tunga, Y., & Cagiltay, K. (2023). Looking through the model’s eye: A systematic review of eye movement modeling example studies. Education and Information Technologies, 28(8), 9607–9633. https://doi.org/10.1007/s10639-022-11569-5
Van der Gijp, A., Ravesloot, C. J., Jarodzka, H., Van der Schaaf, M. F., Van der Schaaf, I. C., Van Schaik, J. P. J., & ten Cate, Th. J. (2017). How visual search relates to visual diagnostic performance: A narrative systematic review of eye-tracking research in radiology. Advances in Health Sciences Education, 22(3), 765–787. https://doi.org/10.1007/s10459-016-9698-1
Van Gog, T. (2021). The Signaling (or Cueing) Principle in Multimedia Learning. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge Handbook of Multimedia Learning (3rd ed., pp. 221–230). Cambridge University Press. https://doi.org/10.1017/9781108894333.022
Van Gog, T., Jarodzka, H., Scheiter, K., Gerjets, P., & Paas, F. (2009). Attention guidance during example study via the model’s eye movements. Computers in Human Behavior, 25(3), 785–791. https://doi.org/10.1016/j.chb.2009.02.007
Van Gog, T., Kok, E. M., Emhardt, S., Van Marlen, T., & Jarodzka, H. (2024). Eye movement modeling examples. In A. Gegenfurtner, & I. Kollar (Eds.), Designing effective digital learning environments (pp.90-105). Taylor & Francis. https://doi.org/10.4324/9781003386131-10
Van Gog, T., & Scheiter, K. (2010). Eye tracking as a tool to study and enhance multimedia learning [Editorial]. Learning and Instruction, 20(2), 95–99. https://doi.org/10.1016/j.learninstruc.2009.02.009
Van Marlen, T., Van Wermeskerken, M., Jarodzka, H., & Van Gog, T. (2016). Showing a model’s eye movements in examples does not improve learning of problem-solving tasks. Computers in Human Behavior, 65, 448–459. https://doi.org/10.1016/j.chb.2016.08.041
Van Marlen, T., Van Wermeskerken, M., Jarodzka, H., & Van Gog, T. (2018). Effectiveness of eye movement modeling examples in problem solving: The role of verbal ambiguity and prior knowledge. Learning and Instruction, 58, 274–283. https://doi.org/10.1016/j.learninstruc.2018.07.005
Velichkovsky, B. M. (1995). Communicating attention: Gaze position transfer in cooperative problem solving. Pragmatics & Cognition, 3(2), 199–223. https://doi.org/10.1075/pc.3.2.02vel
Vig, E., Dorr, M., & Cox, D. (2012). Space-Variant Descriptor Sampling for Action Recognition Based on Saliency and Eye Movements. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, & C. Schmid (Eds.), Computer Vision – ECCV 2012 (Vol. 7578, pp. 84–97). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-33786-4_7
Wang, F., Zhao, T., Mayer, R. E., & Wang, Y. (2020). Guiding the learner’s cognitive processing of a narrated animation. Learning and Instruction, 69, 101357. https://doi.org/10.1016/j.learninstruc.2020.101357
Xie, H., Zhao, T., Deng, S., Peng, J., Wang, F., & Zhou, Z. (2021). Using eye movement modelling examples to guide visual attention and foster cognitive performance: A meta‐analysis. Journal of Computer Assisted Learning, 37(4), 1194–1206. https://doi.org/10.1111/jcal.12568
Zhang, Y., Pfeuffer, K., Chong, M. K., Alexander, J., Bulling, A., & Gellersen, H. (2017). Look together: Using gaze for assisting co-located collaborative search. Personal and Ubiquitous Computing, 21(1), 173–186. https://doi.org/10.1007/s00779-016-0969-x