Abstract
Title of talk: Predicting where to attend in reading and scene perception
Due to our foveated visual system, we constantly need to predict where to attend next, while at the same time cognitively processing the stimulus at fixation as well as previously attended stimuli.
Eye tracking in combination with gaze-contingent display manipulations allows deep insights into how these parallel processes are coordinated. I will present recent research from my lab that addresses how ongoing higher-level cognitive processes guide the prediction of where to attend during reading and scene perception. In reading, the perceptual span gives a real-time readout of how far ahead in the text we attend. We show that the perceptual span is dynamically influenced by ongoing word processing, grows with development, and is longitudinally predicted by executive functioning. We also provide evidence that word predictability from context has a strong influence on how long we need to fixate a given word, suggesting that we constantly generate predictions when reading a sentence. Interestingly, such linguistic predictions also seem to guide where we attend in images during scene perception. We computed linguistic statistics on verbal scene descriptions obtained from humans or large language models and show that these statistics predict where and in which sequence an independent sample of participants attends to the image. Whereas earlier studies of scene perception focused on low-level visual saliency, and more recent studies emphasized the importance of objects, these new results suggest that narrative structure and composition of a scene additionallly guide attention.
About the speaker
Jochen is a senior research associate, senior lecturer, and director of the Eye Lab at the University of Potsdam in Germany. He is a regular attendant of international eye movement conferences. Jochen has been running eye tracking studies for many years, including a longitudinal study on the development of the perceptual span during reading. His research interests range from visual perception and attention via language and psycholinguistics to cognitive control.
This event is open to everyone, no registration needed.