Mary M Hayhoe
Professor — Ph.D., University of California, San Diego

Contact
- E-mail: hayhoe@utexas.edu
- Phone: (512) 475-9338
- Office: SEA 4.234
- Campus Mail Code: A8000
Biography
Vision naturally occurs in the context of voluntary information gathering movements involving the eyes, head, and hand. However, much work in vision is dominated by trying to understand the events occurring within a single view of a scene, and we have only limited understanding of the consequences of eye and head movements for vision and visuo-motor coordination. The technology to look at performance in more natural circumstances now exists, and I am currently developing a human sensory-motor lab, in collaboration with Dana Ballard in Computer Science, for measuring unconstrained eye, head, and hand movements in the performance of natural tasks, and for developing a virtual reality display to allow controlled but visually complex stimulation. We also have the capability of providing force feedback for two finger grasping. The new instrumentation allows a large range of experiments not previously possible. My objective is to understand the demands placed on vision and motor systems by natural behavior and the nature of the representations that are required for visually guided tasks.
Courses
PSY 394U • Intro To Sensory-Motor Systems
42889 • Fall 2022
Meets W 9:00AM-12:00PM SEA 3.250
UGS 302 • Seeing And Acting
60430 • Spring 2022
Meets MW 3:00PM-4:30PM GEA 127
Wr
ID
PSY 394U • Intro To Sensory-Motor Systems
43275 • Fall 2021
Meets W 9:00AM-12:00PM SEA 4.242
PSY 394U • Perception And Action
43280 • Fall 2021
Meets M 9:00AM-12:00PM SEA 4.242
PSY 341K • Vision And Action-Wb
42819 • Spring 2021
Meets TTH 11:00AM-12:30PM
Internet; Synchronous
PSY 341K • Vision And Action
42000 • Spring 2020
Meets TTH 11:00AM-12:30PM SEA 4.242
Wr
PSY 394U • Intro To Sensory-Motor Systems
41873 • Fall 2019
Meets W 9:00AM-12:00PM SEA 4.242
PSY 341K • Vision And Action
42564 • Spring 2019
Meets TTH 11:00AM-12:30PM SEA 4.242
Wr
PSY 394U • Intro To Sensory-Motor Systems
43390 • Fall 2017
Meets W 9:00AM-12:00PM SEA 4.242
PSY 341K • Vision And Action
43255 • Spring 2017
Meets TTH 11:00AM-12:30PM SEA 2.108
PSY 341K • Vision And Action
42380 • Spring 2016
Meets TTH 3:30PM-5:00PM SEA 4.244
PSY 394U • Perception And Action
42595 • Spring 2016
Meets W 9:00AM-12:00PM SEA 4.242
PSY 394U • Intro To Sensory-Motor Systems
42540 • Fall 2015
Meets M 9:00AM-12:00PM SEA 4.242
PSY 394U • Perception And Action
42945 • Spring 2015
Meets W 9:00AM-12:00PM SEA 4.242
PSY 394U • Perception And Action
44353 • Spring 2014
Meets W 9:00AM-12:00PM SEA 4.242
PSY 394U • Intro To Sensory-Motor Systems
43995 • Fall 2013
Meets F 1:00PM-4:00PM SEA 4.242
PSY 341K • Seeing/Acting In Virtual World
43435 • Spring 2013
Meets TTH 9:30AM-11:00AM SEA 4.242
Wr
C2
PSY 341K • Seeing/Acting In Virtual World
43280 • Spring 2012
Meets TTH 9:30AM-11:00AM SEA 3.250
Wr
PSY 394U • Intro To Sensory-Motor Systems
43425 • Fall 2011
Meets F 1:00PM-4:00PM SEA 4.242
PSY 394U • Intro To Sensory-Motor Systems
43385 • Fall 2010
Meets F 1:00PM-4:00PM SEA 4.242
PSY 341K • Seeing/Acting In Virtl World-W
43935 • Spring 2010
Meets TTH 9:30AM-11:00AM SEA 4.242
C2
NEU 394P • Perception And Action
58445 • Fall 2009
Meets F 1:00PM-4:00PM SEA 5.106
(also listed as PSY 394U)
PSY 394U • Intro To Cognitive Science
44346 • Fall 2009
Meets F 9:00AM-12:00PM SEA 4.330
PSY 341K • Seeing/Acting In Virtl World-W
43195 • Spring 2009
Meets TTH 9:30AM-11:00AM SEA 4.242
C2
PSY 394U • Perception And Action
44460 • Fall 2008
Meets F 1:00PM-4:00PM SEA 5.106
PSY 394U • Intro To Cognitive Science
44470 • Fall 2008
Meets F 9:00AM-12:00PM SEA 4.242
PSY 341K • Seeing/Acting In Virtl World-W
44100 • Spring 2008
Meets TTH 9:30AM-11:00AM SEA 4.242
C2
PSY 394U • Perception And Action
45355 • Fall 2007
Meets F 1:00PM-4:00PM SEA 5.106
PSY 341K • Seeing/Acting In Virtl World-W
43730 • Spring 2007
Meets TTH 2:00PM-3:30PM SEA 2.108
C2
PSY 394U • Intro To Cognitive Science
45133 • Fall 2006
Meets F 9:00AM-12:00PM SEA 4.244
Publications
McCann, B.C., Hayhoe, M.M. & Geisler, W.S. (2018) Contributions of monocular and binocular cues to distance discrimination in natural scenes. Journal of Vision 18, 12. doi:10.1167/18.4.12
download
Matthis, J.S., Yates, J.L. & Hayhoe, M.M. (2018) Gaze and the control of foot placement when walking in natural terrain. Current Biology 28,(8) p1224–1233.
download
Hayhoe, M. & Matthis, J.S. (2018) Control of Gaze in Natural Environments: Effects of Rewards and Costs, Uncertainty, and Memory in Target Selection. Interface Focus 8 (4), 20180009
download
Li, C., Aivar, M.P., Tong, M.H. & Hayhoe, M.M. (2018 ) Memory shapes visual search strategies in large-scale environments. Scientific Reports 8:4324
download
Hayhoe, M. (2018) What can be learnt from natural behavior? Teller Award Lecture. Journal of Vision 18, 10. doi:10.1167/18.4.10
download
Zhang, R., Zhang, S., Tong, M.H., Ballard, D.H. & Hayhoe, M.H. (2018) Modeling sensory-motor decisions in natural behavior. PLOS Computational Biology (in press).
download
Hayhoe, M. (2017) Vision and Action. Annual Review of Vision Science. 3:389-413. doi: 102016/061437
download
Tong, M.H., Zohar, O., & Hayhoe, M. (2017) Control of gaze while walking: Task structure, reward, and uncertainty. Journal of Vision. 17(1):28, 1-19. doi: 10.1167/17.1.28
download
Li, C., Aivar, M.P., Kit, D.M., Tong, M.H., Hayhoe, M.M. (2016) Memory and visual search in naturalistic 2D and 3D environments. Journal of Vision. 16(8):9. doi: 10.1167/16.8.9.
download
Kit D, Katz L, Sullivan B, Snyder K, Ballard D, et al. (2014) Eye Movements, Visual Search and Scene Memory, in an Immersive Virtual Environment. PLoS ONE 9(4): e94362. doi:10.1371/journal.pone.0094362
download
Hayhoe, M. & Ballard, D. (2014) Modeling task control of eye movements. Current Biology, 24(13), 622-628.
download
Diaz, G., Cooper, J., Kit, D., & Hayhoe, M. (2013) Real-time recording and classification of eye movements in an immersive virtual environment. J Vis October 10, 2013 13(12): 5; doi:10.1167/13.12.5
download
Diaz, G., Cooper, J., & Hayhoe, M. (2013) Memory and prediction in natural gaze control. Phil Trans Roy Soc B 368:20130064.
download
Johnson, L, Rothkopf, C, Ballard D & Hayhoe M. (2013) Predicting human visuo-motor behavior in a driving task. Phil Trans Roy Soc B 369:20130044.
download
Diaz, G, Cooper, J, Rothkopf, C, & Hayhoe, M. (2013) Saccades to future ball location reveal memory-based prediction in a natural interception task. Journal of Vision, 13(1)20, 1-14.
download
Delerue, C., Hayhoe, M, & Boucart, M. (2013) Eye movements during natural action in schizophrenia J Psychiatry & Neuroscience, 2013 Apr 3;38(3):120143.
download
Sullivan, B.T., Johnson, L., Rothkopf, C., Ballard, D. & Hayhoe, M.H. (2012) The role of uncertainty and reward on eye movements in a virtual driving task. Journal of Vision, 12(13):19, 1-17.
download
Hayhoe, M.H., McKinney, T., Chajka, K. & Pelz, J.B. (2011) Predictive eye movements in natural vision. Experimental Brain Research, 2011 Dec 20. [Epub ahead of print]
download
Hayhoe, M & Rothkopf, C. (2010) Vision in the natural world. Wiley Interdisciplinary Reviews: Cognitive Science, 2(2) 158-166.
download
Iorizzo, D.B., Riley, M.E., Hayhoe, M., & Huxlin, K.R. (2011). Differential impact of partial cortical blindness on gaze strategies when sitting and walking - An immersive virtual reality study. Vision Research, 51, pp. 1173-1184.
download
Tatler, B. W., Hayhoe, M., Land, M. F., & Ballard, D. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5), pp. 1-23.
download
McCann, B., Hayhoe, M. & Geisler, W.S. (2011) Decoding natural signals from peripheral retina. Journal of Vision, 11(10):19, 1-11.
download
Hamid, S. N., Stankiewicz, B., & Hayhoe, M. (2010). Gaze patterns in navigation: Encoding information in large-scale environments. Journal of Vision, 10(12), pp. 1-11.
download
Hayhoe, M. & Droll, J. (2009) Seeing what we can do: Insights into vision and action through observations of natural behaviors. In P. Calvo & G. Gomila (Eds.), Handbook of Embodied Cognitive Science. Elsevier.
Hayhoe, M. (2009) Visual Memory in Motor Planning and Action. In J. Brockmole (Ed.), Memory for the Visual World (pp.117-139). Psychology Press.
download
Huxlin, K., Martin, T., Kelly, K., Riley, M., Friedman, D. & Burgin, W. & Hayhoe, M. (2009, September) Perceptual re-learning of complex visual motion after V1 damage in humans. J Neurosci, 29(13) 3981-3991.
download
Hayhoe, M. & Ballard, D. (2009) Modeling the role of task in the control of gaze. Visual Cognition, 17(6-7), pp. 1185-1204.
download
Joyanceyic, J. & Hayhoe, M.(2009) Adaptive gaze control in natural environments. J Neurosci, 29(19), 6234-6238.
download
Hayhoe, M.H., Gillam, B., Chajka, K. & Vecellio, E. (2008) The role of binocular vision in walking. Visual Neuroscience 26(1):73-80.
download
Droll, J.A., Gigone, K. & Hayhoe, M. (2008) Learning where to direct gaze during change detection. Journal of Vision, 7(14):6, 1-12.
download
Sullivan, B., Jovancevic-Misic, J., Hayhoe, M. & Sterns, G. (2008) Use of multiple preferred retinal loci in Stargardt's disease during natural tasks: a case study*. Ophthalmic & Phys Optics, 28, 168-177.
download
Hayhoe, M., Droll, J. & Mennie, N. (2007) Learning where to look. In R. Van Gompel, M. Fischer, W. Murray & R. Hill (Eds.), Eye movements: A window on mind and brain (pp.641-660). Oxford: Elsevier.
download
Hayhoe, M. & Droll, J. (2007) Deciding when to remember and when to forget: Trade-offs between working memory and gaze. JEP-HPP, 33(6), 1352-1365.
Karacan, H. & Hayhoe, M. (2007) Is attention drawn to changes in familiar scences?. Visual Cognition, 16(2), 346-374.
download
Rothkopf, C., Ballard, D., & Hayhoe, M. (2007) Task and context determine where you look. J of Vision, 7(14):16, 1-20.
download
Martin, T., Riley, M., Kelly, K., Hayhoe, M. & Huxlin, K. (2007) Visually-guided behavior of homonymous hemianopes in a naturalistic task. Vision Research, 47, 3434-3446.
download
Droll, J. & Hayhoe, M. (2007) Trade-offs between gaze and working memory use. Journal of Experimental Psychology:Human Perception and Performance, 33(6), 1352-1365.
download
Hayhoe, M. (2006) Integrating information across saccadic eye movements. In M. Peterson, B. Gillam & H. Sedgwick (Eds.), In the Mind's Eye: Julian Hochberg on the Perception of Pictures, Film, and the World. NY: Oxford University Press, 448-453.
download
Jovanevic, J., Sullivan, B., Hayhoe, M. (2006) Control of attention and gaze in complex environments. Journal of Vision, 6, 1431-1450.
download
Mennie, N., Hayhoe, M., & Sullivan, B. (2006) Look-ahead fixations: anticipatory eye movements in natural tasks. Experimental Brain Research, 179, 427-442.
download
Hayhoe, M. & Ballard, D. (2005) Eye movements in natural behavior. Trends in Cognitive Science, 9, 188-194.
download
Droll, J., Hayhoe, M., Triesch, J. & Sullivan, B. (2005) Task demands control acquisition and storage of visual information. J. Experimental Psychology, 31, 1416-1438.
download
Hayhoe, M., Mennie, N., Sullivan, B. & Gorgos, K. (2005) The role of internal models and prediction in catching balls. Proceedings of AAAI Fall Symposium Series, Fall 2005.
download
Aivar, M.P., Hayhoe, M.M., Chizk, C.L. & Mruczek, R.E.B. (2005) Spatial memory and saccadic targeting in a natural task. Journal of Vision, 5, 177-193.
download
Hayhoe, M. (2004) Advances in relating eye movements and cognition. Infancy 6, 267-274.
download
Hayhoe, M., Shrivastrava, A., Myruczek, R. & Pelz, J. (2003) Visual memory and motor planning in a natural task. J. of Vision, 3, 49-63.
download
Triesch, J., Ballard, D., Hayhoe, M. & Sullivan, B. (2003) What you see is what you need. J. of Vision, 3, 86-94.
download
Shimozaki, S., Hayhoe, M., Zelinsky, G., Weinstein, A., Merigan, W. & Ballard, D. (2003) Effect of parietal lobe lesions on saccade targeting and spatial memory in a naturalistic visual search task. Neuropsychologia, 41, 1365-1386.
download
Rao, R., Zelinsky, G., Hayhoe, M. & Ballard, D. (2002) Eye movements in iconic visual search. Vision Research, 42, 1447-1463.
download
Hayhoe, M., Ballard, D., Triesch, J. & Shinoda, H., Aivar, P., Sullivan, B. (2002) Vision in natural and virtual environments. Proceedings, Eye Tracking Research & Applications, 7-13.
download
Hayhoe, M., Triesch, J., Sullivan, B. & Ballard, D. (2002) Saccade contingent scene changes in unconstrained virtual reality. Proceedings, Eye Tracking Research & Application, 95-102.
Hayhoe, M. (2002) Visual short term memory and motor control. The Brain's Eyes: Neurobiological and Clinical Aspects of Oculomotor Research. In J. Hyona, D. Munoz, W. Heide & R. Radach (Eds.), Progress in Brain Research (pp.349-363). Elsevier.
Pelz, J., Hayhoe, M. & Loeber, R. (2001) The coordination of eye, head, and hand movements in a natural task. Experimental Brain Research, 139, 266-277.
download
Land, M. & Hayhoe, M. (2001) In what ways do eye movements contribute to everday activities?. Vision Research, 41, 3559-3566.
download
Shinoda, H., Hayhoe, M. & Shrivastava, A. (2001) What controls attention in natural environments? Vision Research, 41, 3535-3546.
download
Hayhoe, M. (2000) Vision using routines: a functional account of vision. Visual Cognition, 7, 43-64.
download
Karn, K. & Hayhoe, M. (2000) Memory representations guide targeting eye movements in a natural task. Visual Cognition, 7(6), 673-704.
download
Hayhoe, M., Bensinger, D. & Ballard, D. (1998) Task constraints in visual working memory. Vision Research, 38, 125-137.
download
Karn, K. & Moeller, P. & Hayhoe, M. (1997) Reference Frames in Saccade Targeting. Exp Brain Research, 115, 267-282.
download
Ballard, D., Hayhoe, M., Pook, P. & Rao, R. (1997) Deictic codes for the embodiment of cognition. Behavioral & Brain Sciences, 20, 723-767.
download
Hayhoe, M., Zelinsky, G., Rao, R. & Ballard, D. (1997) Eye movements reveal the spatio-temporal dynamics of visual search. Psychological Science, 8, 448-453.
Hayhoe, M., Rao, R., Zelinsky, G. & Ballard, D. (1996) Modelling Saccade Targeting in visual search. In D. Touretzky, M. Mozer & M. Hasselmo (Eds.), Advances in Neural Information Processing Systems (pp.830-836). Cambridge: MIT Press.
Hayhoe, M., Smeets, J. & Ballard, D. (1996) Influence of hand movements on eye-head coordination. Experimental Brain Res., 109, 434-440.
Pelz, J. & Hayhoe, M. (1995) Influence of the visual scene in visual direction constancy. Vision Res., 35, 2267-2275.
Ballard, D., Hayhoe, M. & Pelz, J. (1995) Memory representations in natural tasks. Cognitive Neuroscience, 7, 66-80.
download
Lachter, J. & Hayhoe, M. (1995) Capacity limitations in memory for visual locations. Perception, 24, 1427-1441.
Hayhoe, M., Lachter, J. & Feldman, J. (1991) Integration of form across saccadic eye movements. Perception, 20, 393-402.
download
Research Videos
Racquetball Demo
Saccade-ahead Movie
Smooth Pursuit Movie
Squash Movie
PBJ Movie
High Uncertainty Movie
Low Uncertainty Movie