Remembering the future: Visual cortex saves energy by predicting what it will see

Published: 24 March 2010

Scientists have discovered the brain saves energy by predicting what it is likely to see.

Scientists have discovered the brain saves energy by predicting what it is likely to see.

According to researchers in the Department of Psychology at the University of Glasgow, working in collaboration with the Max-Planck Institute for Brain Research, Frankfurt, Germany, the visual cortex does not simply react to visual stimuli but proactively predicts what it is likely to see in any given context – for example, within familiar environments such as your house or office.

By doing so it uses less energy to process images, but if something unexpected were to appear in that familiar environment, the visual cortex becomes more active in order to process this information.

“Imagine your desk in your office,” said lead researcher Dr Lars Muckli. ”You’ve seen it a million times so your brain knows what it looks like so it doesn’t need to spend lots of time processing the scene. It already has a mental image of it and so the brain predicts that this is what it will see before you walk into the room.

“However, if you were to walk in to your office one day and see someone totally unexpected sitting in your chair – the Prime Minister, for example, your brain would have to work harder to process the same scene.”

The findings build on a fairly new hypothesis developed by University College London neuroscientist Karl Friston called predictive coding – or free energy principle – which suggests the brain is actively predicting what input it will receive, rather than just passively processing information as it arrives.

Dr Muckli said: “By predictive coding we refer to the idea that the brain generates predictions that estimate the visual input it will most likely receive given the contextual information from the recent past. For the brain it’s really about surprise reduction.”

To test the predictive coding hypothesis, the Glasgow researchers conducted an experiment where 12 volunteer subjects were asked to view a visual stimulus while undergoing and fMRI brain scan.

The subjects had to look at a fixed point on a computer screen above and below which two dots would flash alternately creating an illusion of motion.

For predictable/unpredictable trials, the researchers briefly presented a third dot on the screen. To test predictable stimulus the dot would appear at a point between the two other dots, timed to correlate to the illusion of smooth movement. For the unpredictable stimulus it would appear out of synch with the motion illusion.

The primary visual cortex (V1) of each subject was monitored while the tests were undertaken and the results showed that the predictable patterns resulted in less activity in V1, compared to the unpredictable stimulus.

Dr Muckli said: “The brain expects to see things and really just wants confirm it now and again – it’s almost like remembering the future.

“It might explain why sometimes you don’t notice something different in a familiar environment because your brain is seeing what it expects to see, rather than what is actually there.

“What we need to do now is extend this research to consider predictive coding in more natural environments and other aspects of sensory perception.”

The paper, ‘Stimulus Predictability Reduces Responses in Primary Visual Cortex’, was published in the Journal of Neuroscience.


For more information contact Stuart Forsyth in the University of Glasgow Media Relations Office on 0141 330 4831 or email s.forsyth@admin.gla.ac.uk

First published: 24 March 2010

<< March