Efficient Coding Hypothesis Article Index for
Efficient
Shopping
Coding
Website Links For
Coding
 

Information About

Efficient Coding Hypothesis





EFFICIENT CODING AND INFORMATION THEORY


The development of the Barlow's hypothesis was influenced by Information Theory introduced by Claude Shannon only a decade before. Information theory provides the mathematical framework for analyzing communication systems. It formally defines concepts such as information, channel capacity, and redundancy. Barlow's model treats the sensory pathway as a communications channel where neuronal spiking is an efficient code for representing sensory signals. The spiking code aims to maximize available channel capacity by minimizing the redundancy between representational units.

A key prediction of the efficient coding hypothesis is that sensory processing in the brain should be adapted to natural stimuli. Neurons in the visual (auditory) system should be optimized for coding images (sounds) representative of those found in nature. Researchers have shown that filters optimized for coding natural images lead to filters which resemble the receptive fields of simple-cells in V1 . In the auditory domain, optimizing a network for coding natural sounds leads to filters which resemble the impulse response of cochlear filters found in the inner ear.


REFERENCES


  • Barlow, H. (1961) 'Possible principles underlying the transformation of sensory messages' in Sensory Communication, MIT Press


  • Lewicki, M.S. (2002) Efficient coding of natural sounds. Nature: Neuroscience, 5(4):356–363


  • Olshausen, B. A. and Field, D.J. (1997) Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research, 37(23):3311–3325