Biology:Normalization model

From HandWiki

The normalization model[1] is an influential model of responses of neurons in primary visual cortex. David Heeger developed the model in the early 1990s,[2] and later refined it together with Matteo Carandini and J. Anthony Movshon.[3] The model involves a divisive stage. In the numerator is the output of the classical receptive field. In the denominator, a constant plus a measure of local stimulus contrast. Although the normalization model was initially developed to explain responses in the primary visual cortex, normalization is now thought to operate throughout the visual system, and in many other sensory modalities and brain regions, including the representation of odors in the olfactory bulb,[4] the modulatory effects of visual attention, the encoding of value, and the integration of multisensory information. It has also been observed at subthreshold potentials in the hippocampus.[5] Its presence in such a diversity of neural systems in multiple species, from invertebrates to mammals, suggests that normalization serves as a canonical neural computation.[1] Divisive normalization reduces the redundancy in natural stimulus statistics[6] and is sometimes viewed as an implementation of the efficient coding principle. Formally, divisive normalization is an information-maximizing code for stimuli following a multivariate Pareto distribution.[7]

References

  1. 1.0 1.1 Carandini, M.; Heeger, D. J. (2011). "Normalization as a canonical neural computation". Nature Reviews Neuroscience 13 (1): 51–62. doi:10.1038/nrn3136. PMID 22108672. 
  2. Heeger, D. J. (1992). "Normalization of cell responses in cat striate cortex". Visual Neuroscience 9 (2): 181–197. doi:10.1017/S0952523800009640. PMID 1504027. 
  3. Carandini, M; Heeger, DJ; Movshon, JA (1997). "Linearity and normalization in simple cells of the macaque primary visual cortex". Journal of Neuroscience 17 (21): 8621–44. doi:10.1523/JNEUROSCI.17-21-08621.1997. PMID 9334433. 
  4. Olsen SR, Bhandawat V, Wilson R (2011). "Divisive normalization in olfactory population codes". Neuron 66 (2): 287–299. doi:10.1016/j.neuron.2010.04.009. PMID 20435004. 
  5. Bhatia A, Moza S, Bhalla US (2019). "Precise excitation-inhibition balance controls gain and timing in the hippocampus". eLife 8. doi:10.7554/eLife.43415. PMID 31021319. 
  6. Schwartz, O; Simoncelli, EP (2001). "Natural signal statistics and sensory gain control.". Nature Neuroscience 4 (8): 819–25. doi:10.1038/90526. PMID 11477428. 
  7. Bucher, SF; Brandenburger, AM (2022). "Divisive normalization is an efficient code for multivariate Pareto-distributed environments.". Proceedings of the National Academy of Sciences of the United States of America 119 (40): e2120581119. doi:10.1073/pnas.2120581119. PMID 36161961. Bibcode2022PNAS..11920581B.