Pulse-coupled networks
Pulse-coupled networks or pulse-coupled neural networks (PCNNs) are neural models proposed by modeling a cat's visual cortex, and developed for high-performance biomimetic image processing.[1] In 1989, Eckhorn introduced a neural model to emulate the mechanism of cat's visual cortex. The Eckhorn model provided a simple and effective tool for studying small mammal’s visual cortex, and was soon recognized as having significant application potential in image processing.
In 1994, Johnson adapted the Eckhorn model to an image processing algorithm, calling this algorithm a pulse-coupled neural network. Over the past decade, PCNNs have been used in a variety of image processing applications, including: image segmentation, feature generation, face extraction, motion detection, region growing, and noise reduction.
The basic property of the Eckhorn's linking-field model (LFM) is the coupling term. LFM is a modulation of the primary input by a biased offset factor driven by the linking input. These drive a threshold variable that decays from an initial high value. When the threshold drops below zero it is reset to a high value and the process starts over. This is different than the standard integrate-and-fire neural model, which accumulates the input until it passes an upper limit and effectively "shorts out" to cause the pulse.
LFM uses this difference to sustain pulse bursts, something the standard model does not do on a single neuron level. It is valuable to understand, however, that a detailed analysis of the standard model must include a shunting term, due to the floating voltages level in the dendritic compartment(s), and in turn this causes an elegant multiple modulation effect that enables a true higher-order network (HON).[2] Multidimensional pulse image processing of chemical structure data using PCNN has been discussed by Kinser, et al.[3]
A PCNN is a two-dimensional neural network. Each neuron in the network corresponds to one pixel in an input image, receiving its corresponding pixel's color information (e.g. intensity) as an external stimulus. Each neuron also connects with its neighboring neurons, receiving local stimuli from them. The external and local stimuli are combined in an internal activation system, which accumulates the stimuli until it exceeds a dynamic threshold, resulting in a pulse output. Through iterative computation, PCNN neurons produce temporal series of pulse outputs. The temporal series of pulse outputs contain information of input images and can be used for various image processing applications, such as image segmentation and feature generation. Compared with conventional image processing means, PCNNs have several significant merits, including robustness against noise, independence of geometric variations in input patterns, capability of bridging minor intensity variations in input patterns, etc.
A simplified PCNN called a spiking cortical model was developed in 2009.[4]
PCNNs are useful for image processing, as discussed in a book by Thomas Lindblad and Jason M. Kinser.[5]
Applications
PCNN is proven success in many academic and industrial fields, such as image processing (image denoising,[6] and image enhancement [7]), all pairs shortest path problem,[8] and pattern recognition.
References
- ↑ Zhan, K.; Shi, J.; Wang, H.; Xie, Y.; Li, Q. (2017). "Computational mechanisms of pulse-coupled neural networks: A comprehensive review". Archives of Computational Methods in Engineering 24 (3): 573–588. doi:10.1007/s11831-016-9182-3. https://github.com/kunzhan/Pulse-coupled_neural_networks_PCNN.
- ↑ See Johnson and Padgett IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 3, MAY 1999, page 480-498 for the shunting terms, and C. Lee Giles' old work from the late 80's on HONs)
- ↑ Jason M. Kinser a, Karina Waldemark b, Thomas Lindblad b, Sven P. Jacobsson in Chemometrics and Intelligent Laboratory Systems 51, 2000.115–124
- ↑ K. Zhan, H.J. Zhang, Y.D. Ma. New spiking cortical model for invariant texture retrieval and image processing. IEEE Trans. on neural networks, 2009, 20(12): 1980-1986.
- ↑ Image Processing Using Pulse-Coupled Neural Networks, Second, Revised Version, Springer Verlag ISBN:3-540-24218-X
- ↑ Zhang, Y. (2008). "Improved Image Filter based on SPCNN". Science in China Series F 51 (12): 2115–2125. doi:10.1007/s11432-008-0124-z.
- ↑ Wu, L. (2010). "Color Image Enhancement based on HVS and PCNN". Science China Information Sciences 53 (10): 1963–1976. doi:10.1007/s11432-010-4075-9.
- ↑ Wei, G.; Wang, S. (2011). "A novel algorithm for all pairs shortest path problem based on matrix multiplication and pulse coupled neural network". Digital Signal Processing 21 (4): 517–521. doi:10.1016/j.dsp.2011.02.004.
 |  |
