Engineering:Holographic associative memory

Short description: Information storage system

For holographic data storage, holographic associative memory (HAM) is an information storage and retrieval system based on the principles of holography. Holograms are made by using two beams of light, called a "reference beam" and an "object beam". They produce a pattern on the film that contains them both. Afterwards, by reproducing the reference beam, the hologram recreates a visual image of the original object. In theory, one could use the object beam to do the same thing: reproduce the original reference beam. In HAM, the pieces of information act like the two beams. Each can be used to retrieve the other from the pattern. It can be thought of as an artificial neural network which mimics the way the brain uses information. The information is presented in abstract form by a complex vector which may be expressed directly by a waveform possessing frequency and magnitude. This waveform is analogous to electrochemical impulses believed to transmit information between biological neuron cells.

Definition

HAM is part of the family of analog, correlation-based, associative, stimulus-response memories, where information is mapped onto the phase orientation of complex numbers. It can be considered as a complex valued artificial neural network. The holographic associative memory exhibits some remarkable characteristics. Holographs have been shown to be effective for associative memory tasks, generalization, and pattern recognition with changeable attention. Ability of dynamic search localization is central to natural memory. For example, in visual perception, humans always tend to focus on some specific objects in a pattern. Humans can effortlessly change the focus from object to object without requiring relearning. HAM provides a computational model which can mimic this ability by creating representation for focus. At the heart of this new memory lies a novel bi-modal representation of pattern and a hologram-like complex spherical weight state-space. Besides the usual advantages of associative computing, this technique also has excellent potential for fast optical realization because the underlying hyper-spherical computations can be naturally implemented on optical computations.

It is based on principle of information storage in the form of stimulus-response patterns where information is presented by phase angle orientations of complex numbers on a Riemann surface. A very large number of stimulus-response patterns may be superimposed or "enfolded" on a single neural element. Stimulus-response associations may be both encoded and decoded in one non-iterative transformation. The mathematical basis requires no optimization of parameters or error backpropagation, unlike connectionist neural networks. The principal requirement is for stimulus patterns to be made symmetric or orthogonal in the complex domain. HAM typically employs sigmoid pre-processing where raw inputs are orthogonalized and converted to Gaussian distributions.

Principles of operation

1. Stimulus-response associations are both learned and expressed in one non-iterative transformation. No backpropagation of error terms or iterative processing required.
2. The method forms a non-connectionist model in which the ability to superimpose a very large set of analog stimulus-response patterns or complex associations exists within the individual neuron cell.
3. The generated phase angle communicates response information, and magnitude communicates a measure of recognition (or confidence in the result).
4. The process permits a capability with neural system to establish dominance profile of stored information, thus exhibiting a memory profile of any range - from short-term to long-term memory.
5. The process follows the non-disturbance rule, that is prior stimulus-response associations are minimally influenced by subsequent learning.
6. The information is presented in abstract form by a complex vector which may be expressed directly by a waveform possessing frequency and magnitude. This waveform is analogous to electrochemical impulses believed to transmit information between biological neuron cells.

See also

• AND Corporation
• Holographic data storage
• Holonomic brain theory
• Self-organizing map
• Sparse distributed memory

Further reading

• Gopalan, R. P.; Lee, G (2002). "Indexing of Image Databases Using Untrained 4D Holographic Memory Model". in McKay, R. I.; Slaney, J.. 15th Australian Joint Conference on Artificial Intelligence. Springer. pp. 237–248. 
• Hendra, Y.; Gopalan, R. P.; Nair, M. G. (1999). "A method for dynamic indexing of large image databases". IEEE SMC'99. Systems, Man, and Cybernetics. 
• Khan, J. I. (August 1995). Attention Modulated Associative Computing and Content-Associative Search in Image Archive (PDF) (PhD thesis). University of Hawaii.
• Michel, H. E.; Awwal, A. A. S. (1999). "Enhanced artificial neural networks using complex numbers". IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339. 1. Washington, DC, USA. pp. 456–461. doi:10.1109/IJCNN.1999.831538. 
• Michel, H. E.; Kunjithapatham, S. (2002). "Processing Landsat TM data using complex-valued neural networks". Proceedings of SPIE. Data Mining and Knowledge Discovery: Theory, Tools, and Technology IV (International Society for Optical) 4730: 43–51. doi:10.1117/12.460209. https://pdfs.semanticscholar.org/e1f3/8018ce36d455d441492e3dd17c7d58e3ce03.pdf. 
• Stoop, R.; Buchli, J.; Keller, G.; Steeb, W. H. (2003). "Stochastic resonance in pattern recognition by a holographic neuron model". Physical Review E 67. https://infoscience.epfl.ch/record/58512/files/stoop03.pdf.