Optical neural network

From HandWiki
Schematic of an optical neural network that functions as a logic gate (above) and its implementation in microwave frequencies (below). The intermediate diffractive metasurfaces function as hidden layers.[1]

An optical neural network is a physical implementation of an artificial neural network with optical components. Early optical neural networks used a photorefractive Volume hologram to interconnect arrays of input neurons to arrays of output with synaptic weights in proportion to the multiplexed hologram's strength.[2] Volume holograms were further multiplexed using spectral hole burning to add one dimension of wavelength to space to achieve four dimensional interconnects of two dimensional arrays of neural inputs and outputs.[3] This research led to extensive research on alternative methods using the strength of the optical interconnect for implementing neuronal communications.[4]

Some artificial neural networks that have been implemented as optical neural networks include the Hopfield neural network[5] and the Kohonen self-organizing map with liquid crystal spatial light modulators[6] Optical neural networks can also be based on the principles of neuromorphic engineering, creating neuromorphic photonic systems. Typically, these systems encode information in the networks using spikes, mimicking the functionality of spiking neural networks in optical and photonic hardware. Photonic devices that have demonstrated neuromorphic functionalities include (among others) vertical-cavity surface-emitting lasers,[7][8] integrated photonic modulators,[9] optoelectronic systems based on superconducting Josephson junctions[10] or systems based on resonant tunnelling diodes.[11]

Electrochemical vs. optical neural networks

Biological neural networks function on an electrochemical basis, while optical neural networks use electromagnetic waves. Optical interfaces to biological neural networks can be created with optogenetics, but is not the same as an optical neural networks. In biological neural networks there exist a lot of different mechanisms for dynamically changing the state of the neurons, these include short-term and long-term synaptic plasticity. Synaptic plasticity is among the electrophysiological phenomena used to control the efficiency of synaptic transmission, long-term for learning and memory, and short-term for short transient changes in synaptic transmission efficiency. Implementing this with optical components is difficult, and ideally requires advanced photonic materials. Properties that might be desirable in photonic materials for optical neural networks include the ability to change their efficiency of transmitting light, based on the intensity of incoming light.

Rising Era of Optical Neural Networks

With the increasing significance of computer vision in various domains, the computational cost of these tasks has increased, making it more important to develop the new approaches of the processing acceleration. Optical computing has emerged as a potential alternative to GPU acceleration for modern neural networks, particularly considering the looming obsolescence of Moore's Law. Consequently, optical neural networks have garnered increased attention in the research community. Presently, two primary methods of optical neural computing are under research: silicon photonics-based and free-space optics. Each approach has its benefits and drawbacks; while silicon photonics may offer superior speed, it lacks the massive parallelism that free-space optics can deliver. Given the substantial parallelism capabilities of free-space optics, researchers have focused on taking advantage of it. One implementation, proposed by Lin et al.,[12] involves the training and fabrication of phase masks for a handwritten digit classifier. By stacking 3D-printed phase masks, light passing through the fabricated network can be read by a photodetector array of ten detectors, each representing a digit class ranging from 1 to 10. Although this network can achieve terahertz-range classification, it lacks flexibility, as the phase masks are fabricated for a specific task and cannot be retrained. An alternative method for classification in free-space optics, introduced by Cahng et al.,[13] employs a 4F system that is based on the convolution theorem to perform convolution operations. This system uses two lenses to execute the Fourier transforms of the convolution operation, enabling passive conversion into the Fourier domain without power consumption or latency. However, the convolution operation kernels in this implementation are also fabricated phase masks, limiting the device's functionality to specific convolutional layers of the network only. In contrast, Li et al.[14] proposed a technique involving kernel tiling to use the parallelism of the 4F system while using a Digital Micromirror Device (DMD) instead of a phase mask. This approach allows users to upload various kernels into the 4F system and execute the entire network's inference on a single device. Unfortunately, modern neural networks are not designed for the 4F systems, as they were primarily developed during the CPU/GPU era. Mostly because they tend to use a lower resolution and a high number of channels in their feature maps.

Other Implementations

In 2007 there was one model of Optical Neural Network: the Programmable Optical Array/Analogic Computer (POAC). It had been implemented in the year 2000 and reported based on modified Joint Fourier Transform Correlator (JTC) and Bacteriorhodopsin (BR) as a holographic optical memory. Full parallelism, large array size and the speed of light are three promises offered by POAC to implement an optical CNN. They had been investigated during the last years with their practical limitations and considerations yielding the design of the first portable POAC version.

The practical details – hardware (optical setups) and software (optical templates) – were published. However, POAC is a general purpose and programmable array computer that has a wide range of applications including:

See also

References

  1. ↑ Qian, Chao; Lin, Xiao; Lin, Xiaobin; Xu, Jian; Sun, Yang; Li, Erping; Zhang, Baile; Chen, Hongsheng (2020). "Performing optical logic operations by a diffractive neural network". Light: Science & Applications 9 (59): 59. doi:10.1038/s41377-020-0303-2. PMID 32337023. Bibcode: 2020LSA.....9...59Q. 
  2. ↑ "Adaptive optical networks using photorefractive crystals". Appl. Opt. 27 (9): 1752–1759. 1988. doi:10.1364/AO.27.001752. PMID 20531647. Bibcode: 1988ApOpt..27.1752P. http://infoscience.epfl.ch/record/158535. 
  3. ↑ "Fully interconnected, two-dimensional neural arrays using wavelength-multiplexed volume holograms". Optics Letters 16 (11): 826–828. 1991. doi:10.1364/OL.16.000826. PMID 19776798. Bibcode: 1991OptL...16..826W. 
  4. ↑ "Optical neural networks: an introduction by the feature editors". Appl. Opt. 32 (8): 1261–1263. 1993. doi:10.1364/AO.32.001261. PMID 20820259. Bibcode: 1993ApOpt..32.1261W. http://infoscience.epfl.ch/record/158511. 
  5. ↑ "Optical Implementation of Two Dimensional Bipolar Hopfield Model Neural Network (Scientific Note)". Proceedings-National Science Council Republic of China Part a Physical Science and Engineering 24 (1): 73–8. 2000. http://nr.stic.gov.tw/ejournal/ProceedingA/v24n1/73-78.pdf. 
  6. ↑ "All-optical implementation of a self-organizing map: a preliminary approach". Applied Optics 33 (2): 258–66. January 1994. doi:10.1364/AO.33.000258. PMID 20862015. Bibcode: 1994ApOpt..33..258D. 
  7. ↑ "Neuromorphic encoding of image pixel data into rate-coded optical spike trains with a photonic VCSEL-neuron" (in en). APL Photonics 6 (6): 060802. 2021-06-01. doi:10.1063/5.0048674. ISSN 2378-0967. Bibcode: 2021APLP....6f0802H. 
  8. ↑ "Ultrafast optical integration and pattern classification for neuromorphic photonics based on spiking VCSEL neurons". Scientific Reports 10 (1): 6098. April 2020. doi:10.1038/s41598-020-62945-5. PMID 32269249. Bibcode: 2020NatSR..10.6098R. 
  9. ↑ "Neuromorphic photonics with electro-absorption modulators". Optics Express 27 (4): 5181–5191. February 2019. doi:10.1364/OE.27.005181. PMID 30876120. Bibcode: 2019OExpr..27.5181G. 
  10. ↑ "Fluxonic Processing of Photonic Synapse Events". IEEE Journal of Selected Topics in Quantum Electronics 26 (1): 1–15. January 2020. doi:10.1109/JSTQE.2019.2927473. ISSN 1077-260X. Bibcode: 2020IJSTQ..2627473S. https://ieeexplore.ieee.org/document/8758167. 
  11. ↑ "Excitability and optical pulse generation in semiconductor lasers driven by resonant tunneling diode photo-detectors". Optics Express 21 (18): 20931–40. September 2013. doi:10.1364/OE.21.020931. PMID 24103966. Bibcode: 2013OExpr..2120931R. 
  12. ↑ Lin, Xing; Rivenson, Yair; Yardimci, Nezih T.; Veli, Muhammed; Luo, Yi; Jarrahi, Mona; Ozcan, Aydogan (7 September 2018). "All-optical machine learning using diffractive deep neural networks". Science 361 (6406): 1004–1008. doi:10.1126/science.aat8084. PMID 30049787. Bibcode: 2018Sci...361.1004L. https://www.science.org/doi/abs/10.1126/science.aat8084. 
  13. ↑ Chang, Julie; Sitzmann, Vincent; Dun, Xiong; Heidrich, Wolfgang; Wetzstein, Gordon (17 August 2018). "Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification". Scientific Reports 8 (1): 12324. doi:10.1038/s41598-018-30619-y. PMID 30120316. Bibcode: 2018NatSR...812324C. 
  14. ↑ Li, Shurui; Miscuglio, Mario; Sorger, Volker J.; Gupta, Puneet (2020). "Channel Tiling for Improved Performance and Accuracy of Optical Neural Network Accelerators". arXiv:2011.07391 [cs.ET].



Retrieved from "https://handwiki.org/wiki/index.php?title=Optical_neural_network&oldid=3373625"