Stochastic Neural Analog Reinforcement Calculator

From HandWiki
Short description: Neural-net machine

The Stochastic Neural Analog Reinforcement Calculator (SNARC) is a neural-net machine designed by Marvin Lee Minsky.[1] Prompted by a letter from Minsky, George Armitage Miller gathered the funding for the project from the Air Force Office of Scientific Research in the summer of 1951 with the work to be carried out by Minsky, who was then a graduate student in mathematics at Princeton University. At the time, a physics graduate student at Princeton, Dean S. Edmonds,[2] volunteered that he was good with electronics and therefore Minsky brought him onto the project.[3]

During undergraduate years, he was inspired by the 1943 Warren McCulloch and Walter Pitts paper on artificial neurons, and decided to build such a machine. The learning was Skinnerian reinforcement learning, and Minsky talked with Skinner extensively during the development of the machine. The machine simulated rats running in a maze, and the circuit was reinforced each time the simulated rat reached the goal. The machine surprised its creators. "The rats actually interacted with one another. If one of them found a good path, the others would tend to follow it."[3]

The machine itself is a randomly connected network of approximately 40 Hebb synapses. These synapses each have a memory that holds the probability that signal comes in one input and another signal will come out of the output. There is a probability knob that goes from 0 to 1 that shows this probability of the signals propagating. If the probability signal gets through, a capacitor remembers this function and engages a "clutch". At this point, the operator will press a button to give reward to the machine. At this point, a large motor starts and there is a chain that goes to all 40 synapse machines, checking if the clutch is engaged or not. As the capacitor can only "remember" for a certain amount of time, the chain only catches the most recent updates of the probabilities.

Each synapse machine contained 6 vacuum tubes, and the tubes failed regularly, but the machine would still work despite failures.[3]

This machine is considered one of the first pioneering attempts at the field of artificial intelligence. Minsky went on to be a founding member of MIT's Project MAC, which split to become the MIT Laboratory for Computer Science and the MIT Artificial Intelligence Lab, and is now the MIT Computer Science and Artificial Intelligence Laboratory. In 1985 Minsky became a founding member of the MIT Media Laboratory.

References

Citations
  1. ↑ Crevier 1993, pp. 34–35 and Russell & Norvig 2003, p. 17
  2. ↑ Edmonds, Jr, Dean S. (12 May 2021). "Recollections of my Wartime and University Experiences". https://ethw.org/First-Hand:Recollections_of_my_Wartime_and_University_Experiences_in_Nuclear_Physics. 
  3. ↑ 3.0 3.1 3.2 Bernstein, Jeremy (1981-12-06). "Marvin Minsky's Vision of the Future" (in en-US). The New Yorker. ISSN 0028-792X. https://www.newyorker.com/magazine/1981/12/14/a-i. Retrieved 2023-10-29. 
Works cited
  • Crevier, Daniel (1993). AI: The Tumultuous Search for Artificial Intelligence. New York, NY: BasicBooks. ISBN 0-465-02997-3. 
  • Russell, Stuart; Norvig, Peter (2003). Artificial Intelligence: A Modern Approach. London, England: Pearson Education. ISBN 0-137-90395-2. 

Further reading

  • Levy, Steven (2010). Hackers. Sebastapol, California: O'Reilly. ISBN 978-1-449-38839-3. 
  • A Neural-Analogue Calculator Based upon a Probability Model of Reinforcement. Cambridge, Massachusetts: Harvard University Psychological Laboratories. January 8, 1952. Template:Incomplete citation Describes the hardware of the SNARC.

External links




Retrieved from "https://handwiki.org/wiki/index.php?title=Stochastic_Neural_Analog_Reinforcement_Calculator&oldid=3360476"