Biography:Richard S. Sutton
Richard S. Sutton | |
|---|---|
 | |
| Nationality | Canadian |
| Citizenship | Canadian |
| Alma mater | University of Massachusetts Amherst Stanford University |
| Known for | Temporal difference learning, Dyna, Options, GQ(λ) |
| Awards | AAAI Fellow (2001) President's Award (INNS) (2003) Royal Society of Canada Fellow (2016) |
| Scientific career | |
| Fields | Artificial Intelligence Reinforcement Learning |
| Institutions | University of Alberta |
| Thesis | Temporal credit assignment in reinforcement learning (1984) |
| Doctoral advisor | Andrew Barto |
| Doctoral students | David Silver, Doina Precup |
| Website | incompleteideas |
Richard S. Sutton FRS FRSC is a Canadian computer scientist. He is a professor of computing science at the University of Alberta and a research scientist at Keen Technologies.[1] Sutton is considered one of the founders of modern computational reinforcement learning,[2] having several significant contributions to the field, including temporal difference learning and policy gradient methods.
Life and education
Richard Sutton was born in Ohio, and grew up in Oak Brook, Illinois, a suburb of Chicago .
Sutton received his B.A. in psychology from Stanford University in 1978 before taking an M.S. (1980) and Ph.D. (1984) in computer science from the University of Massachusetts Amherst under the supervision of Andrew Barto. His doctoral dissertation, Temporal Credit Assignment in Reinforcement Learning, introduced actor-critic architectures and temporal credit assignment.[3]
He was influenced by Harry Klopf's work in the 1970s, which proposed that supervised learning is insufficient for AI or explaining intelligent behavior, and trial-and-error learning, driven by "hedonic aspects of behavior", is necessary. This focussed his interest to reinforcement learning.[4]
Career
In 1984, Sutton was a postdoctoral researcher at the University of Massachusetts.
From 1985 to 1994, he was a principal member of technical staff in the Computer and Intelligent Systems Laboratory at GTE in Waltham, Massachusetts. In 1995, he returned to the University of Massachusetts as a senior research scientist.
From 1998 to 2002, Sutton worked at the AT&T Shannon Laboratory in Florham Park, New Jersey as principal technical staff member in the artificial intelligence department.
Since 2003, he has been a professor of computing science at the University of Alberta. He led the institution's Reinforcement Learning and Artificial Intelligence Laboratory until 2018.
While retaining his professorship, Sutton joined Deepmind in June 2017 as a distinguished research scientist and co-founder of its Edmonton office.[3][5][6]
Sutton became a Canadian citizen in 2015 and renounced his US citizenship in 2017.[citation needed]
In a 2019 essay, Sutton criticized the field of AI research for failing "to learn the bitter lesson that building in how we think we think does not work in the long run", arguing that "70 years of AI research [had shown] that general methods that leverage computation are ultimately the most effective, and by a large margin", beating efforts building on human knowledge about specific fields like computer vision, speech recognition, chess or Go.[7][8]
In 2023 he and John Carmack announced a partnership for the development of AGI.[9]
Selected publications
- Sutton, R. S., Barto, A. G., Reinforcement Learning: An Introduction. MIT Press, 1998. Also translated into Japanese and Russian. Second edition MIT Press 2018.
- Miller, W. T., Sutton, R. S., Werbos, P. J. (Eds.), Neural Networks for Control. MIT Press, 1991.
- Sutton, R. S. (Ed.), Reinforcement Learning. Reprinting of a special issue of Machine Learning Journal. Kluwer Academic Press, 1992
Awards and honors
Sutton is fellow of the Association for the Advancement of Artificial Intelligence (AAAI) since 2001.[10] In 2003 he received the President's Award from the International Neural Network Society[11] and in 2013, the Outstanding Achievement in Research award from the University of Massachusetts Amherst.[12]
Sutton's nomination as a AAAI fellow reads:[10]
| “ | For significant contributions to many topics in machine learning, including reinforcement learning, temporal difference techniques, and neural networks. | ” |
In 2016, Sutton was elected Fellow of the Royal Society of Canada.[13] In 2021, he was elected Fellow of the Royal Society.[14]
References
- ↑ "John Carmack and Rich Sutton partner to accelerate development of Artificial General Intelligence" (in en). https://markets.businessinsider.com/news/stocks/john-carmack-and-rich-sutton-partner-to-accelerate-development-of-artificial-general-intelligence-1032654257.
- ↑ "Exclusive: Interview with Rich Sutton, the Father of Reinforcement Learning". 2018-01-11. https://www.kdnuggets.com/2017/12/interview-rich-sutton-reinforcement-learning.html.
- ↑ 3.0 3.1 "Brief Biography for Richard Sutton". http://incompleteideas.net/BriefBio.html.
- ↑ Sutton, Richard S.; Barto, Andrew (2020). Reinforcement learning: an introduction (Second ed.). Cambridge, Massachusetts: The MIT Press. pp. 22-23. ISBN 978-0-262-03924-6.
- ↑ "DeepMind expands to Canada with new research office in Edmonton, Alberta". https://deepmind.com/blog/deepmind-office-canada-edmonton/.
- ↑ "Edmonton AI guru Rich Sutton has lost his DeepMind but not his ambition". 2023-03-19. https://nationalpost.com/news/canada/ai-guru-rich-sutton-deepmind.
- ↑ Sutton, Rich (2019-03-13). "The Bitter Lesson". http://www.incompleteideas.net/IncIdeas/BitterLesson.html.
- ↑ Tunstall, Lewis; Werra, Leandro von; Wolf, Thomas (2022-01-26) (in en). Natural Language Processing with Transformers. "O'Reilly Media, Inc.". ISBN 978-1-0981-0319-4. https://books.google.com/books?id=nTxbEAAAQBAJ&dq=sutton+%22bitter+lesson%22&pg=PT354.
- ↑ "John Carmack and Rich Sutton partner to accelerate development of Artificial General Intelligence" (in en). https://markets.businessinsider.com/news/stocks/john-carmack-and-rich-sutton-partner-to-accelerate-development-of-artificial-general-intelligence-1032654257.
- ↑ 10.0 10.1 "Elected AAAI Fellows". https://www.aaai.org/Awards/fellows-list.php.
- ↑ "INNS Award Recipients". https://www.inns.org/inns-award-recipients.
- ↑ "Outstanding Achievement and Advocacy Award Recipients" (in en). 2010-10-05. https://www.cics.umass.edu/people/outstanding-achievement-and-advocacy-award-recipients.
- ↑ Brown, Michael (19 September 2016). "U of A Scholars Join Ranks of Royal Society". https://www.ualberta.ca/the-quad/2016/09/u-of-a-scholars-join-ranks-of-royal-society.html.
- ↑ "Royal Society elects outstanding new Fellows and Foreign Members". royalsociety.org. https://royalsociety.org/news/2021/05/new-fellows-announcement-2021/.
External links
- Richard Sutton's Homepage
- {{Google Scholar id}} template missing ID and not present in Wikidata.
 |  |
