Biography:Ilya Sutskever

From HandWiki
Short description: Computer scientist (born 1985/86)

Ilya Sutskever

FRS
איליה סוצקבר
Илья Суцкевер
Ilya Sutskever and Sam Altman in TAU.jpg
Ilya Sutskever (right) with Sam Altman at Tel Aviv University in 2023
Born
Илья Суцкевер

1985/1986 (age 37–39)[1]
Gorky, Russian SFSR, Soviet Union[2][3]
CitizenshipCanadian, Israeli
Alma mater
Known forAlexNet
Co-founding OpenAI
Scientific career
FieldsMachine learning
Neural networks
Artificial intelligence
Deep learning[4]
InstitutionsUniversity of Toronto
Stanford University
Google Brain
OpenAI
ThesisTraining Recurrent Neural Networks (2013)
Doctoral advisorGeoffrey Hinton[5][6]
Website{{{1}}}

Ilya Sutskever FRS (/ˈɪljə ˈsuːtskɪvər/; Hebrew: איליה סוצקבר‎; Russian: Илья́ Суцке́вер ru born 1985/86)[1] is a computer scientist working in machine learning.[4] He is a co-founder and former Chief Scientist at OpenAI.[7]

He has made several major contributions to the field of deep learning.[8][9][10] In 2023, Sutskever was one of the members of the OpenAI board who fired CEO Sam Altman; Altman returned a week later, and Sutskever stepped down from the board. He is the co-inventor, with Alex Krizhevsky and Geoffrey Hinton, of AlexNet, a convolutional neural network.[11] Sutskever is also one of the many co-authors of the AlphaGo paper.[12]

Early life and education

Sutskever was born in Nizhny Novgorod, Russia , then called Gorky, at the time part of the Soviet Union, and at age 5 immigrated with his family to Israel.[13] He spent his formative years in Jerusalem.[14]

Sutskever attended the Open University of Israel between 2000 and 2002.[15] After that, he moved to Canada with his family and attended the University of Toronto in Ontario.

From the University of Toronto, Sutskever received a Bachelor of Science in mathematics in 2005,[15][16][3][17] a Master of Science in computer science in 2007,[16][18] and a Doctor of Philosophy in computer science in 2013.[6][19][20] His doctoral supervisor was Geoffrey Hinton.[5]

In 2012, Sutskever built AlexNet in collaboration with Hinton and Alex Krizhevsky. To support the computing demands of AlexNet, Sutskever bought many GTX 580 GPUs online.[21]

Career and research

Sutskever (second from right) at the Stanford Graduate School of Business in 2014

From November to December 2012, Sutskever spent about two months as a postdoc with Andrew Ng at Stanford University. He then returned to the University of Toronto and joined Hinton's new research company DNNResearch, a spinoff of Hinton's research group. Four months later, in March 2013, Google acquired DNNResearch and hired Sutskever as a research scientist at Google Brain.[22]

At Google Brain, Sutskever worked with Oriol Vinyals and Quoc Viet Le to create the sequence-to-sequence learning algorithm,[23] and worked on TensorFlow.[24]

At the end of 2015, he left Google to become cofounder and chief scientist of the newly founded organization OpenAI.[25][26][27]

In 2023, he announced that he will co-lead OpenAI's new "Superalignment" project, which tries to solve the alignment of superintelligences in 4 years. He wrote that even if superintelligence seems far off, it could happen this decade.[28]

Sutskever was formerly one of the six board members of the non-profit entity which controls OpenAI.[29] The Information speculated that the firing of Sam Altman in part resulted from a conflict over the extent to which the company should commit to AI safety.[30] In a company all-hands meeting shortly after the board meeting, Sutskever stated that firing Altman was "the board doing its duty",[31] though in the following week, he expressed regret at having participated in Altman's ousting.[32] The firing of Altman and resignation of Brockman led to resignation of three senior researchers from OpenAI.[33] Following these events, Sutskever stepped down from the board of OpenAI.[34]

Awards and honours

  • 2015, Sutskever was named in MIT Technology Review's 35 Innovators Under 35.[35]
  • 2018, Sutskever was the keynote speaker at Nvidia Ntech 2018[36] and AI Frontiers Conference 2018.[37]
  • 2022, he was elected a Fellow of the Royal Society (FRS).[23]

References

  1. ↑ 1.0 1.1 Simonite, Tom (18 August 2015). "Ilya Sutskever". https://www.technologyreview.com/innovator/ilya-sutskever/. 
  2. ↑ "Heard It Through the AI | University of Toronto Magazine" (in en-US). 28 September 2022. https://magazine.utoronto.ca/people/alumni-donors/heard-it-through-the-ai-openai-ilya-sutskever/. 
  3. ↑ 3.0 3.1 "Season 1 Ep. 22 Ilya Sutskever". The Robot Brains Podcast. 21 September 2021. https://www.youtube.com/watch?v=fCoavgGZ64Y. 
  4. ↑ 4.0 4.1 {{Google Scholar id}} template missing ID and not present in Wikidata.
  5. ↑ 5.0 5.1 Ilya Sutskever at the Mathematics Genealogy Project
  6. ↑ 6.0 6.1 Sutskever, Ilya (2013). Training Recurrent Neural Networks. utoronto.ca (PhD thesis). University of Toronto. hdl:1807/36012. OCLC 889910425. ProQuest 1501655550. Archived from the original on 26 March 2023. Retrieved 24 March 2023.
  7. ↑ Metz, Cade (19 April 2018). "A.I. Researchers Are Making More Than $1 Million, Even at a Nonprofit" (in en). The New York Times. https://www.nytimes.com/2018/04/19/technology/artificial-intelligence-salaries-openai.html?action=click&module=RelatedCoverage&pgtype=Article&region=Footer. 
  8. ↑ Krizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E (2012). "ImageNet Classification with Deep Convolutional Neural Networks". Advances in Neural Information Processing Systems (Curran Associates, Inc.) 25. https://proceedings.neurips.cc/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html. 
  9. ↑ Srivastava, Nitish; Hinton, Geoffrey; Krizhevsky, Alex; Sutskever, Ilya; Salakhutdinov, Ruslan (2014). "Dropout: A Simple Way to Prevent Neural Networks from Overfitting". Journal of Machine Learning Research 15 (56): 1929–1958. ISSN 1533-7928. http://jmlr.org/papers/v15/srivastava14a.html. 
  10. ↑ Sutskever, Ilya; Vinyals, Oriol; Le, Quoc V. (2014-12-08). "Sequence to sequence learning with neural networks". Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2. NIPS'14 (Cambridge, MA, USA: MIT Press): 3104–3112. https://dl.acm.org/doi/10.5555/2969033.2969173. 
  11. ↑  , Wikidata Q59445836
  12. ↑  , Wikidata Q28005460
  13. ↑ מן, יובל (2022-11-18). ""הבינה המלאכותית מהמדע הבדיוני תהפוך למציאות"" (in he). Ynet. https://www.ynet.co.il/digital/technology/article/h1ebvhxuj. 
  14. ↑ Ansari, Tasmia (2023-03-07). "The Brain That Supercharged ChatGPT, ImageNet and TF" (in en-US). https://analyticsindiamag.com/the-brain-that-supercharged-chatgpt-imagenet-tensorflow/. 
  15. ↑ 15.0 15.1 "Neural networking". 25 October 2010. https://thevarsity.ca/2010/10/25/neural-networking/. 
  16. ↑ 16.0 16.1 Johnston, Jessica Leigh (8 December 2010). "A Neural Network for a New Millennium". https://magazine.utoronto.ca/people/students/ilya-sutskever-google-phd-fellowship/. 
  17. ↑ Template:Linkedin
  18. ↑ Sutskever, Ilya (2007). Nonlinear multilayered sequence models. utoronto.ca (MSc thesis). University of Toronto. hdl:1807/119676. OCLC 234120052. Archived from the original on 24 March 2023. Retrieved 24 March 2023.
  19. ↑ "RAM Workshop". http://www.thespermwhale.com/jaseweston/ram/. 
  20. ↑ "Episode 85: A Conversation with Ilya Sutskever". Gigaom. https://voicesinai.com/episode/episode-85-a-conversation-with-ilya-sutskever/. 
  21. ↑ "Exclusive: Ilya Sutskever, OpenAI's chief scientist, on his hopes and fears for the future of AI" (in en). https://www.technologyreview.com/2023/10/26/1082398/exclusive-ilya-sutskever-openais-chief-scientist-on-his-hopes-and-fears-for-the-future-of-ai/. 
  22. ↑ McMillan, Robert (13 March 2013). "Google Hires Brains that Helped Supercharge Machine Learning". https://www.wired.com/2013/03/google_hinton/. 
  23. ↑ 23.0 23.1 Anon (2022). "Ilya Sutskever". London: Royal Society. https://royalsociety.org/people/ilya-sutskever-35834/. 
  24. ↑  , Wikidata Q29040034
  25. ↑ "OpenAI Blog". 12 December 2015. https://www.openai.com/blog/introducing-openai/. 
  26. ↑ {{{1}}}
  27. ↑ Metz, Cade (27 April 2016). "Inside OpenAI, Elon Musk's Wild Plan to Set Artificial Intelligence Free". https://www.wired.com/2016/04/openai-elon-musk-sam-altman-plan-to-set-artificial-intelligence-free/. 
  28. ↑ "Introducing Superalignment" (in en-US). https://openai.com/blog/introducing-superalignment. 
  29. ↑ "Our structure". https://openai.com/our-structure. "OpenAI is governed by the board of the OpenAI Nonprofit, composed of OpenAI Global, LLC employees Greg Brockman (Chairman & President), Ilya Sutskever (Chief Scientist), and Sam Altman (CEO), and non-employees Adam D’Angelo, Tasha McCauley, Helen Toner." 
  30. ↑ "Before OpenAI Ousted Altman, Employees Disagreed Over AI 'Safety'". https://www.theinformation.com/articles/before-openai-ousted-altman-employees-disagreed-over-ai-safety. 
  31. ↑ Edwards, Benj (2023-11-18). "Details emerge of surprise board coup that ousted CEO Sam Altman at OpenAI". https://arstechnica.com/information-technology/2023/11/report-sutskever-led-board-coup-at-openai-that-ousted-altman-over-ai-safety-concerns/. 
  32. ↑ Rosenberg, Scott (2023-11-20). "OpenAI's Sutskever says he regrets board's firing of Altman". Axios. https://www.axios.com/2023/11/20/sam-altman-fired-openai-board-illya-sutsever-regrets. 
  33. ↑ Thompson, Polly. "3 senior OpenAI researchers resign in the wake of Sam Altman's shock dismissal as CEO, report says" (in en-US). https://www.businessinsider.com/3-open-ai-researchers-resign-sam-altman-dismissal-ceo-2023-11. 
  34. ↑ "OpenAI announces return of Sam Altman as CEO.". 22 November 2023. https://x.com/OpenAI/status/1727206187077370115?s=20. 
  35. ↑ "35 Innovators Under 35: Ilya Sutskever". https://www.technologyreview.com/lists/innovators-under-35/2015/visionary/ilya-sutskever/. 
  36. ↑ Martin, Scott (15 September 2018). "Reinforcement Learning 'Really Works' for AI Against Pro Gamers, OpenAI Trailblazer Says". Nvidia. https://blogs.nvidia.com/blog/2018/09/14/reinforcement-learning-openai-pro-gamers-ilya-sutskeverai-elon-musk-gpu-dgx/. 
  37. ↑ "The man who revolutionized computer vision, machine translation, games and robotics · AI Frontiers Conference". https://aifrontiers.com/2018/08/29/the-journey-of-openais-founder-ilya-sutskever-s-story/. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Biography:Ilya_Sutskever&oldid=3442171"