Organization:Machine Intelligence Research Institute
Formation | 2000 |
---|---|
Type | Nonprofit research institute |
Purpose | Research into friendly artificial intelligence and the AI control problem |
Location |
|
Key people | Eliezer Yudkowsky |
Website | intelligence |
The Machine Intelligence Research Institute (MIRI), formerly the Singularity Institute for Artificial Intelligence (SIAI), is a non-profit research institute focused since 2005 on identifying and managing potential existential risks from artificial general intelligence. MIRI's work has focused on a friendly AI approach to system design and on predicting the rate of technology development.
History
In 2000, Eliezer Yudkowsky founded the Singularity Institute for Artificial Intelligence with funding from Brian and Sabine Atkins, with the purpose of accelerating the development of artificial intelligence (AI).[1][2][3] However, Yudkowsky began to be concerned that AI systems developed in the future could become superintelligent and pose risks to humanity,[1] and in 2005 the institute moved to Silicon Valley and began to focus on ways to identify and manage those risks, which were at the time largely ignored by scientists in the field.[2]
Starting in 2006, the Institute organized the Singularity Summit to discuss the future of AI including its risks, initially in cooperation with Stanford University and with funding from Peter Thiel. The San Francisco Chronicle described the first conference as a "Bay Area coming-out party for the tech-inspired philosophy called transhumanism".[4][5] In 2011, its offices were four apartments in downtown Berkeley.[6] In December 2012, the institute sold its name, web domain, and the Singularity Summit to Singularity University,[7] and in the following month took the name "Machine Intelligence Research Institute".[8]
In 2014 and 2015, public and scientific interest in the risks of AI grew, increasing donations to fund research at MIRI and similar organizations.[3][9]:327
In 2019, Open Philanthropy recommended a general-support grant of approximately $2.1 million over two years to MIRI.[10] In April 2020, Open Philanthropy supplemented this with a $7.7M grant over two years.[11][12]
In 2021, Vitalik Buterin donated several million dollars worth of Ethereum to MIRI.[13]
Research and approach
MIRI's approach to identifying and managing the risks of AI, led by Yudkowsky, primarily addresses how to design friendly AI, covering both the initial design of AI systems and the creation of mechanisms to ensure that evolving AI systems remain friendly.[3][14][15]
MIRI researchers advocate early safety work as a precautionary measure.[16] However, MIRI researchers have expressed skepticism about the views of singularity advocates like Ray Kurzweil that superintelligence is "just around the corner".[14] MIRI has funded forecasting work through an initiative called AI Impacts, which studies historical instances of discontinuous technological change, and has developed new measures of the relative computational power of humans and computer hardware.[17]
MIRI aligns itself with the principles and objectives of the effective altruism movement.[18]
Works by MIRI staff
- Graves, Matthew (8 November 2017). "Why We Should Be Concerned About Artificial Superintelligence". The Skeptics Society. https://www.skeptic.com/reading_room/why-we-should-be-concerned-about-artificial-superintelligence/.
- LaVictoire, Patrick; Fallenstein, Benja; Yudkowsky, Eliezer; Bárász, Mihály; Christiano, Paul; Herreshoff, Marcello (2014). "Program Equilibrium in the Prisoner's Dilemma via Löb's Theorem". AAAI Publications. http://www.aaai.org/ocs/index.php/WS/AAAIW14/paper/viewFile/8833/8294.
- Soares, Nate; Levinstein, Benjamin A. (2017). "Cheating Death in Damascus". Formal Epistemology Workshop (FEW). https://intelligence.org/files/DeathInDamascus.pdf. Retrieved 28 July 2018.
- Soares, Nate; Fallenstein, Benja; Yudkowsky, Eliezer; Armstrong, Stuart (2015). "Corrigibility". AAAI Publications. http://aaai.org/ocs/index.php/WS/AAAIW15/paper/view/10124/10136.
- Soares, Nate; Fallenstein, Benja (2015). "Aligning Superintelligence with Human Interests: A Technical Research Agenda". in Miller, James; Yampolskiy, Roman; Armstrong, Stuart et al.. The Technological Singularity: Managing the Journey. Springer. https://intelligence.org/files/TechnicalAgenda.pdf.
- Yudkowsky, Eliezer (2008). "Artificial Intelligence as a Positive and Negative Factor in Global Risk". in Bostrom, Nick; Ćirković, Milan. Global Catastrophic Risks. Oxford University Press. ISBN 978-0199606504. https://intelligence.org/files/AIPosNegFactor.pdf.
- Taylor, Jessica (2016). "Quantilizers: A Safer Alternative to Maximizers for Limited Optimization". Workshops at the Thirtieth AAAI Conference on Artificial Intelligence. https://www.aaai.org/ocs/index.php/WS/AAAIW16/paper/view/12613.
- Yudkowsky, Eliezer (2011). "Complex Value Systems in Friendly AI". Berlin: Springer. https://intelligence.org/files/ComplexValues.pdf.
See also
- Allen Institute for Artificial Intelligence
- Future of Humanity Institute
- Institute for Ethics and Emerging Technologies
References
- ↑ 1.0 1.1 "MIRI: Artificial Intelligence: The Danger of Good Intentions - Future of Life Institute". Future of Life Institute. 11 October 2015. https://futureoflife.org/2015/10/11/113/.
- ↑ 2.0 2.1 Khatchadourian, Raffi. "The Doomsday Invention". The New Yorker. https://www.newyorker.com/magazine/2015/11/23/doomsday-invention-artificial-intelligence-nick-bostrom. Retrieved 2018-08-28.
- ↑ 3.0 3.1 3.2 Waters, Richard (31 October 2014). "Artificial intelligence: machine v man". Financial Times. https://www.ft.com/content/abc942cc-5fb3-11e4-8c27-00144feabdc0.
- ↑ Abate, Tom (2006). "Smarter than thou?". San Francisco Chronicle. http://www.sfgate.com/cgi-bin/article.cgi?f=/c/a/2006/05/12/BUG9IIMG1V197.DTL.
- ↑ Abate, Tom (2007). "Public meeting will re-examine future of artificial intelligence". San Francisco Chronicle. http://www.sfgate.com/news/article/Public-meeting-will-re-examine-future-of-2504766.php.
- ↑ Kaste, Martin (January 11, 2011). "The Singularity: Humanity's Last Invention?" (in en). All Things Considered, NPR. https://www.npr.org/2011/01/11/132840775/The-Singularity-Humanitys-Last-Invention.
- ↑ "Press release: Singularity University Acquires the Singularity Summitt". Singularity University. 9 December 2012. https://singularityu.org/2012/12/09/singularity-university-acquires-the-singularity-summit/.
- ↑ "Press release: We are now the "Machine Intelligence Research Institute" (MIRI) - Machine Intelligence Research Institute". Machine Intelligence Research Institute. 30 January 2013. https://intelligence.org/2013/01/30/we-are-now-the-machine-intelligence-research-institute-miri/.
- ↑ Tegmark, Max (2017). Life 3.0: Being Human in the Age of Artificial Intelligence. United States: Knopf. ISBN 978-1-101-94659-6.
- ↑ "Machine Intelligence Research Institute — General Support (2019)" (in en). 2019-03-29. https://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence/machine-intelligence-research-institute-general-support-2019.
- ↑ "Machine Intelligence Research Institute — General Support (2020)". Open Philanthropy Project. 10 March 2020. https://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence/machine-intelligence-research-institute-general-support-2020.
- ↑ Bensinger, Rob (April 27, 2020). "MIRI's largest grant to date!". MIRI. https://intelligence.org/2020/04/27/miris-largest-grant-to-date/.
- ↑ Maheshwari, Suyash (2021-05-13). "Ethereum creator Vitalik Buterin donates $1.5 billion in cryptocurrency to India COVID Relief Fund & other charities". https://www.msn.com/en-in/money/topstories/ethereum-creator-vitalik-buterin-donates-15-billion-in-cryptocurrency-to-india-covid-relief-fund-other-charities/ar-BB1gG1nr.
- ↑ 14.0 14.1 LaFrance, Adrienne (2015). "Building Robots With Better Morals Than Humans". The Atlantic. https://www.theatlantic.com/technology/archive/2015/01/building-robots-with-better-morals-than-humans/385015/.
- ↑ Russell, Stuart; Norvig, Peter (2009). A Modern Approach. Prentice Hall. ISBN 978-0-13-604259-4.
- ↑ Sathian, Sanjena (4 January 2016). "The Most Important Philosophers of Our Time Reside in Silicon Valley" (in en). https://www.ozy.com/fast-forward/the-21st-century-philosophers/65230.
- ↑ Hsu, Jeremy (2015). "Making Sure AI's Rapid Rise Is No Surprise". Discover. http://blogs.discovermagazine.com/lovesick-cyborg/2015/09/02/making-sure-ais-rapid-rise-is-no-surprise/.
- ↑ "AI and Effective Altruism" (in en-US). 2015-08-28. https://intelligence.org/2015/08/28/ai-and-effective-altruism/.
Further reading
- Russell, Stuart; Dewey, Daniel; Tegmark, Max (Winter 2015). "Research Priorities for Robust and Beneficial Artificial Intelligence". AI Magazine 36 (4): 6. doi:10.1609/aimag.v36i4.2577. Bibcode: 2016arXiv160203506R.
External links
Original source: https://en.wikipedia.org/wiki/Machine Intelligence Research Institute.
Read more |