Unsolved:Global catastrophic risk

From HandWiki
Short description: Hypothetical future events that could damage human well-being globally
Artist's impression of a major asteroid impact. An asteroid may have caused the extinction of the non-avian dinosaurs.[1]

A global catastrophic risk is a hypothetical future event that could damage human well-being on a global scale,[2] even endangering or destroying modern civilization.[3] An event that could cause human extinction or permanently and drastically curtail humanity's potential is known as an existential risk.[4]

Potential global catastrophic risks include anthropogenic risks, caused by humans (technology, governance, climate change), and non-anthropogenic or natural risks.[3] Technological risks include the creation of destructive artificial intelligence, biotechnology or nanotechnology. Insufficient or malign global governance creates risks in the social and political domain, such as a global war, including nuclear holocaust, bioterrorism using genetically modified organisms, cyberterrorism destroying critical infrastructure like the electrical grid; or the failure to manage a natural pandemic. Problems and risks in the domain of earth system governance include global warming, environmental degradation, including extinction of species, famine as a result of non-equitable resource distribution, human overpopulation, crop failures and non-sustainable agriculture.

Examples of non-anthropogenic risks are an asteroid impact event, a supervolcanic eruption, a lethal gamma-ray burst, a geomagnetic storm destroying electronic equipment, natural long-term climate change, hostile extraterrestrial life, or the predictable Sun transforming into a red giant star engulfing the Earth.

Over the last two decades, a number of academic and non-profit organizations have been established to research global catastrophic and existential risks and formulate potential mitigation measures.[5][6][7][8]

Definition and classification

Scope/intensity grid from Bostrom's paper "Existential Risk Prevention as Global Priority"[9]

Defining global catastrophic risks

The term global catastrophic risk "lacks a sharp definition", and generally refers (loosely) to a risk that could inflict "serious damage to human well-being on a global scale".[10]

Humanity has suffered large catastrophes before. Some of these have caused serious damage, but were only local in scope—e.g. the Black Death may have resulted in the deaths of a third of Europe's population,[11] 10% of the global population at the time.[12] Some were global, but were not as severe—e.g. the 1918 influenza pandemic killed an estimated 3-6% of the world's population.[13] Most global catastrophic risks would not be so intense as to kill the majority of life on earth, but even if one did, the ecosystem and humanity would eventually recover (in contrast to existential risks).

Similarly, in Catastrophe, Richard Posner singles out and groups together events that bring about "utter overthrow or ruin" on a global, rather than a "local or regional", scale. Posner highlights such events as worthy of special attention on cost–benefit grounds because they could directly or indirectly jeopardize the survival of the human race as a whole.[14]

Defining existential risks

Existential risks are defined as "risks that threaten the destruction of humanity's long-term potential."[15] The instantiation of an existential risk (an existential catastrophe[16]) would either cause outright human extinction or irreversibly lock in a drastically inferior state of affairs.[9][17] Existential risks are a sub-class of global catastrophic risks, where the damage is not only global, but also terminal and permanent (preventing recovery and thus impacting both the current and all subsequent generations).[9]

Non-extinction risks

While extinction is the most obvious way in which humanity's long-term potential could be destroyed, there are others, including unrecoverable collapse and unrecoverable dystopia.[18] A disaster severe enough to cause the permanent, irreversible collapse of human civilisation would constitute an existential catastrophe, even if it fell short of extinction.[18] Similarly, if humanity fell under a totalitarian regime, and there were no chance of recovery—as imagined by George Orwell in his 1949 novel Nineteen Eighty-Four[19]such a dystopian future would also be an existential catastrophe.[20] Bryan Caplan writes that "perhaps an eternity of totalitarianism would be worse than extinction".[20] A dystopian scenario shares the key features of extinction and unrecoverable collapse of civilisation—before the catastrophe, humanity faced a vast range of bright futures to choose from; after the catastrophe, humanity is locked forever in a terrible state.[18]

Likelihood

Natural vs. anthropogenic

Experts generally agree that anthropogenic existential risks are (much) more likely than natural risks.[18][21][22][23][24] A key difference between these risk types is that empirical evidence can place an upper bound on the level of natural risk.[23] Humanity has existed for at least 200,000 years, over which it has been subject to a roughly constant level of natural risk. If the natural risk were high, then it would be highly unlikely that humanity would have survived as long as it has. Based on a formalization of this argument, researchers have concluded that we can be confident that natural risk is lower than 1 in 14,000 (and likely "less than one in 87,000") per year.[23]

Another empirical method to study the likelihood of certain natural risks is to investigate the geological record.[18] For example, a comet or asteroid impact event sufficient in scale to cause an impact winter that would cause human extinction before the year 2100 has been estimated at one-in-a-million.[25][26] Moreover, large supervolcano eruptions may cause a volcanic winter that could endanger the survival of humanity.[27] The geological record suggests that supervolcanic eruptions are estimated to occur on average about every 50,000 years, though most such eruptions would not reach the scale required to cause human extinction.[27] Famously, the supervolcano Mt. Toba may have almost wiped out humanity at the time of its last eruption (though this is contentious).[27][28]

Since anthropogenic risk is a relatively recent phenomenon, humanity's track record of survival cannot provide similar assurances.[23] Humanity has only survived 75 years since the creation of nuclear weapons, and for future technologies, there is no track record at all. This has led thinkers like Carl Sagan to conclude that humanity is currently in a ‘time of perils’[29]—a uniquely dangerous period in human history, where it is subject to unprecedented levels of risk, beginning from when we first started posing risks to ourselves through our actions.[18][30]

Risk estimates

Given the limitations of ordinary observation and modeling, expert elicitation is frequently used instead to obtain probability estimates.[31] In 2008, an informal survey of experts at a conference hosted by the Future of Humanity Institute estimated a 19% risk of human extinction by the year 2100, though given the survey's limitations these results should be taken "with a grain of salt".[22]

Risk Estimated probability
for human extinction
before 2100
Overall probability
19%
Molecular nanotechnology weapons
5%
Superintelligent AI
5%
All wars (including civil wars)
4%
Engineered pandemic
2%
Nuclear war
1%
Nanotechnology accident
0.5%
Natural pandemic
0.05%
Nuclear terrorism
0.03%

Table source: Future of Humanity Institute, 2008.[22]

There have been a number of other estimates of existential risk, extinction risk, or a global collapse of civilization:

  • In 1996, John Leslie estimated a 30% risk over the next five centuries (equivalent to around 9% per century, on average).[32]
  • In 2002, Nick Bostrom gave the following estimate of existential risk over the long term: ‘My subjective opinion is that setting this probability lower than 25% would be misguided, and the best estimate may be considerably higher.’[33]
  • In 2003, Martin Rees estimated a 50% chance of collapse of civilisation in the twenty-first century.[34]
  • The Global Challenges Foundation's 2016 annual report estimates an annual probability of human extinction of at least 0.05% per year.[35]
  • A 2016 survey of AI experts found a median estimate of 5% that human-level AI would cause an outcome that was "extremely bad (e.g. human extinction)".[36]
  • In 2020, Toby Ord estimates existential risk in the next century at ‘1 in 6’ in his book The Precipice: Existential Risk and the Future of Humanity.[18][37]
  • Metaculus users currently estimate a 3% probability of humanity going extinct before 2100.[38]

Methodological challenges

Research into the nature and mitigation of global catastrophic risks and existential risks is subject to a unique set of challenges and consequently not easily subject to the usual standards of scientific rigour.[18] For instance, it is neither feasible nor ethical to study these risks experimentally. Carl Sagan expressed this with regards to nuclear war: “Understanding the long-term consequences of nuclear war is not a problem amenable to experimental verification”.[39] Moreover, many catastrophic risks change rapidly as technology advances and background conditions (such as international relations) change. Another challenge is the general difficulty of accurately predicting the future over long timescales, especially for athropogenic risks which depend on complex human political, economic and social systems.[18] In addition to known and tangible risks, unforeseeable black swan extinction events may occur, presenting an additional methodological problem.[18][40]

Lack of historical precedent

Humanity has never suffered an existential catastrophe and if one were to occur, it would necessarily be unprecedented.[18] Therefore, existential risks pose unique challenges to prediction, even more than other long-term events, because of observation selection effects.[41] Unlike with most events, the failure of a complete extinction event to occur in the past is not evidence against their likelihood in the future, because every world that has experienced such an extinction event has no observers, so regardless of their frequency, no civilization observes existential risks in its history.[41] These anthropic issues may partly be avoided by looking at evidence that does not have such selection effects, such as asteroid impact craters on the Moon, or directly evaluating the likely impact of new technology.[9]

To understand the dynamics of an unprecedented, unrecoverable global civilizational collapse (a type of existential risk), it may be instructive to study the various local civilizational collapses that have occurred throughout human history.[42] For instance, civilizations such as the Roman Empire have ended in a loss of centralized governance and a major civilization-wide loss of infrastructure and advanced technology. However, these examples demonstrate that societies appear to be fairly resilient to catastrophe; for example, Medieval Europe survived the Black Death without suffering anything resembling a civilization collapse despite losing 25 to 50 percent of its population.[43]

Incentives and coordination

There are economic reasons that can explain why so little effort is going into existential risk reduction. It is a global public good, so we should expect it to be undersupplied by markets.[9] Even if a large nation invests in risk mitigation measures, that nation will enjoy only a small fraction of the benefit of doing so. Furthermore, existential risk reduction is an intergenerational global public good, since most of the benefits of existential risk reduction would be enjoyed by future generations, and though these future people would in theory perhaps be willing to pay substantial sums for existential risk reduction, no mechanism for such a transaction exists.[9]

Cognitive biases

Numerous cognitive biases can influence people's judgment of the importance of existential risks, including scope insensitivity, hyperbolic discounting, availability heuristic, the conjunction fallacy, the affect heuristic, and the overconfidence effect.[44]

Scope insensitivity influences how bad people consider the extinction of the human race to be. For example, when people are motivated to donate money to altruistic causes, the quantity they are willing to give does not increase linearly with the magnitude of the issue: people are roughly as willing to prevent the deaths of 200,000 or 2,000 birds.[45] Similarly, people are often more concerned about threats to individuals than to larger groups.[44]

Moral importance of existential risk

See also: Human extinction#EthicsIn one of the earliest discussions of ethics of human extinction, Derek Parfit offers the following thought experiment:[46]

The scale of what is lost in an existential catastrophe is determined by humanity's long-term potential—what humanity could expect to achieve if it survived.[18] From a utilitarian perspective, the value of protecting humanity is the product of its duration (how long humanity survives), its size (how many humans there are over time), and its quality (on average, how good is life for future people).[18]:273[47] On average, species survive for around a million years before going extinct. Parfit points out that the Earth will remain habitable for around a billion years.[46] And these might be lower bounds on our potential: if humanity is able to expand beyond Earth, it could greatly increase the human population and survive for trillions of years.[17][18]:21 The size of the foregone potential that would be lost, were humanity to go extinct, is very large. Therefore, reducing existential risk by even a small amount would have a very significant moral value.[9][48]

Some economists and philosophers have defended views, including exponential discounting and person-affecting views of population ethics, on which future people do not matter (or matter much less), morally speaking.[49] While these views are controversial,[25][50][51] even they would agree that an existential catastrophe would be among the worst things imaginable. It would cut short the lives of eight billion presently existing people, destroying all of what makes their lives valuable, and most likely subjecting many of them to profound suffering. So even setting aside the value of future generations, there may be strong reasons to reduce existential risk, grounded in concern for presently existing people.[52]

Beyond utilitarianism, other moral perspectives lend support to the importance of reducing existential risk. An existential catastrophe would destroy more than just humanity—it would destroy all cultural artifacts, languages, and traditions, and many of the things we value.[18][39] So moral viewpoints on which we have duties to protect and cherish things of value would see this as a huge loss that should be avoided.[18] One can also consider reasons grounded in duties to past generations. For instance, Edmund Burke writes of a "partnership ... between those who are living, those who are dead, and those who are to be born".[53] If one takes seriously the debt humanity owes to past generations, Ord argues the best way of repaying it might be to 'pay it forward', and ensure that humanity's inheritance is passed down to future generations.[18]:49–51

There are several economists who have discussed the importance of global catastrophic risks. For example, Martin Weitzman argues that most of the expected economic damage from climate change may come from the small chance that warming greatly exceeds the mid-range expectations, resulting in catastrophic damage.[54] Richard Posner has argued that humanity is doing far too little, in general, about small, hard-to-estimate risks of large-scale catastrophes.[55]

Potential sources of risk

Some sources of catastrophic risk are anthropogenic (man-made), such as global warming,[56] environmental degradation, engineered pandemics and nuclear war.[57] On the other hand, some risks are non-anthropogenic or natural, such as meteor impacts or supervolcanoes.

Anthropogenic

Many experts—including those at the Future of Humanity Institute at the University of Oxford and the Centre for the Study of Existential Risk at the University of Cambridge—prioritize anthropogenic over natural risks due to their much greater estimated likelihood.[5][6][9][24] They are especially concerned by, and consequently focus on, risks posed by advanced technology, such as artificial intelligence and biotechnology.[58][59]

Artificial intelligence

Main pages: Unsolved:Existential risk from artificial general intelligence, Unsolved:AI takeover, Philosophy:Friendly artificial intelligence, and Philosophy:Technological singularity

It has been suggested that if AI systems rapidly become super-intelligent, they may take unforeseen actions or out-compete humanity.[60] According to philosopher Nick Bostrom, it is possible that the first super-intelligence to emerge would be able to bring about almost any possible outcome it valued, as well as to foil virtually any attempt to prevent it from achieving its objectives.[61] Thus, even a super-intelligence indifferent to humanity could be dangerous if it perceived humans as an obstacle to unrelated goals. In Bostrom's book Superintelligence, he defines this as the control problem.[62] Physicist Stephen Hawking, Microsoft founder Bill Gates, and SpaceX founder Elon Musk have echoed these concerns, with Hawking theorizing that such an AI could "spell the end of the human race".[63]

In 2009, the Association for the Advancement of Artificial Intelligence (AAAI) hosted a conference to discuss whether computers and robots might be able to acquire any sort of autonomy, and how much these abilities might pose a threat or hazard. They noted that some robots have acquired various forms of semi-autonomy, including being able to find power sources on their own and being able to independently choose targets to attack with weapons. They also noted that some computer viruses can evade elimination and have achieved "cockroach intelligence". They noted that self-awareness, as depicted in science-fiction, is probably unlikely, but there are other potential hazards and pitfalls.[64] Various media sources and scientific groups have noted separate trends in differing areas which might together result in greater robotic functionalities and autonomy, and which pose some inherent concerns.[65][66]

A survey of AI experts estimated that the chance of human-level machine learning having an "extremely bad (e.g., human extinction)" long-term effect on humanity is 5%.[67] A 2008 survey by the Future of Humanity Institute estimated a 5% probability of extinction by super-intelligence by 2100.[22] Eliezer Yudkowsky believes risks from artificial intelligence are harder to predict than any other known risks due to bias from anthropomorphism. Since people base their judgments of artificial intelligence on their own experience, he claims they underestimate the potential power of AI.[68]

Biotechnology

Main pages: Engineering:Biotechnology risk, Biology:Biological warfare, and Social:Bioterrorism

Biotechnology can pose a global catastrophic risk in the form of bioengineered organisms (viruses, bacteria, fungi, plants, or animals). In many cases the organism will be a pathogen of humans, livestock, crops, or other organisms we depend upon (e.g. pollinators or gut bacteria). However, any organism able to catastrophically disrupt ecosystem functions, e.g. highly competitive weeds, outcompeting essential crops, poses a biotechnology risk.

A biotechnology catastrophe may be caused by accidentally releasing a genetically engineered organism from controlled environments, by the planned release of such an organism which then turns out to have unforeseen and catastrophic interactions with essential natural or agro-ecosystems, or by intentional usage of biological agents in biological warfare or bioterrorism attacks.[69] Pathogens may be intentionally or unintentionally genetically modified to change virulence and other characteristics.[69] For example, a group of Australian researchers unintentionally changed characteristics of the mousepox virus while trying to develop a virus to sterilize rodents.[69] The modified virus became highly lethal even in vaccinated and naturally resistant mice.[70][71] The technological means to genetically modify virus characteristics are likely to become more widely available in the future if not properly regulated.[69]

Terrorist applications of biotechnology have historically been infrequent. To what extent this is due to a lack of capabilities or motivation is not resolved.[69] However, given current development, more risk from novel, engineered pathogens is to be expected in the future.[69] Exponential growth has been observed in the biotechnology sector, and Noun and Chyba predict that this will lead to major increases in biotechnological capabilities in the coming decades.[69] They argue that risks from biological warfare and bioterrorism are distinct from nuclear and chemical threats because biological pathogens are easier to mass-produce and their production is hard to control (especially as the technological capabilities are becoming available even to individual users).[69] In 2008, a survey by the Future of Humanity Institute estimated a 2% probability of extinction from engineered pandemics by 2100.[22]

Noun and Chyba propose three categories of measures to reduce risks from biotechnology and natural pandemics: Regulation or prevention of potentially dangerous research, improved recognition of outbreaks, and developing facilities to mitigate disease outbreaks (e.g. better and/or more widely distributed vaccines).[69]

Cyberattack

Main page: Cyberattack

Cyberattacks have the potential to destroy everything from personal data to electric grids. Christine Peterson, co-founder and past president of the Foresight Institute, believes a cyberattack on electric grids has the potential to be a catastrophic risk. She notes that little has been done to mitigate such risks, and that mitigation could take several decades of readjustment.[72]

Environmental disaster

An environmental or ecological disaster, such as world crop failure and collapse of ecosystem services, could be induced by the present trends of overpopulation, economic development, and non-sustainable agriculture. Most environmental scenarios involve one or more of the following: Holocene extinction event,[73] scarcity of water that could lead to approximately half the Earth's population being without safe drinking water, pollinator decline, overfishing, massive deforestation, desertification, climate change, or massive water pollution episodes. Detected in the early 21st century, a threat in this direction is colony collapse disorder,[74] a phenomenon that might foreshadow the imminent extinction[75] of the Western honeybee. As the bee plays a vital role in pollination, its extinction would severely disrupt the food chain.

An October 2017 report published in The Lancet stated that toxic air, water, soils, and workplaces were collectively responsible for nine million deaths worldwide in 2015, particularly from air pollution which was linked to deaths by increasing susceptibility to non-infectious diseases, such as heart disease, stroke, and lung cancer.[76] The report warned that the pollution crisis was exceeding "the envelope on the amount of pollution the Earth can carry" and "threatens the continuing survival of human societies".[76]

A May 2020 analysis published in Scientific Reports found that if deforestation and resource consumption continue at current rates they could culminate in a "catastrophic collapse in human population" and possibly "an irreversible collapse of our civilization" within the next several decades. The study says humanity should pass from a civilization dominated by the economy to a "cultural society" that "privileges the interest of the ecosystem above the individual interest of its components, but eventually in accordance with the overall communal interest." The authors also note that "while violent events, such as global war or natural catastrophic events, are of immediate concern to everyone, a relatively slow consumption of the planetary resources may be not perceived as strongly as a mortal danger for the human civilization."[77][78]

Experimental technology accident

Nick Bostrom suggested that in the pursuit of knowledge, humanity might inadvertently create a device that could destroy Earth and the Solar System.[79] Investigations in nuclear and high-energy physics could create unusual conditions with catastrophic consequences. For example, scientists worried that the first nuclear test might ignite the atmosphere.[80][81] Others worried that the RHIC[82] or the Large Hadron Collider might start a chain-reaction global disaster involving black holes, strangelets, or false vacuum states. These particular concerns have been challenged,[83][84][85][86] but the general concern remains.

Biotechnology could lead to the creation of a pandemic, chemical warfare could be taken to an extreme, nanotechnology could lead to grey goo in which out-of-control self-replicating robots consume all living matter on earth while building more of themselves—in both cases, either deliberately or by accident.[87]

Global warming

Main pages: Earth:Climate apocalypse, Earth:Tipping points in the climate system, and Earth:Climate security
This 1902 article attributes to Swedish Nobel laureate (for chemistry) Svante Arrhenius a theory that coal combustion could eventually lead to a degree of global warming causing human extinction.[88]

Global warming refers to the warming caused by human technology since the 19th century or earlier. Projections of future climate change suggest further global warming, sea level rise, and an increase in the frequency and severity of some extreme weather events and weather-related disasters. Effects of global warming include loss of biodiversity, stresses to existing food-producing systems, increased spread of known infectious diseases such as malaria, and rapid mutation of microorganisms. In November 2017, a statement by 15,364 scientists from 184 countries indicated that increasing levels of greenhouse gases from the use of fossil fuels, human population growth, deforestation, and overuse of land for agricultural production, particularly by farming ruminants for meat consumption, are trending in ways that forecast an increase in human misery over coming decades.[3]

Mineral resource exhaustion

Romanian American economist Nicholas Georgescu-Roegen, a progenitor in economics and the paradigm founder of ecological economics, has argued that the carrying capacity of Earth—that is, Earth's capacity to sustain human populations and consumption levels—is bound to decrease sometime in the future as Earth's finite stock of Mineral resources is presently being extracted and put to use; and consequently, that the world economy as a whole is heading towards an inevitable future collapse, leading to the demise of human civilization itself.[89]:303f Ecological economist and steady-state theorist Herman Daly, a student of Georgescu-Roegen, has propounded the same argument by asserting that "... all we can do is to avoid wasting the limited capacity of creation to support present and future life [on Earth]."[90]:370

Ever since Georgescu-Roegen and Daly published these views, various scholars in the field have been discussing the existential impossibility of allocating earth's finite stock of mineral resources evenly among an unknown number of present and future generations. This number of generations is likely to remain unknown to us, as there is no way—or only little way—of knowing in advance if or when mankind will ultimately face extinction. In effect, any conceivable intertemporal allocation of the stock will inevitably end up with universal economic decline at some future point.[91]:253–256[92]:165[93]:168–171[94]:150–153[95]:106–109[96]:546–549[97]:142–145[98]

Nanotechnology

Many nanoscale technologies are in development or currently in use.[99] The only one that appears to pose a significant global catastrophic risk is molecular manufacturing, a technique that would make it possible to build complex structures at atomic precision.[100] Molecular manufacturing requires significant advances in nanotechnology, but once achieved could produce highly advanced products at low costs and in large quantities in nanofactories of desktop proportions.[99][100] When nanofactories gain the ability to produce other nanofactories, production may only be limited by relatively abundant factors such as input materials, energy and software.[99]

Molecular manufacturing could be used to cheaply produce, among many other products, highly advanced, durable weapons.[99] Being equipped with compact computers and motors these could be increasingly autonomous and have a large range of capabilities.[99]

Chris Phoenix and Treder classify catastrophic risks posed by nanotechnology into three categories:

  1. From augmenting the development of other technologies such as AI and biotechnology.
  2. By enabling mass-production of potentially dangerous products that cause risk dynamics (such as arms races) depending on how they are used.
  3. From uncontrolled self-perpetuating processes with destructive effects.

Several researchers say the bulk of risk from nanotechnology comes from the potential to lead to war, arms races, and destructive global government.[70][99][101] Several reasons have been suggested why the availability of nanotech weaponry may with significant likelihood lead to unstable arms races (compared to e.g. nuclear arms races):

  1. A large number of players may be tempted to enter the race since the threshold for doing so is low;[99]
  2. The ability to make weapons with molecular manufacturing will be cheap and easy to hide;[99]
  3. Therefore, lack of insight into the other parties' capabilities can tempt players to arm out of caution or to launch preemptive strikes;[99][102]
  4. Molecular manufacturing may reduce dependency on international trade,[99] a potential peace-promoting factor;
  5. Wars of aggression may pose a smaller economic threat to the aggressor since manufacturing is cheap and humans may not be needed on the battlefield.[99]

Since self-regulation by all state and non-state actors seems hard to achieve,[103] measures to mitigate war-related risks have mainly been proposed in the area of international cooperation.[99][104] International infrastructure may be expanded giving more sovereignty to the international level. This could help coordinate efforts for arms control. International institutions dedicated specifically to nanotechnology (perhaps analogously to the International Atomic Energy Agency IAEA) or general arms control may also be designed.[104] One may also jointly make differential technological progress on defensive technologies, a policy that players should usually favour.[99] The Center for Responsible Nanotechnology also suggests some technical restrictions.[105] Improved transparency regarding technological capabilities may be another important facilitator for arms-control.

Grey goo is another catastrophic scenario, which was proposed by Eric Drexler in his 1986 book Engines of Creation[106] and has been a theme in mainstream media and fiction.[107][108] This scenario involves tiny self-replicating robots that consume the entire biosphere using it as a source of energy and building blocks. Nowadays, however, nanotech experts—including Drexler—discredit the scenario. According to Phoenix, a "so-called grey goo could only be the product of a deliberate and difficult engineering process, not an accident".[109]

Warfare and mass destruction

Joseph Pennell's 1918 Liberty bond poster calls up the pictorial image of an invaded, burning New York City.

The scenarios that have been explored most frequently are nuclear warfare and doomsday devices. Mistakenly launching a nuclear attack in response to a false alarm is one possible scenario; this nearly happened during the 1983 Soviet nuclear false alarm incident. Although the probability of a nuclear war per year is slim, Professor Martin Hellman has described it as inevitable in the long run; unless the probability approaches zero, inevitably there will come a day when civilization's luck runs out.[110] During the Cuban Missile Crisis, U.S. president John F. Kennedy estimated the odds of nuclear war at "somewhere between one out of three and even".[111] The United States and Russia have a combined arsenal of 14,700 nuclear weapons,[112] and there is an estimated total of 15,700 nuclear weapons in existence worldwide.[112] Beyond nuclear, other military threats to humanity include biological warfare (BW). By contrast, chemical warfare, while able to create multiple local catastrophes, is unlikely to create a global one.

Nuclear war could yield unprecedented human death tolls and habitat destruction. Detonating large numbers of nuclear weapons would have an immediate, short term and long-term effects on the climate, causing cold weather and reduced sunlight and photosynthesis[113] that may generate significant upheaval in advanced civilizations.[114] However, while popular perception sometimes takes nuclear war as "the end of the world", experts assign low probability to human extinction from nuclear war.[115][116] In 1982, Brian Martin estimated that a US–Soviet nuclear exchange might kill 400–450 million directly, mostly in the United States, Europe and Russia, and maybe several hundred million more through follow-up consequences in those same areas.[115] In 2008, a survey by the Future of Humanity Institute estimated a 4% probability of extinction from warfare by 2100, with a 1% chance of extinction from nuclear warfare.[22]

World population and agricultural crisis

Main pages: Unsolved:Malthusianism and Unsolved:Human overpopulation
M. King Hubbert's prediction of world petroleum production rates. Modern agriculture is heavily dependent on petroleum energy.

The 20th century saw a rapid increase in human population due to medical developments and massive increases in agricultural productivity[117] such as the Green Revolution.[118] Between 1950 and 1984, as the Green Revolution transformed agriculture around the globe, world grain production increased by 250%. The Green Revolution in agriculture helped food production to keep pace with worldwide population growth or actually enabled population growth. The energy for the Green Revolution was provided by fossil fuels in the form of fertilizers (natural gas), pesticides (oil), and hydrocarbon-fueled irrigation.[119] David Pimentel, professor of ecology and agriculture at Cornell University, and Mario Giampietro, senior researcher at the National Research Institute on Food and Nutrition (INRAN), place in their 1994 study Food, Land, Population and the U.S. Economy the maximum U.S. population for a sustainable economy at 200 million. To achieve a sustainable economy and avert disaster, the United States must reduce its population by at least one-third, and world population will have to be reduced by two-thirds, says the study.[120]

The authors of this study believe the mentioned agricultural crisis will begin to have an effect on the world after 2020 and will become critical after 2050. Geologist Dale Allen Pfeiffer claims that coming decades could see spiraling food prices without relief and massive starvation on a global level such as never experienced before.[121][122]

Since supplies of petroleum and natural gas are essential to modern agriculture techniques, a fall in global oil supplies (see peak oil for global concerns) could cause spiking food prices and unprecedented famine in the coming decades.[123][124]

Wheat is humanity's third-most-produced cereal. Extant fungal infections such as Ug99[125] (a kind of stem rust) can cause 100% crop losses in most modern varieties. Little or no treatment is possible and the infection spreads on the wind. Should the world's large grain-producing areas become infected, the ensuing crisis in wheat availability would lead to price spikes and shortages in other food products.[126]

Non-anthropogenic

Of all species that have ever lived, 99% have gone extinct.[127] Earth has experienced numerous mass extinction events, in which up to 96% of all species present at the time were eliminated.[127] A notable example is the K-T extinction event, which killed the dinosaurs. The types of threats posed by nature have been argued to be relatively constant, though this has been disputed.[128]

Asteroid impact

Main pages: Astronomy:Impact event, Astronomy:Impact winter, and Astronomy:Asteroid impact prediction

Several asteroids have collided with Earth in recent geological history. The Chicxulub asteroid, for example, was about six miles in diameter and is theorized to have caused the extinction of non-avian dinosaurs at the end of the Cretaceous. No sufficiently large asteroid currently exists in an Earth-crossing orbit; however, a comet of sufficient size to cause human extinction could impact the Earth, though the annual probability may be less than 10−8.[129] Geoscientist Brian Toon estimates that while a few people, such as "some fishermen in Costa Rica", could plausibly survive a six-mile meteorite, a sixty-mile meteorite would be large enough to "incinerate everybody".[130] Asteroids with around a 1 km diameter have impacted the Earth on average once every 500,000 years; these are probably too small to pose an extinction risk, but might kill billions of people.[129][131] Larger asteroids are less common. Small near-Earth asteroids are regularly observed and can impact anywhere on the Earth injuring local populations.[132] As of 2013, Spaceguard estimates it has identified 95% of all NEOs over 1 km in size.[133]

In April 2018, the B612 Foundation reported "It's a 100 per cent certain we'll be hit [by a devastating asteroid], but we're not 100 per cent sure when."[134] Also in 2018, physicist Stephen Hawking, in his final book Brief Answers to the Big Questions, considered an asteroid collision to be the biggest threat to the planet.[135][136][137] In June 2018, the US National Science and Technology Council warned that America is unprepared for an asteroid impact event, and has developed and released the "National Near-Earth Object Preparedness Strategy Action Plan" to better prepare.[138][139][140][141][142] According to expert testimony in the United States Congress in 2013, NASA would require at least five years of preparation before a mission to intercept an asteroid could be launched.[143]

Cosmic threats

A number of astronomical threats have been identified. Massive objects, e.g. a star, large planet, or black hole, could be catastrophic if a close encounter occurred in the Solar System. In April 2008, it was announced that two simulations of long-term planetary movement, one at the Paris Observatory and the other at the University of California, Santa Cruz, indicate a 1% chance that Mercury's orbit could be made unstable by Jupiter's gravitational pull sometime during the lifespan of the Sun. Were this to happen, the simulations suggest a collision with Earth could be one of four possible outcomes (the others being Mercury colliding with the Sun, colliding with Venus, or being ejected from the Solar System altogether). If Mercury were to collide with Earth, all life on Earth could be obliterated entirely: an asteroid 15 km wide is believed to have caused the extinction of the non-avian dinosaurs, whereas Mercury is 4,879 km in diameter.[144]

A dark gray and red sphere representing the Earth lies against a black background to the right of an orange circular object representing the Sun
Conjectured illustration of the scorched Earth after the Sun has entered the red giant phase, about seven billion years from now[145]

If our universe lies within a false vacuum, a bubble of lower-energy vacuum could come to exist by chance or otherwise in our universe, and catalyze the conversion of our universe to a lower energy state in a volume expanding at nearly the speed of light, destroying all that we know without forewarning. Such an occurrence is called vacuum decay.[146][147]

Another cosmic threat is a gamma-ray burst, typically produced by a supernova when a star collapses inward on itself and then "bounces" outward in a massive explosion. Under certain circumstances, these events are thought to produce massive bursts of gamma radiation emanating outward from the axis of rotation of the star. If such an event were to occur oriented towards the Earth, the massive amounts of gamma radiation could significantly affect the Earth's atmosphere and pose an existential threat to all life. Such a gamma-ray burst may have been the cause of the Ordovician–Silurian extinction events. Neither this scenario nor the destabilization of Mercury's orbit is likely in the foreseeable future.[148]

A powerful solar flare or solar superstorm, which is a drastic and unusual decrease or increase in the Sun's power output, could have severe consequences for life on Earth.[149][150]

Astrophysicists currently calculate that in a few billion years the Earth will probably be swallowed by the expansion of the Sun into a red giant star.[151][152]

Extraterrestrial invasion

Main page: Unsolved:Alien invasion

Intelligent extraterrestrial life, if existent, could invade Earth either to exterminate and supplant human life, enslave it under a colonial system, steal the planet's resources, or destroy the planet altogether.[153]

Although evidence of alien life has never been proven, scientists such as Carl Sagan have postulated that the existence of extraterrestrial life is very likely. In 1969, the "Extra-Terrestrial Exposure Law" was added to the United States Code of Federal Regulations (Title 14, Section 1211) in response to the possibility of biological contamination resulting from the U.S. Apollo Space Program. It was removed in 1991.[154] Scientists consider such a scenario technically possible, but unlikely.[155]

An article in The New York Times discussed the possible threats for humanity of intentionally sending messages aimed at extraterrestrial life into the cosmos in the context of the SETI efforts. Several public figures such as Stephen Hawking and Elon Musk have argued against sending such messages on the grounds that extraterrestrial civilizations with technology are probably far more advanced than humanity and could pose an existential threat to humanity.[156]

Natural pandemic

Main page: Finance:Pandemic

There are numerous historical examples of pandemics[157] that have had a devastating effect on a large number of people. The present, unprecedented scale and speed of human movement make it more difficult than ever to contain an epidemic through local quarantines, and other sources of uncertainty and the evolving nature of the risk mean natural pandemics may pose a realistic threat to human civilization.[128]

There are several classes of argument about the likelihood of pandemics. One stems from history, where the limited size of historical pandemics is evidence that larger pandemics are unlikely. This argument has been disputed on grounds including the changing risk due to changing population and behavioral patterns among humans, the limited historical record, and the existence of an anthropic bias.[128]

Another argument is based on an evolutionary model that predicts that naturally evolving pathogens will ultimately develop an upper limit to their virulence.[158] This is because pathogens with high enough virulence quickly kill their hosts and reduce their chances of spreading the infection to new hosts or carriers.[159] This model has limits, however, because the fitness advantage of limited virulence is primarily a function of a limited number of hosts. Any pathogen with a high virulence, high transmission rate and long incubation time may have already caused a catastrophic pandemic before ultimately virulence is limited through natural selection. Additionally, a pathogen that infects humans as a secondary host and primarily infects another species (a zoonosis) has no constraints on its virulence in people, since the accidental secondary infections do not affect its evolution.[160] Lastly, in models where virulence level and rate of transmission are related, high levels of virulence can evolve.[161] Virulence is instead limited by the existence of complex populations of hosts with different susceptibilities to infection, or by some hosts being geographically isolated.[158] The size of the host population and competition between different strains of pathogens can also alter virulence.[162]

Neither of these arguments is applicable to bioengineered pathogens, and this poses entirely different risks of pandemics. Experts have concluded that "Developments in science and technology could significantly ease the development and use of high consequence biological weapons," and these "highly virulent and highly transmissible [bio-engineered pathogens] represent new potential pandemic threats."[163]

Natural climate change

Climate change refers to a lasting change in the Earth's climate. The climate has ranged from ice ages to warmer periods when palm trees grew in Antarctica. It has been hypothesized that there was also a period called "snowball Earth" when all the oceans were covered in a layer of ice. These global climatic changes occurred slowly, near the end of the last Major Ice Age when the climate became more stable. However, abrupt climate change on the decade time scale has occurred regionally. A natural variation into a new climate regime (colder or hotter) could pose a threat to civilization.[164][165]

In the history of the Earth, many Ice Ages are known to have occurred. An ice age would have a serious impact on civilization because vast areas of land (mainly in North America, Europe, and Asia) could become uninhabitable. Currently, the world is in an Interglacial period within a much older glacial event. The last glacial expansion ended about 10,000 years ago, and all civilizations evolved later than this. Scientists do not predict that a natural ice age will occur anytime soon.[citation needed] The amount of heat-trapping gases emitted into Earth's oceans and atmosphere will prevent the next ice age, which otherwise would begin in around 50,000 years, and likely more glacial cycles.[166][167]

Volcanism

Main pages: Earth:Supervolcano and Earth:Volcanic winter
Yellowstone sits on top of three overlapping calderas

A geological event such as massive flood basalt, volcanism, or the eruption of a supervolcano[168] could lead to a so-called volcanic winter, similar to a nuclear winter. One such event, the Toba eruption,[169] occurred in Indonesia about 71,500 years ago. According to the Toba catastrophe theory,[170] the event may have reduced human populations to only a few tens of thousands of individuals. Yellowstone Caldera is another such supervolcano, having undergone 142 or more caldera-forming eruptions in the past 17 million years.[171] A massive volcano eruption would eject extraordinary volumes of volcanic dust, toxic and greenhouse gases into the atmosphere with serious effects on global climate (towards extreme global cooling: volcanic winter if short-term, and ice age if long-term) or global warming (if greenhouse gases were to prevail).

When the supervolcano at Yellowstone last erupted 640,000 years ago, the thinnest layers of the ash ejected from the caldera spread over most of the United States west of the Mississippi River and part of northeastern Mexico. The magma covered much of what is now Yellowstone National Park and extended beyond, covering much of the ground from Yellowstone River in the east to Idaho falls in the west, with some of the flows extending north beyond Mammoth Springs.[172]

According to a recent study, if the Yellowstone caldera erupted again as a supervolcano, an ash layer one to three millimeters thick could be deposited as far away as New York, enough to "reduce traction on roads and runways, short out electrical transformers and cause respiratory problems". There would be centimeters of thickness over much of the U.S. Midwest, enough to disrupt crops and livestock, especially if it happened at a critical time in the growing season. The worst-affected city would likely be Billings, Montana, population 109,000, which the model predicted would be covered with ash estimated as 1.03 to 1.8 meters thick.[173]

The main long-term effect is through global climate change, which reduces the temperature globally by about 5–15 °C for a decade, together with the direct effects of the deposits of ash on their crops. A large supervolcano like Toba would deposit one or two meters thickness of ash over an area of several million square kilometers. (1000 cubic kilometers is equivalent to a one-meter thickness of ash spread over a million square kilometers). If that happened in some densely populated agricultural area, such as India, it could destroy one or two seasons of crops for two billion people.[174]

However, Yellowstone shows no signs of a supereruption at present, and it is not certain that a future supereruption will occur there.[175][176]

Research published in 2011 finds evidence that massive volcanic eruptions caused massive coal combustion, supporting models for the significant generation of greenhouse gases. Researchers have suggested that massive volcanic eruptions through coal beds in Siberia would generate significant greenhouse gases and cause a runaway greenhouse effect.[177] Massive eruptions can also throw enough pyroclastic debris and other material into the atmosphere to partially block out the sun and cause a volcanic winter, as happened on a smaller scale in 1816 following the eruption of Mount Tambora, the so-called Year Without a Summer. Such an eruption might cause the immediate deaths of millions of people several hundred miles from the eruption, and perhaps billions of death worldwide, due to the failure of the monsoons,[178] resulting in major crop failures causing starvation on a profound scale.[178]

A much more speculative concept is the verneshot: a hypothetical volcanic eruption caused by the buildup of gas deep underneath a craton. Such an event may be forceful enough to launch an extreme amount of material from the crust and mantle into a sub-orbital trajectory.

Proposed mitigation

Defense in depth is a useful framework for categorizing risk mitigation measures into three layers of defense:[179]

  1. Prevention: Reducing the probability of a catastrophe occurring in the first place. Example: Measures to prevent outbreaks of new highly infectious diseases.
  2. Response: Preventing the scaling of a catastrophe to the global level. Example: Measures to prevent escalation of a small-scale nuclear exchange into an all-out nuclear war.
  3. Resilience: Increasing humanity's resilience (against extinction) when faced with global catastrophes. Example: Measures to increase food security during a nuclear winter.

Human extinction is most likely when all three defenses are weak, that is, "by risks we are unlikely to prevent, unlikely to successfully respond to, and unlikely to be resilient against".[179]

The unprecedented nature of existential risks poses a special challenge in designing risk mitigation measures since humanity will not be able to learn from a track record of previous events.[18]

Planetary management and respecting planetary boundaries have been proposed as approaches to preventing ecological catastrophes. Within the scope of these approaches, the field of geoengineering encompasses the deliberate large-scale engineering and manipulation of the planetary environment to combat or counteract anthropogenic changes in atmospheric chemistry. Space colonization is a proposed alternative to improve the odds of surviving an extinction scenario.[180] Solutions of this scope may require megascale engineering. Food storage has been proposed globally, but the monetary cost would be high. Furthermore, it would likely contribute to the current millions of deaths per year due to malnutrition.[181]

Some survivalists stock survival retreats with multiple-year food supplies.

The Svalbard Global Seed Vault is buried 400 feet (120 m) inside a mountain on an island in the Arctic. It is designed to hold 2.5 billion seeds from more than 100 countries as a precaution to preserve the world's crops. The surrounding rock is −6 °C (21 °F) (as of 2015) but the vault is kept at −18 °C (0 °F) by refrigerators powered by locally sourced coal.[182][183]

More speculatively, if society continues to function and if the biosphere remains habitable, calorie needs for the present human population might in theory be met during an extended absence of sunlight, given sufficient advance planning. Conjectured solutions include growing mushrooms on the dead plant biomass left in the wake of the catastrophe, converting cellulose to sugar, or feeding natural gas to methane-digesting bacteria.[184][185]

Global catastrophic risks and global governance

Insufficient global governance creates risks in the social and political domain, but the governance mechanisms develop more slowly than technological and social change. There are concerns from governments, the private sector, as well as the general public about the lack of governance mechanisms to efficiently deal with risks, negotiate and adjudicate between diverse and conflicting interests. This is further underlined by an understanding of the interconnectedness of global systemic risks.[186] In absence or anticipation of global governance, national governments can act individually to better understand, mitigate and prepare for global catastrophes.[187]

Climate emergency plans

In 2018, the Club of Rome called for greater climate change action and published its Climate Emergency Plan, which proposes ten action points to limit global average temperature increase to 1.5 degrees Celsius.[188] Further, in 2019, the Club published the more comprehensive Planetary Emergency Plan.[189]

Organizations

The Bulletin of the Atomic Scientists (est. 1945) is one of the oldest global risk organizations, founded after the public became alarmed by the potential of atomic warfare in the aftermath of WWII. It studies risks associated with nuclear war and energy and famously maintains the Doomsday Clock established in 1947. The Foresight Institute (est. 1986) examines the risks of nanotechnology and its benefits. It was one of the earliest organizations to study the unintended consequences of otherwise harmless technology gone haywire at a global scale. It was founded by K. Eric Drexler who postulated "grey goo".[190][191]

Beginning after 2000, a growing number of scientists, philosophers and tech billionaires created organizations devoted to studying global risks both inside and outside of academia.[192]

Independent non-governmental organizations (NGOs) include the Machine Intelligence Research Institute (est. 2000), which aims to reduce the risk of a catastrophe caused by artificial intelligence,[193] with donors including Peter Thiel and Jed McCaleb.[194] The Nuclear Threat Initiative (est. 2001) seeks to reduce global threats from nuclear, biological and chemical threats, and containment of damage after an event.[8] It maintains a nuclear material security index.[195] The Lifeboat Foundation (est. 2009) funds research into preventing a technological catastrophe.[196] Most of the research money funds projects at universities.[197] The Global Catastrophic Risk Institute (est. 2011) is a think tank for catastrophic risk. It is funded by the NGO Social and Environmental Entrepreneurs. The Global Challenges Foundation (est. 2012), based in Stockholm and founded by Laszlo Szombatfalvy, releases a yearly report on the state of global risks.[35][198] The Future of Life Institute (est. 2014) aims to support research and initiatives for safeguarding life considering new technologies and challenges facing humanity.[7] Elon Musk is one of its biggest donors.[199] The Center on Long-Term risk (est. 2016), formerly known as the Foundational Research Institute, is a British organization focused on reducing risks of astronomical suffering (s-risks) from emerging technologies.[200]

University-based organizations include the Future of Humanity Institute (est. 2005) which researches the questions of humanity's long-term future, particularly existential risk.[5] It was founded by Nick Bostrom and is based at Oxford University.[5] The Centre for the Study of Existential Risk (est. 2012) is a Cambridge University-based organization which studies four major technological risks: artificial intelligence, biotechnology, global warming and warfare.[6] All are man-made risks, as Huw Price explained to the AFP news agency, "It seems a reasonable prediction that some time in this or the next century intelligence will escape from the constraints of biology". He added that when this happens "we're no longer the smartest things around," and will risk being at the mercy of "machines that are not malicious, but machines whose interests don't include us."[201] Stephen Hawking was an acting adviser. The Millennium Alliance for Humanity and the Biosphere is a Stanford University-based organization focusing on many issues related to global catastrophe by bringing together members of academic in the humanities.[202][203] It was founded by Paul Ehrlich among others.[204] Stanford University also has the Center for International Security and Cooperation focusing on political cooperation to reduce global catastrophic risk.[205] The Center for Security and Emerging Technology was established in January 2019 at Georgetown's Walsh School of Foreign Service and will focus on policy research of emerging technologies with an initial emphasis on artificial intelligence.[206] They received a grant of 55M USD from Good Ventures as suggested by the Open Philanthropy Project.[206]

Other risk assessment groups are based in or are part of governmental organizations. The World Health Organization (WHO) includes a division called the Global Alert and Response (GAR) which monitors and responds to global epidemic crisis.[207] GAR helps member states with training and coordination of response to epidemics.[208] The United States Agency for International Development (USAID) has its Emerging Pandemic Threats Program which aims to prevent and contain naturally generated pandemics at their source.[209] The Lawrence Livermore National Laboratory has a division called the Global Security Principal Directorate which researches on behalf of the government issues such as bio-security and counter-terrorism.[210]

History

Early history of thinking about human extinction

Before the 18th and 19th centuries, the possibility that humans or other organisms could go extinct was viewed with scepticism.[211] It contradicted the principle of plenitude, a doctrine that all possible things exist.[211] The principle traces back to Aristotle, and was an important tenet of Christian theology.[212]:121 The doctrine was gradually undermined by evidence from the natural sciences, particular the discovery of fossil evidence of species that appeared to no longer exist, and the development of theories of evolution.[212]:121 In On the Origin of Species, Darwin discussed the extinction of species as a natural process and core component of natural selection.[213] Notably, Darwin was skeptical of the possibility of sudden extinctions, viewing it as a gradual process. He held that the abrupt disappearance of species from the fossil record were not evidence of catastrophic extinctions, but rather were a function of unrecognised gaps in the record.[213]

As the possibility of extinction became more widely established in the sciences, so did the prospect of human extinction.[211] Beyond science, human extinction was explored in literature. The Romantic authors and poets were particularly interested in the topic.[211] Lord Byron wrote about the extinction of life on earth in his 1816 poem ‘Darkness’, and in 1824 envisaged humanity being threatened by a comet impact, and employing a missile system to defend against it.[214] Mary Shelley’s 1826 novel The Last Man is set in a world where humanity has been nearly destroyed by a mysterious plague.[214]

Atomic era

Castle Romeo nuclear test on Bikini Atoll.

The invention of the atomic bomb prompted a wave of discussion about the risk of human extinction among scientists, intellectuals, and the public at large.[211] In a 1945 essay, Bertrand Russell wrote that "[T]he prospect for the human race is sombre beyond all precedent. Mankind are faced with a clear-cut alternative: either we shall all perish, or we shall have to acquire some slight degree of common sense."[215] A 1950 Gallup poll found that 19% of Americans believed that another world war would mean "an end to mankind".[216]

The discovery of 'nuclear winter' in the early 1980s, a specific mechanism by which nuclear war could result in human extinction, again raised the issue to prominence. Writing about these findings in 1983, Carl Sagan argued that measuring the badness of extinction solely in terms of those who die "conceals its full impact," and that nuclear war "imperils all of our descendants, for as long as there will be humans."[217]

Modern era

John Leslie's 1996 book The End of The World was an academic treatment of the science and ethics of human extinction. In it, Leslie considered a range of threats to humanity and what they have in common. In 2003, British Astronomer Royal Sir Martin Rees published Our Final Hour, in which he argues that advances in certain technologies create new threats for the survival of humankind and that the 21st century may be a critical moment in history when humanity's fate is decided.[21] Edited by Nick Bostrom and Milan M. Ćirković, Global Catastrophic Risks was published in 2008, a collection of essays from 26 academics on various global catastrophic and existential risks.[218] Toby Ord's 2020 book The Precipice: Existential Risk and the Future of Humanity argues that preventing existential risks is one of the most important moral issues of our time. The book discusses, quantifies, and compares different existential risks, concluding that the greatest risks are presented by unaligned artificial intelligence and biotechnology.[18]

See also


Notes

  1. Schulte, P. et al. (March 5, 2010). "The Chicxulub Asteroid Impact and Mass Extinction at the Cretaceous-Paleogene Boundary". Science 327 (5970): 1214–1218. doi:10.1126/science.1177265. PMID 20203042. Bibcode2010Sci...327.1214S. http://doc.rero.ch/record/210367/files/PAL_E4389.pdf. 
  2. Bostrom, Nick (2008). Global Catastrophic Risks. Oxford University Press. p. 1. http://www.global-catastrophic-risks.com/docs/Chap01.pdf. 
  3. 3.0 3.1 3.2 "World Scientists' Warning to Humanity: A Second Notice". BioScience 67 (12): 1026–1028. November 13, 2017. doi:10.1093/biosci/bix125. 
  4. Bostrom, Nick (March 2002). "Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards". Journal of Evolution and Technology 9. http://www.nickbostrom.com/existential/risks.html. 
  5. 5.0 5.1 5.2 5.3 "About FHI" (in en-GB). http://www.fhi.ox.ac.uk/. 
  6. 6.0 6.1 6.2 "About us". https://www.cser.ac.uk/about-us/. 
  7. 7.0 7.1 "The Future of Life Institute". http://thefutureoflife.org/. 
  8. 8.0 8.1 "Nuclear Threat Initiative". http://www.nti.org. 
  9. 9.0 9.1 9.2 9.3 9.4 9.5 9.6 9.7 Bostrom, Nick (2013). "Existential Risk Prevention as Global Priority". Global Policy 4 (1): 15–3. doi:10.1111/1758-5899.12002. http://www.existential-risk.org/concept.pdf. 
  10. Bostrom, Nick; Cirkovic, Milan (2008). Global Catastrophic Risks. Oxford: Oxford University Press. p. 1. ISBN 978-0-19-857050-9. 
  11. Ziegler, Philip (2012). The Black Death. Faber and Faber. p. 397. ISBN 9780571287116. 
  12. Muehlhauser, Luke (March 15, 2017). "How big a deal was the Industrial Revolution?". https://lukemuehlhauser.com/industrial-revolution/. 
  13. Taubenberger, Jeffery; Morens, David (2006). "1918 Influenza: the Mother of All Pandemics". Emerging Infectious Diseases 12 (1): 15–22. doi:10.1257/jep.24.2.163. PMID 16494711. 
  14. Posner, Richard A. (2006). Catastrophe: Risk and Response. Oxford: Oxford University Press. ISBN 978-0195306477.  Introduction, "What is Catastrophe?"
  15. Ord, Toby (2020). The Precipice: Existential Risk and the Future of Humanity. New York: Hachette. ISBN 9780316484916. "This is an equivalent, though crisper statement of Nick Bostrom's definition: "An existential risk is one that threatens the premature extinction of Earth-originating intelligent life or the permanent and drastic destruction of its potential for desirable future development." Source: Bostrom, Nick (2013). "Existential Risk Prevention as Global Priority". Global Policy. 4:15-31." 
  16. Cotton-Barratt, Owen; Ord, Toby (2015), Existential risk and existential hope: Definitions, Future of Humanity Institute – Technical Report #2015-1, pp. 1–4, http://www.fhi.ox.ac.uk/Existential-risk-and-existential-hope.pdf 
  17. 17.0 17.1 Bostrom, Nick (2009). "Astronomical Waste: The opportunity cost of delayed technological development". Utilitas 15 (3): 308–314. doi:10.1017/s0953820800004076. http://www.nickbostrom.com/astronomical/waste.html. 
  18. 18.00 18.01 18.02 18.03 18.04 18.05 18.06 18.07 18.08 18.09 18.10 18.11 18.12 18.13 18.14 18.15 18.16 18.17 18.18 Ord, Toby (2020). The Precipice: Existential Risk and the Future of Humanity. New York: Hachette. ISBN 9780316484916. 
  19. Orwell, George (1949). Nineteen Eighty-Four. A novel. London: Secker & Warburg. http://catalogue.bl.uk/. 
  20. 20.0 20.1 Bryan Caplan (2008). "The totalitarian threat". Global Catastrophic Risks, eds. Bostrom & Cirkovic (Oxford University Press): 504-519. ISBN:9780198570509
  21. 21.0 21.1 Reese, Martin (2003). Our Final Hour: A Scientist's Warning: How Terror, Error, and Environmental Disaster Threaten Humankind's Future In This Century - On Earth and Beyond. Basic Books. ISBN 0-465-06863-4. 
  22. 22.0 22.1 22.2 22.3 22.4 22.5 Bostrom, Nick; Sandberg, Anders (2008). "Global Catastrophic Risks Survey". FHI Technical Report #2008-1 (Future of Humanity Institute). https://www.fhi.ox.ac.uk/reports/2008-1.pdf. 
  23. 23.0 23.1 23.2 23.3 Snyder-Beattie, Andrew E.; Ord, Toby; Bonsall, Michael B. (July 30, 2019). "An upper bound for the background rate of human extinction" (in en). Scientific Reports 9 (1): 11054. doi:10.1038/s41598-019-47540-7. ISSN 2045-2322. PMID 31363134. Bibcode2019NatSR...911054S. 
  24. 24.0 24.1 "Frequently Asked Questions". Future of Humanity Institute. http://existential-risk.org/faq.html. ""The great bulk of existential risk in the foreseeable future is anthropogenic; that is, arising from human activity."" 
  25. 25.0 25.1 Matheny, Jason Gaverick (2007). "Reducing the Risk of Human Extinction". Risk Analysis 27 (5): 1335–1344. doi:10.1111/j.1539-6924.2007.00960.x. PMID 18076500. http://users.physics.harvard.edu/~wilson/pmpmta/Mahoney_extinction.pdf. 
  26. Asher, D.J.; Bailey, M.E.; Emel'yanenko, V.; Napier, W.M. (2005). "Earth in the cosmic shooting gallery". The Observatory 125: 319–322. Bibcode2005Obs...125..319A. http://www.arm.ac.uk/preprints/455.pdf. 
  27. 27.0 27.1 27.2 Rampino, M.R.; Ambrose, S.H. (2002). "Super eruptions as a threat to civilizations on Earth-like planets". Icarus 156 (2): 562–569. doi:10.1006/icar.2001.6808. Bibcode2002Icar..156..562R. http://www.eos.ubc.ca/~mjelline/website212/rampino02.pdf. 
  28. Yost, Chad L.; Jackson, Lily J.; Stone, Jeffery R.; Cohen, Andrew S. (March 1, 2018). "Subdecadal phytolith and charcoal records from Lake Malawi, East Africa imply minimal effects on human evolution from the ∼74 ka Toba supereruption" (in en). Journal of Human Evolution 116: 75–94. doi:10.1016/j.jhevol.2017.11.005. ISSN 0047-2484. PMID 29477183. https://www.sciencedirect.com/science/article/abs/pii/S0047248417302750. 
  29. Sagan, Carl (1994). Pale Blue Dot. Random House. pp. 305–6. ISBN 0-679-43841-6. ""Some planetary civilizations see their way through, place limits on what may and what must not be done, and safely pass through the time of perils. Others are not so lucky or so prudent, perish."" 
  30. Parfit, Derek (2011). On What Matters Vol. 2. Oxford University Press. p. 616. ISBN 9780199681044. ""We live during the hinge of history ... If we act wisely in the next few centuries, humanity will survive its most dangerous and decisive period."" 
  31. Rowe, Thomas; Beard, Simon (2018). "Probabilities, methodologies and the evidence base in existential risk assessments". Working Paper, Centre for the Study of Existential Risk. http://eprints.lse.ac.uk/89506/1/Beard_Existential-Risk-Assessments_Accepted.pdf. Retrieved August 26, 2018. 
  32. Leslie, John (1996). The End of the World: The Science and Ethics of Human Extinction. Routledge. p. 146. 
  33. Bostrom, Nick (2002), "Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards", Journal of Evolution and Technology 9 
  34. Rees, Martin (2004). Our Final Century. Arrow Books. p. 9. 
  35. 35.0 35.1 Meyer, Robinson (April 29, 2016). "Human Extinction Isn't That Unlikely". Boston, Massachusetts: Emerson Collective. https://www.theatlantic.com/technology/archive/2016/04/a-human-extinction-isnt-that-unlikely/480444/. 
  36. Grace, Katja; Salvatier, John; Dafoe, Allen; Zhang, Baobao; Evans, Owain (May 3, 2018). "When Will AI Exceed Human Performance? Evidence from AI Experts". arXiv:1705.08807 [cs.AI].
  37. Purtill, Corinne. "How Close Is Humanity to the Edge?" (in en-us). The New Yorker. https://www.newyorker.com/culture/annals-of-inquiry/how-close-is-humanity-to-the-edge. Retrieved January 8, 2021. 
  38. "Will humans go extinct by 2100?". November 12, 2017. https://www.metaculus.com/questions/578/human-extinction-by-2100. 
  39. 39.0 39.1 Sagan, Carl (Winter 1983). "Nuclear War and Climatic Catastrophe: Some Policy Implications". Foreign Affairs (Council on Foreign Relations). doi:10.2307/20041818. https://www.foreignaffairs.com/articles/1983-12-01/nuclear-war-and-climatic-catastrophe-some-policy-implications. Retrieved August 4, 2020. 
  40. Jebari, Karim (2014). "Existential Risks: Exploring a Robust Risk Reduction Strategy". Science and Engineering Ethics 21 (3): 541–54. doi:10.1007/s11948-014-9559-3. PMID 24891130. https://philpapers.org/archive/JEBERE.pdf. Retrieved August 26, 2018. 
  41. 41.0 41.1 Cirkovic, Milan M.; Bostrom, Nick; Sandberg, Anders (2010). "Anthropic Shadow: Observation Selection Effects and Human Extinction Risks". Risk Analysis 30 (10): 1495–1506. doi:10.1111/j.1539-6924.2010.01460.x. PMID 20626690. https://www.nickbostrom.com/papers/anthropicshadow.pdf. 
  42. Kemp, Luke (February 2019). "Are we on the road to civilization collapse?" (in en). https://www.bbc.com/future/article/20190218-are-we-on-the-road-to-civilisation-collapse. 
  43. Ord, Toby (2020). The Precipice: Existential Risk and the Future of Humanity. ISBN 9780316484893. "Europe survived losing 25 to 50 percent of its population in the Black Death, while keeping civilization firmly intact" 
  44. 44.0 44.1 Yudkowsky, Eliezer (2008). "Cognitive Biases Potentially Affecting Judgment of Global Risks". Global Catastrophic Risks: 91–119. Bibcode2008gcr..book...86Y. https://intelligence.org/files/CognitiveBiases.pdf. 
  45. Desvousges, W.H., Johnson, F.R., Dunford, R.W., Boyle, K.J., Hudson, S.P., and Wilson, N. 1993, Measuring natural resource damages with contingent valuation: tests of validity and reliability. In Hausman, J.A. (ed), Contingent Valuation:A Critical Assessment, pp. 91–159 (Amsterdam: North Holland).
  46. 46.0 46.1 Parfit, Derek (1984). Reasons and Persons. Oxford University Press. pp. 453–454. 
  47. MacAskill, William; Yetter Chappell, Richard (2021). "Population Ethics | Practical Implications of Population Ethical Theories" (in en-US). https://www.utilitarianism.net/population-ethics. 
  48. Todd, Benjamin (2017). "The case for reducing existential risks". https://80000hours.org/articles/existential-risks/. 
  49. Narveson, Jan (1973). "Moral Problems of Population". The Monist 57 (1): 62–86. doi:10.5840/monist197357134. PMID 11661014. 
  50. Greaves, Hilary (2017). "Discounting for Public Policy: A Survey" (in en). Economics & Philosophy 33 (3): 391–439. doi:10.1017/S0266267117000062. ISSN 0266-2671. https://www.cambridge.org/core/journals/economics-and-philosophy/article/discounting-for-public-policy-a-survey/4CDDF711BF8782F262693F4549B5812E. 
  51. Greaves, Hilary (2017). "Population axiology" (in en). Philosophy Compass 12 (11): e12442. doi:10.1111/phc3.12442. ISSN 1747-9991. https://onlinelibrary.wiley.com/doi/abs/10.1111/phc3.12442. 
  52. Lewis, Gregory (May 23, 2018). "The person-affecting value of existential risk reduction". https://gregoryjlewis.com/2018/05/23/the-person-affecting-value-of-existential-risk-reduction/. 
  53. Burke, Edmund (1999). "Reflections on the Revolution in France". in Canavan, Francis. Select Works of Edmund Burke Volume 2. Liberty Fund. p. 192. http://oll-resources.s3.amazonaws.com/titles/656/0005-02_SM.pdf. 
  54. Weitzman, Martin (2009). "On modeling and interpreting the economics of catastrophic climate change". The Review of Economics and Statistics 91 (1): 1–19. doi:10.1162/rest.91.1.1. http://dash.harvard.edu/bitstream/handle/1/3693423/Weitzman_OnModeling.pdf. 
  55. Posner, Richard (2004). Catastrophe: Risk and Response. Oxford University Press. 
  56. IPCC (November 11, 2013): D. "Understanding the Climate System and its Recent Changes", in: Summary for Policymakers (finalized version) , in: IPCC AR5 WG1 2013, p. 13
  57. "Global Catastrophic Risks: a summary". Centre for the Study of Existential Risk. August 11, 2019. https://www.gcrpolicy.com/risks. 
  58. "Research Areas" (in en-GB). https://www.fhi.ox.ac.uk/research/research-areas/. 
  59. "Research". https://www.cser.ac.uk/research/. 
  60. Bill Joy, Why the future doesn't need us. Wired magazine.
  61. Nick Bostrom 2002 "Ethical Issues in Advanced Artificial Intelligence"
  62. Bostrom, Nick. Superintelligence: Paths, Dangers, Strategies. 
  63. Rawlinson, Kevin (January 29, 2015). "Microsoft's Bill Gates insists AI is a threat". BBC News. https://www.bbc.co.uk/news/31047780. 
  64. Scientists Worry Machines May Outsmart Man by John Markoff, The New York Times, July 26, 2009.
  65. Gaming the Robot Revolution: A military technology expert weighs in on Terminator: Salvation., By P. W. Singer, slate.com Thursday, May 21, 2009.
  66. robot page, engadget.com.
  67. Grace, Katja (2017). "When Will AI Exceed Human Performance? Evidence from AI Experts". Journal of Artificial Intelligence Research. Bibcode2017arXiv170508807G. 
  68. Yudkowsky, Eliezer (2008). Artificial Intelligence as a Positive and Negative Factor in Global Risk. Bibcode2008gcr..book..303Y. http://yudkowsky.net/singularity/ai-risk. Retrieved July 26, 2013. 
  69. 69.0 69.1 69.2 69.3 69.4 69.5 69.6 69.7 69.8 Ali Noun; Christopher F. Chyba (2008). "Chapter 20: Biotechnology and biosecurity". in Bostrom, Nick. Global Catastrophic Risks. Oxford University Press. 
  70. 70.0 70.1 Sandberg, Anders. "The five biggest threats to human existence". http://theconversation.com/the-five-biggest-threats-to-human-existence-27053. 
  71. Jackson, Ronald J.; Ramsay, Alistair J.; Christensen, Carina D.; Beaton, Sandra; Hall, Diana F.; Ramshaw, Ian A. (2001). "Expression of Mouse Interleukin-4 by a Recombinant Ectromelia Virus Suppresses Cytolytic Lymphocyte Responses and Overcomes Genetic Resistance to Mousepox". Journal of Virology 75 (3): 1205–1210. doi:10.1128/jvi.75.3.1205-1210.2001. PMID 11152493. 
  72. UCLA Engineering (June 28, 2017). "Scholars assess threats to civilization, life on Earth". UCLA. http://newsroom.ucla.edu/stories/scholars-assess-existential-and-catastrophic-risks-to-humanity. 
  73. Graham, Chris (July 11, 2017). "Earth undergoing sixth 'mass extinction' as humans spur 'biological annihilation' of wildlife". The Telegraph. https://www.telegraph.co.uk/news/2017/07/11/earth-undergoing-sixth-mass-extinction-humans-spur-biological/. 
  74. Evans-Pritchard, Ambrose (February 6, 2011). "Einstein was right - honey bee collapse threatens global food security". The Daily Telegraph (London). https://www.telegraph.co.uk/finance/comment/ambroseevans_pritchard/8306970/Einstein-was-right-honey-bee-collapse-threatens-global-food-security.html. 
  75. Lovgren, Stefan. "Mystery Bee Disappearances Sweeping U.S." National Geographic News. URL accessed March 10, 2007.
  76. 76.0 76.1 Carrington, Damian (October 20, 2017). "Global pollution kills 9m a year and threatens 'survival of human societies'". The Guardian (London, UK). https://www.theguardian.com/environment/2017/oct/19/global-pollution-kills-millions-threatens-survival-human-societies. 
  77. Nafeez, Ahmed. "Theoretical Physicists Say 90% Chance of Societal Collapse Within Several Decades". https://www.vice.com/en_us/article/akzn5a/theoretical-physicists-say-90-chance-of-societal-collapse-within-several-decades. 
  78. Bologna, M.; Aquino, G. (2020). "Deforestation and world population sustainability: a quantitative analysis". Scientific Reports 10 (7631): 7631. doi:10.1038/s41598-020-63657-6. PMID 32376879. Bibcode2020NatSR..10.7631B. 
  79. Bostrom 2002, section 4.8
  80. Richard Hamming (1998). "Mathematics on a Distant Planet". The American Mathematical Monthly 105 (7): 640–650. doi:10.1080/00029890.1998.12004938. 
  81. "Report LA-602, Ignition of the Atmosphere With Nuclear Bombs". https://fas.org/sgp/othergov/doe/lanl/docs1/00329010.pdf. 
  82. Matthews, Robert. "A black hole ate my planet". https://www.newscientist.com/article/mg16322014-700-a-black-hole-ate-my-planet/. 
  83. Konopinski, E. J; Marvin, C.; Teller, Edward (1946). Ignition of the Atmosphere with Nuclear Bombs. Los Alamos National Laboratory. https://fas.org/sgp/othergov/doe/lanl/docs1/00329010.pdf. Retrieved November 23, 2008. 
  84. "Home - Unit - DPF". Archived from the original on October 24, 2009. https://web.archive.org/web/20091024184048/http://www.aps.org/units/dpf/governance/reports/upload/lhc_saftey_statement.pdf. 
  85. "Safety at the LHC". http://public.web.cern.ch/Public/en/LHC/Safety-en.html. 
  86. J. Blaizot et al., "Study of Potentially Dangerous Events During Heavy-Ion Collisions at the LHC", CERN library record CERN Yellow Reports Server (PDF)
  87. Eric Drexler, Engines of Creation, ISBN:0-385-19973-2, available online
  88. "Hint to Coal Consumers". The Selma Morning Times (Selma, Alabama, US): p. 4. October 15, 1902. https://www.newspapers.com/image/570090173/. 
  89. Georgescu-Roegen, Nicholas (1971) (Full book accessible in three parts at Scribd). The Entropy Law and the Economic Process.. Cambridge, Massachusetts: Harvard University Press. ISBN 978-0674257801. https://archive.org/details/entropylawe00nich. 
  90. Daly, Herman E., ed (1980) (PDF contains only the introductory chapter of the book). Economics, Ecology, Ethics. Essays Towards a Steady-State Economy. (2nd ed.). San Francisco: W.H. Freeman and Company. ISBN 978-0716711780. http://www.uvm.edu/~jdericks/EE/Daly_Ends_n_Means.pdf. 
  91. Rifkin, Jeremy (1980) (PDF contains only the title and contents pages of the book). Entropy: A New World View.. New York: The Viking Press. ISBN 978-0670297177. http://www.foet.org/books/Entropy-toc.pdf. 
  92. Boulding, Kenneth E. (1981). Evolutionary Economics. Beverly Hills: Sage Publications. ISBN 978-0803916487. https://archive.org/details/evolutionaryecon0000boul. 
  93. Martínez-Alier, Juan (1987). Ecological Economics: Energy, Environment and Society.. Oxford: Basil Blackwell. ISBN 978-0631171461. https://archive.org/details/ecologicaleconom0000mart. 
  94. Gowdy, John M.; Mesner, Susan (1998). "The Evolution of Georgescu-Roegen's Bioeconomics". Review of Social Economy 56 (2): 136–156. doi:10.1080/00346769800000016. http://eurekamag.com/pdf/003/003304967.pdf. 
  95. Schmitz, John E.J. (2007) (Author's science blog, based on his textbook). The Second Law of Life: Energy, Technology, and the Future of Earth As We Know It.. Norwich: William Andrew Publishing. ISBN 978-0815515371. https://secondlawoflife.wordpress.com/contents. 
  96. Kerschner, Christian (2010). "Economic de-growth vs. steady-state economy". Journal of Cleaner Production 18 (6): 544–551. doi:10.1016/j.jclepro.2009.10.019. http://degrowth.org/wp-content/uploads/2012/11/Kerschner-2010.pdf. 
  97. Perez-Carmona, Alexander (2013). "Growth: A Discussion of the Margins of Economic and Ecological Thought". in Meuleman, Louis. Transgovernance. Advancing Sustainability Governance.. Heidelberg: Springer. pp. 83–161. doi:10.1007/978-3-642-28009-2_3. ISBN 9783642280085. http://www.slideshare.net/lucieevers1/growth-in-margin-of-ecological-thought-by-perez. 
  98. Dirzo, Rodolfo; Hillary S. Young; Mauro Galetti; Gerardo Ceballos; Nick J. B. Isaac; Ben Collen (2014). "Defaunation in the Anthropocene". Science 345 (6195): 401–406. doi:10.1126/science.1251817. PMID 25061202. Bibcode2014Sci...345..401D. http://www.uv.mx/personal/tcarmona/files/2010/08/Science-2014-Dirzo-401-6-2.pdf. 
  99. 99.00 99.01 99.02 99.03 99.04 99.05 99.06 99.07 99.08 99.09 99.10 99.11 99.12 Chris Phoenix; Mike Treder (2008). "Chapter 21: Nanotechnology as global catastrophic risk". in Bostrom, Nick. Global catastrophic risks. Oxford: Oxford University Press. ISBN 978-0-19-857050-9. 
  100. 100.0 100.1 "Frequently Asked Questions - Molecular Manufacturing". http://www.foresight.org/nano/whatismm.html. 
  101. Drexler, Eric. "A Dialog on Dangers". http://www.foresight.org/Updates/Background3.html#DangerDialog. 
  102. Drexler, Eric. "ENGINES OF DESTRUCTION (Chapter 11)". http://e-drexler.com/d/06/00/EOC/EOC_Chapter_11.html. 
  103. "Dangers of Molecular Manufacturing". http://www.crnano.org/dangers.htm. 
  104. 104.0 104.1 "The Need for International Control". http://www.crnano.org/int_control.htm. 
  105. "Technical Restrictions May Make Nanotechnology Safer". http://www.crnano.org/restrictions.htm. 
  106. Joseph, Lawrence E. (2007). Apocalypse 2012. New York: Broadway. p. 6. ISBN 978-0-7679-2448-1. https://archive.org/details/apocalypse2012sc00jose/page/6. 
  107. Rincon, Paul (June 9, 2004). "Nanotech guru turns back on 'goo'". BBC News. http://news.bbc.co.uk/2/hi/science/nature/3788673.stm. 
  108. Hapgood, Fred (November 1986). "Nanotechnology: Molecular Machines that Mimic Life". Omni. http://metamodern.com/b/wp-content/uploads/docs/OMNI_TINYTECH.pdf. Retrieved July 19, 2014. 
  109. "Leading nanotech experts put 'grey goo' in perspective". http://www.crnano.org/PR-IOP.htm. 
  110. Hellman, Martin (April 29, 1985). "On the Probability of Nuclear War". Houston Post (Houston, Texas: MediaNews Group). http://www-ee.stanford.edu/~hellman/opinion/inevitability.html. 
  111. Cohen, Avner; Lee, Steven (1986). Nuclear Weapons and the Future of Humanity: The Fundamental Questions. Lanham, Maryland: Rowman & Littlefield. p. 237. gYmPp6lZqtMC. ISBN 978-0847672585. https://archive.org/details/nuclearweaponsfu0000unse/page/237. 
  112. 112.0 112.1 Federation of American Scientists (April 28, 2015). "Status of World Nuclear Forces". https://fas.org/issues/nuclear-weapons/status-world-nuclear-forces/. 
  113. "Atmospheric effects and societal consequences of regional-scale nuclear conflicts and acts of individual nuclear terrorism", Atmospheric Chemistry and Physics
  114. Bostrom 2002, section 4.2.
  115. 115.0 115.1 Martin, Brian (1982). "Critique of nuclear extinction". Journal of Peace Research 19 (4): 287–300. doi:10.1177/002234338201900401. http://www.bmartin.cc/pubs/82jpr.html. Retrieved October 25, 2014. 
  116. Shulman, Carl (November 5, 2012). "Nuclear winter and human extinction: Q&A with Luke Oman". http://www.overcomingbias.com/2012/11/nuclear-winter-and-human-extinction-qa-with-luke-oman.html. 
  117. "The end of India's green revolution?". BBC News. May 29, 2006. http://news.bbc.co.uk/1/hi/world/south_asia/4994590.stm. 
  118. admin (April 8, 2000). "Food First/Institute for Food and Development Policy". Foodfirst.org. http://www.foodfirst.org/media/opeds/2000/4-greenrev.html. 
  119. "How peak oil could lead to starvation". May 27, 2009. http://wolf.readinglitho.co.uk/mainpages/agriculture.html. 
  120. "Eating Fossil Fuels". EnergyBulletin.net. October 2, 2003. http://www.energybulletin.net/node/281. 
  121. The Oil Drum: Europe. "Agriculture Meets Peak Oil". Europe.theoildrum.com. http://europe.theoildrum.com/node/2225. 
  122. "Drawing Momentum from the Crash" by Dale Allen Pfeiffer
  123. Neff, R. A.; Parker, C. L.; Kirschenmann, F. L.; Tinch, J.; Lawrence, R. S. (September 2011). "Peak Oil, Food Systems, and Public Health". American Journal of Public Health 101 (9): 1587–1597. doi:10.2105/AJPH.2011.300123. PMID 21778492. 
  124. "Former BP geologist: peak oil is here and it will 'break economies'". The Guardian. December 23, 2013. https://www.theguardian.com/environment/earth-insight/2013/dec/23/british-petroleum-geologist-peak-oil-break-economy-recession. 
  125. "Cereal Disease Laboratory : Ug99 an emerging virulent stem rust race". Ars.usda.gov. http://www.ars.usda.gov/Main/docs.htm?docid=14649. 
  126. "Durable Rust Resistance in Wheat". https://bgri.cornell.edu/durable-rust-resistance-in-wheat/. 
  127. 127.0 127.1 Barnosky, Anthony D.; Matzke, Nicholas; Tomiya, Susumu; Wogan, Guinevere O. U.; Swartz, Brian; Quental, Tiago B.; Marshall, Charles; McGuire, Jenny L. et al. (March 3, 2011). "Has the Earth's sixth mass extinction already arrived?". Nature 471 (7336): 51–57. doi:10.1038/nature09678. PMID 21368823. Bibcode2011Natur.471...51B. 
  128. 128.0 128.1 128.2 Manheim, David (2018). "Questioning Estimates of Natural Pandemic Risk". Health Security 16 (6): 381–390. doi:10.1089/hs.2018.0039. PMID 30489178. 
  129. 129.0 129.1 Gehrels, Tom; Matthews, Mildred Shapley; Schumann, A. M. (1994) (in en). Hazards Due to Comets and Asteroids. University of Arizona Press. p. 71. ISBN 9780816515059. https://books.google.com/books?id=xXWZolI9NkUC. 
  130. "How Big Would A Meteorite Have To Be To Wipe Out All Human Life?" (in en). Popular Science. February 26, 2015. https://www.popsci.com/how-big-would-meteorite-have-be-wipe-out-all-human-life. 
  131. Bostrom 2002, section 4.10
  132. Rumpf, Clemens (December 20, 2016). Asteroid Impact Risk (PhD thesis). University of Southampton.
  133. "Committee on Science, Space and Technology". NASA. March 19, 2013. https://www.nasa.gov/pdf/736848main_3_19_13_bolden_comm_space.pdf. 
  134. Homer, Aaron (April 28, 2018). "Earth Will Be Hit by an Asteroid With 100 Percent Certainty, Says Space-Watching Group B612 - The group of scientists and former astronauts is devoted to defending the planet from a space apocalypse.". Inquisitr. https://www.inquisitr.com/4881237/earth-will-be-hit-by-an-asteroid-with-100-percent-certainty-says-space-watching-group-b612/. 
  135. Stanley-Becker, Isaac (October 15, 2018). "Stephen Hawking feared race of 'superhumans' able to manipulate their own DNA". The Washington Post. https://www.washingtonpost.com/news/morning-mix/wp/2018/10/15/stephen-hawking-feared-race-of-superhumans-able-to-manipulate-their-own-dna/. 
  136. Haldevang, Max de (October 14, 2018). "Stephen Hawking left us bold predictions on AI, superhumans, and aliens". https://qz.com/1423685/stephen-hawking-says-superhumans-will-take-over-ai-is-a-threat-and-humans-will-conquer-space/. 
  137. Bogdan, Dennis (June 18, 2018). "Comment - Better Way To Avoid Devastating Asteroids Needed?". The New York Times. https://www.nytimes.com/2018/06/14/science/asteroids-nasa-nathan-myhrvold.html#permid=27500228:27506217. 
  138. Staff (June 21, 2018). "National Near-Earth Object Preparedness Strategy Action Plan". https://trumpwhitehouse.archives.gov/wp-content/uploads/2018/06/National-Near-Earth-Object-Preparedness-Strategy-and-Action-Plan-23-pages-1MB.pdf. 
  139. Mandelbaum, Ryan F. (June 21, 2018). "America Isn't Ready to Handle a Catastrophic Asteroid Impact, New Report Warns". Gizmodo. https://gizmodo.com/america-isnt-ready-to-handle-a-catastrophic-asteroid-im-1827014709. 
  140. Myhrvold, Nathan (May 22, 2018). "An empirical examination of WISE/NEOWISE asteroid analysis and results". Icarus 314: 64–97. doi:10.1016/j.icarus.2018.05.004. Bibcode2018Icar..314...64M. 
  141. Chang, Kenneth (June 14, 2018). "Asteroids and Adversaries: Challenging What NASA Knows About Space Rocks - Two years ago, NASA dismissed and mocked an amateur's criticisms of its asteroids database. Now Nathan Myhrvold is back, and his papers have passed peer review.". The New York Times. https://www.nytimes.com/2018/06/14/science/asteroids-nasa-nathan-myhrvold.html. 
  142. Chang, Kenneth (June 14, 2018). "Asteroids and Adversaries: Challenging What NASA Knows About Space Rocks - Relevant Comments". The New York Times. https://www.nytimes.com/2018/06/14/science/asteroids-nasa-nathan-myhrvold.html#permid=27500228:27506217. 
  143. U.S.Congress (March 19, 2013). "Threats From Space: a Review of U.S. Government Efforts to Track and mitigate Asteroids and Meteors (Part I and Part II) – Hearing Before the Committee on Science, Space, and Technology House of Representatives One Hundred Thirteenth Congress First Session". p. 147. http://www.gpo.gov/fdsys/pkg/CHRG-113hhrg80552/pdf/CHRG-113hhrg80552.pdf. 
  144. Croswell, Ken (April 24, 2008). "Will Mercury Hit Earth Someday?" (in en-US). https://skyandtelescope.org/astronomy-news/will-mercury-hit-earth-someday/. 
  145. Sackmann, I.-Juliana; Boothroyd, Arnold I.; Kraemer, Kathleen E. (1993), "Our Sun. III. Present and Future", The Astrophysical Journal 418 (7491): 457–68, doi:10.1086/173407, Bibcode1993ApJ...418..457S 
  146. M.S. Turner; F. Wilczek (1982). "Is our vacuum metastable?". Nature 298 (5875): 633–634. doi:10.1038/298633a0. Bibcode1982Natur.298..633T. http://ctp.lns.mit.edu/Wilczek_Nature/%2872%29vacuum_metastable.pdf. Retrieved October 31, 2015. 
  147. M. Tegmark; N. Bostrom (2005). "Is a doomsday catastrophe likely?". Nature 438 (5875): 754. doi:10.1038/438754a. PMID 16341005. Bibcode2005Natur.438..754T. http://www.fhi.ox.ac.uk/wp-content/uploads/is-doomsday-likely.pdf. Retrieved March 16, 2016. 
  148. Bostrom 2002, section 4.7
  149. Lassen, B (2013). "Is livestock production prepared for an electrically paralysed world?". J Sci Food Agric 93 (1): 2–4. doi:10.1002/jsfa.5939. PMID 23111940. 
  150. Coleman, Sidney; De Luccia, Frank (June 15, 1980). "Gravitational effects on and of vacuum decay". Physical Review D D21 (12): 3305–3315. doi:10.1103/PhysRevD.21.3305. Bibcode1980PhRvD..21.3305C. http://www.sns.ias.edu/pitp2/2011files/PhysRevD.21.3305.pdf. 
  151. Siegel, Ethan (2020). "Ask Ethan: Will The Earth Eventually Be Swallowed By The Sun?" (in en). Forbes/Starts with a Bang. https://www.forbes.com/sites/startswithabang/2020/02/08/ask-ethan-will-the-earth-eventually-be-swallowed-by-the-sun/. 
  152. Schroeder, K.-P.; Connon Smith, Robert (May 1, 2008). "Distant future of the Sun and Earth revisited". Monthly Notices of the Royal Astronomical Society 386 (1): 155–163. doi:10.1111/j.1365-2966.2008.13022.x. Bibcode2008MNRAS.386..155S. 
  153. Twenty ways the world could end suddenly , Discover Magazine
  154. "FACT CHECK: Extraterrestrial Contact Law". https://www.snopes.com/fact-check/et-make-bail/. 
  155. Bostrom 2002, section 7.2
  156. Johnson, Steven (June 28, 2017). "Greetings, E.T. (Please Don't Murder Us.)" (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2017/06/28/magazine/greetings-et-please-dont-murder-us.html. 
  157. "Near Apocalypse Causing Diseases, a Historical Look". postapocalypticsurvival.com. http://www.postapocalypticsurvival.com/apocalypse-causing-diseases/. 
  158. 158.0 158.1 Frank SA (March 1996). "Models of parasite virulence". Q Rev Biol 71 (1): 37–78. doi:10.1086/419267. PMID 8919665. http://sites.biology.duke.edu/rausher/Frank.pdf. 
  159. "Crossing the Line: Selection and Evolution of Virulence Traits". PLOS Pathogens 2 (5): e42. May 2006. doi:10.1371/journal.ppat.0020042. PMID 16733541. 
  160. Gandon S (March 2004). "Evolution of multihost parasites". Evolution 58 (3): 455–69. doi:10.1111/j.0014-3820.2004.tb01669.x. PMID 15119430. 
  161. "Challenging the trade-off model for the evolution of virulence: is virulence management feasible?". Trends Microbiol. 11 (1): 15–20. January 2003. doi:10.1016/S0966-842X(02)00003-3. PMID 12526850. 
  162. "Virulence evolution in emerging infectious diseases". Evolution 59 (7): 1406–12. July 2005. doi:10.1554/05-111. PMID 16153027. 
  163. [1] "Powerful actor, high impact bio-threats. Wilton Park. Wednesday 7 – Friday 9 November 2018"
  164. Haines, A.; Kovats, R.S.; Campbell-Lendrum, D.; Corvalan, C. (July 2006). "Climate change and human health: Impacts, vulnerability and public health" (in en). Public Health 120 (7): 585–596. doi:10.1016/j.puhe.2006.01.002. ISSN 0033-3506. PMID 16542689. 
  165. Epstein, Paul R. (October 6, 2005). "Climate Change and Human Health" (in EN). New England Journal of Medicine 353 (14): 1433–1436. doi:10.1056/nejmp058079. ISSN 0028-4793. PMID 16207843. 
  166. "Global Warming Good News: No More Ice Ages". LiveScience. 2007. https://www.livescience.com/1846-global-warming-good-news-ice-ages.html. 
  167. "Human-made climate change suppresses the next ice age". Potsdam Institute for Climate Impact Research in Germany. 2016. https://www.pik-potsdam.de/news/press-releases/human-made-climate-change-suppresses-the-next-ice-age. 
  168. Kate Ravilious (April 14, 2005). "What a way to go". The Guardian. https://www.theguardian.com/science/2005/apr/14/research.science2. 
  169. 2012 Admin (February 4, 2008). "Toba Supervolcano". 2012 Final Fantasy. http://www.2012finalfantasy.com/2008/toba-supervolcano.php. 
  170. Science Reference. "Toba Catastrophe Theory". Science Daily. https://www.sciencedaily.com/articles/t/toba_catastrophe_theory.htm. Retrieved February 28, 2018. 
  171. Greg Breining (November 10, 2007). "The Next Big Blast". Super Volcano: The Ticking Time Bomb Beneath Yellowstone National Park. MBI Publishing Company. ISBN 978-1-61673-898-3. https://books.google.com/books?id=YmD0AwAAQBAJ&pg=PA9. 
  172. Greg Breining (November 10, 2007). "Distant Death". Super Volcano: The Ticking Time Bomb Beneath Yellowstone National Park. MBI Publishing Company. ISBN 978-1-61673-898-3. https://books.google.com/books?id=YmD0AwAAQBAJ&pg=PA14. 
  173. "Modeling the Ash Distribution of a Yellowstone Supereruption". USGS Volcanic Observatory. https://volcanoes.usgs.gov/volcanoes/yellowstone/faqs_ash3d.html. 
  174. "Extreme Geohazards: Reducing the Disaster Risk and Increasing Resilience". European Space Foundation. https://hazdoc.colorado.edu/bitstream/handle/10590/4136/C024175.pdf. 
  175. "Questions About Future Volcanic Activity at Yellowstone". https://volcanoes.usgs.gov/volcanoes/yellowstone/faqs_future_activity.html. 
  176. "Steam Explosions, Earthquakes, and Volcanic Eruptions—What's in Yellowstone's Future?". https://pubs.usgs.gov/fs/2005/3024/. "The USGS puts it like this: "If another large caldera-forming eruption were to occur at Yellowstone, its effects would be worldwide. Thick ash deposits would bury vast areas of the United States, and an injection of huge volumes of volcanic gases into the atmosphere could drastically affect the global climate. Fortunately, the Yellowstone volcanic system shows no signs that it is headed toward such an eruption. The probability of a large caldera-forming eruption within the next few thousand years is exceedingly low."" 
  177. "World's biggest extinction event: Massive volcanic eruption, burning coal, and accelerated greenhouse gas choked out life -- ScienceDaily". https://www.sciencedaily.com/releases/2011/01/110123131014.htm. 
  178. 178.0 178.1 Breining, Greg (2007). "The Next Big Blast". Super Volcano: The Ticking Time Bomb Beneath Yellowstone National Park. St. Paul, MN.: Voyageur Press. p. 256 pg. ISBN 978-0-7603-2925-2. https://archive.org/details/supervolcanotick0000brei/page/256. 
  179. 179.0 179.1 Cotton-Barratt, Owen; Daniel, Max; Sandberg, Anders (2020). "Defence in Depth Against Human Extinction: Prevention, Response, Resilience, and Why They All Matter" (in en). Global Policy 11 (3): 271–282. doi:10.1111/1758-5899.12786. ISSN 1758-5899. PMID 32427180. 
  180. "Mankind must abandon earth or face extinction: Hawking", physorg.com, August 9, 2010, http://www.physorg.com/news200591777.html, retrieved January 23, 2012 
  181. Smil, Vaclav (2003). The Earth's Biosphere: Evolution, Dynamics, and Change. MIT Press. p. 25. ISBN 978-0-262-69298-4. https://books.google.com/books?id=8ntHWPMUgpMC&pg=PA25. 
  182. Lewis Smith (February 27, 2008). "Doomsday vault for world's seeds is opened under Arctic mountain". The Times Online (London). http://www.timesonline.co.uk/tol/news/environment/article3441435.ece. 
  183. Suzanne Goldenberg (May 20, 2015). "The doomsday vault: the seeds that could save a post-apocalyptic world". https://www.theguardian.com/science/2015/may/20/the-doomsday-vault-seeds-save-post-apocalyptic-world. 
  184. "Here's how the world could end—and what we can do about it" (in en). Science | AAAS. July 8, 2016. http://www.sciencemag.org/news/2016/07/here-s-how-world-could-end-and-what-we-can-do-about-it. 
  185. Denkenberger, David C.; Pearce, Joshua M. (September 2015). "Feeding everyone: Solving the food crisis in event of global catastrophes that kill crops or obscure the sun". Futures 72: 57–68. doi:10.1016/j.futures.2014.11.008. https://hal.archives-ouvertes.fr/hal-02113583/file/Feeding_Everyone_Solving_the_Food_Crisis.pdf. 
  186. "Global Challenges Foundation | Understanding Global Systemic Risk" (in en-US). https://globalchallenges.org/en/our-work/quarterly-reports/resetting-the-frame/understanding-global-systemic-risk. 
  187. "Global Catastrophic Risk Policy |" (in en-US). https://www.gcrpolicy.com. 
  188. Club of Rome (2018). "The Climate Emergency Plan". https://clubofrome.org/publication/the-climate-emergency-plan/. 
  189. Club of Rome (2019). "The Planetary Emergency Plan". https://clubofrome.org/publication/the-planetary-emergency-plan/. 
  190. Fred Hapgood (November 1986). "Nanotechnology: Molecular Machines that Mimic Life". http://metamodern.com/b/wp-content/uploads/docs/OMNI_TINYTECH.pdf. 
  191. Giles, Jim (2004). "Nanotech takes small step towards burying 'grey goo'". Nature 429 (6992): 591. doi:10.1038/429591b. PMID 15190320. Bibcode2004Natur.429..591G. 
  192. Sophie McBain (September 25, 2014). "Apocalypse soon: the scientists preparing for the end times". http://www.newstatesman.com/sci-tech/2014/09/apocalypse-soon-scientists-preparing-end-times. 
  193. "Reducing Long-Term {{subst:lc:Catastrophic}} Risks from Artificial Intelligence". Machine Intelligence Research Institute. https://intelligence.org/summary/. "The Machine Intelligence Research Institute aims to reduce the risk of a catastrophe, should such an event eventually occur." 
  194. Angela Chen (September 11, 2014). "Is Artificial Intelligence a Threat?". The Chronicle of Higher Education. https://chronicle.com/article/Is-Artificial-Intelligence-a/148763/. Retrieved June 5, 2015. 
  195. Alexander Sehmar (May 31, 2015). "Isis could obtain nuclear weapon from Pakistan, warns India". https://www.independent.co.uk/news/world/asia/india-warns-isis-could-obtain-nuclear-weapon-from-pakistan-10287276.html. 
  196. "About the Lifeboat Foundation". The Lifeboat Foundation. http://lifeboat.com. 
  197. Ashlee Vance (July 20, 2010). "The Lifeboat Foundation: Battling Asteroids, Nanobots and A.I.". http://bits.blogs.nytimes.com/2010/07/20/the-lifeboat-foundation-battling-asteroids-nanobots-and-a-i/. 
  198. "Global Challenges Foundation website". http://globalchallenges.org. 
  199. Nick Bilton (May 28, 2015). "Ava of 'Ex Machina' Is Just Sci-Fi (for Now)". https://www.nytimes.com/2015/05/21/style/ava-of-ex-machina-is-just-sci-fi-for-now.html. 
  200. "About Us". Center on Long-Term {{subst:lc:Risk}}. https://longtermrisk.org/about-us. "We currently focus on efforts to reduce the worst risks of astronomical suffering (s-risks) from emerging technologies, with a focus on transformative artificial intelligence." 
  201. Hui, Sylvia (November 25, 2012). "Cambridge to study technology's risks to humans". Associated Press. http://bigstory.ap.org/article/cambridge-study-technologys-risk-humans. 
  202. Scott Barrett (2014). Environment and Development Economics: Essays in Honour of Sir Partha Dasgupta. Oxford University Press. p. 112. ISBN 9780199677856. https://books.google.com/books?id=_26VAwAAQBAJ&pg=PA112. Retrieved June 5, 2015. 
  203. "Millennium Alliance for Humanity & The Biosphere". http://mahb.stanford.edu/. 
  204. Guruprasad Madhavan (2012). Practicing Sustainability. Springer Science & Business Media. p. 43. ISBN 9781461443483. https://books.google.com/books?id=BQ6bxpMr5yMC&pg=PA43. Retrieved June 5, 2015. 
  205. "Center for International Security and Cooperation". Center for International Security and Cooperation. http://cisac.stanford.edu. 
  206. 206.0 206.1 https://www.facebook.com/profile.php?id=1216916378.+"Georgetown launches think tank on security and emerging technology" (in en). Washington Post. https://www.washingtonpost.com/local/education/georgetown-launches-think-tank-on-security-and-emerging-technology/2019/02/27/d6dabc62-391f-11e9-a2cd-307b06d0257b_story.html. 
  207. "Global Alert and Response (GAR)". https://www.who.int/csr/en/. 
  208. Kelley Lee (2013). Historical Dictionary of the World Health Organization. Rowman & Littlefield. p. 92. ISBN 9780810878587. https://books.google.com/books?id=9zCEmpopjG0C&pg=PA92. Retrieved June 5, 2015. 
  209. "USAID Emerging Pandemic Threats Program". USAID. http://avianflu.aed.org/eptprogram. 
  210. "Global Security". Lawrence Livermore National Laboratory. https://www-gs.llnl.gov. 
  211. 211.0 211.1 211.2 211.3 211.4 Moynihan, Thomas (2020). X-Risk: How Humanity Discovered Its Own Extinction. Urbanomic. ISBN 978-1913029845. https://mitpress.mit.edu/books/x-risk. 
  212. 212.0 212.1 Darwin, Charles; Costa, James T. (2009). The Annotated Origin. Harvard University Press. ISBN 978-0674032811. 
  213. 213.0 213.1 Raup, David M. (1995). "The Role of Extinction in Evolution". in Fitch, W. M.. Tempo And Mode in Evolution: Genetics And Paleontology 50 Years After Simpson. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK232212/. 
  214. 214.0 214.1 Moynihan, Thomas (2019). "The end of us". https://aeon.co/essays/to-imagine-our-own-extinction-is-to-be-able-to-answer-for-it. 
  215. Russell, Bertrand (1945). "The Bomb and Civilization". http://www.personal.kent.edu/~rmuhamma/Philosophy/RBwritings/bombCivilization.htm. 
  216. Erskine, Hazel Gaudet (1963). "The Polls: Atomic Weapons and Nuclear Energy". The Public Opinion Quarterly 27 (2): 155–190. doi:10.1086/267159. https://www.jstor.org/stable/2746913. 
  217. Sagan, Carl (January 28, 2009). "Nuclear War and Climatic Catastrophe: Some Policy Implications" (in en-US). doi:10.2307/20041818. https://www.foreignaffairs.com/articles/1983-12-01/nuclear-war-and-climatic-catastrophe-some-policy-implications. 
  218. Bostrom, Nick, ed (2008). Global catastrophic risks. Oxford University Press. ISBN 978-0199606504. 

Further reading

External links