View source for Information explosion

{{Short description|Rapid increase in the amount of published information or data}}
The '''information explosion''' is the rapid increase in the amount of published [[Information|information]] or [[Data|data]] and the effects of this abundance.<ref>Hilbert, M. (2015). Global information Explosion:https://www.youtube.com/watch?v=8-AqzPe_gNs&list=PLtjBSCvWCU3rNm46D3R85efM0hrzjuAIg. Digital Technology and Social Change [Open Online Course at the University of California] freely available at: https://canvas.instructure.com/courses/949415</ref> As the amount of available data grows, the problem of [[Information management|managing the information]] becomes more difficult, which can lead to information overload. The Online Oxford English Dictionary indicates use of the phrase in a March 1964 ''New Statesman'' article.<ref>“Information.” http://dictionary.oed.com. accessed January 4, 2008</ref> ''The New York Times'' first used the phrase in its editorial content in an article by Walter Sullivan on June 7, 1964, in which he described the phrase as "much discussed". (p11.) <ref>{{Cite news|url=https://www.nytimes.com/1964/06/07/u-s-will-remove-reactor-in-arctic.html?_r=0|title=U. S. WILL REMOVE REACTOR IN ARCTIC; Compacting Snow Squeezes Device Under Ice Sheet|newspaper=The New York Times|date=7 June 1964}}</ref> The earliest known use of the phrase was in a speech about television by NBC president Pat Weaver at the Institute of Practitioners of Advertising in London on September 27, 1955. The speech was rebroadcast on radio station WSUI in Iowa and excerpted in the ''Daily Iowan'' newspaper two months later.<ref>{{Cite news|last=Weaver|first=Sylvester|date=22 Nov 1955|title=The Impact of TV in the U.S.|page=2|work=Daily Iowan|url=https://newspaperarchive.com/iowa-city-daily-iowan-nov-22-1955-p-2/|access-date=18 Aug 2021|quote=I believe that in the last few years we have set in motion an information explosion. To each man there is flooding more information than he can presently handle, but he is learning how to handle it and, as he learns, it will do him good.}}</ref>

Many sectors are seeing this rapid increase in the amount of information available such as healthcare, supermarkets, and governments.<ref name="Sweeney, Latanya 2001">Sweeney, Latanya. "Information explosion." Confidentiality, disclosure, and data access: Theory and practical applications for statistical agencies (2001): 43-74.</ref> Another sector that is being affected by this phenomenon is journalism. Such a profession, which in the past was responsible for the dissemination of information, may be suppressed by the overabundance of information today.<ref>Fuller, Jack. What is happening to news: The information explosion and the crisis in journalism. University of Chicago Press, 2010.</ref>

Techniques to gather knowledge from an overabundance of electronic information (e.g., [[Data fusion|data fusion]] may help in [[Data mining|data mining]]) have existed since the 1970s. Another common technique to deal with such amount of information is [[Qualitative research|qualitative research]].<ref>Major, Claire Howell, and Maggi Savin-Baden. An introduction to qualitative research synthesis: Managing the information explosion in social science research. Routledge, 2010.</ref> Such approaches aim to organize the information, synthesizing, categorizing and systematizing in order to be more usable and easier to search.

==Growth patterns==
* The world's technological capacity to store information grew from, optimally compressed, 2.6 exabytes in 1986 to 15.7 in 1993, over 54.5 in 2000, and to 295 exabytes in 2007. <ref name="HilbertLopez2011">[https://www.science.org/doi/10.1126/science.1200970 "The Womartinhilbert.net/WorldInfoCapacity.html "free access to the study"] and [https://www.youtube.com/watch?v=iIKPjOuwqHo "video animation"].</ref>
* The world's technological capacity to receive information through one-way broadcast networks was 432 exabytes of (optimally compressed) information in 1986, 715 (optimally compressed) exabytes in 1993, 1,200 (optimally compressed) exabytes in 2000, and 1,900 in 2007.<ref name="HilbertLopez2011"/>
* The world's effective capacity to exchange information through two-way [[Engineering:Telecommunication|telecommunication]] networks was 0.281 exabytes of (optimally compressed) information in 1986, 0.471 in 1993, 2.2 in 2000, and 65 (optimally compressed) exabytes in 2007.<ref name="HilbertLopez2011"/>

A new metric that is being used in an attempt to characterize the growth in person-specific information, is the disk storage per person (DSP), which is measured in megabytes/person (where megabytes is 10<sup>6</sup> bytes and is abbreviated MB). Global DSP (GDSP) is the total rigid disk drive space (in MB) of new units sold in a year divided by the world population in that year. The GDSP metric is a crude measure of how much disk storage could possibly be used to collect person-specific data on the world population.<ref name="Sweeney, Latanya 2001"/> 
In 1983, one million fixed drives with an estimated total of 90 terabytes were sold worldwide; 30MB drives had the largest market segment.<ref>Disk/Trend report 1983,” Computer Week. Mountain View, CA. (46) 11/11/83.</ref> In 1996, 105 million drives, totaling 160,623 terabytes were sold with 1 and 2 [[Gigabyte|gigabyte]] drives leading the industry.<ref>Rigid disk drive sales to top $34 billion in 1997,” Disk/Trend News. Mountain View, CA: Disk/Trend, Inc., 1997.</ref> By the year 2000, with 20GB drive leading the industry, rigid drives sold for the year are projected to total 2,829,288 terabytes Rigid disk drive sales to top $34 billion in 1997.

According to [[Biography:Latanya Sweeney|Latanya Sweeney]], there are three trends in data gathering today:

'''Type 1.''' Expansion of the number of fields being collected, known as the “collect more” trend.

'''Type 2.''' Replace an existing aggregate data collection with a person-specific one, known as the “collect specifically” trend.

'''Type 3.''' Gather information by starting a new person-specific data collection, known as the “collect it if you can” trend.<ref name="Sweeney, Latanya 2001"/>

==Related terms==
Since "information" in electronic media is often used synonymously with "data", the term ''information explosion'' is closely related to the concept of ''data flood'' (also dubbed ''data deluge''). Sometimes the term ''information flood'' is used as well. All of those basically boil down to the ever-increasing amount of [[Digital data|electronic data]] exchanged per time unit. The awareness about non-manageable amounts of data grew along with the advent of ever more powerful data processing since the mid-1960s.<ref>[https://books.google.com/ngrams/graph?content=data+flood%2Cdata+deluge%2Cinformation+flood&year_start=1955&year_end=2010&corpus=0&smoothing=2 Google Books Ngram viewer] for the terms mentioned here</ref>

==Challenges==
Even though the abundance of information can be beneficial in several levels, some problems may be of concern such as [[Privacy|privacy]], legal and ethical guidelines, filtering and data accuracy.<ref name="Berner, Eta S. 2005">Berner, Eta S., and Jacqueline Moss. "Informatics challenges for the impending patient information explosion." Journal of the American Medical Informatics Association 12.6 (2005): 614-617.</ref> Filtering refers to finding useful information in the middle of so much data, which relates to the job of data scientists. A typical example of a necessity of data filtering ([[Data mining|data mining]]) is in healthcare since in the next years is due to have EHRs (Electronic Health Records) of patients available. With so much information available, the doctors will need to be able to identify patterns and select important data for the diagnosis of the patient.<ref name="Berner, Eta S. 2005"/> On the other hand, according to some experts, having so much public data available makes it difficult to provide data that is actually anonymous.<ref name="Sweeney, Latanya 2001"/>
Another point to take into account is the legal and ethical guidelines, which relates to who will be the owner of the data and how frequently he/she is obliged to the release this and for how long.<ref name="Berner, Eta S. 2005"/>
With so many sources of data, another problem will be accuracy of such. An untrusted source may be challenged by others, by ordering a new set of data, causing a repetition in the information.<ref name="Berner, Eta S. 2005"/>
According to Edward Huth, another concern is the accessibility and cost of such information.<ref>Huth, Edward J. "The information explosion." Bulletin of the New York Academy of Medicine 65.6 (1989): 647.</ref> The accessibility rate could be improved by either reducing the costs or increasing the utility of the information. The reduction of costs according to the author, could be done by associations, which should assess which information was relevant and gather it in a more organized fashion.

==Web servers==

As of August 2005, there were over 70 million [[Web server|web server]]s.<ref>{{cite web|title=Hobbes' Internet Timeline 10.1|url=http://www.zakon.org/robert/internet/timeline/|publisher=zakon.org|access-date=27 August 2011|author=Robert H Zakon|date=15 December 2010}}</ref> {{As of|2007|09}} there were over 135 million web servers.<ref>{{cite web|title=August 2011 Web Server Survey|url=http://news.netcraft.com/archives/web_server_survey.html|publisher=netcraft.com|access-date=27 August 2011|date=August 2011}}</ref>

==Blogs==
According to [[Software:Technorati|Technorati]], the number of blogs doubles about every 6 months with a total of 35.3 million blogs {{As of|2006|04|lc=y|url=http://www.sifry.com/alerts/archives/000432.html}}.<ref>{{cite web|title=State of the Blogosphere, April 2006 Part 1: On Blogosphere Growth|url=http://www.sifry.com/alerts/archives/000432.html|publisher=Sifry's Alerts (sifry.com)|access-date=27 August 2011|date=April 17, 2006|url-status=dead|archive-url=https://web.archive.org/web/20130109014955/http://www.sifry.com/alerts/archives/000432.html|archive-date=9 January 2013}}</ref> This is an example of the early stages of logistic growth, where growth is approximately [[Exponential growth|exponential]], since blogs are a recent innovation. As the number of blogs approaches the number of possible producers (humans), saturation occurs, growth declines, and the number of blogs eventually stabilizes.

==See also==
{{div col|colwidth=20em}}
* {{annotated link|Big data}}
* {{annotated link|Curse of dimensionality}}
* {{annotated link|Combinatorial explosion}}
* {{annotated link|Data mining}}
* {{annotated link|Information society}}
* {{annotated link|Philosophy:Information Age}}
* {{annotated link|Information filtering system}}
* {{annotated link|Metcalfe's law}}
* {{annotated link|Philosophy:Neuroenhancement}}
{{div col end}}

==References==
{{Reflist}}

==External links==
*[https://ssrn.com/abstract=991165 Conceptualizing Information Systems and Cognitive Sustainability in 21st Century 'Attention' Economies (Includes Syllabus)]
*[http://www.sims.berkeley.edu/research/projects/how-much-info-2003/ How Much Information? 2003]
*''Surviving the Information Explosion: How People Find Their Electronic Information'' [http://dspace.mit.edu/bitstream/handle/1721.1/6713/AIM-2003-006.pdf]
*''Why the Information Explosion Can Be Bad for Data Mining, and How Data Fusion Provides a Way Out'' [https://web.archive.org/web/20060924071254/http://www.siam.org/meetings/sdm02/proceedings/sdm02-08.pdf]
*[https://www.youtube.com/watch?v=TeQOALjiq5o Information Explosion, Largest databases]

{{Digital media use and mental health}}

[[Category:Information science]]

{{Sourceattribution|Information explosion}}