The Signal and the Noise

From HandWiki
Revision as of 14:22, 6 February 2024 by Rtexter1 (talk | contribs) (linkage)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
The Signal and the Noise
The Signal and the Noise.jpg
AuthorNate Silver
CountryUnited States
LanguageEnglish
PublisherPenguin Group
Publication date
27 September 2012 (2012-09-27)
Pages534
AwardsPhi Beta Kappa Award in Science (2013)
ISBNISBN:978-1-59-420411-1

The Signal and the Noise: Why So Many Predictions Fail – but Some Don't is a 2012 book by Nate Silver detailing the art of using probability and statistics as applied to real-world circumstances. The book includes case studies from baseball, elections, climate change, the 2008 financial crash, poker, and weather forecasting.

The book was the recipient of the 2013 Phi Beta Kappa Society book award in science. It has also been translated into several languages.

Synopsis

The book emphasizes Silver's skill, which is the practical art of mathematical model building using probability and statistics. Silver takes a big-picture approach to using statistical tools, combining sources of unique data (e.g., timing a minor league ball player's fastball using a radar gun), with historical data and principles of sound statistical analysis, many of which are violated by many pollsters and pundits who nonetheless have important media roles.

The book includes richly detailed case studies from baseball, elections, climate change, the financial crash, poker, and weather forecasting. These different topics illustrate different statistical principles. For example, weather forecasting is used to introduce the idea of "calibration," or how well weather forecasts fit actual weather outcomes. There is much on the need for improved expressions of uncertainty in all statistical statements, reflecting ranges of probable outcomes and not just single "point estimates" like averages.

Silver would like to see the media move away from vague terminology like "Obama has an edge in Ohio" or "Florida still a toss-up state" to probability statements, like "the probability of Obama winning the electoral college is 83%, while the expected fraction won by him of the popular vote is now 50.1% with an error range of ±2%". Such statements give odds on outcomes, including a 17% chance of Romney winning the electoral college. The shares of the popular vote similarly are ranges including outcomes in which Romney gets the most votes. What is highly probable is that the voting shares are in these ranges, but not whose share is highest; that's another probability question with closer odds. From such information, it's up to the consumer of such statements to use that information as best they can in dealing with an uncertain future in an age of information overload. That last idea frames Silver's entire narrative and motivates his pedagogical mission.

Silver rejects much ideology taught with statistical method in colleges and universities today, specifically the "frequentist" approach of Ronald Fisher, originator of many classical statistical tests and methods. The problem Silver finds is a belief in perfect experimental, survey, or other designs, when data often comes from a variety of sources and idealized modeling assumptions rarely hold true. Often such models reduce complex questions to overly simple "hypothesis tests" using arbitrary "significance levels" to "accept or reject" a single parameter value.

In contrast, the practical statistician first needs a sound understanding of how baseball, poker, elections or other uncertain processes work, what measures are reliable and which not, what scales of aggregation are useful, and then to utilize the statistical tool kit as well as possible. Silver believes in the need for extensive data sets, preferably collected over long periods of time, from which one can then use statistical techniques to incrementally change probabilities up or down relative to prior data. This Bayesian approach is named for the 18th-century minister Thomas Bayes who is credited for first deriving a simple formula for updating probabilities using new data. For Silver, the well-known method needs revitalizing as a broader paradigm for thinking about uncertainty, founded on learning and understanding gained incrementally, rather than through any single set of observations or an ideal model summarized by just a few key parameters. Part of that learning is the informal process of changing assumptions or the modeling approach, in the spirit of a craft whose goal is to devise the best betting odds on well-defined future events and their outcomes.

Release and sales

Published in the United States on September 27, 2012, The Signal and The Noise reached the New York Times Best Sellers list as No. 12 for non-fiction hardback books after its first week in print. It dropped to No. 20 in the second week, before rising to No. 13 in the third, and remaining on the non-fiction hardback top 15 list for the following thirteen weeks, with a highest weekly ranking of No. 4.[1] The book's already strong sales soared right after election night, November 6, jumping 800% and becoming the second best seller on Amazon.com.[2]

The Signal and the Noise (print edition) was named Amazon's No. 1 Best NonFiction Book for 2012.[3] It was named by the Wall Street Journal as one of the ten best books of nonfiction published in 2012.[4]

Silver signing a copy of The Signal and the Noise at South by Southwest 2013

The book was first released in the United Kingdom in April 2013, with the title The Signal and the Noise: The Art and Science of Prediction, in hardback under an Allen Lane imprint[5] and in paperback under a Penguin imprint.[6]

It was published in Brazil in a Portuguese translation, O sinal e o ruído, in June 2013.[7] A German edition was released in September 2013 by the publisher Heine Verlag, using a somewhat different main title: Die Berechnung der Zukunft: Warum die meisten Prognosen falsch sind und manche trotzdem zutreffen..[8] An Italian version, Il segnale e il rumore. Arte e scienza della previsione, appeared in October 2013.[9] A Finnish translation, Signaali ja kohina, appeared in 2014.

The book was published in simplified Chinese characters by China Citic Press in Beijing[10] as well as in traditional Chinese characters by Suncolor Press in Taipei[11] in Fall 2013. It was published in Japanese in November 2013.[12] A Spanish translation appeared in April 2014, under the title La señal y el ruido.[13]

In 2013, an edition was published in Romanian by Publica press: Semnalul și zgomotul: de ce atât de multe predicții dau greș - pe când altele reușesc.[14] In May 2014, an edition was published in Czech: Signál a šum. Většina předpovědí selže. Některé ne.[15]

A Korean language edition was published by The Quest in July 2014.[16]

A Polish edition was scheduled for publication in hardcover in 2015 by Helion: Sygnal i szum: Sztuka prognozowania w erze technologii.[17]

The Signal and the Noise was first published in paperback in the United States on February 3, 2015.[18] It contained a new introduction.[19] It reached The New York Times paperback best seller list, ranked No. 4 in the field of Education in March 2015.[20]

Criticism and commentary

Climate scientist Michael E. Mann criticized the book for analyzing the "hard science" physical phenomena of climate trends with the same approach as used to analyze the social phenomena of voter preferences, which he characterized as "laden with subjective and untestable assumptions".[21]

In praise of the book, Murray Cantor, IBM Distinguished Engineer, wrote

Nate Silver's The Signal and Noise is an excellent description of how prediction works. However, he purposefully leaves out the mathematics. In 2012, after his triumph of predicting the outcome of the last two presidential elections and selling his "fivethirtyeight" blog to the New York Times, Nate Silver accomplished what is almost impossible. In his recent book The Signal and the Noise, he correctly describes the discipline of making predictions, without explicitly invoking the math. He accomplishes this feat even though the prediction methods he describes require more than one kind of mathematics. By leaving out the math, he has reached a broad audience with a compelling book with lots of examples.[22]

Awards

  • In October 2013, The Signal and the Noise won the 2013 Phi Beta Kappa Society book award in science, which recognizes "outstanding contributions by scientists to the literature of science".[23]

See also

References

  1. ↑ New York Times Best Sellers List
  2. ↑ Jason Notte, "Nate Silver sees soaring Amazon book sales: The FiveThirty Eight blogger's confident and steadfast Obama forecast gets readers curious and critics furious", MSN Money, November 8, 2012 .
  3. ↑ Amazon Best Non-Fiction Book of Year 2012.
  4. ↑ "The Best Nonfiction of 2012," Wall Street Journal, December 14, 2012.
  5. ↑ UK hardback Edition, Allen Lane, 2013 ISBN:978-1846147524.
  6. ↑ UK paperback edition, Penguin, 2013 ISBN:978-0141975658.
  7. ↑ O sinal e o ruído. ASIN: B00DD0E3A2.
  8. ↑ Full German Title: Die Berechnung der Zukunft: Warum die meisten Prognosen falsch sind und manche trotzdem zutreffen. ISBN:978-3453200487.
  9. ↑ Il segnale e il rumore. Arte e scienza della previsione, Fandango Libri [paperback]. ISBN:978-8860443861. Italian paperback edition.
  10. ↑ ISBN:978-7-5086-4114-0.
  11. ↑ ISBN:978-986-229-960-9.
  12. ↑ Japanese edition: ISBN:978-4822249809.
  13. ↑ Spanish edition: ISBN:978-8499423081. Cited in: Amazon.es.
  14. ↑ Romanian edition: ISBN:978-606-8360-58-4.
  15. ↑ ISBN:978-80-7432-440-6.
  16. ↑ ISBN:978-896-618-7584 and ISBN:896-618-7587
  17. ↑ Nate Silver, Sygnal i szum: Sztuka prognozowania w erze technologii [Signal and Noise: The Art of Forecasting in the Era of Technology], ISBN:978-8324691227.
  18. ↑ U.S. paperback edition ISBN:978-0143125082.
  19. ↑ Noah Gordon, "Do We Want to Believe the Numbers? A Q&A With Nate Silver The FiveThirtyEight founder on broken-windows policing, Max Scherzer, and foxes in the Oval Office, The Atlantic, February 4, 2005.
  20. ↑ "Best Sellers," The New York Times, March 1, 2015.
  21. ↑ Mann, Michael (2012-09-24). "FiveThirtyEight: The Number of Things Nate Silver Gets Wrong About Climate Change". Huffington Post. http://www.huffingtonpost.com/michael-e-mann/nate-silver-climate-change_b_1909482.html. Retrieved 3 November 2012. 
  22. ↑ Murray Cantor, "Filling in the blanks: The math behind Nate Silver's The Signal and the Noise," IBMdeveloperWorks, 28 May 2013. [retrieved October 25, 2016]
  23. ↑ "Phi Beta Kappa book award in science". http://www.pbk.org/home/newsview.aspx?id=998. 

External links



Retrieved from "https://handwiki.org/wiki/index.php?title=The_Signal_and_the_Noise&oldid=3359341"