Strong inference

From HandWiki
Short description: Philosophy of science concept emphasizing the need for alternative hypotheses

In philosophy of science, strong inference is a model of scientific inquiry that emphasizes the need for alternative hypotheses, rather than a single hypothesis to avoid confirmation bias.

The term "strong inference" was coined by John R. Platt,[1] a biophysicist at the University of Chicago. Platt notes that some fields, such as molecular biology and high-energy physics, seem to adhere strongly to strong inference, with very beneficial results for the rate of progress in those fields.

The single hypothesis problem

The problem with single hypotheses, confirmation bias, was aptly described by Thomas Chrowder Chamberlin in 1897:

Despite the admonitions of Platt, reviewers of grant-applications often require "A Hypothesis" as part of the proposal (note the singular). Peer-review of research can help avoid the mistakes of single-hypotheses, but only so long as the reviewers are not in the thrall of the same hypothesis. If there is a shared enthrallment among the reviewers in a commonly believed hypothesis, then innovation becomes difficult because alternative hypotheses are not seriously considered, and sometimes not even permitted.

Strong Inference

The method, very similar to the scientific method, is described as:

  1. Devising alternative hypotheses;
  2. Devising a crucial experiment (or several of them), with alternative possible outcomes, each of which will, as nearly as possible, exclude one or more of the hypotheses;
  3. Carrying out the experiment(s) so as to get a clean result;
  4. Recycling the procedure, making subhypotheses or sequential hypotheses to refine the possibilities that remain, and so on.

The methods of Grey system theory effectively entertain strong inference.[3][4] In such methods, the first step is the nullification of the single hypothesis by assuming that the true information of the system under study is only partially known.[5]

Criticisms

The original paper outlining strong inference has been criticized, particularly for overstating the degree that certain fields used this method.[6][7]

Strong inference plus

The limitations of Strong-Inference can be corrected by having two preceding phases:[2]

  1. An exploratory phase: at this point information is inadequate so observations are chosen randomly or intuitively or based on scientific creativity.
  2. A pilot phase: in this phase statistical power is determined by replicating experiments under identical experimental conditions.

These phases create the critical seed observation (s) upon which one can base alternative hypotheses.[2]

References

  1. John R. Platt (1964). "Strong inference". Science 146 (3642): 347–53. doi:10.1126/science.146.3642.347. PMID 17739513. Bibcode1964Sci...146..347P. http://256.com/gray/docs/strong_inference.html. 
  2. 2.0 2.1 2.2 Don L. Jewett (1 January 2005). "What's wrong with single hypotheses? Why it is time for Strong-Inference-PLUS". Scientist (Philadelphia, Pa.) 19 (21): 10. PMID 17975652. 
  3. Haken, Hermann (2011-01-28). "Grey Information: Theory and Practical Applications" (in en). Grey Systems: Theory and Application 1 (1): 105–106. doi:10.1108/gs.2011.1.1.105.1. ISSN 2043-9377. https://www.emerald.com/insight/content/doi/10.1108/gs.2011.1.1.105.1/full/html. 
  4. Ju-Long, Deng (March 1982). "Control problems of grey systems" (in en). Systems & Control Letters 1 (5): 288–294. doi:10.1016/S0167-6911(82)80025-X. https://linkinghub.elsevier.com/retrieve/pii/S016769118280025X. 
  5. Javed, Saad Ahmed; Mahmoudi, Amin; Liu, Sifeng (June 2020). "Grey Absolute Decision Analysis (GADA) Method for Multiple Criteria Group Decision-Making Under Uncertainty" (in en). International Journal of Fuzzy Systems 22 (4): 1073–1090. doi:10.1007/s40815-020-00827-8. ISSN 1562-2479. https://link.springer.com/10.1007/s40815-020-00827-8. 
  6. O'Donohue, William; Buchanan, Jeffrey A. (2001). "The weaknesses of strong inference". Behavior and Philosophy (Cambridge Center for Behavioral Studies) 29: 1–20. http://www.behavior.org/resource.php?id=102. 
  7. Rowland H. Davis (2006). "Strong Inference: rationale or inspiration?". Perspectives in Biology and Medicine 49 (2): 238–250. doi:10.1353/pbm.2006.0022. PMID 16702707. http://muse.jhu.edu/login?uri=/journals/perspectives_in_biology_and_medicine/v049/49.2davis01.html.