Quantitative storytelling

From HandWiki

Quantitative storytelling (QST) is a systematic approach used to explore the multiplicity of frames potentially legitimate in a scientific study or controversy.[1][2] QST assumes that in an interconnected society multiple frameworks and worldviews are legitimately upheld by different entities and social actors. QST looks critically on models used in evidence-based policy (EBP. Such models are often reductionist, in the sense discussed by,[3] in that tractability is achieved at the expenses of suppressing relevant available evidence.[4] QST suggests corrective approaches to this practice.

Context

Quantitative storytelling (QST) addresses evidence based policy and can be considered as a reaction to a style of quantification based on cost benefit or risk analysis which—in the opinion of QST proponents—may contain important implicit normative assumptions.[2]

In the logic of QST, a single quantification corresponding to a single view of what the problem is runs the risk of distracting from what could be alternative readings.[2]

The concept that some of the evidence needed for policy is removed from view is discussed by Ravetz, 1987; [5] Rayner, 2012).[6] They suggest that ‘uncomfortable knowledge’ is subtracted from the policy discourse with the objective to ease tractability or to advance a given agenda. The word ‘hypo-cognition’ has been used in the context of these instrumental uses of frames (Lakoff et al., 2008;[7] Lakoff, 2010[8]).

For Rayner,[6] a phenomenon of ‘displacement’ takes place when a model becomes the objective instead of the tool, e.g. when an institution chooses to monitor and manage the outcome of a model rather than what happens in reality.[6] Once exposed, the strategic use of hypo-cognition erodes the trust in the involved actors and institutions.[6]

Approach

QST suggests acknowledging ignorance, as to work out ‘clumsy solutions’ (Rayner, 2012[6]), which may permit negotiation to be had among parties with different normative orientations. Saltelli and Giampietro (2017)[2] suggest that our present approach to evidence-based policy, even in the more nuanced formulation of evidence-informed policy (Gluckman, 2014[9]), is often based on an arbitrary restriction of the definition of the problem, which is then reinforced by an effort of quantification - via models and/or indicators, of the selected frame. QST is also sensitive to power and knowledge asymmetries (Boden and Epstein, 2006;[10] Strassheim and Kettunen, 2014[11]), as interest groups have more scope to capture regulators than the average citizen ad consumer.[12][13]

QST encourages an effort in the pre-analytic, pre-quantitative phase of the analysis to map a socially robust (i.e. inclusive of the interest of different stakeholders) universe of possible frames. QST expands on one of the rules sensitivity auditing by asking the question of ‘what to do’ in order to avoid that an issue is framed unilaterally. Obviously, the medicine for a diseased evidence-based policy is not a prejudice- or superstition-based policy, but a more democratic and participatory access to the provision of evidence—even in terms of agenda setting. For this a new institutional setting is needed.[2] The proponents of QST[2] flag the affinity of this approach to others such as NUSAP and Sensitivity auditing.

QST does not eschew the use quantitative tools altogether. It suggests instead to explore quantitatively multiple narratives, avoiding spurious accuracy and focusing on some salient features of the selected stories. Rather than attempting to amass evidence in support of a given reading or policy, or to optimise it with modelling, QST tries to test whether the a given policy option or framing runs conflicts with existing social or biophysical constraints. These are (Giampietro et al., 2014[1]):

  1. feasibility (is the policy permissible given the existing resources?)
  2. viability (is it compatible with existing social arrangements or rules?)
  3. desirability (will society subscribe to it?).

Applications

A recent application of QST exploring the transition to intermittent electrical energy supply in Germany and Spain is due to Renner and Giampietro.[14] Cabello et al. use QST to explore a case of water and agricultural governance in the Canary Islands.[15]

Other applications of approaches which can be referred to QST are to the analyses for the cost of climate change,[16][17] to the controversy surrounding the OECD-PISA study[18][19]), to food security,[20][21] to the controversy surrounding the use of Golden Rice, a GMO crop,[22] and to the ecological footprint of the Ecological Footprint Network.[23][24]

References

  1. ↑ 1.0 1.1 [Giampietro, M., Aspinall, R. J., Ramos-Martin, J. and Bukkens, S. G. F. (2014) Resource Accounting for Sustainability Assessment: The Nexus between Energy, Food, Water and Land Use. Taylor & Francis (Routledge Explorations in Sustainability and Governance).](https://books.google.es/books?id=Vb6uAwAAQBAJ)
  2. ↑ 2.0 2.1 2.2 2.3 2.4 2.5 Saltelli, Andrea; Giampietro, Mario (2017). "What is wrong with evidence based policy, and how can it be improved?". Futures 91: 62–71. doi:10.1016/j.futures.2016.11.012. 
  3. ↑ van Zvanenberg, P., 2020. The unravelling of technocratic ortodoxy, in: Scoones, I., Stirling, A. (Eds.), The Politics of Uncertainty. Routledge, pp. 58–72.
  4. ↑ Scoones, I., Stirling, A., 2020. The Politics of Uncertainty. Routledge, Abingdon, Oxon; New York, NY: Routledge, 2020. | Series: Pathways to sustainability.
  5. ↑ Ravetz, Jerome R (2016). "Usable Knowledge, Usable Ignorance". Knowledge 9: 87–116. doi:10.1177/107554708700900104. 
  6. ↑ 6.0 6.1 6.2 6.3 6.4 Rayner, Steve (2012). "Uncomfortable knowledge: The social construction of ignorance in science and environmental policy discourses". Economy and Society 41: 107–25. doi:10.1080/03085147.2011.637335. 
  7. ↑ [Lakoff, G., Dean, H. and Hazen, D. (2008) Don’t Think of an Elephant!: Know Your Values and Frame the Debate. Chelsea Green Publishing.](https://books.google.es/books?id=zbJ1oxHC9a0C)
  8. ↑ Lakoff, George (2010). "Why it Matters How We Frame the Environment". Environmental Communication 4: 70–81. doi:10.1080/17524030903529749. https://escholarship.org/content/qt6mf9j40q/qt6mf9j40q.pdf?t=nq1oa6. 
  9. ↑ Gluckman, Peter (2014). "Policy: The art of science advice to government". Nature 507 (7491): 163–5. doi:10.1038/507163a. PMID 24627919. 
  10. ↑ Boden, Rebecca; Epstein, Debbie (2006). "Managing the research imagination? Globalisation and research in higher education". Globalisation, Societies and Education 4 (2): 223–36. doi:10.1080/14767720600752619. 
  11. ↑ Strassheim, Holger; Kettunen, Pekka (2014). "When does evidence-based policy turn into policy-based evidence? Configurations, contexts and mechanisms". Evidence & Policy: A Journal of Research, Debate and Practice 10 (2): 259–77. doi:10.1332/174426514X13990433991320. 
  12. ↑ Drutman, L., 2015. The business of America is lobbying : how corporations became politicized and politics became more corporate. Oxford University Press.
  13. ↑ Laurens, S., 2017. Lobbyists and bureaucrats in Brussels : capitalism’s brokers. Routledge.
  14. ↑ A. Renner and M. Giampietro, “Socio-technical discourses of European electricity decarbonization: Contesting narrative credibility and legitimacy with quantitative story-telling,” Energy Res. Soc. Sci., vol. 59, Jan. 2020.
  15. ↑ Cabello, V., Romero, D., Musicki, A. et al. Co-creating narratives for WEF nexus governance: a Quantitative Story-Telling case study in the Canary Islands. Sustain Sci (2021). https://doi.org/10.1007/s11625-021-00933-y.
  16. ↑ Saltelli, Andrea; d'Hombres, Beatrice (2010). "Sensitivity analysis didn't help. A practitioner's critique of the Stern review". Global Environmental Change 20 (2): 298. doi:10.1016/j.gloenvcha.2009.12.003. 
  17. ↑ Saltelli, Andrea; Stark, Philip B.; Becker, William; Stano, Pawel (2015). "Climate models As economic guides scientific challenge or quixotic quest?". Issues in Science and Technology 31 (3): 79–84. 
  18. ↑ Araujo, Luisa; Saltelli, Andrea; Schnepf, Sylke V (2017). "Do PISA data justify PISA-based education policy?". International Journal of Comparative Education and Development 19: 20–34. doi:10.1108/IJCED-12-2016-0023. https://eprints.soton.ac.uk/408303/1/Final_accepted_Manuscript_PISA_critique_paper.docx. 
  19. ↑ [Saltelli, A., 2017, International PISA tests show how evidence-based policy can go wrong, The Conversation, June 12.](https://theconversation.com/international-pisa-tests-show-how-evidence-based-policy-can-go-wrong-77847)
  20. ↑ Saltelli, Andrea; Piano, Samuele Lo (2017). "Problematic Quantifications: A Critical Appraisal of Scenario Making for a Global 'Sustainable' Food Production". Food Ethics 1 (2): 173–9. doi:10.1007/s41055-017-0020-6. 
  21. ↑ Saltelli, Andrea; Lo Piano, Samuele (2018). "Doing the Sum Right or the Right Sums? Techno-Optimist Numbers in Food Security Scenarios". Frontiers in Sustainable Food Systems 2. doi:10.3389/fsufs.2018.00006. 
  22. ↑ [Saltelli, A., Giampietro, M. & Gomiero, T. Forcing consensus is bad for science and society. The Conversation (2017).](https://theconversation.com/forcing-consensus-is-bad-for-science-and-society-77079)
  23. ↑ Giampietro, Mario; Saltelli, Andrea (2014). "Footprints to nowhere". Ecological Indicators 46: 610–21. doi:10.1016/j.ecolind.2014.01.030. 
  24. ↑ Galli, Alessandro; Giampietro, Mario; Goldfinger, Steve; Lazarus, Elias; Lin, David; Saltelli, Andrea; Wackernagel, Mathis; Müller, Felix (2016). "Questioning the Ecological Footprint". Ecological Indicators 69: 224–232. doi:10.1016/j.ecolind.2016.04.014. 




Retrieved from "https://handwiki.org/wiki/index.php?title=Quantitative_storytelling&oldid=63245"