Social:Process tracing

From HandWiki
Short description: Method to develop and test theories

Process tracing is a research method used to develop and test theories.[1][2][3] It is generally understood as a "within-case" method to draw inferences on the basis of causal mechanisms.[4][5] It has been used in social sciences (such as in psychology[2]), as well as in natural sciences.[5]

Scholars that use process tracing evaluate the weight of evidence on the basis of the strength of tests (notably straw-in-the-wind tests, hoop tests, smoking gun tests, double decisive tests).[5] As a consequence, what matters is not solely the quantity of observations, but the quality and manner of observations.[5][6] By using Bayesian probability, it may be possible to make strong causal inferences from a small sliver of data through process tracing.[5][7] As a result, process tracing is a prominent case study method.[8]

Process tracing

Process-tracing can be used both for inductive (theory-generating) and deductive (theory-testing) purposes.[5]

In terms of theory-testing, the process-tracing method works by presenting the observable implications (hypotheses) of a theory, as well as alternative explanations that are inconsistent with the theory. Once these observable implications are presented, they are then tested empirically to see which of the observable implications can be observed and which cannot.[1][9] Process-tracing emphasizes the temporal sequence of events, and requires fine-grained case knowledge.[1]

Stephen Van Evera's influential typology of process-tracing tests distinguishes tests depending on how they adjudicate between theoretical expectations:[5][10]

  • Straw-in-the-wind tests: Failure or passage of this test neither lends strong support for or against the theory
  • Hoop tests: Failure to pass a hoop test can be disqualifying for a theory but passing the hoop test does not necessarily lend strong support for the theory
  • Smoking gun tests: Passing a smoking gun test lends strong support for theory, whereas failure does not necessarily lend strong support against the theory
  • Double decisive tests: Passing a double decisive test lends strong support for the theory while also lending strong support against alternative theories

It is often used to complement comparative case study methods. By tracing the causal process from the independent variable of interest to the dependent variable, it may be possible to rule out potentially intervening variables in imperfectly matched cases. This can create a stronger basis for attributing causal significance to the remaining independent variables.[11]

A limitation to process-tracing is the problem of infinite regress.[12][13] While some influential works by methods scholars have argued that the ability of process-tracing to make causal claims is limited by low degrees of freedom,[14] methodologists widely reject that the "degrees of freedom" problem applies to research that uses process-tracing, given that qualitative research entails different logics than quantitative research (where scholars do need to be wary of degrees of freedom).[12][5]

One advantage to process-tracing over quantitative methods is that process-tracing provides inferential leverage.[1] In addition to aiding uncovering and testing causal mechanisms, process-tracing also contributes descriptive richness.[1]

By assigning probabilities to outcomes under specific conditions, scholars can use Bayesian rules in their process tracing to draw robust conclusions about the causes of outcomes.[15][16][5][8][17][18][7] For example, if a scholar's theory assumes that a number of observable implications will happen under certain conditions, then the repeated occurrence of those outcomes under the theorized conditions lends strong support for the scholar's theory because the observed outcomes would be improbable to occur in the manner expected by the scholar if the theory were false.[15] By using Bayesian probability, it may be possible to make strong causal inferences from a small sliver of data.[5] For example, a video recording of a person committing a bank robbery can be very strong evidence that a particular person committed the robbery while also ruling out that other potential suspects did it, even if it is only a single piece of evidence.[5]

Scholars can also use set theory in their process tracing.[19]

See also

References

  1. 1.0 1.1 1.2 1.3 1.4 Collier, David (2011). "Understanding Process Tracing". PS: Political Science & Politics 44 (4): 823–830. doi:10.1017/s1049096511001429. ISSN 1049-0965. 
  2. 2.0 2.1 Schulte-Mecklenbeck, M.; Kühberger, A.; Ranyard, R., eds (2011). A Handbook of Process Tracing Methods for Decision Research: A Critical Review and User's Guide. New York: Taylor & Francis. 
  3. Ford, J. Kevin; Schmitt, Neal; Schechtman, Susan L.; Hults, Brian M.; Doherty, Mary L. (1989). "Process Tracing Methods: Contributions, Problems, and Neglected Research Questions". Organizational Behavior and Human Decision Processes 43 (1): 75–117. doi:10.1016/0749-5978(89)90059-9. 
  4. Jacobs, Alan M.; Büthe, Tim; Arjona, Ana; Arriola, Leonardo R.; Bellin, Eva; Bennett, Andrew; Björkman, Lisa; Bleich, Erik et al. (2021). "The Qualitative Transparency Deliberations: Insights and Implications" (in en). Perspectives on Politics Supplementary materials, Pt 2: 171–208. doi:10.1017/S1537592720001164. ISSN 1537-5927. https://www.cambridge.org/core/journals/perspectives-on-politics/article/abs/qualitative-transparency-deliberations-insights-and-implications/890AA58A1829A075F1D28DA9BD54C2EB#supplementary-materials. 
  5. 5.00 5.01 5.02 5.03 5.04 5.05 5.06 5.07 5.08 5.09 5.10 Bennett, Andrew (2008). "Process Tracing: a Bayesian Perspective". in Box-Steffensmeier, Janet M; Brady, Henry E; Collier, David (in en). doi:10.1093/oxfordhb/9780199286546.001.0001. https://www.oxfordhandbooks.com/view/10.1093/oxfordhb/9780199286546.001.0001/oxfordhb-9780199286546-e-30. 
  6. Gerring, John (2007) (in en). Case Study Research: Principles and Practices. Cambridge University Press. pp. 173, 180. ISBN 978-0-521-85928-8. https://books.google.com/books?id=xECY0nnkTvMC. 
  7. 7.0 7.1 Fairfield, Tasha; Charman, Andrew E. (2022) (in en). Social Inquiry and Bayesian Inference. Cambridge University Press. ISBN 978-1-108-42164-5. https://books.google.com/books?id=kHB3EAAAQBAJ. 
  8. 8.0 8.1 Mahoney, James (2016-09-02). "Mechanisms, Bayesianism, and process tracing". New Political Economy 21 (5): 493–499. doi:10.1080/13563467.2016.1201803. ISSN 1356-3467. https://doi.org/10.1080/13563467.2016.1201803. 
  9. King, Gary; Keohane, Robert O.; Verba, Sidney. Designing Social Inquiry. 
  10. Van Evera, Stephen (1997). Guide to Methods for Students of Political Science. Cornell University Press. ISBN 978-0-8014-5444-8. https://www.jstor.org/stable/10.7591/j.ctvrf8bm7. 
  11. George, Alexander L.; Bennett, Andrew (2005). Case studies and theory development in the social sciences. London: MIT Press. pp. 214–15. ISBN 0-262-57222-2. 
  12. 12.0 12.1 Bennett, Andrew (2010). "Process Tracing and Causal Inference" in Rethinking social inquiry diverse tools, shared standards. Rowman & Littlefield Publishers. ISBN 978-1-4422-0343-3. OCLC 787870333. 
  13. Verghese, Ajay (2020-02-24) (in en). Who's Afraid of Infinite Regress? A Process-Tracing Exercise. Rochester, NY. https://papers.ssrn.com/abstract=3484930. 
  14. King, Gary; Keohane, Robert O.; Verba, Sidney (1994). Designing Social Inquiry. Princeton, New Jersey: Princeton University Press. pp. 86. doi:10.1515/9781400821211. ISBN 978-1-4008-2121-1. 
  15. 15.0 15.1 Humphreys, Macartan; Jacobs, Alan M. (2015). "Mixing Methods: A Bayesian Approach". American Political Science Review 109 (4): 654. doi:10.1017/s0003055415000453. ISSN 0003-0554. 
  16. Fairfield, Tasha; Charman, Andrew E. (2017). "Explicit Bayesian Analysis for Process Tracing: Guidelines, Opportunities, and Caveats" (in en). Political Analysis 25 (3): 363–380. doi:10.1017/pan.2017.14. ISSN 1047-1987. https://www.cambridge.org/core/journals/political-analysis/article/abs/explicit-bayesian-analysis-for-process-tracing-guidelines-opportunities-and-caveats/F93D3EA784730ED731AC910EEF306231. 
  17. Bennett, Andrew (2014), Bennett, Andrew; Checkel, Jeffrey T., eds., "Disciplining our conjectures", Process Tracing: From Metaphor to Analytic Tool, Strategies for Social Inquiry (Cambridge University Press): pp. 276–298, ISBN 978-1-107-04452-4, https://www.cambridge.org/core/books/process-tracing/disciplining-our-conjectures/15EC8729563ED558732E3867DC0C56D4 
  18. Bennett, Andrew; Charman, Andrew E.; Fairfield, Tasha (2021). "Understanding Bayesianism: Fundamentals for Process Tracers" (in en). Political Analysis 30 (2): 298–305. doi:10.1017/pan.2021.23. ISSN 1047-1987. 
  19. Barrenechea, Rodrigo; Mahoney, James (2019-08-01). "A Set-Theoretic Approach to Bayesian Process Tracing" (in en). Sociological Methods & Research 48 (3): 451–484. doi:10.1177/0049124117701489. ISSN 0049-1241. https://doi.org/10.1177/0049124117701489. 

Further reading

  • Bennett, A. and A.L. George (2001). "Case Studies and Process Tracing in History and Political Science: Similar Strokes for Different Foci" in C. Elman and M.F. Elman (eds.) Bridges and Boundaries: Historians, Political Scientists, and the Study of International Relations. MIT Press pp. 137–166.
  • Checkel. J. T. (2006) "Tracing Causal Mechanisms." The International Studies Review 8: 362-370.
  • Checkel, J. T. (2008) "Process Tracing." in A. Klotz and D. Prakash (eds.) Qualitative Methods in International Relations: A Pluralist Guide. Palgrave. pp. 114–129.
  • Vennesson, P. and I. Wiesner (2014) "Process Tracing in Case Studies." in J. Soeters, P. Shields and S Reitjens (eds) Routledge Handbook of Research Methods in Military Studies. Routledge. pp. 92–103.