Software:CovidSim

From HandWiki
Short description: Epidemiological model for COVID-19
CovidSim
Original author(s)Neil Ferguson
Repositoryhttps://github.com/mrc-ide/covid-sim
Written inC++
LicenseGNU General Public License v3.0

CovidSim is an epidemiological model for COVID-19 developed by Imperial College COVID-19 Response Team, led by Neil Ferguson.[1] The Imperial College study addresses the question: If complete suppression is not feasible, what is the best strategy combining incomplete suppression and control that is feasible and leads to acceptable outcomes?[2]

History

CovidSim is an agent-based model and was based on an earlier influenza model.[3]

The codebase for the model was initially constructed c. 2005.[4]

Informing policy decisions

For UK Prime Minister Boris Johnson,[4] it was, according to David Adam writing in The Atlantic, "a critical factor in jolting the UK government into changing its policy on the pandemic" and order a nationwide lockdown to limit the spread of the Coronavirus.[5][1][6][7]

Software

In May 2020, a C++ derivative of the code was released to GitHub.[8]

(As of May 2023), the current release tag is v0.15.0.[9] Additionally, an Anaconda package exists with release v0.8.0[10]

The software should be distinguished from the ICL's COVID-19 Scenario Analysis Tool (currently Version 4[11]), which is hosted under the domain name https://www.covidsim.org, but according to the research documentation is relying on the model combined with a squire model, which is the underlying transmission model in the absence of vaccination.[12][13] Further details are available under ICL's Report 33.[14]

Code reviews and expert opinions

Note that the mentioned model ships with and is marked with a list of warnings and user information, e.g. no support, stochastic nature/kernel, criticality of input parameters etc.[15][16]

Soundness

American programmer John Carmack said in April 2020 that he worked on the code before it was released to the public, when it was a single 15,000-line C programming language file and "some of the functions looked like they were machine translated from Fortran", but that "it fared a lot better going through the gauntlet of code analysis tools I hit it with than a lot of more modern code".[17][18]

Shortcomings

New Scientist reported in March 2020 that one group from the New England Complex Systems Institute reviewing the model suggested that it contained "systematic errors".[19][20] British newspaper The Telegraph reported that some software engineers who reviewed the new code called it "totally unreliable" and a "buggy mess".[21]

In the opinion of University of Oxford computer scientist Michael Wooldridge, the code was "developed without the ceremony and rigor" of professional products, which is not untypical for research software and often intended to be not understood by third parties, or to be reused; and "while the extensive criticism about relaxed software engineering practices is perhaps justified, it was not fundamentally flawed".[22]

Model characteristics

Reproducibility

An independent review by Codecheck led by Dr Stephen Eglen of the University of Cambridge confirmed that they were able to reproduce the key findings from the response team's report by using the software.[17][23][24] A June 2020 editorial in Nature declared the original CovidSim codebase met the requirements of scientific reproducibility.[25]

Uncertainty

Further research exists to identify the following three sources of uncertainty in the simulation:[26][27] parametric uncertainty, model structure uncertainty and scenario uncertainty:[28] The simulation output depends critically on the inputs and can change up to 300% based on 940 parameters, of which 19 are considered most sensitive. Model structure and scenario uncertainty must therefore be understood.[28]

The results obtained by Imperial using the model are consistent with other models that make similar assumptions.[2]

Extensibility

Calibration of the model has been hampered by the lack of testing, especially the poor understanding of the prevalence of asymptomatic infection, however the Imperial College team makes reasonable assumptions. The model's reliance on a simplified picture of social interactions limits its extensibility to counterfactuals. The general nature of conclusions based on such a model can be expected to be similar to those of a simple compartmental model.[2]

Other applications, related or follow-up research

  • Additional research is based on the model, e.g. for simulation of effect of school closures on mortality.[29]
  • Wouter Edeling et al. contributed a FabSim3 plug-in called FabCovidSim,[30][31] which is based on EasyVVUQ, a Python 3 library to facilitate verification, validation and uncertainty quantification (VVUQ) for a wide variety of simulations.[32][33]
  • In a recent publication on MedRxiv, which was now accepted by BMJ Open by Laydon et al., the authors utilize the model to "Measure the effects of the Tier system on the COVID-19 pandemic in the UK between the first and second national lockdowns, before the emergence of the B.1.1.7 variant of concern" and conclude that "...interventions at least as stringent as Tier 3 are required to suppress transmission, especially considering more transmissible variants, at least until effective vaccination is widespread or much greater population immunity has amassed."[34]

See also

  • List of COVID-19 simulation models
  • MRC Centre for Global Infectious Disease Analysis

References

  1. ↑ 1.0 1.1 "Special report: The simulations driving the world's response to COVID-19". Nature 580 (7803): 316–318. April 2020. doi:10.1038/d41586-020-01003-6. PMID 32242115. Bibcode: 2020Natur.580..316A. 
  2. ↑ 2.0 2.1 2.2 "Commentary on Ferguson, et al., "Impact of Non-pharmaceutical Interventions (NPIs) to Reduce COVID-19 Mortality and Healthcare Demand"". Bulletin of Mathematical Biology 82 (4): 52. April 2020. doi:10.1007/s11538-020-00726-x. PMID 32270376.  CC-BY icon.svg Text was copied from this source, which is available under a Creative Commons Attribution 4.0 International License.
  3. ↑ "Mathematical modeling as a tool for policy decision making: Applications to the COVID-19 pandemic" (in en). Handbook of Statistics 44: 291–326. January 2021. doi:10.1016/bs.host.2020.12.001. ISBN 9780323852005. 
  4. ↑ 4.0 4.1 "How 'Professor Lockdown' helped save tens of thousands of lives worldwide — and carried COVID-19 into Downing Street", Business Insider, April 25, 2020, https://www.businessinsider.com/neil-ferguson-transformed-uk-covid-response-oxford-challenge-imperial-model-2020-4 
  5. ↑ "Report 9 - Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand" (in en-GB). http://www.imperial.ac.uk/medicine/departments/school-public-health/infectious-disease-epidemiology/mrc-global-infectious-disease-analysis/covid-19/report-9-impact-of-npis-on-covid-19/. 
  6. ↑ "Sobering coronavirus study prompted Britain to toughen its approach". Reuters. March 17, 2020. https://www.reuters.com/article/us-health-coronavirus-britain-research/sobering-coronavirus-study-prompted-britain-to-toughen-its-approach-idUSKBN2141EP. 
  7. ↑ "Don't Believe the COVID-19 Models.That's not what they're for.". The Atlantic. April 2, 2020. https://www.theatlantic.com/technology/archive/2020/04/coronavirus-models-arent-supposed-be-right/609271/. 
  8. ↑ mrc-ide/covid-sim, MRC Centre for Global Infectious Disease Analysis, 2021-03-08, https://github.com/mrc-ide/covid-sim, retrieved 2021-03-09 
  9. ↑ "Release v0.15.0 · mrc-ide/covid-sim" (in en). https://github.com/mrc-ide/covid-sim/releases/tag/v0.15.0. 
  10. ↑ "Covid Sim :: Anaconda.org". https://anaconda.org/covid19/covid-sim. 
  11. ↑ "Covid-19 Scenario Analysis". https://covidsim.org/v4.20210322/versions.html. 
  12. ↑ "SEIR transmission model of COVID-19" (in en). https://mrc-ide.github.io/squire/. 
  13. ↑ Consulting, Bio Nano. "Covid-19 Scenario Analysis" (in en). https://covidsim.org/v4.20210322/research.html. 
  14. ↑ "Report 33 - Modelling the allocation and impact of a COVID-19 vaccine" (in en-GB). http://www.imperial.ac.uk/medicine/departments/school-public-health/infectious-disease-epidemiology/mrc-global-infectious-disease-analysis/covid-19/report-33-vaccine/. 
  15. ↑ "mrc-ide/covid-sim" (in en). https://github.com/mrc-ide/covid-sim. 
  16. ↑ "COVID-19 planning tools" (in en-GB). http://www.imperial.ac.uk/medicine/departments/school-public-health/infectious-disease-epidemiology/mrc-global-infectious-disease-analysis/covid-19/covid-19-planning-tools/. 
  17. ↑ 17.0 17.1 "Codecheck confirms reproducibility of COVID-19 model results". Imperial News. Imperial College London. June 2020. https://www.imperial.ac.uk/news/197875/codecheck-confirms-reproducibility-covid-19-model-results/. 
  18. ↑ @ID_AA_Carmack (April 27, 2020). "Before the GitHub team started working on the code it was a single 15k line C file that had been worked on for a decade, and some of the functions looked like they were machine translated from Fortran.". https://twitter.com/ID_AA_Carmack/status/1254872369556074496. 
  19. ↑ "Review of Ferguson et al "Impact of non-pharmaceutical interventions..."" (in en-US). 17 March 2020. https://necsi.edu/review-of-ferguson-et-al-impact-of-non-pharmaceutical-interventions. 
  20. ↑ "UK's scientific advice on coronavirus is a cause for concern", New Scientist, March 23, 2020, https://www.newscientist.com/article/2238186-uks-scientific-advice-on-coronavirus-is-a-cause-for-concern/ 
  21. ↑ "Coding that led to lockdown was 'totally unreliable' and a 'buggy mess', say experts". May 16, 2020. https://www.telegraph.co.uk/technology/2020/05/16/coding-led-lockdown-totally-unreliable-buggy-mess-say-experts/. 
  22. ↑ "The Software that Led to the Lockdown" (in en). https://cacm.acm.org/blogs/blog-cacm/246511-the-software-that-led-to-the-lockdown/fulltext. 
  23. ↑ "Codecheck confirms reproducibility of COVID-19 model results". Mirage News. 2 June 2020. https://www.miragenews.com/codecheck-confirms-reproducibility-of-covid-19-model-results/. 
  24. ↑ CODECHECK certificate 2020-010. Geneva, Switzerland. 29 May 2020. doi:10.5281/zenodo.3865491. https://zenodo.org/record/3865491. Retrieved 2020-10-14.  PDF report available.
  25. ↑ "Critiqued coronavirus simulation gets thumbs up from code-checking efforts". Nature 582 (7812): 323–324. June 2020. doi:10.1038/d41586-020-01685-y. PMID 32546864. Bibcode: 2020Natur.582..323S. https://media.nature.com/original/magazine-assets/d41586-020-01685-y/d41586-020-01685-y.pdf. Retrieved 2020-10-14. 
  26. ↑ Computer Simulations in Science (Winter 2019 ed.), Metaphysics Research Lab, Stanford University, 2019, https://plato.stanford.edu/archives/win2019/entries/simulations-science/, retrieved 2021-03-09 
  27. ↑ "Quantifying the uncertainty of CovidSim" (in en). Nature Computational Science 1 (2): 98–99. February 2021. doi:10.1038/s43588-021-00031-0. ISSN 2662-8457. 
  28. ↑ 28.0 28.1 "The impact of uncertainty on predictions of the CovidSim epidemiological code" (in en). Nature Computational Science 1 (2): 128–135. February 2021. doi:10.1038/s43588-021-00028-9. 
  29. ↑ "Effect of school closures on mortality from coronavirus disease 2019: old and new predictions". BMJ 371: m3588. October 2020. doi:10.1136/bmj.m3588. PMID 33028597. 
  30. ↑ "An automation toolkit for complex simulation tasks — FabSim3 Initial Release documentation" (in en). https://fabsim3.readthedocs.io/en/latest/. 
  31. ↑ Wouter Edeling; Hamid Arabnejad; Robert C Sinclair; Diana Suleimenova; Krishnakumar Gopalakrishnan; Bartosz Bosak; Derek Groen; Imran Mahmood Qureshi Hashmi et al. (2021-01-16), FabCovidSim, doi:10.5281/zenodo.4445290, https://zenodo.org/record/4445290, retrieved 2021-04-02 
  32. ↑ Richardson, Robin A.; Wright, David W.; Edeling, Wouter; Jancauskas, Vytautas; Lakhlili, Jalal; Coveney, Peter V. (2020-04-29). "EasyVVUQ: A Library for Verification, Validation and Uncertainty Quantification in High Performance Computing" (in en). Journal of Open Research Software 8: 11. doi:10.5334/jors.303. ISSN 2049-9647. 
  33. ↑ "wedeling/EasyVVUQ" (in en). https://github.com/wedeling/EasyVVUQ. 
  34. ↑ Template:Cite medRxiv

Further reading

External links




Retrieved from "https://handwiki.org/wiki/index.php?title=Software:CovidSim&oldid=3453195"