Medicine:Learning health systems

From HandWiki
Short description: Type of health care system

Learning health systems (LHS) are health and healthcare systems in which knowledge generation processes are embedded in daily practice to improve individual and population health. At its most fundamental level, a learning health system applies a conceptual approach wherein science, informatics, incentives, and culture are aligned to support continuous improvement, innovation, and equity, and seamlessly embed knowledge and best practices into care delivery[1][2][3]

The idea was first conceptualized in a 2006 workshop organized by the US Institute of Medicine (now the National Academy of Medicine (NAM)), building on ideas around evidence-based medicine[1] and "practice-based evidence".[4] and around recognition of the persistent gap between evidence generated in the context of biomedical research and the application of that evidence in the provision of care. The need to close this gap was further underscored by the growth of electronic health records (EHR) and other innovations in health information technology and computational power, and the resulting ability to generate data that can lead to better evidence and better outcomes. There has since been increasing interest in the topic, including the creation of the John Wiley & Sons journal Learning Health Systems.[3]

Cornerstone elements of the LHS include:

  1. generation, application, and improvement of scientific knowledge;
  2. an organizational infrastructure that supports the engagement of communities of patients, healthcare professionals and researchers who collaborate to identify evidence gaps that could be addressed through research in routine healthcare settings;[5]
  3. deployment of computational technologies and informatics approaches that organize and leverage large electronic health data sets, i.e. "big data" for use in research;
  4. quality improvement at the point of care for each patient using new knowledge generated by research.

Other compatible ways of describing the LHS co-exist alongside the NAM definition, including the definition used by AHRQ, the Agency for Healthcare Research and Quality. AHRQ defines a learning health system as "a health system in which internal data and experience are systematically integrated with external evidence, and that knowledge is put into practice. As a result, patients get higher quality, safer, more efficient care, and health care delivery organizations become better places to work.”

In 2023, the NAM established ten core principles of learning health organizations to serve as a unifying touchstone for the field. The principles reflect and build upon the six aims of the seminal "Crossing the Quality Chasm" report published in 2001 (safe, equitable, effective, efficient, timely, and patient-centered),[6] and account for the ways in which health care has evolved since the publication of this 2001 report.

  • Engaged - Informed engagement, options, and choices for those who are served
  • Safe - Tested and up-to-date protocols to protect from harm
  • Effective - Evidence-based services tailored to understanding of each person's goals
  • Equitable - Parity in opportunity to attain desired health and goals
  • Efficient - Optimal outcomes for accessible, non-wasteful resources
  • Accessible - Effective services readily available where and when they are most needed
  • Measurable - Reliable and valid assessment of consequential activities and outcomes
  • Transparent - Clear information related to the nature, use, costs, and results of services
  • Secure - Validated access and use safeguards for digitally-mediated activities
  • Adaptive - Continuous learning and improvement are integral to organizational culture

History

The NAM’s early efforts to develop the ideas underpinning the LHS began in 2006, via a series of workshops held over several years from 2006-2013. Among several early publications to express the need for a rapid learning health system was a commentary in Health Affairs in 2007[7] where Lynn Etheredge applied the term “rapid learning health system” in recognition of the opportunity to leverage electronic health records (EHR) to “learn” what works in health care. The series of NAM workshops generated several summary publications on topics under the mantle of the LHS, including publications focused on the digital infrastructure[2] as well as on ethical considerations.[8] In 2013, the workshops culminated in a seminal report, “Best Care at Lower Cost: the Path to Continuously Learning Health Care in America.”[9] Summarizing the heretofore efforts, McGinnis and colleagues enumerate key milestones in the evolution of the LHS that include these reports as well as decades-old efforts to generate evidence from routine health care delivery.[10]

Nomenclature may vary in reference to the LHS concept. Some refer to a learning healthcare system, others refer to learning health systems or collaborative learning health systems.[11] The architecture and objectives are similar, irrespective of the label—addressing evidence gaps, harnessing data, and effectively utilizing the best evidence at the point of need. Related concepts include the use of real-world data to generate real-world evidence, and mobilizing computable biomedical knowledge.[12]

Given that the LHS has an expansive definition and scope, many of the early adopters of this approach were health systems that also had embedded research capabilities, such as a formal department or institute. The Veterans Administration Health System,[13] Group Health Cooperative,[14] Kaiser Permanente [15] and Geisinger Health System [16] were among the vanguard organizations who also published insights from their experience of launching formal learning health system activities. Increasingly, academic health systems have taken up the principles and practices espoused by the earliest adopters.

Adoption and spread

Early experiences with deploying the LHS have been instructive and have led to further adoption and spread. The LHS model is being applied in specific medical specialties such as pediatrics [17] and oncology,[18] and further examination of the environment and conditions that support learning have spurred development of increasingly detailed and specialized frameworks [19][20][21] that can support further adoption and adaptation based on the needs, features, and capabilities of a particular health system.

Along with a growing body of peer-reviewed publications on the specific experience of different systems as they evolve toward continuous learning, review articles have been published to reflect on the growth of the LHS as a whole. A systematic review by Budrionis [22] observed that the ability to evaluate how well an LHS improves outcomes was not well-explored in the literature. Subsequently, Platt [23] examined progress of theories and implementation of the LHS, Nash focused a review on deployment of the LHS in primary care,[24] and Ellis mapped empirical applications of the LHS.[25] Easterling and colleagues (REF LHS 2022) proffer an elaborate taxonomy of LHS elements and use this to describe an LHS-IP, or “Learning Health System In Practice” as a model for health care systems who seek to become an LHS.[26]

The motivations for applying LHS concepts are largely and logically focused on improving the quality of care. Exemplar organizations are numerous and growing and include both community-based health systems and university-based academic health systems/medical centers in the United States:

  • Atrium Health/Advocate Aurora
  • Baylor Scott & White Health
  • Care South Carolina
  • Cleveland Clinic
  • Children’s Hospital of Philadelphia
  • Cincinnati Children's Hospital Medical Center
  • Denver Health Medical Center
  • Geisinger Health System
  • HealthPartners
  • Indiana University Health
  • Kaiser Permanente
  • Mayo Clinic
  • Medstar Health
  • Feinberg School of Medicine
  • NYU Langone Health
  • SSM Health
  • Sutter Health
  • Trillium Healthcare Institute for Better Health (Canada)
  • University of Alabama at Birmingham School of Medicine
  • Michigan Medicine
  • UPMC
  • Vanderbilt University Medical Center
  • Veterans Administration Health System
  • Wake Forest School of Medicine
  • Washington University School of Medicine
  • Weill Cornell Medicine

In many cases, these institutions are engaged in research activities such as the HCSRN, Clinical and Translational Science Awards (CTSA), and PCORnet where the LHS concepts are applied. The University of Michigan has also established a formal academic department, the Department of Learning Health Sciences. Alongside these exemplar organizations, related initiatives and consortia have been established in recent years. The Learning Health Community is an umbrella organization that has united many systems and health data organizations to develop shared principles and processes, and foster learning about the applications of technologies in the context of learning systems via a periodic virtual forum (LHS IT Forum). Given their centrality to the generation of health data and information, two of the largest EHR vendors have also created communities to support LHS: Cerner’s Learning Health Network and Epic System's Health Research Network. Still, much of the LHS development has been concentrated in large academic medical centers and health systems with a sizable footprint. Masica notes that nearly 85% of more than 6000 hospitals in the US are categorized as community hospitals, and the ability to develop and implement an LHS may be more challenging due to workforce and other constraints.[27]

Dissemination of the activities and experiences of learning health systems has been an instrumental aspect of their growth and spread.  While peer-reviewed literature on the LHS appears in a variety of journals, the creation of Healthcare: the Journal of Delivery Science and Innovation and the Learning Health Systems Journal are dedicated to manuscripts that showcase the experience of those deploying or refining aspects of learning in real-world practices. Each has also published special issues with thematic emphases on LHS-related topics such as embedded research and ethical, legal, and social implications of the LHS. Another marker of the spread of the LHS is its international adoption. Australia, Canada, the United Kingdom and other countries are applying the LHS concepts, offering opportunities to compare and contrast global experiences and develop a richer picture of how the local context, structure of care delivery, and regulatory environment affect the ability to support continuous learning. Patient involvement in the LHS has grown, partly due to the establishment of the Patient-Centered Outcomes Research Institute, continued emphasis on shared decision-making, and the growing recognition of participatory medicine. However, the engagement of patients is not consistent across health systems and there is not a uniform template for patient engagement or approaches to educating patients about the value and significance of the LHS as a model for improving evidence-based care.

Electronic health data as a central component to the LHS

A large proportion of LHS research relies on the use of electronic health records (EHRs) and must navigate the inherent challenges of EHRs.[28] EHRs were primarily created to support billing for clinical services and tracking health insurance claims. Generation of rich real-world clinical data is an essential "byproduct" of this highly transactional purpose of the contemporary EHR.

The LHS leverages a clinical lifecycle. Patient data is collected, which can then be amalgamated across multiple patients to identify, define, and analyze a problem or a gap in the application of evidence-based care.[29] These are activities largely driven by healthcare professionals. With the support of technology (both computational and statistical), an analysis of the amalgamated data can result in new evidence. Such knowledge generation can then spur changes in clinical practice, and thus to new patient data being collected.[3][30][31] This is the optimum for the LHS. However, dissemination of implementation of new evidence can be operationally and technically challenging in many settings, including the original health system that identified a problem based on their own clinical data.

McLachlan and colleagues (2018) suggest a taxonomy of nine LHS classification types:[3]

  1. Cohort identification looks for patients with similar attributes.[32]
  2. Positive deviance finds examples of better care against a benchmark.[33]
  3. Negative deviance finds examples of sub-optimal care.[30]
  4. Predictive patient risk modeling uses patterns in data to find groups at greater risk of adverse events.[34]
  5. Predictive care risk and outcome models identify situations that are at greater risk of poor care.[35]
  6. Clinical decision support systems use patient algorithms applied to patient data to make specific treatment recommendations.
  7. Comparative effectiveness research determines the most effective treatments.[35]
  8. Intelligent assistance use data to automate routine processes.[35]
  9. Surveillance monitors data for disease outbreaks or other treatment issues.[36]

Synergy with other disciplines

The LHS is a multidisciplinary and multi-stakeholder model for improvement, wherein clinical practitioners, health system leaders, data analysts and health IT experts, operations personnel, and researchers bring requisite expertise to bear throughout the cycle of improving health and healthcare. In a complex healthcare environment, sustained engagement of all health system stakeholders is necessary to successfully identify and prioritize evidence gaps, develop suitable interventions, analyze insights from the interventions, and deploy resulting changes. Hence, many disciplines and scientific domains may contribute various types of subspecialty expertise including:

Training

As the LHS has matured, leaders and vanguard organizations have identified the requisite skills needed to lead and develop interventions that support learning. The Agency for Healthcare Research and Quality convened a technical expert panel in 2016 to identify core competencies, which yielded 33 competencies spanning seven domains.[37] These competency domains are (1) Systems Science; (2) Research Questions and Standards of Scientific Evidence; (3) Research Methods; (4) Informatics; (5) Ethics of Research and Implementation in Health Systems; (6) Improvement and Implementation Science; (7) Engagement, Leadership, and Research Management. An 8th domain, Equity and Justice, was added in 2022 and a total of 38 competencies are now identified. These competencies form the backbone of a training program collaboratively funded by AHRQ and PCORI, two US funding agencies that also issue funding opportunities for LHS-related studies. A $40 million funding opportunity for mentored career development awards was issued in 2017 and 11 Centers of Excellence were awarded five years of federal funding in 2018 to support the training of clinician and research scientists to conduct patient-centered outcomes research within LHS.[38][39]

The LHS Centers of Excellence funded in 2018 were:[40]

  1. A Chicago Center of Excellence in Learning Health Systems Research Training (ACCELERAT), Northwestern University, Chicago, Ill.
  2. CATALyST: Consortium for Applied Training to Advance the Learning Health System with Scholars/Trainees, Kaiser Permanente Washington Research Institute, Seattle, WA.[41]
  3. Learning Health System Scholar Program at Vanderbilt University, Nashville, Tenn.
  4. Leveraging Infrastructure to Train Investigators in Patient-Centered Outcomes Research in Learning Health System (LITI- PCORLHS), Indiana University School of Medicine, Indianapolis, Ind.[42]
  5. Minnesota Learning Health System Mentored Career Development Program (MN-LHS), University of Minnesota, Minneapolis, Minnesota.[43]
  6. Northwest Center of Excellence & K12 in Patient Centered Learning Health Systems Science, Oregon Health and Science University, Portland, Oregon.[44]
  7. PEDSnet Scholars: A Training Program for Pediatric Learning Health System Researchers, Children’s Hospital of Philadelphia, Philadelphia, PA[45]
  8. Stakeholder-Partnered Implementation Research and Innovation Translation (SPIRIT) program, University of California Los Angeles, Los Angeles, California.[46]
  9. The Center of Excellence in Promoting LHS Operations and Research at Einstein/Montefiore (EXPLORE), Albert Einstein College of Medicine, Bronx, N.Y.
  10. Transforming the Generation and Adoption of PCOR into Practice (T-GAPP), University of Pennsylvania, Philadelphia, PA.
  11. University of California-San Francisco Learning Health System K12 Career Development Program, University of California San Francisco, San Francisco, California.

As the funding for the aforementioned Centers of Excellence concludes in 2023, a successor funding opportunity was created by AHRQ and PCORI to fund Learning Health System Embedded Scientist Training and Research (LHS E-STaR) Centers. Other similar training and fellowship programs have been offered by AcademyHealth via their Delivery System Science Fellowship program, Kaiser Permanente’s Division of Research, and the Veterans Administration via the Seattle-Denver Center of Innovation. Program offerings and emphases vary from institution to institution, but all involve training and professional development in topics related to improving health systems and the ability to generate and learn from evidence. Articles describing multidisciplinary workforce training efforts was published as a supplement to the LHS Journal in 2022, including an experience report summarizing the collective insights from the 11 initially funded Centers of Excellence.

Funding and financial support

Support for learning activities may be derived from federal, philanthropic, and other sources. Examples include the National Institutes of Health and AHRQ (federal); and the Robert Wood Johnson Foundation (philanthropic). The Patient-Centered Outcomes Research Institute (PCORI) has designated the realization of a national learning health system as one of their five national priorities for health, which is indicative of future funding opportunities. Funding provided to personnel within an organization (i.e., a health system) may be designated for internally-directed learning activities with no expectation about developing and publishing generalizable results. In this way, learning health system may be distinguished from traditional health services or informatics research and more closely resemble the funding and infrastructure that health systems designate for quality improvement activities. In 2015, the Centers for Medicare and Medicaid Services (CMS) funded the Health Care Payment Learning and Action Network to ascertain what works with respect to alternative health care delivery arrangements, however, reimbursement for learning activities from insurers/payers is not currently a steady avenue for financial support to incentivize health system learning.

Ethical considerations

Bioethics scholars including Faden, Asch, Finkelstein, Morain, and Platt have averred that in a learning health system, consideration should be given to both clinical ethics and research ethics. Faden, Kass and colleagues have put forth an ethics framework for the learning health system that is anchored on seven essential obligations: (1) respecting dignity and rights of all patients; (2) respecting clinical judgment; (3) providing optimal care to every patient; (4) avoiding the introduction of non-clinical burdens and risks; (5) reducing health inequities; (6) ensuring responsible activities are conducted in a way that fosters learning; and (7) contributing to the overall aim of improving quality and value in health care.[47] This framework and several companion articles were published as a special report from the Hastings Center. Subsequent articles by Finkelstein et al, as well as Asch and colleagues seek to use examples of learning activities as a means to describe different approaches to research oversight and compliance.[48][49] Rigorous deliberations about the approach to informed consent are also germane to the ethics of learning activities in the healthcare context.

See also

  • Real World Evidence

References

  1. ↑ 1.0 1.1 "The Learning Healthcare System: Workshop Summary". Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care. National Academies Press (US). 2007. ISBN 978-0-309-10300-8. https://www.ncbi.nlm.nih.gov/books/NBK53494/. Retrieved 2018-06-15. 
  2. ↑ 2.0 2.1 Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care. Washington, DC. 2011. ISBN 978-0-309-15416-1. https://www.ncbi.nlm.nih.gov/books/NBK83569/pdf/Bookshelf_NBK83569.pdf. Retrieved 2018-06-15. 
  3. ↑ 3.0 3.1 3.2 3.3 "The Heimdall Framework for Supporting Characterisation of Learning Health Systems". Journal of Innovation in Health Informatics 25 (2): 77–87. June 2018. doi:10.14236/jhi.v25i2.996. PMID 30398449. 
  4. ↑ "Implementing the learning health system: from concept to action". Annals of Internal Medicine 157 (3): 207–10. August 2012. doi:10.7326/0003-4819-157-3-201208070-00012. PMID 22868839. 
  5. ↑ "PEDSnet: how a prototype pediatric learning health system is being expanded into a national network". Health Affairs 33 (7): 1171–7. July 2014. doi:10.1377/hlthaff.2014.0127. PMID 25006143. 
  6. ↑ Institute of Medicine (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: National Academy Press. pp. 360. doi:10.17226/10027. ISBN 978-0-309-46561-8. https://doi.org/10.17226/10027. 
  7. ↑ "A rapid-learning health system". Health Affairs 26 (2): w107–18. 2007. doi:10.1377/hlthaff.26.2.w107. PMID 17259191. 
  8. ↑ "An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics". The Hastings Center Report Spec No: S16–27. 2013. doi:10.1002/hast.134. PMID 23315888. 
  9. ↑ Smith, M.; Saunders, R.; Stuckhardt, L.; McGinnis, J. M.; Committee on the Learning Health Care System in America; Institute of Medicine (2013). Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, D.C.: The National Academies Press. doi:10.17226/13444. ISBN 978-0-309-26073-2. 
  10. ↑ "Advancing the Learning Health System". The New England Journal of Medicine 385 (1): 1–5. July 2021. doi:10.1056/NEJMp2103872. PMID 34192452. 
  11. ↑ "A science of collaborative learning health systems". Learning Health Systems 5 (3): e10278. July 2021. doi:10.1002/lrh2.10278. PMID 34277944. 
  12. ↑ "Summary of third annual MCBK public meeting: Mobilizing computable biomedical knowledge-Accelerating the second knowledge revolution". Learning Health Systems 5 (1): e10255. January 2021. doi:10.1002/lrh2.10255. PMID 33490385. 
  13. ↑ "Quality Enhancement Research Initiative (QUERI): A collaboration between research and clinical practice". Medical Care 38 (6 Suppl 1): I17–I25. June 2000. doi:10.1097/00005650-200006001-00003. PMID 10843267. https://pubmed.ncbi.nlm.nih.gov/10843267/. Retrieved 2022-12-07. 
  14. ↑ "Implementing the learning health system: from concept to action". Annals of Internal Medicine 157 (3): 207–210. August 2012. doi:10.7326/0003-4819-157-3-201208070-00012. PMID 22868839. 
  15. ↑ Institute of Medicine (US) (2010-07-02). A Foundation for Evidence-Driven Practice: A Rapid Learning System for Cancer Care: Workshop Summary. Washington, D.C.: National Academies Press. doi:10.17226/12868. ISBN 978-0-309-15126-9. http://www.nap.edu/catalog/12868. 
  16. ↑ "Operationalizing the learning health care system in an integrated delivery system". eGEMs 3 (1): 1122. 2015-03-10. doi:10.13063/2327-9214.1122. PMID 25992388. 
  17. ↑ "PEDSnet: a National Pediatric Learning Health System". Journal of the American Medical Informatics Association 21 (4): 602–606. 2014-07-01. doi:10.1136/amiajnl-2014-002743. PMID 24821737. 
  18. ↑ "Rapid-learning system for cancer care". Journal of Clinical Oncology 28 (27): 4268–4274. September 2010. doi:10.1200/JCO.2010.28.5478. PMID 20585094. 
  19. ↑ "The Heimdall Framework for Supporting Characterisation of Learning Health Systems". Journal of Innovation in Health Informatics 25 (2): 77–87. June 2018. doi:10.14236/jhi.v25i2.996. PMID 30398449. 
  20. ↑ "A framework for value-creating learning health systems". Health Research Policy and Systems 17 (1): 79. August 2019. doi:10.1186/s12961-019-0477-3. PMID 31399114. 
  21. ↑ Foley, Tom; Vale, Luke (2022-05-20). "A framework for understanding, designing, developing and evaluating learning health systems" (in en). Learning Health Systems 7 (1): e10315. doi:10.1002/lrh2.10315. ISSN 2379-6146. PMID 36654802. 
  22. ↑ "The Learning Healthcare System: Where are we now? A systematic review". Journal of Biomedical Informatics 64: 87–92. December 2016. doi:10.1016/j.jbi.2016.09.018. PMID 27693565. 
  23. ↑ "An Analysis of the Learning Health System in Its First Decade in Practice: Scoping Review". Journal of Medical Internet Research 22 (3): e17026. March 2020. doi:10.2196/17026. PMID 32191214. 
  24. ↑ "Learning health systems in primary care: a systematic scoping review". BMC Family Practice 22 (1): 126. June 2021. doi:10.1186/s12875-021-01483-z. PMID 34162336. 
  25. ↑ "The Science of Learning Health Systems: Scoping Review of Empirical Research". JMIR Medical Informatics 10 (2): e34907. February 2022. doi:10.2196/34907. PMID 35195529. 
  26. ↑ "Clarifying the concept of a learning health system for healthcare delivery organizations: Implications from a qualitative analysis of the scientific literature". Learning Health Systems 6 (2): e10287. April 2022. doi:10.1002/lrh2.10287. PMID 35434353. 
  27. ↑ "The Texas Health Resources Clinical Scholars Program: Learning healthcare system workforce development through embedded translational research". Learning Health Systems 6 (4): e10332. October 2022. doi:10.1002/lrh2.10332. PMID 36263262. 
  28. ↑ "A framework for analysing learning health systems: Are we removing the most impactful barriers?". Learning Health Systems 3 (4): e10189. October 2019. doi:10.1002/lrh2.10189. PMID 31641685. 
  29. ↑ Paul Taylor (2007). From Patient Data to Medical Knowledge: The Principles and Practice of Health Informatics. Blackwell Publishing Ltd.. doi:10.1002/9780470994702. ISBN 9780470994702. https://onlinelibrary.wiley.com/doi/book/10.1002/9780470994702. Retrieved 2018-06-15. 
  30. ↑ 30.0 30.1 "Making sense of the shadows: priorities for creating a learning healthcare system based on routinely collected data". BMJ Quality & Safety 24 (8): 505–15. August 2015. doi:10.1136/bmjqs-2015-004278. PMID 26065466. 
  31. ↑ "Electronic patient-reported data capture as a foundation of rapid learning cancer care". Medical Care 48 (6 Suppl): S32–8. June 2010. doi:10.1097/MLR.0b013e3181db53a4. PMID 20473201. 
  32. ↑ "Achieving a nationwide learning health system". Science Translational Medicine 2 (57): 57cm29. November 2010. doi:10.1126/scitranslmed.3001456. PMID 21068440. 
  33. ↑ "Research in action: using positive deviance to improve quality of health care". Implementation Science 4: 25. May 2009. doi:10.1186/1748-5908-4-25. PMID 19426507. 
  34. ↑ "How health systems could avert 'triple fail' events that are harmful, are costly, and result in poor patient satisfaction". Health Affairs 32 (4): 669–76. April 2013. doi:10.1377/hlthaff.2012.1350. PMID 23569046. 
  35. ↑ 35.0 35.1 35.2 "What role for learning health systems in quality improvement within healthcare providers?". Learning Health Systems 1 (4): e10025. October 2017. doi:10.1002/lrh2.10025. PMID 31245567. 
  36. ↑ "Health and demographic surveillance systems: a step towards full civil registration and vital statistics system in sub-Sahara Africa?". BMC Public Health 12: 741. September 2012. doi:10.1186/1471-2458-12-741. PMID 22950896. 
  37. ↑ "Development of the Learning Health System Researcher Core Competencies". Health Services Research 53 (4): 2615–2632. August 2018. doi:10.1111/1475-6773.12751. PMID 28777456. 
  38. ↑ "AHRQ and PCORI Institutional Mentored Career Development Program (K12) to Support the Next Generation of Learning Health System Researchers". http://www.ahrq.gov/funding/training-grants/lhs-k12.html. 
  39. ↑ "Supporting the Next Generation of Learning Health Systems Researchers". October 27, 2017. https://www.pcori.org/research-results/2017/supporting-next-generation-learning-health-systems-researchers. 
  40. ↑ "AHRQ and PCORI Announce Awards to Support The Next Generation of Learning-Health-System Researchers". http://www.ahrq.gov/news/newsroom/press-releases/next-generation-lhs-researchers.html. 
  41. ↑ "CATALyST K12 - Early Career Scientist Training". https://www.kpwashingtonresearch.org/about-us/careers/catalyst-k12-washington-learning-health-system-scholar-program. 
  42. ↑ "IU-Regenstrief receive award for learning health system researchers". https://www.regenstrief.org/article/iu-regenstrief-ahrq-award/. 
  43. ↑ "Minnesota Learning Health System - Projects and Research Studies - School of Public Health - University of Minnesota". https://www.sph.umn.edu/research/projects/minnesota-learning-health-system/. 
  44. ↑ "PACT-K12 | OHSU". https://www.ohsu.edu/pact-k12. 
  45. ↑ "Scholars - PEDSnet". https://pedsnet.org/pedsnet-scholars/.. 
  46. ↑ "SPIRIT K12 - General Internal Medicine & Health Services Research - UCLA Health - Los Angeles, CA". https://www.uclahealth.org/internal-medicine/spirit-k12-program. 
  47. ↑ "An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics". The Hastings Center Report Spec No (s1): S16–S27. January 2013. doi:10.1002/hast.134. PMID 23315888. 
  48. ↑ "Oversight on the borderline: Quality improvement and pragmatic research". Clinical Trials 12 (5): 457–466. October 2015. doi:10.1177/1740774515597682. PMID 26374685. 
  49. ↑ "Rethinking ethical oversight in the era of the learning health system". Healthcare 8 (4): 100462. December 2020. doi:10.1016/j.hjdsi.2020.100462. PMID 32992106. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Medicine:Learning_health_systems&oldid=3273099"