Advertisement
Original Contributions|Articles in Press

CLINICAL IMPACT OF A SEPSIS ALERT SYSTEM PLUS ELECTRONIC SEPSIS NAVIGATOR USING THE EPIC SEPSIS PREDICTION MODEL IN THE EMERGENCY DEPARTMENT

  • Adam R. Schertz
    Correspondence
    Reprint Address: Adam R. Schertz, MD, MS, Atrium Health Wake Forest Baptist, 1 Medical Center Boulevard, Winston-Salem, NC 27157
    Affiliations
    Department of Internal Medicine, Section on Pulmonology, Critical Care, Allergy, and Immunologic Diseases, Wake Forest University School of Medicine, Winston-Salem, North Carolina
    Search for articles by this author
  • Sydney A. Smith
    Affiliations
    Department of Biostatistics and Data Science, Division of Public Health Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina
    Search for articles by this author
  • Kristin M. Lenoir
    Affiliations
    Department of Biostatistics and Data Science, Division of Public Health Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina
    Search for articles by this author
  • Karl W. Thomas
    Affiliations
    Department of Internal Medicine, Section on Pulmonology, Critical Care, Allergy, and Immunologic Diseases, Wake Forest University School of Medicine, Winston-Salem, North Carolina
    Search for articles by this author

      Abstract

      Background

      The Epic Sepsis Prediction Model (SPM) is a proprietary sepsis prediction algorithm that calculates a score correlating with the likelihood of an International Classification of Diseases, Ninth Revision code for sepsis.

      Objective

      This study aimed to assess the clinical impact of an electronic sepsis alert and navigator using the Epic SPM on time to initial antimicrobial delivery.

      Methods

      We performed a retrospective review of a nonrandomized intervention of an electronic sepsis alert system and navigator using the Epic SPM. Data from the SPM site (site A) was compared with contemporaneous data from hospitals within the same health care system (sites B–D) and historical data from site A. Nonintervention sites used a systemic inflammatory response syndrome (SIRS)–based alert without a sepsis navigator.

      Results

      A total of 5368 admissions met inclusion criteria. Time to initial antimicrobial delivery from emergency department arrival was 3.33 h (interquartile range [IQR] 2.10–5.37 h) at site A, 3.22 h (IQR 1.97–5.60; p = 0.437, reference site A) at sites B–D, and 6.20 h (IQR 3.49–11.61 h; p < 0.001, reference site A) at site A historical. After adjustment using matching weights, there was no difference in time from threshold SPM score to initial antimicrobial between contemporaneous sites. Adjusted time to initial antimicrobial improved by 2.87 h (p < 0.001) at site A compared with site A historical.

      Conclusions

      Implementation of an electronic sepsis alert system plus navigator using the Epic SPM showed no difference in time to initial antimicrobial delivery between the contemporaneous SPM alert plus sepsis navigator site and the SIRS-based electronic alert sites within the same health care system.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Emergency Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      REFERENCES

        • Singer M
        • Deutschman CS
        • Seymour CW
        • et al.
        The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3).
        JAMA. 2016; 315: 801-810
        • Rhee C
        • Dantes R
        • Epstein L
        • et al.
        Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014.
        JAMA. 2017; 318: 1241-1249
        • Riester MR
        • Bosco E
        • Silva JBB
        • et al.
        Causes and timing of 30-day rehospitalization from skilled nursing facilities after a hospital admission for pneumonia or sepsis.
        PLoS One. 2022; 17e0260664https://doi.org/10.1371/journal.pone
        • Rhee C
        • Jones TM
        • Hamad Y
        • et al.
        Prevalence, underlying causes, and preventability of sepsis-associated mortality in US acute care hospitals.
        JAMA Netw Open. 2019; 2e187571https://doi.org/10.1001/jamanetworkopen.2018.7571
        • Seymour CW
        • Gesten F
        • Prescott HC
        • et al.
        Time to treatment and mortality during mandated emergency care for sepsis.
        N Engl J Med. 2017; 376: 2235-2244
        • Prescott HC
        • Angus DC
        Enhancing recovery from sepsis: a review.
        JAMA. 2018; 319: 62-75
        • Mayr FB
        • Talisa VB
        • Balakumar V
        • et al.
        Proportion and cost of unplanned 30-day readmissions after sepsis compared with other medical conditions.
        JAMA. 2017; 317: 530-531
        • Pruinelli L
        • Westra BL
        • Yadav P
        • et al.
        Delay within the 3-hour surviving sepsis campaign guideline on mortality for patients with severe sepsis and septic shock.
        Crit Care Med. 2018; 46: 500-505
        • Andersson M
        • Östholm-Balkhed Å
        • Fredrikson M
        • et al.
        Delay of appropriate antimicrobial treatment is associated with high mortality in patients with community-onset sepsis in a Swedish setting.
        Eur J Clin Microbiol Infect Dis. 2019; 38: 1223-1234
        • Peltan ID
        • Brown SM
        • Bledsoe JR
        • et al.
        ED door-to-antimicrobial time and long-term mortality in sepsis.
        Chest. 2019; 155: 938-946
      1. Whiles BB, Deis AS, Simpson SQ. Increased time to initial antimicrobial administration is associated with progression to septic shock in severe sepsis patients. Crit Care Med 017;45:623–9.

        • Sherwin R
        • Winters ME
        • Vilke GM
        • Wardi G
        Does early and appropriate antimicrobial administration improve mortality in emergency department patients with severe sepsis or septic shock?.
        J Emerg Med. 2017; 53: 588-595
        • Seymour CW
        • Kahn JM
        • Martin-Gill C
        • et al.
        Delays from first medical contact to antimicrobial administration for sepsis.
        Crit Care Med. 2017; 45: 759-765
        • Liu VX
        • Fielding-Singh V
        • Greene JD
        • et al.
        The timing of early antimicrobials and hospital mortality in sepsis.
        Am J Respir Crit Care Med. 2017; 196: 856-863
        • Wallgren UM
        • Antonsson VE
        • Castrén MK
        • et al.
        Longer time to antimicrobials and higher mortality among septic patients with non-specific presentations–a cross sectional study of emergency department patients indicating that a screening tool may improve identification.
        Scand J Trauma Resusc Emerg Med. 2016; 24: 1
        • Sterling SA
        • Miller WR
        • Pryor J
        • Puskarich MA
        • Jones AE
        The impact of timing of antimicrobials on outcomes in severe sepsis and septic shock: a systematic review and meta-analysis.
        Crit Care Med. 2015; 43: 1907-1915
        • de Groot B
        • Ansems A
        • Gerling DH
        • et al.
        The association between time to antimicrobials and relevant clinical outcomes in emergency department patients with various stages of sepsis: a prospective multi-center study.
        Crit Care. 2015; 19: 194
        • Ferrer R
        • Martin-Loeches I
        • Phillips G
        • et al.
        Empiric antimicrobial treatment reduces mortality in severe sepsis and septic shock from the first hour: results from a guideline-based performance improvement program.
        Crit Care Med. 2014; 42: 1749-1755
      2. International Classification of Diseases, Ninth Revision. Centers for Disease Control and Prevention. Accessed March 16, 2023. https://www.cdc.gov/nchs/icd/icd9.htm.

      3. Bennett TD, Russell S, King J, et al. Accuracy of the epic sepsis prediction model in a regional health system. Arxiv. Preprint posted online February 19, 2019. doi:10.48550/arXiv.1902.07276.

        • Wong A
        • Otles E
        • Donnelly JP
        • et al.
        External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients.
        JAMA Intern Med. 2021; 181: 1065-1070
        • Fernando SM
        • Tran A
        • Taljaard M
        • et al.
        Prognostic accuracy of the quick Sequential Organ Failure Assessment for mortality in patients with suspected infection: a systematic review and meta-analysis.
        Ann Intern Med. 2018; 168: 266-275
        • Habib AR
        • Lin AL
        • Grant RW
        The Epic Sepsis Model falls short-the importance of external validation.
        JAMA Int Med. 2021; 181: 1040-1041
        • Bone RC
        • Balk RA
        • Cerra FB
        • et al.
        Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis.
        Chest. 1992; 101 (The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine): 1644-1655
      4. International Statistical Classification of Diseases and Related Health Problems, Tenth Revision. World Health Organization; 2004.

        • Downing NL
        • Rolnick J
        • Poole SF
        • et al.
        Electronic health record-based clinical decision support alert for severe sepsis: a randomized evaluation.
        BMJ Qual Saf. 2019; 28: 762-768
        • Schootman M
        • Wiskow C
        • Loux T
        • et al.
        Evaluation of the effectiveness of an automated sepsis predictive tool on patient outcomes.
        J Crit Care. 2022; 71154061https://doi.org/10.1016/j.jcrc.2022.154061
        • Manaktala S
        • Claypool SR
        Evaluating the impact of computerized surveillance algorithm and decision support system on sepsis mortality.
        J Am Med Inform Assoc. 2017; 24: 88-795
        • Shimabukuro DW
        • Barton CW
        • Feldman MD
        • Mantaraso SJ
        • Das R
        Effect of a machine learning-based severe sepsis prediction algorithm on patient survival and hospital length of stay: a randomized clinical trial.
        BMJ Open Resp Res. 2017; 4e000234https://doi.org/10.1136/bmjresp-2017-000234
        • Guirgis FW
        • Jones L
        • Esma R
        • et al.
        Managing sepsis: electronic recognition, rapid response teams, and standardized care save lives.
        J Crit Care. 2018; 40: 296-302
        • Tarabichi Y
        • Cheng A
        • Bar-Shain D
        • et al.
        Improving timeliness of antimicrobial administration using a provider and pharmacist facing sepsis early warning system in the emergency department setting: a randomized controlled quality improvement initiative.
        Crit Care Med. 2022; 50: 418-427
        • Rhee C
        • Zhang Z
        • Kadri SS
        • et al.
        CDC Prevention Epicenters Program. Sepsis surveillance using adult sepsis events simplified eSOFA criteria versus Sepsis-3 Sequential Organ Failure Assessment criteria.
        Crit Care Med. 2019; 47: 307-314
      5. Hospital Toolkit for Adult Sepsis Surveillance. Centers for Disease Control and Prevention. Accessed October 25, 2021. https://www.cdc.gov/sepsis/pdfs/Sepsis-Surveillance-Toolkit-Aug-2018_508.pdf.

        • Dong R
        • Tian H
        • Zhou J
        • et al.
        External validity of Adult Sepsis Event's simplified eSOFA criteria: a retrospective analysis of patients with confirmed infection in China.
        Ann Intensive Care. 2020; 10: 14
        • Quan H
        • Li B
        • Couris CM
        • et al.
        Updating and validating the Charlson Comorbidity Index and score for risk adjustment in hospital discharge abstracts using data from 6 countries.
        Am J Epidemiol. 2011; 173: 676-682
        • Evans L
        • Rhodes A
        • Alhazzani W
        • et al.
        Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021.
        Crit Care Med. 2021; 49 (–43): e1063https://doi.org/10.1097/CCM.0000000000005337
        • Barbash IJ
        • Davis B
        • Kahn JM
        National performance on the Medicare SEP-1 Sepsis Quality Measure.
        Crit Care Med. 2019; 47: 1026-1032
        • Gesten F
        • Evans L
        SEP-1—taking the measure of a measure.
        JAMA Netw Open. 2021; 4e2138823
        • Rhee C
        • Yu T
        • Wang R
        • et al.
        Association between implementation of the severe sepsis and septic shock early management bundle performance measure and outcomes in patients with suspected sepsis in US hospitals.
        JAMA Netw Open. 2021; 4e2138596https://doi.org/10.1001/jamanetworkopen.2021.38596
        • van Buuren S
        • Groothuis-Oudshoorn K
        MICE: multivariate imputation by chained equations in R.
        J Stat Softw. 2011; 45
        • D'Agostino RB
        Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group.
        Stat Med. 1998; 17: 2265-2281
        • Yoshida K
        • Hernández-Díaz S
        • Solomon DH
        • et al.
        Matching weights to simultaneously compare three treatment groups: comparison to three-way matching.
        Epidemiology. 2017; 28: 387-395
        • Brookhart MA
        • Schneeweiss S
        • Rothman KJ
        • Glynn RJ
        • Avorn J
        • Stürmer T
        Variable selection for propensity score models.
        Am J Epidemiol. 2006; 163: 1149-1156
      6. Koenker R. quantreg: Quantile Regression. R package, version 5.88; 2022. Accessed XXX. https://CRAN.R-project.org/package=quantreg.

        • Hernán MÁ
        • Brumback B
        • Robins JM
        Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men.
        Epidemiology. 2000; 11: 561-570
        • Austin PC
        • Stuart EA
        Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies.
        Stat Med. 2015; 34: 3661-3679
        • Levy MM
        • Evans LE
        • Rhodes A
        The Surviving Sepsis campaign bundle: 2018 update.
        Intensive Care Med. 2018; 44: 925-928
        • Ancker JS
        • Edwards A
        • Nosal S
        • et al.
        Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system.
        BMC Med Inform Decis Mak. 2017; 17: 36
      7. Bermudez E, Warburton P. US Hospital EMR Market Share 2018. KLAS Report. Published May 24, 2018. Accessed March 25, 2021. https://klasresearch.com/report/us-hospital-emr-market-share-2018/1279.

      8. Spitzer J. All of US News' top 20 hospitals use Epic. Becker's Hospital Review. Published August 16, 2018. Accessed March 25, 2021. https://www.beckershospitalreview.com/ehrs/all-of-us-news-top-20-hospitals-use-epic.html.