Advertisement

Validation of the Pediatric Appendicitis Risk Calculator (pARC) in a Community Emergency Department Setting

      Study objective

      The pediatric Appendicitis Risk Calculator (pARC) is a validated clinical tool for assessing a child’s probability of appendicitis. Our objective was to assess the performance of the pARC in community emergency departments (EDs) and to compare its performance with that of the Pediatric Appendicitis Score (PAS).

      Methods

      We conducted a prospective validation study from October 1, 2016, to April 30, 2018, in 11 community EDs serving general populations. Patients aged 5 to 20.9 years and with a chief complaint of abdominal pain and less than or equal to 5 days of right-sided or diffuse abdominal pain were eligible for study enrollment. Our primary outcome was the presence or absence of appendicitis within 7 days of the index visit. We reported performance characteristics and secondary outcomes by pARC risk strata and compared the receiver operator characteristic (ROC) curves of the PAS and pARC.

      Results

      We enrolled 2,089 patients with a mean age of 12.4 years, 46% of whom were male patients. Appendicitis was confirmed in 353 patients (16.9%), of whom 55 (15.6%) had perforated appendixes. Fifty-four percent of patients had very low (<5%) or low (5% to 14%) predicted risk, 43% had intermediate risk (15% to 84%), and 4% had high risk (≥85%). In the very-low- and low-risk groups, 1.4% and 3.0% of patients had appendicitis, respectively. The area under the ROC curve was 0.89 (95% confidence interval 0.87 to 0.92) for the pARC compared with 0.80 (95% confidence interval 0.77 to 0.82) for the PAS.

      Conclusion

      The pARC accurately assessed appendicitis risk for children aged 5 years and older in community EDs and the pARC outperformed the PAS.
      To read this article in full you will need to make a payment
      ACEP Member Login
      ACEP Members, full access to the journal is a member benefit. Use your society credentials to access all journal content and features.
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Purchase one-time access:

      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Scholer S.J.
        • Pituch K.
        • Orr D.P.
        • et al.
        Clinical outcomes of children with acute abdominal pain.
        Pediatrics. 1996; 98: 680-685
        • Rothrock S.G.
        • Skeoch G.
        • Rush J.J.
        • et al.
        Clinical features of misdiagnosed appendicitis in children.
        Ann Emerg Med. 1991; 20: 45-50
        • Rasmussen T.
        • Fonnes S.
        • Rosenberg J.
        Long-term complications of appendectomy: a systematic review.
        Scand J Surg. 2018; 107: 189-196
        • Hale D.A.
        • Molloy M.
        • Pearl R.H.
        • et al.
        Appendectomy: a contemporary appraisal.
        Ann Surg. 1997; 225: 252-261
        • Becker T.
        • Kharbanda A.
        • Bachur R.
        Atypical clinical features of pediatric appendicitis.
        Acad Emerg Med. 2007; 14: 124-129
        • Russell W.S.
        • Schuh A.M.
        • Hill J.G.
        • et al.
        Clinical practice guidelines for pediatric appendicitis evaluation can decrease computed tomography utilization while maintaining diagnostic accuracy.
        Pediatr Emerg Care. 2013; 29: 568-573
        • Bachur R.G.
        • Hennelly K.
        • Callahan M.J.
        • et al.
        Advanced radiologic imaging for pediatric appendicitis, 2005-2009: trends and outcomes.
        J Pediatr. 2012; 160: 1034-1038
        • Kobayashi E.
        • Johnson B.
        • Goetz K.
        • et al.
        Does the implementation of a pediatric appendicitis pathway promoting ultrasound work outside of a children's hospital?.
        Am J Surg. 2018; 215: 917-920
        • Kharbanda A.B.
        • Madhok M.
        • Krause E.
        • et al.
        Implementation of electronic clinical decision support for pediatric appendicitis.
        Pediatrics. 2016; 137: e20151745
        • Garcia Peña B.M.
        • Cook E.F.
        • Mandl K.D.
        Selective imaging strategies for the diagnosis of appendicitis in children.
        Pediatrics. 2004; 113: 24-28
        • Stephen A.E.
        • Segev D.L.
        • Ryan D.P.
        • et al.
        The diagnosis of acute appendicitis in a pediatric population: to CT or not to CT.
        J Pediatr Surg. 2003; 38 (discussion 367-371): 367-371
        • Partrick D.A.
        • Janik J.E.
        • Janik J.S.
        • et al.
        Increased CT scan utilization does not improve the diagnostic accuracy of appendicitis in children.
        J Pediatr Surg. 2003; 38: 659-662
        • Lee S.L.
        • Walsh A.J.
        • Ho H.S.
        Computed tomography and ultrasonography do not improve and may delay the diagnosis and treatment of acute appendicitis.
        Arch Surg. 2001; 136: 556-562
        • Miglioretti D.L.
        • Johnson E.
        • Williams A.
        • et al.
        The use of computed tomography in pediatrics and the associated radiation exposure and estimated cancer risk.
        JAMA Pediatr. 2013; 167: 700-707
        • Brenner D.
        • Elliston C.
        • Hall E.
        • et al.
        Estimated risks of radiation-induced fatal cancer from pediatric CT.
        AJR Am J Roentgenol. 2001; 176: 289-296
        • Kotagal M.
        • Richards M.K.
        • Flum D.R.
        • et al.
        Use and accuracy of diagnostic imaging in the evaluation of pediatric appendicitis.
        J Pediatr Surg. 2015; 50: 642-646
        • Kotagal M.
        • Richards M.K.
        • Chapman T.
        • et al.
        Improving ultrasound quality to reduce computed tomography use in pediatric appendicitis: the Safe and Sound campaign.
        Am J Surg. 2015; 209 (discussion 900): 896-900
        • Kharbanda A.B.
        • Vazquez-Benitez G.
        • Ballard D.W.
        • et al.
        Development and validation of a novel pediatric appendicitis risk calculator (pARC).
        Pediatrics. 2018; 14: e20172699
        • Bachur R.G.
        • Hennelly K.
        • Callahan M.J.
        • et al.
        Diagnostic imaging and negative appendectomy rates in children: effects of age and gender.
        Pediatrics. 2012; 129: 877-884
        • Mandeville K.
        • Pottker T.
        • Bulloch B.
        • et al.
        Using appendicitis scores in the pediatric ED.
        Am J Emerg Med. 2011; 29: 972-977
        • Gausche-Hill M.
        • Schmitz C.
        • Lewis R.J.
        Pediatric preparedness of US emergency departments: a 2003 survey.
        Pediatrics. 2007; 120: 1229-1237
        • Maguire J.L.
        • Kulik D.M.
        • Laupacis A.
        • et al.
        Clinical prediction rules for children: a systematic review.
        Pediatrics. 2011; 128: e666-e677
        • Gordon N.
        • Lin T.
        The Kaiser Permanente Northern California adult member health survey.
        Perm J. 2016; 20: 34-42
        • Bornstein S.
        An integrated EHR at Northern California Kaiser Permanente: pitfalls, challenges, and benefits experienced in transitioning.
        Appl Clin Inform. 2012; 3: 318-325
        • Lieu T.A.
        • Platt R.
        Applied research and development in health care: time for a frameshift.
        N Engl J Med. 2017; 376: 710-713
        • Ballard D.W.
        • Vemula R.
        • Chettipally U.K.
        • et al.
        Optimizing clinical decision support in the electronic health record. Clinical characteristics associated with the use of a decision tool for disposition of ED patients with pulmonary embolism.
        Appl Clin Inform. 2016; 7: 883-898
        • Vinson D.R.
        • Mark D.G.
        • Chettipally U.K.
        • et al.
        Increasing safe outpatient management for emergency department patients with pulmonary embolism: a controlled pragmatic trial.
        Ann Intern Med. 2018; 169: 855-865
        • Simon L.E.
        • Rauchwerger A.S.
        • Chettipally U.K.
        • et al.
        Real-time text message alerts to emergency physicians identifying potential study candidates increases clinical trial enrollment.
        J Patient Cent Res Rev. 2018; 5: 57
        • Kaji A.H.
        • Schriger D.
        • Green S.
        Looking through the retrospectoscope: reducing bias in emergency medicine chart review studies.
        Ann Emerg Med. 2014; 64: 292-298
        • Samuel M.
        Pediatric appendicitis score.
        J Pediatr Surg. 2002; 37: 877-881
        • Steyerberg E.W.
        • Borsboom G.J.
        • van Houwelingen H.C.
        • et al.
        Validation and updating of predictive logistic regression models: a study on sample size and shrinkage.
        Stat Med. 2004; 23: 2567-2586
        • Altman D.G.
        • Vergouwe Y.
        • Royston P.
        • et al.
        Prognosis and prognostic research: validating a prognostic model.
        BMJ. 2009; 338: b605
        • Altman D.G.
        • Royston P.
        What do we mean by validating a prognostic model?.
        Stat Med. 2000; 19: 453-473
        • Jamoom E.
        • Hing E.
        Progress with electronic health record adoption among emergency and outpatient departments: United States, 2006-2011.
        NCHS Data Brief. 2015; : 1-8
        • Bennett P.
        • Hardiker N.R.
        The use of computerized clinical decision support systems in emergency care: a substantive review of the literature.
        J Am Med Inform Assoc. 2017; 24: 655-668
        • Varghese J.
        • Kleine M.
        • Gessner S.I.
        • et al.
        Effects of computerized decision support system implementations on patient outcomes in inpatient care: a systematic review.
        J Am Med Inform Assoc. 2018; 25: 593-602
        • Parikh R.B.
        • Kakad M.
        • Bates D.W.
        Integrating predictive analytics into high-value care: the dawn of precision delivery.
        JAMA. 2016; 315: 651-652
        • Stiell I.G.
        • Wells G.A.
        Methodologic standards for the development of clinical decision rules in emergency medicine.
        Ann Emerg Med. 1999; 33: 437-447
        • Almaramhy H.H.
        Acute appendicitis in young children less than 5 years: review article.
        Ital J Pediatr. 2017; 43: 15
        • Hamid K.A.
        • Mohamed M.A.
        • Salih A.
        Acute appendicitis in young children: a persistent diagnostic challenge for clinicians.
        Cureus. 2018; 10: e2347
        • Altali K.
        • Ruiz-Artacho P.
        • Trenchs V.
        • et al.
        [Hospital emergency room diagnosis of acute appendicitis in patients aged 2 to 20 years: the INFURG-SEMES score from the emergency infections study of the Spanish Society of Emergency Medicine].
        Emergencias. 2017; 29: 231-236
        • Aydin D.
        • Turan C.
        • Yurtseven A.
        • et al.
        Integration of radiology and clinical score in pediatric appendicitis.
        Pediatr Int. 2018; 60: 173-178
        • Green S.M.
        • Schriger D.L.
        • Yealy D.M.
        Methodologic standards for interpreting clinical decision rules in emergency medicine: 2014 update.
        Ann Emerg Med. 2014; 64: 286-291
        • Benabbas R.
        • Hanna M.
        • Shah J.
        • et al.
        Diagnostic accuracy of history, physical examination, laboratory tests, and point-of-care ultrasound for pediatric acute appendicitis in the emergency department: a systematic review and meta-analysis.
        Acad Emerg Med. 2017; 24: 523-551
        • Bhatt M.
        • Joseph L.
        • Ducharme F.M.
        • et al.
        Prospective validation of the Pediatric Appendicitis Score in a Canadian pediatric emergency department.
        Acad Emerg Med. 2009; 16: 591-596
        • Ebell M.H.
        • Shinholser J.
        What are the most clinically useful cutoffs for the Alvarado and Pediatric Appendicitis Scores? a systematic review.
        Ann Emerg Med. 2014; 64: 365-372.e362
        • Escriba A.
        • Gamell A.M.
        • Fernandez Y.
        • et al.
        Prospective validation of two systems of classification for the diagnosis of acute appendicitis.
        Pediatr Emerg Care. 2011; 27: 165-169
        • Goldman R.D.
        • Carter S.
        • Stephens D.
        • et al.
        Prospective validation of the Pediatric Appendicitis Score.
        J Pediatr. 2008; 153: 278-282
        • Pogorelic Z.
        • Rak S.
        • Mrklic I.
        • et al.
        Prospective validation of Alvarado score and Pediatric Appendicitis Score for the diagnosis of acute appendicitis in children.
        Pediatr Emerg Care. 2015; 31: 164-168
        • Dahabreh I.J.
        • Adam G.P.
        • Halladay C.W.
        • et al.
        Diagnosis of right lower quadrant pain and suspected acute appendicitis.
        AHRQ Comparative Effectiveness Reviews. 2015; 15 (EHC025-EF)
        • Kulik D.M.
        • Uleryk E.M.
        • Maguire J.L.
        Does this child have appendicitis? a systematic review of clinical prediction rules for children with acute abdominal pain.
        J Clin Epidemiol. 2013; 66: 95-104
        • Ohmann C.
        • Yang Q.
        • Franke C.
        Diagnostic scores for acute appendicitis. Abdominal Pain Study Group.
        Eur J Surg. 1995; 161: 273-281
        • Carmelli G.
        • Grock A.
        • Picart E.
        • et al.
        The nitty-gritty of clinical decision rules.
        Ann Emerg Med. 2018; 71: 711-713
        • Ekstrom H.L.
        • Kharbanda E.O.
        • Ballard D.W.
        • et al.
        Development of a clinical decision support system for pediatric abdominal pain in emergency department settings across two health systems within the Healthcare Systems Research Network.
        EGEMS (Wash DC). 2019; 7: 15
        • Bendeck S.E.
        • Nino-Murcia M.
        • Berry G.J.
        • et al.
        Imaging for suspected appendicitis: negative appendectomy and perforation rates.
        Radiology. 2002; 225: 131-136
        • Kosloske A.M.
        • Love C.L.
        • Rohrer J.E.
        • et al.
        The diagnosis of appendicitis in children: outcomes of a strategy based on pediatric surgical evaluation.
        Pediatrics. 2004; 113: 29-34
        • Xu J.
        • Adams S.
        • Liu Y.C.
        • et al.
        Nonoperative management in children with early acute appendicitis: a systematic review.
        J Pediatr Surg. 2017; 52: 1409-1415