Annals of Emergency Medicine
Volume 52, Issue 3 , Pages 204-210.e8 , September 2008

Assessment of the Reliability of the Johns Hopkins/Agency for Healthcare Research and Quality Hospital Disaster Drill Evaluation Tool

  • Amy H. Kaji, MD, MPH

      Affiliations

    • Department of Emergency Medicine, Harbor–UCLA Medical Center, Torrance, CA
    • David Geffen School of Medicine at UCLA, Los Angeles, CA
    • Los Angeles Biomedical Research Institute, Torrance, CA
    • The South Bay Disaster Resource Center at Harbor–UCLA Medical Center, Los Angeles, CA
    • Corresponding Author InformationAddress for correspondence: Amy H. Kaji, MD, MPH, Department of Emergency Medicine, Harbor–UCLA Medical Center, 1000 West Carson Street, Box 21, Torrance, CA 90509; 310-222-3500, fax 310-782-1763
    • ,
  • Roger J. Lewis, MD, PhD

      Affiliations

    • Department of Emergency Medicine, Harbor–UCLA Medical Center, Torrance, CA
    • David Geffen School of Medicine at UCLA, Los Angeles, CA
    • Los Angeles Biomedical Research Institute, Torrance, CA

Received 13 April 2007 ,Revised 24 July 2007 ,Accepted 31 July 2007.

References 

  1. The Joint Commission. http://www.JCAHO.orgAccessed April 2, 2007
  2. Levi L, Bregman D, Geva H, et al. Hospital disaster management simulation system. Prehosp Disaster Med. 1998;13:29–34
  3. Gofrit ON, Leibovici D, Shemer J, et al. The efficacy of integrating “smart simulated casualties” in hospital disaster drills. Prehosp Disaster Med. 1997;12:97–101
  4. Levy K, Aghababian RV, Hirsche EF, et al. An Internet-based exercise as a component of an overall training program addressing medical aspects of radiation emergency management. Prehosp Disaster Med. 2000;15:18–25
  5. Evaluation of Hospital Disaster Drills: A Module-Based Approach. Prepared for the Agency for Healthcare Research and Quality. Contract No. 290-02-0018, and prepared by the Johns Hopkins University Evidence-based Practice Center, the Johns Hopkins University Bloomberg School of Public Health, and the Johns Hopkins University Applied Physics Laboratory, April 2004.
  6. Training of hospital staff to respond to a mass casualty incident. http://www.ahcpr.gov/clinic/epcix.htmAccessed on April 2, 2007
  7. Visit http://www.emsa.cahwnet.gov/dms2/download.htmAccessed on April 2, 2007
  8. http://www.ambpeds.org/ReliabilityandValidity.pdfAccessed on April 2, 2007
  9. http://www.emsa.cahwnet.gov/dms2/hospambex.aspAccessed on April 2, 2007
  10. http://www.nhs.gov/aspr/opeo/hppAccessed on April 2, 2007
  11. Hatcher L. A Step-By-Step Approach Using the SAS(R) System for Factor Analysis and Structural Equation Modeling. Cary, NC: SAS Institute.
  12. Yu CH. An introduction to computing and interpreting Cronbach coefficient alpha in SAS (Statistics, data analysis, and data mining). http://www.creative-wisdom.com/pub/cronbach.htmlAccessed April 2, 2007
  13. Nunnaly J. Psychometric Theory. New York, NY: McGraw-Hill Publishing; 1978;
  14. Santos JR. Cronbach's alpha: a tool for assessing the reliability of scales. http://www.joe.org/joe/1999april/tt3.htmlAccessed April 2, 2007
  15. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–333
  16. Iacobucci D, Duhacek A. Advancing alpha: measuring reliability with confidence. J Consumer Psychol. 2003;13:478–487
  17. Ebel RL. Estimation of the reliability of ratings. Psychometrika. 1951;16:407–424
  18. Duhachek A, Coughlan AT, Iacobucci D. Results on the standard error of the coefficient alpha index of reliability. Market Sci. 2005;24:294–301
  19. Thompson WD, Walter SD. Variance and dissent (A reappraisal of the kappa coefficient). J Clin Epidemiol. 1988;41:949–958
  20. Thompson WD. Kappa and attenuation of the odds ratio. Epidemiology. 1990;1:357–369
  21. Gwet K. Kappa statistic is not satisfactory for assessing the extent of agreement between raters. http://www.msu.edu/course/psy/818/deshon/Projects/Project 2/generalized kappa.docAccessed September 6, 2007

 Supervising editor: Jonathan L. Burstein, MD

 Author contributions: AHK and RJL conceived and designed the study, obtained research funding, supervised the conduct of the data collection, had full access to the data, and take full responsibility for the integrity of the data and the accuracy of the data analysis. AHK undertook recruitment of participating centers and managed the data. AHK and RJL analyzed the data. AHK drafted the article, and both authors contributed substantially to its revision. AHK takes responsibility for the paper as a whole.

 Funding and support: By Annals policy, all authors are required to disclose any and all commercial, financial, and other relationships in any way related to the subject of this article, that might create any potential conflict of interest. The authors have stated that no such relationships exist. See the Manuscript Submission Agreement in this issue for examples of specific conflicts covered by this statement.

 Publication dates: Available online October 15, 2007.

 Reprints not available from the authors.

PII: S0196-0644(07)01440-0

doi: 10.1016/j.annemergmed.2007.07.025

Annals of Emergency Medicine
Volume 52, Issue 3 , Pages 204-210.e8 , September 2008

Article Tools