The Quality of Medical Record Review Studies in the International Emergency Medicine Literature
Study objective
We assess the methodologic quality of studies using medical record review methodology in 4 international emergency medicine journals. A secondary aim was to compare methodology quality among these journals and across years.
Methods
This was an observational study of articles whose main methodology was medical record review published in Academic Emergency Medicine (AEM), Annals of Emergency Medicine (Annals), Emergency Medicine Journal (EMJ), and Emergency Medicine Australasia (EMA) between January 2002 and May 2004. Eligible articles were reviewed for reporting of a clear hypothesis or objective, training of abstractors, defined inclusion and exclusion criteria, use of a standard abstraction form, definition of important variables, monitoring of abstractor performance, blinding of abstractors to study hypothesis, reporting of interrater reliability, sample size or power calculation, reporting of ethics approval or waiver, and disclosure of funding source. The primary outcome was the proportion of articles meeting each criterion. Secondary outcomes were comparison of the proportions of articles meeting each criterion among journals and by years.
Results
One hundred seven articles were analyzed; 31 were published in AEM, 29 in Annals, 29 in EMJ, and 18 in EMA. A clear aim was reported in 93% of articles, standardized abstraction forms were reported in 51%, interrater reliability was reported in 25%, ethics approval or waiver was reported in 68%, and sample size or power calculation was reported in 10%.
Conclusion
Adherence to the quality criteria for medical record reviews was suboptimal, and there were significant differences among journals in overall methodologic quality.
Author contributions: AMK and DB conceived the study. AMK designed the data collection instrument. AMK and DK identified qualifying papers. DK, DB, and TR performed the data collection and data entry. AMK and DK performed the data analysis. AMK and DB wrote the draft manuscript. All authors contributed to data interpretation and the final manuscript. AMK takes responsibility for the paper as a whole.Funding and support: The authors report this study did not receive any outside funding or support.Reprints not available from the authors.
PII: S0196-0644(04)01685-3
doi:10.1016/j.annemergmed.2004.11.011
© 2005 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.
