The First National Institutes of Health Institutional Training Program in Emergency Care Research: Productivity and Outcomes

      Study objective

      We assess the productivity, outcomes, and experiences of participants in the National Institutes of Health/National Heart, Lung, and Blood Institute–funded K12 institutional research training programs in emergency care research.


      We used a mixed-methods study design to evaluate the 6 K12 programs, including 2 surveys, participant interviews, scholar publications, grant submissions, and funded grants. The training program lasted from July 1, 2011, through June 30, 2017. We tracked scholars for a minimum of 3 years and up to 5 years, beginning with date of entry into the program. We interviewed program participants by telephone using open-ended prompts.


      There were 94 participants, including 43 faculty scholars, 13 principal investigators, 30 non–principal investigator primary mentors, and 8 program administrators. The survey had a 74% overall response rate, including 95% of scholars. On entry to the program, scholars were aged a median of 37 years (interquartile range [IQR] 34 to 40 years), with 16 women (37%), and represented 11 disciplines. Of the 43 scholars, 40 (93%) submitted a career development award or research project grant during or after the program; 26 (60%) have secured independent funding as of August 1, 2017. Starting with date of entry into the program, the median time to grant submission was 19 months (IQR 11 to 27 months) and time to funding was 33 months (IQR 27 to 39 months). Cumulative median publications per scholar increased from 7 (IQR 4 to 15.5) at program entry to 21 (IQR 11 to 33.5) in the first post-K12 year. We conducted 57 semistructured interviews and identified 7 primary themes.


      This training program produced 43 interdisciplinary investigators in emergency care research, with demonstrated productivity in grant funding and publications.
      To read this article in full you will need to make a payment
      ACEP Member Login
      ACEP Members, full access to the journal is a member benefit. Use your society credentials to access all journal content and features.
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Purchase one-time access:

      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


      1. National Heart, Lung, and Blood Institute. Training and career development. Available at: Accessed July 13, 2017.

      2. Institute of Medicine. Emergency Care for Children: Growing Pains. Washington, DC: National Academies Press; 2006.

        • Institute of Medicine; Committee on the Future of Emergency Care in the United States Health System
        Emergency Medical Services: At the Crossroads.
        National Academies Press, Washington, DC2006
        • Institute of Medicine; Committee on the Future of Emergency Care in the United States Health System
        Hospital-Based Emergency Care: At the Breaking Point.
        National Academies Press, Washington, DC2006
        • Cairns C.B.
        • Maier R.V.
        • Adeoye O.
        • et al.
        NIH roundtable on emergency trauma research.
        Ann Emerg Med. 2010; 56: 538-550
        • D'Onofrio G.
        • Jauch E.
        • Jagoda A.
        • et al.
        NIH roundtable on opportunities to advance research on neurologic and psychiatric emergencies.
        Ann Emerg Med. 2010; 56: 551-564
        • Kaji A.H.
        • Lewis R.J.
        • Beavers-May T.
        • et al.
        Summary of NIH Medical-Surgical Emergency Research Roundtable held on April 30 to May 1, 2009.
        Ann Emerg Med. 2010; 56: 522-537
        • Hutchins B.I.
        • Yuan X.
        • Anderson J.M.
        • et al.
        Relative Citation Ratio (RCR): a new metric that uses citation rates to measure influence at the article level.
        PLoS Biol. 2016; 14: e1002541
      3. National Institutes of Health. iCite bibliometric software. Available at: Accessed September 25, 2017.

        • Wasserman S.F.
        Social Networks Analysis: Methods and Applications.
        Cambridge University Press, Cambridge, UK1994
        • Anderson J.G.
        Evaluation in health informatics: social network analysis.
        Comput Biol Med. 2002; 32: 179-193
        • Miles M.B.
        • Huberman A.M.
        • Saldana J.
        Qualitative Data Analysis.
        Sage Publications, Thousand Oaks, CA2013
        • Tong A.
        • Sainsbury P.
        • Craig J.
        Consolidated Criteria for Reporting Qualitative Research (COREQ): a 32-item checklist for interviews and focus groups.
        Int J Qual Health Care. 2007; 19: 349-357
      4. National Institutes of Health. Funding success rates. Available at: Accessed December 6, 2017.

        • Brown J.
        National Institutes of Health support for clinical emergency care research, 2011 to 2014.
        Ann Emerg Med. 2016; 68: 164-171
      5. National Institutes of Health. NIH success rate definition. Available at: Accessed May 24, 2018.

        • Nishijima D.K.
        • Yadav K.
        • May L.
        • et al.
        • Society for Academic Emergency Medicine Research Committee
        Description and productivity of emergency medicine researchers receiving K23 or K08 mentored research career development awards.
        Acad Emerg Med. 2013; 20: 611-617
      6. National Institutes of Health. Average age of new investigators at initial R01 equivalent award, 1980-2016; chart 440-16-1. Available at: Accessed May 29, 2018.

        • Mumma B.E.
        • Chang A.M.
        • Kea B.
        • et al.
        • Society for Academic Emergency Medicine Research Committee
        Career development awards in emergency medicine: resources and challenges.
        Acad Emerg Med. 2017; 24: 855-863
        • Duckworth A.
        Grit: The Power of Passion and Perseverance.
        Scribner, New York, NY2016