|
There was substantial variation between sites and countries in all intervals (Table 1). Across the 10 sites, the median (IQR) intervals were activation 0.98 minutes (0.27 to 1.62 minutes), response 4.28 minutes (3.00 to 6.30 minutes), on-scene 19.0 minutes (13.4 to 26.0 minutes), transport 10.0 minutes (6.37 to 15.30 minutes), and total EMS time 36.3 minutes (28.4 to 47.0 minutes). Distribution of total EMS time is illustrated in Figure 2. Descriptive characteristics of the cohort, by quartiles of total time, are listed in Table 2. Depressed GCS score and hypotension (SBP ≤90 mm Hg) appeared more common among patients with the shortest EMS times, though other physiologic measures were similar across quartiles. The proportion of tracheal intubations attempted, median age, women, air medical transport, blunt injury, and unadjusted survival all increased with increasing total EMS times.
Main ResultsIn the multivariable logistic regression model, total EMS time was not associated with mortality (odds ratio [OR] for every minute of total time 1.00; 95% confidence interval [CI] 0.99 to 1.01) (Table 3). When the sample was assessed with 10-minute increments for total EMS time, there was no evidence of increased mortality with increasing field times (OR 0.90; 95% CI 0.80 to 1.02). Similar results were obtained when total times were grouped by quartile (OR 0.95; 95% CI 0.83 to 1.08). We were also unable to demonstrate independent associations between mortality and any other EMS interval for the overall sample (Table 4). When total EMS time was dichotomized to compare patients with greater than 60 minutes to those with less than or equal to 60 minutes, there was no association with mortality (OR 1.11; 95% CI 0.70 to 1.77). Categorization of total EMS time into quartiles did not suggest a threshold effect between time and mortality (quartile 1=reference; quartile 2=OR 0.69, 95% CI 0.47 to 1.00; quartile 3=OR 0.77, 95% CI 0.53 to 1.13; quartile 4=OR 0.81, 95% CI 0.54 to 1.21). For categorized response interval, there was no association with mortality for patients with a 4- to 8-minute interval (OR 0.95; 95% CI 0.71 to 1.25) or greater than 8-minute interval (OR 1.22; 95% CI 0.80 to 1.85) compared with patients with a response less than 4 minutes. Two-step instrumental variable analyses were used only in subgroup analyses (described below) because the correlation between distance and time was low (F test <10) for all intervals using the primary sample. These results did not qualitatively change when the “worst” physiologic values were used in place of initial values (data not shown). The primary model was well fit (Hosmer-Lemeshow goodness of fit statistic P=.80). There was no evidence of effect modification between any interval and clinical variables (all interactions P>.05).
Adjusted ORs for mortality among the subgroups are presented in Table 4. In multivariable logistic regression models, there was no demonstrable association between time and mortality for any subgroup. The only subgroup that met criteria for using instrumental variable analyses to assess total EMS time was trauma patients transported in the United States (F statistic 46.4), and these results were not qualitatively different (OR 1.00; 95% CI 0.997 to 1.001). Sensitivity AnalysisUsing a random-effects model with sites as clusters, the lack of association between total EMS time and mortality persisted (OR 0.99; 95% CI 0.999 to 1.0003). In a hierarchical, non-nested linear probability model integrating EMS agencies (up to 2) and hospital as clusters, there remained no association between total EMS time and mortality (linear probability estimate −0.0004; 95% CI −.001 to 0.0003). When the sample was expanded to include injured adults transported to all types of hospitals (restricted to those with outcomes available; n=5,356), there remained no association between total EMS time and mortality (OR 1.00 per minute; 95% CI 0.99 to 1.00), or between other intervals and mortality (data not shown). Among the 460 children transported to Level I or II trauma centers with outcome information available, there was no association between mortality and total EMS time or other intervals (data not shown). Of the 1,385 patients who died at the scene after injury, there were 914 adults with interval data available for analysis. Of these patients, 722 (79%) were declared dead without attempted resuscitation, 130 (14%) had attempted resuscitation with no documented vital signs, and 62 (7%) had attempted resuscitation with documented initial vital signs. The median (IQR) activation and response intervals for patients who died in the field were 1.00 minute (0.43 to 1.67 minutes) and 4.92 minutes (3.27 to 7.38 minutes) for those without resuscitation; 1.03 minutes (0.58 to 1.67 minutes) and 5.00 minutes (3.62 to 7.69 minutes) for patients with resuscitation attempted and no vital signs; and 1.00 minute (0.32 to 1.57 minutes) and 4.58 minutes (3.40 to 7.33 minutes) for patients with resuscitation attempted and initial measurable vital signs. These intervals were slightly longer than the median activation interval (0.98 minutes; IQR 0.27 to 1.62 minutes) and response interval (4.28 minutes; IQR 3.00 to 6.30 minutes) for patients transported to a hospital (P<.001). When we reevaluated the multivariable models with both the primary sample and patients who died in the field after attempted resuscitation, there remained no statistical association between time and mortality for activation (OR 1.00; 95% CI 0.97 to 1.04) or response (OR 1.00; 95% CI 0.99 to 1.04) intervals. These results persisted when all patients who died in the field (with or without a resuscitation attempt) were included in the models (data not shown). LimitationsPrevious studies have demonstrated an apparent association between increasing out-of-hospital time and decreased mortality (ie, the appearance that longer times decrease mortality),7, 8, 9, 10, 16 even after accounting for injury severity. This phenomenon is at least partly explained by EMS providers moving and driving faster for patients believed to have serious injury and spending more time on calls with patients recognized as having minor injury (ie, less urgency to get such patients to a hospital). The association between increasing injury severity and decreased on-scene and transport intervals has been previously demonstrated.6, 7, 44 This type of confounding, which is unlikely to be fully accounted for with available variables (ie, unmeasured confounding), was the primary reason we considered instrumental variable models in addition to logistic regression. Although the instrumental variables strategy ultimately could not be used for most analyses, the subgroup analysis that met criteria for such analysis generated results similar to those of logistic regression models. Detailed hospital-based information, including measures of injury severity (eg, Injury Severity Score), was not available in the Resuscitation Outcomes Consortium Epistry-Trauma database. We used field-based information to adjust for confounding by injury severity, though it is possible that these measures did not fully account for such relationships. We also did not have longer term (eg, 30-day survival) or functional outcomes for these patients, either of which may have altered the results. In addition, the exclusion of patients enrolled in the concurrent clinical trial and those with missing data could have introduced bias to the results. There was substantial variability in intervals between sites and heterogeneity in our patient population. Such differences likely reflect geographic variation (eg, rural land mass), variability in EMS agencies, EMS system differences, population variation in injury mechanisms (eg, penetrating trauma), and response to injury, plus other factors. A large meta-analysis similarly demonstrated time differences among trauma patients cared for by urban/suburban versus rural ground ambulance crews, especially for activation, response, and transport intervals.45 Although the inclusion criteria were designed to reduce heterogeneity and isolate a field-identified high-risk trauma population, some variability between patients and sites was unavoidable. This variability may have further reduced our ability to demonstrate an association between time and outcome, though we believe inclusion of such a broad and heterogeneous group of sites increased the generalizability of our findings. In addition to variation in intervals, there was also likely variation in field care, hospital care, and injury characteristics between sites, EMS agencies, and hospitals. We attempted to account for this possibility by using fixed-effects models, with sites as clusters. There was likely clustering present on many levels (eg, EMS agencies, hospitals, providers), with overlap between clusters (non-nested), which produced challenges in fully accounting for such potentially correlated data. However, different model specification (ie, hierarchical) to account for non-nested multilevel clustering (ie, EMS agency, hospital) and using random-effects models did not qualitatively change our study results. It is also possible that addressing the study question using sites with mature EMS systems and relatively short EMS intervals could have suppressed a demonstrable association between time and outcome. That is, most patients had a total EMS time well below 60 minutes, which may have precluded the ability to fully test the “golden hour” premise based on a 60-minute cut point. A nonlinear relationship between time and outcome could also exist, though categorical terms for the total EMS interval and response interval did not suggest such a relationship. The duration of time from EMS dispatch through delivery to the receiving hospital represents only a portion of the time from actual injury event to definitive care. We did not know the time of injury and were therefore unable to measure the interval from injury onset to hospital arrival, which may represent a critical window for a small portion of patients (eg, those who die in the field). Our definition for total EMS time and the “golden hour” in this study was based on the assumption that the time between injury onset and 911 notification was short, though this may not have been the case with all patients (eg, unwitnessed injury events, rural areas, lack of immediate telephone access, or call coverage). Time to hospital arrival may also be different from the time to definitive care (eg, for patients requiring operative intervention or other important hospital-based interventions), which may also have affected the ability to demonstrate an association between time and outcome. Finally, the use of instrumental variable analysis is predicated on having an available instrument that fulfills all the required criteria and assumptions. Unfortunately, after geocoding of all injury census tracts to generate the distance measure in this sample, distance did not ultimately have a strong correlation with EMS intervals. There was only one subgroup that met our predefined criteria to use distance as an instrument (F test >10), and this analysis produced similar results to those from logistic regression models. Despite the fact that we could use instrumental variable methods in only a small portion of the analysis, we believe these results support our overall findings of no demonstrable association between time and outcome. DiscussionIn this study, we were unable to support the contention that shorter out-of-hospital times (as measured from receipt of 911 call to hospital arrival) improve survival among injured adults with field-based physiologic abnormality. This finding persisted across many subgroups, including level of first responding EMS provider, mode of transport, country, age, injury type, and more severe physiologic derangement. Our findings are consistent with those of previous studies that similarly have failed to demonstrate a relationship between out-of-hospital time and outcome using different patient populations, trauma and EMS systems, regions, data sources, and confounders.4, 5, 6, 7, 8, 9, 10 However, we believe our findings are unique because of the field-based inclusion criteria for a recognized high-risk subset of injured patients, the sampling design of Epistry (population-based data from a large number of EMS agencies and sites across North America), sensitivity analyses that included deaths in the field and non–trauma center patients, and rigorous data collection for EMS times that accounted for multiple EMS agencies caring for the same patient. It is possible that other factors, such as unmeasured confounders, selection bias, statistical approach, inclusion criteria, intervals assessed, or heterogeneity in the sample (variance), precluded our ability to show such an association. Although it is likely that minutes do affect outcome for certain severely injured individuals, demonstrating this relationship across a field-defined population of injured persons using EMS intervals has generally produced inconclusive results. The 2 previous studies from Quebec suggesting an association between total out-of-hospital time and mortality were conducted with retrospectively defined samples of seriously injured patients2, 3 and have not been replicated in other settings. Although a cornerstone of trauma systems, the “golden hour” premise has proven challenging to consistently demonstrate across larger samples of trauma patients and specific EMS intervals. One must also consider the possibility that assessing the influence of EMS time on outcome is not feasible through an observational study design because of inherent forms of bias and unmeasured confounding. Because more rigorous study designs (ie, randomized controlled trials or quasi-experimental designs) are generally not practical, feasible, or ethical for addressing this study question, adequately testing the hypothesis that shorter intervals improve outcomes may not be possible. The only condition in which rapid EMS response has been shown to consistently improve survival is nontraumatic cardiac arrest.18, 19 Although several studies have demonstrated the survival benefit of trauma systems and trauma centers,2, 35, 46, 47, 48, 49 the benefit of advanced out-of-hospital trauma care (eg, advanced airway intervention and intravenous fluid resuscitation) remains unclear. Further, there is a growing body of literature questioning the benefit of out-of-hospital advanced life support practices in trauma patients.4, 50, 51, 52, 53, 54 Although some seriously injured individuals may require time-dependent EMS interventions to survive (eg, airway obstruction, respiratory arrest, external hemorrhage at a compressible site), faster application of such interventions may not have a measureable effect on outcomes for most trauma patients. It is also plausible that the “golden hour” is primarily dependent on the timeliness of hospital-based interventions (ie, initiation of definitive care after arrival at an ED), rather than out-of-hospital care. Although the relationship between hospital time and outcome among seriously injured patients also remains unproven, such a possibility would lend credence to the “golden hour” concept and be consistent with the previously demonstrated hospital-based effect on survival.35 The relationship between duration of on-scene time and outcomes in trauma also remains unclear. In this study, we were unable to demonstrate a significant relationship between time on-scene and mortality. Previous studies have suggested that on-scene time is affected by injury severity, plus the number and type of EMS interventions.44, 55, 56 As with response intervals, many urban EMS systems are held to specific standards for the acceptable duration of on-scene care. As the scope of practice among EMS providers increases (eg, rapid sequence tracheal intubation, advanced airway management, use of additional medications), such standards may help to contain the opportunity for very long on-scene times. However, our results do not suggest an important association between shorter scene times and improved survival. Similarly, there has been little information to evaluate the potential effect of transport times on outcomes in trauma. Patients perceived by EMS providers to have serious injury are frequently transported to the hospital by “lights and siren” to facilitate rapid arrival at a trauma center. The demonstrated survival benefit of treating seriously injured patients in trauma centers2, 35, 46, 47, 48, 49 suggests that time lost bypassing nontrauma hospitals is recouped by the benefits of specialized care provided for injured persons at major trauma centers. One previous study found that although transport times to trauma centers were higher for patients bypassing other local facilities, longer transport times were not associated with adverse outcomes.57 Our findings support this conclusion and further substantiate the practice of transporting patients presumed to have serious injury to trauma centers, despite longer transport times. Although the association between out-of-hospital time and outcome remains unsubstantiated beyond persons in cardiac arrest, there is a public expectation of rapid EMS response and care after activation of the 911 system. In the setting of a perceived “emergency,” the public may not necessarily value whether faster EMS time and expeditious care have been shown to save lives for the majority of clinical conditions. However, meeting these expectations costs money (eg, establishment of fire houses and positioning of EMS crews to achieve predefined response intervals), can place EMS providers, patients, and the nearby public at risk,20, 21, 22 and is a common reason (ie, emergency vehicle crashes) for tort claims against EMS agencies.58 In an increasingly costly and competitive health care environment, these factors must be contemplated when seeking to further “optimize” EMS systems. Among injured patients with physiologic abnormality prospectively sampled from a diverse group of sites and EMS systems across North America, there was no association between EMS intervals and mortality. The authors thank the many contributing EMS agencies, EMS providers, study coordinators, staff, and investigators (see Appendix E2, available online at http://www.annemergmed.com) for their willingness to participate in and support this project and for their continued dedication to improving the EMS care and outcomes for their patients. Appendix E1. Instrumental variables analysisInstrumental variable analysis is an analytic strategy used in observational research to account for both measured and unmeasured confounders, allowing improved estimation of causal effect, provided an appropriate instrument is available and certain assumptions are met.37, 38, 39 Instrumental variable analysis was proposed in our study as a potential analytic solution to the dilemma of unmeasured confounding (eg, injury severity, patient acuity, and the phenomenon of shorter times for sicker patients with inherently worse prognosis) that may not have been fully accounted for in measured predictor variables. Martens et al37 observed that through certain assumptions, the causal effect of the exposure (in this case, time) on the outcome can be captured through the relationship between the exposure and the instrumental variable. Specifically, McClellan et al38 observed that it is possible to mimic randomization of patients to the likelihood of receiving a certain treatment according to the association between treatment and the instrumental variable. This process eliminates unmeasured confounders and allows for the estimation of causal effect in terms of the likelihood. A Hausman test is also generally used to determine whether a single equation model is sufficient versus use of a 2-step instrumental variable analysis to remove bias associated with unobserved confounders. In essence, 2 relevant equations are estimated: (1) (2)We proposed using distance as an instrumental variable because of its perceived correlation with time, lack of correlation with survival (except through time), and demonstrated success in previous trauma research with instrumental variable analyses.40, 41 In this situation, if we assume distance to be Z and time T, we then use the instrumental variable model to estimate the likelihood of different intervals according to distance; this likelihood is then used to estimate the causal effect of time on outcome. Because a weak instrument can introduce bias to an analysis, the F statistic is typically used to assess adequate correlation between T (time) and Z (distance) after accounting for X (important confounders), with F greater than 10 indicating an adequate instrument.39 In this study, we tested the appropriateness of distance as an instrument for all intervals in the primary sample and for total EMS time in all subgroups. Only the subgroup of trauma patients treated in the United States fulfilled criteria for using distance as an instrument (F test >10), which restricted our use of instrumental variable analysis to this subgroup of patients. Appendix E2. ROC Epistry contributorsAlabama Resuscitation Center, University of Alabama at Birmingham, Birmingham, AL: Jeffrey D. Kerby, MD, PhD, Principal Investigator Core Investigators: Todd B. Brown, MD, MSPH, Thomas Terndrup, MD Coordinators: Shannon W. Stephens, EMT-P, Carolyn R. Williams, BSN, BSME EMS Investigators/Collaborators: Joe E. Acker, EMT-P, MPH, Michael L. Minor, EMT-P Hospital Investigators/Collaborators: Paul A. MacLennan, PhD, Patrick R. Pritchard, MD, Sandra Caldwell, MA, Katherine R. Lai, BS Participating EMS Agencies: Alabama LifeSaver, Bessemer Fire and Rescue, Birmingham Fire and Rescue, Center Point Fire District, Chelsea Fire and Rescue, American Medical Response, Homewood Fire Dept., Pelham Fire Dept., Rocky Ridge Fire Dept., Regional Paramedic Services, Trussville Fire Dept., Vestavia Hills Fire and Rescue Dallas Center for Resuscitation Research, University of Texas Southwestern Medical Center, Dallas, TX: Ahamed H. Idris, MD, Principal Investigator Core Investigators: Fernando Benitez, MD, Raymond Fowler, MD, Dorothy Lemecha, MD, Joseph Minei, MD, Paul Pepe, MD, Michael Ramsay, MD, Robert Simonson, MD, Jane Wigginton, MD Coordinators: Dixie Climer, RN, Melinda Moffat, RN, Kate Newman, RN, Pamela Owens, Andrea Bennett, BS EMS Investigators/Collaborators: Richard Black, EMT-P, Debra Cason, RN, Billy Craft, EMT-P, Lucy Detamble, RN, Ryan Dykes, EMT-P, Tony Harvey, EMT-P, Suzanne Hewitt, RN, Marshal Isaacs, MD, Joe Kay, EMT-P, Tami Kayea, EMT-P, Richard LaChance, EMT-P, Thomas Lehman, Paul Mayer, MD, Jeffrey Metzger, MD, Danny Miller, EMT-P, Kenneth Navarro, EMT-P, Steven Parker, EMT-P, Karen Pickard, RN, Warren Porter, EMT-P, TJ Starling, EMT-P, Tommy Tine, EMT-P, Chris Vinson, EMT-P Hospital Investigators/Collaborators: David Abebefe, MD, Steven Arze, MD, Sean Black, MD, Matthew Bush, MD, Michael Forman, MD, Jeffery Goodloe, MD, Ralph Kelly, DO, Gregory Lachar, MD, Alicia Mangram, MD, Marc Morales, MD, Edward Thornton, MD, Robert Wiebe, MD Participating EMS Agencies: Carrollton Fire Dept., Dallas Fire and Rescue, DeSoto Fire Dept., Duncanville Fire Dept., Farmers Branch Fire Dept., Garland Fire Dept., Highland Park Dept. of Public Safety, Irving Fire Dept., Lancaster Fire Dept., Mesquite Fire Dept., Plano Fire Dept., University Park Fire Dept. University of Iowa Carver College of Medicine-Iowa Resuscitation Network, University of Iowa, Iowa City, IA: Richard Kerber, MD, Principal Investigator Core Investigators: Steve Hata, MD, Dianne Atkins, MD Coordinators: Melanie Kenney, RN, MA, CPNP, Catherine Rost, Alexander Drum, EMT-P, Michael Hartley, EMT-P Participating EMS Agencies: Area Ambulance Service, Davenport Hospital Ambulance Corporation, Covenant Health System - Covenant Ambulance, Covenant Health System - Mercy Oelwein, Covenant Health System - Sartori, City of Dubuque Fire Dept., Dallas County Emergency Medical Services, West Des Moines Emergency Medical Services, Des Moines Fire Dept. EMS, Henry County Health Center Emergency Medical Services, Johnson County Ambulance, Siouxland Paramedics, Inc., Waterloo Fire Rescue Milwaukee Resuscitation Research Center, Medical College of Wisconsin, Milwaukee, WI: Tom P. Aufderheide, MD, Principal Investigator Core Investigators: Ronald G. Pirrallo, MD, MHSA, Karen J. Brasel, MD, MPH, Andrea L. Winthrop, MD, John P. Klein, PhD Coordinators: David J. Kitscha, BS, MS, Barbara J. Burja, BA, EMT, Chris von Briesen, BA, CCRC, Christopher W. Sparks, EMT, Sara Kaebisch, BS EMS Investigators/Collaborators: John Chianelli, MS, Rosemarie Forster, MSOLQ, RHIA, EMT-P, Michael Milbrath, EMT-P, Lauryl Pukansky, BS, RHIA, Kenneth Sternig, MS-EHS, BSN, EMT-P, Eugene Chin, RN, EMT-P, Nancy Frieberg, RN, EMT-P, Kim Krueger, RN, EMT-P, Del Szewczuga, RN, EMT-P Thomas Duerr, Rebecca Funk, BS, RHIA, EMT-B, Gail Jacobsen, BS, Janis Spitzer, Richard Demien, James Martins, John Cohn, Russell R. Spahn, MA, EMT-P, Mike Jankowski, BA, EMT-P, Timothy James, William E. Wentlandt Jr., MBA, EFO, David Berousek, Brian M. Satula, BA, NREMT, Jay B. Behling, BS, EMT-B, Dean K. Redman, BA, EFO, Steven Hook, BS, CFOD, Andrew Neargarder, Jim Singer, RN Hospital Investigators/Collaborators: Thomas Reminga, MD, Dennis Shepherd, MD, Peter Holzhauer, MD, Jonathan Rubin, MD, Craig Skold, MD, Orlando Alvarez, MD, Heidi Harkins, MD, Edward Barthell, MD, William Haselow, MD, Albert Yee, MD, John Whitcomb, MD, Eduardo E. Castro, MD, Steven Motarjeme, MD Participating EMS Agencies: Cudahy Fire Dept., Flight for Life, Franklin Fire Dept., Greendale Fire Dept., Greenfield Fire Dept., Hales Corners Fire Dept., Milwaukee County Airport Fire Dept., Milwaukee Fire Dept., North Shore Fire Dept., Oak Creek Fire Dept., South Milwaukee Fire Dept., St. Francis Fire Dept., Wauwatosa Fire Dept., West Allis Fire Dept. Ottawa/OPALS/British Columbia RCC, Ottawa Health Research Institute, University of Ottawa, Ottawa, Ontario and St. Paul's Hospital, University of British Columbia, British Columbia, Canada: Ian Stiell, MD, Principal Investigator Core Investigators: Jim Christenson, MD, Morad Hameed, MD, Jean Denis Yelle, MD, Martin Osmond, MD, Christian Vaillancourt, MD, David Evans, MD, Riyad Abu-Laban, MD Coordinators: Cathy Clement, RN, Tammy Beaudoin, CCHRA, Barb Boychuk, RN, Sarah Pennington, RN, Helen Connolly, RN, Patrick Lefaivre, PCP, Jane Banek, CCHRA, Angela Marcantonio, Rina Marcantonio, CCHRA, Christine Leclair, RN, Julie Cummins, RN EMS Investigators/Collaborators: Matthew Stempien, MD, Jonathan Dreyer, MD, Douglas Munkley, MD, Justin Maloney, MD, Paul Colella, MD, Andrew Affleck, MD, David Waldbillig, MD, Paul Bradford, MD, Martin Lees, MD, Vincent Arcieri, MD, Ann Wilson, BSc, ACP, Kenneth Boyle, EMCA, RRT, CMA, Lorraine Luinstra-Toohey, BScN, MHA, John Trickett, BScN, Nicole Sykes, BScN, RN, Elaine Graham, ACP, Kieran Ballah, EMCA, Cathy Hedges, A-EMCA, ACP, Paul Mathers, A-EMCA, Dug Andrusiek, MSc, Dan Bishop, ACP, Ron Straight, ACP, Brian Twaites, ACP, Stuart Donn, PhD Participating EMS Agencies: A.A. and M. Volunteer Ambulance Service, Burlington Fire and Rescue, Cambridge Fire Dept., Cornwall Fire and Rescue, Cornwall SDG Emergency Medical Services, Essex-Windsor Emergency Medical Services, Essex-Windsor Fire and Rescue, Frontenac Paramedic Service, Halton Emergency Medical Services, Harrow Ambulance Service Ltd., Kawartha Lakes Emergency Medical Services, Kawartha Lakes Fire and Rescue, Kingston Fire and Rescue, Kitchener Fire Dept., Lambton County Emergency Medical Services, Lasalle Fire Dept., London Fire Dept., Niagara Emergency Medical Services, Niagara Falls Fire and Rescue, Northumberland Emergency Medical Service, Oakville Fire Dept., Ottawa Fire and Rescue, Ottawa Paramedic Service, Peterborough Emergency Medical System, Peterborough Fire Dept., Prescott-Russell Emergency Medical Services, Sarnia Fire Services, St. Catharine's Fire and Rescue, Sudbury Emergency Medical Services, Sudbury Fire and Rescue, SunParlour Emergency Services Inc., Superior North Emergency Medical Services, Tecumseh Fire Dept., Thames Emergency Medical Services, Thunder Bay Fire and Rescue, Waterloo Fire and Rescue, Waterloo Regional Emergency Medical Services, Welland Fire and Rescue, Windsor Fire and Rescue, British Columbia Ambulance Service, Abbotsford Fire Dept., Aggassiz Valley Fire Dept., Burnaby Fire Dept., Campbell River Fire Dept., Central Saanich Fire Dept., City of North Vancouver Fire Dept., Coquitlam Fire Dept., Delta Fire Dept., Esquimalt Fire Dept., Kamloops Fire Dept., Kelowna Fire Dept., Lake Country V Fire Dept., Langford Fire Dept., Langley City Fire Dept., Langley Township Fire Dept., Maple Ridge Fire Dept., Mission Fire Dept., Nanaimo Fire Dept., New Westminster Fire Dept., North Vancouver District Fire Dept., Oak Bay Fire Dept., Peachland Valley Fire Dept., Pitt Meadows Fire Dept., Port Coquitlam Fire Rescue, Port Moody Fire Dept., Prince George Fire Dept., Prince Rupert Fire Dept., Qualicum Beach Fire Dept., Richmond Fire Dept., Saanich Fire Dept., Sooke V Fire Dept., Squamish Fire Dept., Surrey Fire Dept., Trail Fire Dept., Vancouver Fire Dept., Victoria Fire Dept., West Vancouver Fire Dept., Whistler Fire Dept., White Rock Fire Dept. Pittsburgh Resuscitation Network, the University of Pittsburgh, Pittsburgh, PA: Clifton Callaway, MD, PhD, Principal Investigator Core Investigators: Samuel Tisherman, MD, Jon Rittenberger, MD, David Hostler, PhD Coordinators: Joseph Condle, Mitch Kampmeyer, Timothy Markham, Maureen Morgan EMS Investigators/Collaborators: Paul Sabol, Gina Sicchitano, Scott Sherry, Anthony Shrader, Greg Stull, Manuel Torres, MS, William Groft, Robert McCaughan, Rodney Rohrer, John Cole, MD, David Fuchs, MD, Francis Guyette, MD, MS, William Jenkins, MD, Ronald Roth, MD, Heather Walker, MD Hospital Investigators/Collaborators: Alain Corcos, MD, Ankur Doshi, MD, Adrian Ong, MD, Andrew Peitzman, MD Participating EMS Agencies: Washington Ambulance and Chair, Pittsburgh Bureau of Emergency Medical Services, Pittsburgh Bureau of Fire, Mutual Aid Ambulance Service, STAT Medevac Portland Resuscitation Outcomes Consortium, Oregon Health and Science University, Portland, OR: Jerris R. Hedges, MD, MS, Principal Investigator Core Investigators: Craig D. Newgard, MD, MPH, Mohamud R. Daya, MD, MS, Robert A. Lowe, MD, MPH Coordinators: Denise Griffiths, BS, John Brett, EMT-P, Dana Zive, MPH, Abdolaziz Yekrang, MPA, MA, Yoko Nakamura, MD, Brooke Frakes, BS, Aaron Monnig, EMT-P EMS Investigators/Collaborators: Jonathan Jui, MD, MPH, Terri A. Schmidt, MD, MS, Ritu Sahni, MD, Craig R. Warden, MD, MPH, Marc D. Muhr, EMT-P2, John A. Stouffer, EMT-P, Kyle Gorman, MBA, EMT-P, Pontine Rosteck EMT-P, Karl Koenig EMT-P, Jan Lee EMT-P, Roxy Barnes EMT-P, Heather Tucker, EMT-P, Brad Allen, EMT-P, TJ Bishop, EMT-P, Adam Glaser, EMT-P Hospital Investigators/Collaborators: Martin A. Schreiber, MD, Jim Anderson, MD, Ameen I. Ramzy, MD, K. Dean Gubler, DO, Lynn K. Wittwer, MD, Samantha Underwood, MS, Brooke Barone, BS, Denise Haun-Taylor, RN, Elizabeth Bryant, RN, Joanne Miller, ARNP Participating EMS Agencies: American Medical Response - Clackamas, Clark, and Multnomah Counties, Camas Fire Dept., Clackamas County Fire District #1, Clark County Fire District #6, Lake Oswego Fire Dept., LifeFlight, MetroWest Ambulance, North Country Ambulance, Tualatin Valley Fire and Rescue, Vancouver Fire Department, Portland Fire and Rescue, Portland International Airport Fire Department, Gresham Fire and Emergency Services UCSD-San Diego Resuscitation Research Center, University of California at San Diego, San Diego, CA: Daniel Davis, MD, Principal Investigator Core Investigators: David Hoyt, MD, Raul Coimbra, MD, PhD, Gary Vilke, MD Coordinators: Donna Kelly, RN, Lana McCallum-Brown, RN EMS Investigators/Collaborators: Bruce Haynes, MD, Brad Schwartz, MD Hospital Investigators/Collaborators: Michael Sise, MD, Frank Kennedy, MD, Fred Simon, MD, Gail Tominaga, MD, John Steele, MD Participating EMS Agencies: Alpine Fire Protection District, American Medical Response, Barona Fire Dept., Bonita/Sunnyside Fire Protection, Borrego Springs Fire Protection District, Carlsbad Fire Dept., Chula Vista Fire Dept., Coronado Fire Dept., CSA-17 ALS Transporting Agency, Deer Springs, Del Mar Fire Dept., East County Fire Protection District, El Cajon Fire Dept., Elfin Forest CSA 107, Encinitas Fire Protection District, Escondido Fire Dept., Federal Fire Dept. San Diego, Imperial Beach Fire Dept., Julian-Cuyamaca Fire Dept., La Mesa Fire Dept., Lakeside Fire Protection District, Lemon Grove Fire Dept., Mercy Air, Miramar Fire Dept., National City Fire Dept., North County Fire, Oceanside Fire Dept., Pala Fire Dept., Poway Fire Dept., Ramona Fire Dept., Rancho Santa Fe Fire Protection District, San Diego Rural Fire Protection District, San Marcos Fire Dept., San Miguel Fire Protection District, Santee Fire Dept., Solana Beach Fire Dept., Sycuan Fire Dept., Valley Center/Mercy Ambulance, Viejas Fire Dept., Vista Fire Dept. Seattle-King County Center for Resuscitation Research at the University of Washington, University of Washington, Seattle, WA: Peter J. Kudenchuk, MD, Principal Investigator Core Investigators: Tom D. Rea, MD, Eileen Bulger, MD, Mickey S. Eisenberg, MD, Michael Copass, MD Coordinators: Michele Olsufka, RN, Sally Ragsdale, ARNP, Debi Solberg, RN, MN, Susan Damon, RN, Randi Phelps, Jeanne O'Brien, RN, MN EMS Investigators/Collaborators: Earl Sodeman, Marty LaFave, James Boehl, Dave Jones, Gary Somers, Deborah Ayrs, Adrian Whorton, Sam Warren, Jim Fogarty, Jonathan Larsen, Mike Helbock Participating EMS Agencies: Bellevue Fire Dept., Redmond Fire Dept., Seattle Fire Dept., Shoreline Fire Dept., King Co Medic 1, Vashon Island Medic One, Bothell Fire Dept., Burien Fire Dept., Kirkland Fire Dept., Renton Fire Dept., Snoqualmie Fire Dept., Duvall Fire Dept., Eastside Fire and Rescue, Enumclaw Fire Dept., Fall City Fire Dept., Skyway Fire Dept., Kent Fire Dept., Maple Valley Fire and Life Safety, Mercer Island Fire Dept., King County Fire District #44, North Highline Fire Dept., Northshore/Kenmore Fire Dept., Port of Seattle Fire Dept., King County Fire District #47, King County Fire District #40, SeaTac Fire Dept., Skykomish Fire Dept., Snoqualmie Pass, South King Co Medic 1, South King Fire and Rescue, Tukwila Fire Dept., Valley Regional Fire Authority, Vashon Island Fire and Rescue, Woodinville Fire Dept. Toronto Regional Resuscitation Research Out of Hospital Network (Toronto Regional RESCUeNET), University of Toronto, Toronto, Ontario, Canada: Arthur Slutsky, Principal Investigator Core Investigators: Laurie Morrison, Paul Dorian Coordinators: Craig Beers, Blair Bigham, Dina Braga, Grace Burgess, Bruce Cameron, Suzanne Chung, Pete De Maio, Steve Driscoll, Lynne Fell, Jamie Frank, Mark McLennan, Lesley Ann Molyneaux, Welson Ryan, Angela Schotsman, Jacob Simonini, Lynda Turcotte, Flo Veel, Amy Wassenaar, Cathy Zahn EMS Investigators/Collaborators: Dana Bradshaw, Rob Burgess, Bruce Cameron, Sandra Chad, Sheldon Cheskes, Allan Craig, Steve Dewar, Tim Dodd, Rob Duquette, Marty Epp, Michael Feldman, Verena Jones, Russell MacDonald, Larry MacKay, Steve McNenley, Judy Moore, Philip Moran, Michael Murray, Michael Nemeth, Russ Olnyk, Tyrone Perreira, Richard Renaud, Karen Roche, Jennifer Shield, Doug Silver, Jacob Stevens, Rick Verbeek, Tim Waite, Ken Webb, Michelle Welsford Hospital Investigators/Collaborators: Rosemarie Farrell, Jamie Hutchison Participating EMS Agencies: Ajax Fire and Emergency Services, Barrie Fire and Emergency Service, Beausoleil First Nation Emergency Medical Services, Bradford West Gwillimbury Fire and Emergency Services, Brampton Fire and Emergency Services, Brock Township Fire Dept., Caledon Fire and Emergency Services, City of Hamilton Emergency Services – EMS, City of Hamilton Emergency Services – Fire, City of Orillia Fire Dept., Clarington Emergency and Fire Services, County of Simcoe Paramedic Services, Durham Regional Emergency Medical Services, Innisfil Fire and Rescue Service, Mississauga Fire and Emergency Services, Mnjikaning Fire Rescue Service, Muskoka Ambulance Service, Muskoka Ambulance Communication Center, New Tecumseth Fire Dept., OrngeTransport Medicine, Oro Medonte Fire and Emergency Services, Oshawa Fire Services, Pickering Fire Services, The Ramara Township Fire and Rescue Service, Peel Regional Paramedic Services, Toronto EMS, Toronto Fire Services, Township of Essa Fire Dept., Township of Georgian Bay Fire Dept., Township of Scugog Fire Dept., Township of Uxbridge Fire Dept., Wasaga Beach Fire Dept., Whitby Fire and Emergency Services, Durham Regional Basehospital, Sunnybrook Osler Center for Prehospital Care, Hamilton Health Sciences Paramedic Base Hospital Program, Simcoe Muskoka Basehospital Steering Committee Chair, Myron Weisfeldt, MD, Johns Hopkins University School of Medicine, Baltimore, MD, Co-Chair-Cardiac, Joseph P. Ornato, MD, Virginia Commonwealth University Health System, Richmond, VA, Co-Chair-Trauma, David B. Hoyt, MD, University of California at San Diego, San Diego, CA, replacing Col. John B. Holcomb, MD, Commander, U.S. Army ISR National Heart, Lung, and Blood Institute, Bethesda, MD: Tracey Hoke, MD, George Sopko, MD, MPH, David Lathrop, PhD, Alice Mascette, MD, Patrice Desvigne Nickens, MD Clinical Trial Center, University of Washington, Seattle, WA: Al Hallstrom, PhD, Graham Nichol, MD, MPH, Scott Emerson, MD, PhD, Judy Powell, BSN, Gena Sears, BSN, Berit Bardarson, RN, Lois Van Ottingham, BSN, Anna Leonen, MS, Robert B. Ledingham, MS, Chris Finley, Richard Moore, BS, Ben Bergsten-Buret References1. 1. The golden hour: scientific fact or medical “urban legend”?. Acad Emerg Med. 2001;8:758–760. MEDLINE | CrossRef 2. 2 Trauma care regionalization: a process-outcome evaluation. J Trauma. 1999;46:565–581. MEDLINE 3. 3 Impact of on-site care, prehospital time, and level of in-hospital care on survival in severely injured patients. J Trauma. 1993;34:252–261. MEDLINE 4. 4 The OPALS major trauma outcome study: impact of advanced life-support on survival and morbidity. CMAJ. 2008;178:1141–1152. CrossRef 5. 5 The relationship between total prehospital time and outcome in hypotensive victims of penetrating injuries. Ann Emerg Med. 1987;16:293–297. Abstract | Full-Text PDF (547 KB) | CrossRef 6. 6. The effect of prehospital transport time on the mortality from traumatic injury. Prehosp Disaster Med. 1995;10:24–29. 7. 7 Is total out-of-hospital time a significant predictor of trauma patient mortality?. Acad Emerg Med. 2003;10:949–954. MEDLINE | CrossRef 8. 8. Eight minutes or less: does the ambulance response time guideline impact trauma patient outcome?. J Emerg Med. 2002;23:43–48. Abstract | Full Text | Full-Text PDF (87 KB) | CrossRef 9. 9 Are pre-hospital time and emergency department disposition time useful process indicators for trauma care in Italy?. Injury. 2007;38:305–311. Abstract | Full Text | Full-Text PDF (289 KB) | CrossRef 10. 10. Can the “golden hour of shock” safely be extended in blunt polytrauma patients?. Prehosp Disaster Med. 2002;17:75–80. 11. 11 Does out-of-hospital EMS time affect trauma survival?. Am J Emerg Med. 1995;13:133–135. Abstract | Full-Text PDF (334 KB) | CrossRef 12. 12. The importance of prompt transport in salvage of patients with penetrating heart wounds. J Trauma. 1982;22:443–446. MEDLINE 13. 13 Penetrating thoracic injuries: in-field stabilization versus prompt transport. J Trauma. 1987;27:1066–1072. MEDLINE 14. 14. Resuscitative thoracotomy: the effect of field time on outcome. J Trauma. 1988;28:441–445. MEDLINE 15. 15 Urban-rural differences in prehospital care of major trauma. J Trauma. 1997;42:723–729. MEDLINE 16. 16 Paramedic response time: does is affect patient survival?. Acad Emerg Med. 2005;12:594–600. CrossRef 17. 17. Response time effectiveness: comparison of response time and survival in an urban EMS system. Acad Emerg Med. 2002;9:288–295. MEDLINE | CrossRef 18. 18. Cardiac resuscitation in the community: importance of rapid provision and implications for program planning. JAMA. 1979;241:1905–1907. MEDLINE 19. 19 Optimal defibrillation response intervals for maximum out-of-hospital cardiac arrest survival rates. Ann Emerg Med. 2003;42:242–250. Abstract | Full Text | Full-Text PDF (89 KB) | CrossRef 20. 20Ambulance crash-related injuries among emergency medical services workers—Unites States, 1991-2002. MMWR Morb Mortal Wkly Rep. 2003;52:154–156. MEDLINE 21. 21. Characteristics of fatal ambulance crashes in the United States: an 11-year retrospective analysis. Prehosp Emerg Care. 2001;5:261–269. MEDLINE | CrossRef 22. 22 Relative risk of injury and death in ambulances and other emergency vehicles. Accid Anal Prev. 2003;35:941–948. MEDLINE | CrossRef 23. 23 The Resuscitation Outcomes Consortium Epistry-Trauma: design, development, and implementation of a North American epidemiologic out-of-hospital trauma registry. Resuscitation. 2008;78:170–178. Abstract | Full Text | Full-Text PDF (347 KB) | CrossRef 24. 24 A descriptive analysis of emergency medical service systems participating in a large, out-of-hospital resuscitation research network. Prehosp Emerg Care. 2007;11:369–382. CrossRef 25. 25. Resources for Optimal Care of the Injured Patient. Chicago, IL: American College of Surgeons; 2006;. 26. 26 The utility of physiologic status, injury site, and injury mechanism in identifying patients with major trauma. J Trauma. 1988;28:305–311. MEDLINE 27. 27 Do prehospital trauma center triage criteria identify major trauma victims?. Arch Surg. 1995;130:171–176. MEDLINE 28. 28 Empirical development and evaluation of out of hospital trauma triage instruments. J Trauma. 1985;25:482–489. MEDLINE 29. 29 Application of American College of Surgeons' field triage guidelines by pre-hospital personnel. J Am Coll Surg. 1995;181:539–544. MEDLINE 30. 30 Incremental benefit of individual American College of Surgeons trauma triage criteria. Acad Emerg Med. 1996;3:992–1000. MEDLINE | CrossRef 31. 31 Physiologic trauma triage criteria in adult trauma patients: are they effective in saving lives by transporting patients to trauma centers?. J Am Coll Surg. 2005;200:584–592. Abstract | Full Text | Full-Text PDF (102 KB) | CrossRef 32. 32. The Trauma Triage Rule: a new, resource-based approach to the out-of-hospital identification of major trauma victims. Ann Emerg Med. 1990;19:1401–1406. Abstract | Full-Text PDF (617 KB) | CrossRef 33. 33 Applying the trauma triage rule to blunt trauma patients. Acad Emerg Med. 1995;2:1043–1052. MEDLINE | CrossRef 34. 34. Studies evaluating current field triage: 1966-2005. Prehosp Emerg Care. 2006;10:303–306. MEDLINE | CrossRef 35. 35 A national evaluation of the effect of trauma-center care on mortality. N Engl J Med. 2006;354:366–378. CrossRef 36. 36 Prospective validation of a new model for evaluating emergency medical services systems by in-field observation of specific time intervals in prehospital care. Ann Emerg Med. 1993;22:638–645. Abstract | Full-Text PDF (864 KB) | CrossRef 37. 37 Instrumental variables applications and limitations. Epidemiology. 2006;17:260–267. MEDLINE | CrossRef 38. 38. Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality?. JAMA. 1994;272:859–866. MEDLINE 39. 39. A survey of weak instruments and weak identification in generalized methods of moments. 2002. J Business Econ Stat. 2002;20:518–529. 40. 40 Survival advantage associated with treatment of injury at designated trauma centers: a bivariate probit model with instrumental variables. Med Care Res Rev. 2007;64:83–97. MEDLINE | CrossRef 41. 41 Mortality benefit of transfer to level I versus level II trauma centers for head-injured patients: analysis using instrumental variables. Health Serv Res. 2005;40:435–457. MEDLINE | CrossRef 42. 42. Advanced statistics: statistical methods for analyzing cluster and cluster-randomized data. Acad Emerg Med. 2002;9:330–341. MEDLINE | CrossRef 43. 43 Hypertonic resuscitation: design and implementation of a prehospital intervention trial. J Am Coll Surg. 2008;206:220–232. Abstract | Full Text | Full-Text PDF (275 KB) | CrossRef 44. 44 The impact of injury severity and prehospital procedures on scene time in victims of major trauma. Ann Emerg Med. 1991;20:1299–1305. Abstract | Full-Text PDF (650 KB) | CrossRef 45. 45 A meta-analysis of prehospital care times for trauma. Prehosp Emerg Care. 2006;10:198–206. MEDLINE | CrossRef 46. 46 Outcome of hospitalized injured patients after institution of a trauma system in an urban area. JAMA. 1994;271:1919–1924. MEDLINE 47. 47 Influence of a statewide trauma system on location of hospitalization and outcome of injured patients. J Trauma. 1996;40:536–545. MEDLINE 48. 48 Preferential benefit of implementation of a statewide trauma system in one of two adjacent states. J Trauma. 1998;44:609–617. MEDLINE 49. 49 The effect of trauma center designation and trauma volume on outcome in specific severe injuries. Ann Surg. 2005;242:512–519. MEDLINE 50. 50. Advanced or basic life support for trauma: meta-analysis and critical review of the literature. J Trauma. 2000;49:584–599. MEDLINE 51. 51 Immediate versus delayed fluid resuscitation for hypotensive patients with penetrating torso injuries. N Engl J Med. 1994;331:1105–1109. MEDLINE | CrossRef 52. 52 Out-of-hospital endotracheal intubation and outcome after traumatic brain injury. Ann Emerg Med. 2004;44:439–450. Abstract | Full Text | Full-Text PDF (169 KB) | CrossRef 53. 53 The effect of paramedic rapid sequence intubation on outcome in patients with severe traumatic brain injury. J Trauma. 2003;54:444–453. MEDLINE 54. 54. Out-of-hospital endotracheal intubation: where are we?. Ann Emerg Med. 2006;47:532–541. Abstract | Full Text | Full-Text PDF (156 KB) | CrossRef 55. 55. Prehospital interventions: on-scene time and ambulance technicians' experience. Prehosp Disaster Med. 2002;17:167–169. 56. 56 Endotracheal intubation increases out of hospital time in trauma patients. Prehosp Emerg Care. 2007;11:224–229. MEDLINE | CrossRef 57. 57 The effect of urban trauma system hospital bypass on prehospital transport times and level 1 trauma patient survival. Ann Emerg Med. 1989;18:1146–1150. Abstract | Full-Text PDF (531 KB) | CrossRef 58. 58 Tort claims and adverse events in emergency medical services. Ann Emerg Med. 2008;52:256–262. Abstract | Full Text | Full-Text PDF (106 KB) | CrossRef a Center for Policy and Research in Emergency Medicine, Department of Emergency Medicine, Oregon Health & Science University, Portland, OR b Department of Biostatistics, University of Washington, Seattle, WA c Department of Surgery, University of Washington, Seattle, WA d University of Washington Clinical Trial Center, University of Washington–Harborview Center for Prehospital Emergency Care, University of Washington, Seattle, WA e Department of Medicine, John A. Burns School of Medicine, University of Hawaii–Manoa, Honolulu, HI f Department of Emergency Medicine, University of Ottawa, Ottawa, Ontario, Canada g Department of Surgery, University of Ottawa, Ottawa, Ontario, Canada h Department of Emergency Medicine, University of California at San Diego, San Diego, CA i Department of Emergency Medicine, Medical College of Wisconsin, Milwaukee, WI j Department of Surgery, University of Texas Southwestern Medical Center, Dallas, TX k Department of Anesthesia, Division of Critical Care, University of Iowa, Iowa City, IA l Legacy Emanuel Trauma Program, Portland, OR m Department of Emergency Medicine, University of Alabama at Birmingham, Birmingham, AL
Supervising editor: Daniel W. Spaite, MD Author contributions: CDN conceived of and designed the study. RS performed the database management, quality assurance of the data, and all statistical analyses. CDN, RS, JRH, JPT, DPD, EMB, and GN interpreted preliminary findings and assisted in refining the final analysis. CDN drafted the article, and all authors contributed substantially to its revision. RS takes responsibility for data quality and all analyses. CDN takes responsibility for the paper as a whole. Funding and support: By Annals policy, all authors are required to disclose any and all commercial, financial, and other relationships in any way related to the subject of this article that might create any potential conflict of interest. See the Manuscript Submission Agreement in this issue for examples of specific conflicts covered by this statement. The Resuscitation Outcome Consortium was supported by a series of cooperative agreements to 10 regional clinical centers and 1 data coordinating center (5U01 HL077863, HL077881, HL077871, HL077872, HL077866, HL077908, HL077867, HL077885, HL077877, HL077873) from the National Heart, Lung, and Blood Institute, in partnership with the National Institute of Neurological Disorders and Stroke, US Army Medical Research and Material Command, the Canadian Institutes of Health Research-Institute of Circulatory and Respiratory Health, Defence Research and Development Canada, the Heart and Stroke Foundation of Canada, and the American Heart Association. Publication date: Available online September 22, 2009. Reprints not available from the authors. Provide feedback on this article at the journal's Web site, www.annemergmed.com. Please see page 236 for the Editor's Capsule Summary of this article. PII: S0196-0644(09)01284-0 doi:10.1016/j.annemergmed.2009.07.024 © 2009 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||