Journal Home
Search for

Volume 42, Issue 4, Pages 492-506 (October 2003)


View previous. 17 of 50 View next.

A decision rule for identifying children at low risk for brain injuries after blunt head trauma

Michael J. Palchak, MDa, James F. Holmes, MDa, Cheryl W. Vance, MDab, Rebecca E. Gelber, MDa, Bobbie A. Schauer, MDa, Mathew J. Harrison, BSa, Jason Willis-Shore, MDd, Sandra L. Wootton-Gorges, MDc, Robert W. Derlet, MDa, Nathan Kuppermann, MD, MPHabCorresponding Author Informationemail address

Received 14 November 2002; received in revised form 10 April 2003; accepted 14 April 2003.

Abstract 

Study objective

Computed tomography (CT) is frequently used in evaluating children with blunt head trauma. Routine use of CT, however, has disadvantages. Therefore, we sought to derive a decision rule for identifying children at low risk for traumatic brain injuries.

Methods

We enrolled children with blunt head trauma at a pediatric trauma center in an observational cohort study between July 1998 and September 2001. We evaluated clinical predictors of traumatic brain injury on CT scan and traumatic brain injury requiring acute intervention, defined by a neurosurgical procedure, antiepileptic medications for more than 1 week, persistent neurologic deficits, or hospitalization for at least 2 nights. We performed recursive partitioning to create clinical decision rules.

Results

Two thousand forty-three children were enrolled, 1,271 (62%) underwent CT, 98 (7.7%; 95% confidence interval [CI] 6.3% to 9.3%) had traumatic brain injuries on CT scan, and 105 (5.1%; 95% CI 4.2% to 6.2%) had traumatic brain injuries requiring acute intervention. Abnormal mental status, clinical signs of skull fracture, history of vomiting, scalp hematoma (in children ≤2 years of age), or headache identified 97/98 (99%; 95% CI 94% to 100%) of those with traumatic brain injuries on CT scan and 105/105 (100%; 95% CI 97% to 100%) of those with traumatic brain injuries requiring acute intervention. Of the 304 (24%) children undergoing CT who had none of these predictors, only 1 (0.3%; 95% CI 0% to 1.8%) had traumatic brain injury on CT, and that patient was discharged from the ED without complications.

Conclusion

Important factors for identifying children at low risk for traumatic brain injuries after blunt head trauma included the absence of: abnormal mental status, clinical signs of skull fracture, a history of vomiting, scalp hematoma (in children ≤2 years of age), and headache.

Article Outline

Abstract

1. Introduction

2. Materials and methods

3. Results

4. Discussion

Acknowledgment

References

Copyright

1. Introduction 

return to Article Outline

Trauma is the leading cause of childhood death.1 Traumatic brain injury is the leading cause of death and disability caused by trauma in children,2, 3, 4 resulting in approximately 3,000 deaths, 50,000 hospitalizations, and 650,000 emergency department (ED) visits per year in the United States.5, 6 Cranial computed tomography (CT) is routinely used in the assessment of children evaluated in the ED with head trauma; however, less than 10% of these CT scans are diagnostic of traumatic brain injuries.7, 8, 9, 10

Some studies have proposed that clinical signs and symptoms may be used to identify children at low risk for traumatic brain injuries after blunt head trauma.7, 11 Others have concluded that clinical signs and symptoms are inadequate for identifying these children.9, 10, 12, 13, 14 Many studies, however, were limited by small size of the study populations, retrospective design, uncontrolled or univariable data analyses, and nonstandardized age inclusion criteria and outcome variable definition.

Although CT is the diagnostic test of choice for evaluating children with head trauma, this procedure has disadvantages, including exposure to ionizing radiation,15, 16, 17, 18 transport of the child away from the direct supervision of emergency physicians, the frequent requirement for pharmacologic sedation,19, 20, 21 additional health care costs, and increased time for completing ED evaluation. Therefore, CT scans should ideally be selectively used.

Because the results of previous studies are inconclusive, variation exists in physicians' practice patterns regarding the use of CT scans in the ED evaluation of children with blunt head trauma.22, 23 Published guidelines acknowledge the limitations of available data and highlight the need for larger, prospective studies on this topic.8, 24, 25, 26 In this study, we sought to derive a clinical decision rule with high sensitivity for traumatic brain injury and high negative predictive value for identifying children without traumatic brain injuries after blunt head trauma, with the goal of maximizing the clinical efficiency of CT use. We hypothesized that a set of clinical signs and symptoms can accurately identify individuals at very low risk of traumatic brain injuries.

2. Materials and methods 

return to Article Outline

We conducted a prospective observational cohort study in the pediatric ED of a Level I trauma center. The study was approved by the study site's Human Subjects Research Committee.

From July 1998 to September 2001, we enrolled children younger than 18 years and presenting to the pediatric ED after a history of nontrivial blunt head trauma with historical or physical examination findings consistent with head trauma. These findings included a history of loss of consciousness, amnesia, seizures, vomiting, current headache, dizziness, nausea, or vision change or physical examination findings of abnormal mental status, focal neurologic deficits, clinical signs of skull fracture, or scalp trauma. This patient population included children with head injuries of all severities. We excluded children with trivial head trauma defined by falls from ground level or trauma resulting from walking or running into stationary objects if the only abnormal finding was a scalp laceration or abrasion. We also excluded children transferred to the study facility if CT scans were performed before transfer.

Patients were examined by faculty emergency physicians. The aforementioned clinical findings were recorded on a standardized data sheet before CT scan (if CT imaging was obtained). Abnormal mental status was considered to be present if the patient had a Glasgow Coma Scale (GCS) score or pediatric GCS score27 of less than 15 or if the patient was confused, somnolent, repetitive, or slow to respond to verbal communication. Clinical signs of skull fractures were defined as a palpable skull fracture, retroauricular bruising, periorbital bruising, hemotympanum, or cerebrospinal fluid otorrhea or rhinorrhea. Two faculty emergency physicians independently evaluated a convenience sample of 5% of patients to assess interobserver agreement.

A study research assistant reviewed the medical records for patients in whom predictor data fields were incomplete and abstracted the missing information from the medical record. Abstracted information was used on an average of less than 1% of all data fields, with a range of 0% to 3% for each variable studied.

CT scans were obtained at the discretion of the treating faculty physicians. Institutional recommendations for obtaining CT scans in head-injured children, however, included a history of loss of consciousness, amnesia, seizure, vomiting, or headache; or physical examination findings of abnormal mental status, neurologic deficit, skull fracture, or deep or multiple scalp lacerations; children younger than 2 years with scalp hematomas; children with multiple trauma; or concern about shaken baby syndrome. Ethical considerations precluded obtaining CT scans on all enrolled patients.28 CT scans were performed with a GE High Speed CT/i (GE Medical Systems, Waukesha, WI) or Toshiba 900 scanner (Toshiba America Medical Systems, Tustin, CA), with 5-mm cuts from the foramen magnum to the vertex of the skull.

We reviewed the medical records of hospitalized patients to determine interventions and outcomes. All patients discharged to home from the ED received a follow-up telephone call approximately 1 week after ED evaluation to inquire about symptoms of head injury, the need for reevaluation by a physician, or a missed diagnosis of traumatic brain injury. We mailed a questionnaire to those unavailable by telephone. Children who were discharged from the ED and did not have a traumatic brain injury demonstrated by subsequent brain imaging and did not require subsequent hospitalization were considered not to have traumatic brain injuries. At study completion, we reviewed the county morgue records and hospital trauma center registry for the names of patients who were unavailable by telephone or mail follow-up to ensure that they were not subsequently diagnosed with a traumatic brain injury.

We defined 2 outcome variables: (1) traumatic brain injury identified on CT scan; and (2) traumatic brain injury requiring acute intervention. These 2 outcome variables have an overlapping but nonhierarchical relationship.

Traumatic brain injury identified on CT imaging was defined by the presence of intracranial hemorrhage, hematoma, or cerebral edema according to the faculty radiologists' interpretations of the initial CT scans conducted in the ED. CT scans with equivocal readings were given to a faculty pediatric radiologist for definitive interpretation, masked to clinical information. Isolated skull fractures (ie, without visible brain injury) were not considered traumatic brain injuries, because children with isolated skull fractures do not routinely require hospitalization.29, 30

We defined traumatic brain injury requiring acute intervention by 1 or more of the following: the requirement for a neurosurgical procedure, ongoing antiepileptic pharmacotherapy beyond 7 days, the presence of a neurologic deficit that persisted until discharge from the hospital, or 2 or more nights of hospitalization because of treatment of the head injury. This novel definition excludes children routinely admitted for overnight observation because of a small traumatic brain injury identified on CT scan, children who are given an empirical prophylactic 1-week course of antiepileptic medication after head trauma, and children hospitalized for social or other reasons not directly related to the head trauma. In constructing the definition of traumatic brain injury requiring acute intervention, we sought to define an outcome that was meaningful to clinical decisionmaking, independent of the sensitivity of neuroimaging technology, and independent of physician accuracy in recognition of subtle traumatic brain injuries on CT.

We performed descriptive and univariable analyses with Fisher's exact test for categorical data, the Wilcoxon rank sum test for ordinal data, and Student's test for continuous data by using Stata statistical software (version 7.0, Stata Corporation, College Station, TX). Statistical significance was determined with 95% confidence intervals (CIs). Interobserver agreement was calculated with the κ coefficient.

We used Answer Tree 2.1 (SPSS, Inc., Chicago, IL) binary recursive partitioning software to create decision trees with 9 clinical variables for each of the following outcomes: (1) traumatic brain injury identified on CT scan, (2) traumatic brain injury requiring acute intervention, and (3) traumatic brain injury identified on CT scan or traumatic brain injury requiring acute intervention. This software package used the classification and regression tree algorithm and the Gini measure of impurity in decision tree creation. Binary recursive partitioning is a nonparametric analytic technique used to classify observations according to risk profiles for the outcome of interest by using a treelike structure with decision « nodes”.31 Recursive partitioning analysis may be preferable to multiple logistic regression when the objective is derivation of a highly sensitive clinical decision rule.32

Recursive partitioning allows for the inclusion of patients with missing predictors by substituting «surrogate” variables containing information similar to that contained in the missing variables. Therefore, preverbal children, who cannot provide information about headache and amnesia, were not excluded from the analyses.

In the construction of the trees, we assigned «costs” to misclassification errors that would parallel clinical decisionmaking. For the analysis of traumatic brain injury identified on CT imaging, we assigned a relative cost of 100 for the misclassification error of not identifying a patient who has a traumatic brain injury compared with the error of identifying patients as having a traumatic brain injury when they do not. For the analysis of traumatic brain injury requiring acute intervention, we assigned a relative cost of 500 to the error of missing a traumatic brain injury because of the greater clinical implications of this type of error. By making incorrect underdiagnoses more costly in these analyses, we sought to minimize these more important mistakes at the expense of overclassifying patients without traumatic brain injuries.

We internally validated the decision trees developed in the main analyses by using 10-fold cross-validation. The results of this cross-validation are demonstrated by a cross-validated «risk-estimate” of making a misclassification error, which is calculated by adding the probability of the 2 types of misclassification errors (false negative and false positive), each multiplied by their assigned relative costs.

The 9 predictor variables considered in the recursive partitioning analyses included a history of loss of consciousness, amnesia, seizure, or vomiting; current headache; and physical examination findings of abnormal mental status, focal neurologic deficits, signs of skull fracture, and scalp hematomas in children aged 2 years and younger because of the known association of scalp hematomas and traumatic brain injury in this age group.25, 26, 33, 34, 35, 36, 37

We determined the sensitivity and negative predictive values of each resulting decision tree, with 95% CIs and calculated positive and negative likelihood ratios for each tree. Only children who underwent CT scans were included in the analyses for traumatic brain injury identified on CT scan. All patients, however, were included in the analysis for traumatic brain injury requiring acute intervention.

We performed subanalyses on children with GCS scores of 14 or 15, as well as on children aged 2 years and younger, for the outcome of traumatic brain injury identified on CT scan, recognizing the importance of these subpopulations. We also performed a separate analysis on the full study population to identify those with traumatic brain injuries requiring neurosurgical procedures.

The study sample size goal was 90 children with traumatic brain injuries identified on CT scan. This figure is based on the suggested requirement of 10 outcomes of interest for each of the 9 predictive variables evaluated in multivariable logistic regression analyses.38, 39 Although this suggested ratio is not necessarily applicable to recursive partitioning analysis, limiting the number of predictor variables studied minimizes the likelihood of overfitting a model to our data.

3. Results 

return to Article Outline

We enrolled 2,043 (77.4%) of 2,640 eligible children. The mean age was 8.3 years (SD 5.3 years; range 10 days to 17.9 years), 327 (16%) were 2 years or younger, 65% were male patients, and 36% had histories of loss of consciousness. The mechanisms of injury were fall (35%), motor vehicle crash (19%), automobile versus pedestrian (11%), assault (8%), fall off bicycle (7%), automobile versus bicyclist (5%), child abuse (0.2%), and other (15%). Fifty-three percent of enrolled patients had isolated head trauma. The median GCS score of enrolled patients was 15 (interquartile range 15 to 15), and 91% had GCS scores of 14 or 15.

CT scans were performed on 1,271 (62.2%) patients, and traumatic brain injury on CT scan was present in 98 patients (7.7%; 95% CI 6.3% to 9.3%;Table 1). Of the 98 patients with traumatic brain injuries identified on CT scan, 23 (23.5%) did not meet the criteria for traumatic brain injury requiring acute intervention. Traumatic brain injuries requiring acute intervention were present in 105 (5.1%; 95% CI 4.2% to 6.2%) of the 2,043 patients (Table 2). Of these 105 patients, 12 (11.4%) died and 29 (27.6%) required neurosurgical procedures (Table 3). Twenty-nine (27.6%) of the patients with traumatic brain injury requiring acute intervention did not have a traumatic brain injury identified on the CT scan obtained in the ED (Table 4).

Table 1.

Traumatic brain injuries identified on CT (total 98 children).

Type of InjuryNo. (% of Children)
Cerebral contusion/hemorrhage50(51.0)
Subdural hematoma31 (31.6)
Subarachnoid hemorrhage24 (24.5)
Cerebral edema17 (17.3)
Epidural hematoma16 (16.3)

A total of 98 enrolled children had traumatic brain injury identified on CT scan; a combination of injuries was found in 41 of these 98 patients. Note that an isolated skull fracture was not considered a traumatic brain injury.

Table 2.

Description of children with traumatic brain injury requiring acute intervention (total 105 children).

Criteria MetNo. (% of Children)
Hospitalization ≥2 nights58 (55.2)
Neurosurgical procedure29 (27.6)
Neurologic deficit14 (13.3)
Antiepileptic medication >1 wk4 (3.8)

Without any of the other 3 criteria.

Table 3.

Neurosurgical procedures performed (total 29 children).

Neurosurgical ProcedureNo. of Patients (% of Children)
Ventriculostomy17 (58.6)
Hematoma evacuation14 (48.3)
Intracranial pressure monitor8 (27.6)
Tissue debridement5 (17.2)
Dura repair to correct cerebrospinal fluid leak2 (6.9)
Fracture elevation1 (3.4)

Twenty-nine enrolled children had a traumatic brain injury requiring a neurosurgical procedure; 7 of these children required a combination of procedures.

Table 4.

Description of the 29 children with traumatic brain injuries requiring acute intervention who did not have traumatic brain injury identified on CT from the ED.

Defining CharacteristicNo.Comment
Hospitalization ≥2 nights29Eighteen hospitalized for abnormal mental status, 4 required intravenous anti-biotics for deep scalp lacerations, over skull fractures, 3 required a neurosurgical procedure, 2 had persistent vomiting, 1 required observation for cerebrospinal fluid leak, 1 had persistent severe headache and dizziness
Antiepileptic medication for >7 d7One required a neurosurgical procedure, none had persistent neurologic deficits
Persistent neurologic deficit4None required anti-epileptic medication or a neurosurgical procedure
Neurosurgical procedure3One required antiepileptic medication, none had a persistent neurologic deficit

Sixteen of these 29 children had skull fractures evident on CT scan, and 8 had depressed skull fractures. Six of the 29 children underwent repeated neuroimaging (CT scan or magnetic resonance imaging) after leaving the ED, and 4 of these repeated studies were interpreted as positive for traumatic brain injury.

Follow-up was achieved in 88% of patients who were discharged to home from the ED, and none had a missed traumatic brain injury. Review of county morgue records and hospital trauma registry for the remaining 12% did not identify any patients with a missed traumatic brain injury.

Five hundred ninety-seven (22.6%) of the 2,640 eligible patients were inadvertently “missed” from enrollment, although both groups were similar (data not shown). The rate of traumatic brain injury identified on CT scan was similar between groups (7.7% for enrolled, 5.9% for missed patients; difference 1.8%; 95% CI –1.3% to 4.9%).

The univariable association between each predictor variable studied and traumatic brain injury identified on CT scan is presented in Table 5; the univariable association between each predictor variable studied and traumatic brain injury requiring acute intervention is presented in Table 6.

Table 5.

Univariable risks of traumatic brain injury on CT scan, given the presence or absence of selected predictors (1,271 patients imaged, 98 with traumatic brain injury identified on CT).

Predictor VariableRisk of TBI if Variable Present (%)Risk of TBI if Variable Absent (%)Relative Risk95% CI
Amnesia32/483 (6.6)12/373 (3.2)2.11.1–3.9
Loss of consciousness58/601 (9.7)15/411(3.6)2.61.5–5.6
Headache26/495 (5.3)13/380 (3.4)1.50.8–2.9
Seizure10/62 (16.1)79/1174 (6.7)2.41.3–4.4
History of vomiting28/245 (11.4)48/976 (4.9)2.31.5–3.6
Clinical signs of skull fracture23/67 (34.3)75/1204 (6.2)5.53.7–8.2
Focal neurologic deficit14/39 (35.9)84/1232 (6.8)5.33.3–8.4
Scalp hematoma and ≤2 y old14/77 (18.2)84/1194 (7.0)2.61.5–4.3
Abnormal mental status82/545 (15.1)16/726 (2.2)6.84.0–11.5

TBI, Traumatic brain injury.

Please see methods section for definitions of predictor and outcome variables.

Percentages were calculated only for patients who had known presence or absence of the variable of interest.

Table 6.

Univariable risks of traumatic brain injury requiring acute intervention given the presence or absence of selected predictors (2,043 patients enrolled, 105 with traumatic brain injury requiring acute intervention).

Predictor VariableRisk of TBI if Variable Present (%)Risk of TBI if Variable Absent (%)Relative Risk95% CI
Amnesia32/522 (6.1)12/913 (1.3)4.72.4–9.0
Loss of consciousness65/633 (10.3)15/114(1.4)7.64.4–13.3
Headache29/652 (4.5)8/813 (1.0)4.52.1–9.8
Seizure14/63 (22.2)81/1941 (4.2)5.33.2–8.9
History of vomiting27/271 (10.0)49/1716 (2.9)3.52.2–5.5
Clinical signs of skull fracture31/73 (42.5)74/1970 (3.8)11.38.0–16.0
Focal neurologic deficit18/39 (46.2)87/2004 (4.3)10.67.2–15.8
Scalp hematoma and ≤2 y old8/129 (6.2)97/1914 (5.1)1.20.6–2.5
Abnormal mental status94/578 (16.3)11/1465 (0.8)21.711.7–40.1

Please see methods section for definitions of predictor and outcome variables.

Percentages were calculated only for patients who had known presence or absence of the variable of interest.

Two investigators independently evaluated a convenience sample of 109 (5.3%) of the 2,043 patients. Interobserver agreement was moderate to almost perfect,40 with κ values ranging from 0.53 to 0.91 (P<.05 for all measurements; Table 7).

Table 7.

Interobserver agreement on the presence or absence of clinical predictors studied (total 109 children).

PredictorκProportion of Agreement, %
GCS score0.9198.1
History of vomiting0.8897.0
History of loss of consciousness0.8693.1
Altered mental status0.7689.0
Clinical signs of skull fracture0.7197.3
Seizure0.7197.1
Headache0.6783.6
Focal neurologic deficit0.6596.3
Amnesia0.6381.7
Scalp hematoma, age ≤2 y0.5376.9

P<.05 for all measurements.

In the binary recursive partitioning analysis for traumatic brain injury identified on CT scan, the most important variable was abnormal mental status (Figure 1). The other variables in this tree were clinical signs of skull fracture, scalp hematoma in children aged 2 years and younger, and a history of vomiting. The presence of any of these 4 predictors correctly identified 96 of the 98 children with traumatic brain injury on CT scan (sensitivity 98%; 95% CI 92.8% to 99.8%). Of the 526 patients who had none of the 4 findings, 524 did not have traumatic brain injury on CT scan (negative predictive value 99.6%; 95% CI 98.6% to 100%). The risk estimate of this model with our data was 0.668, and the cross-validation risk estimate was 0.876.


View full-size image.

Figure 1. Decision tree for predicting children with traumatic brain injuries on CT scan.


Two children with traumatic brain injuries identified on CT scan were not identified by this decision rule. One patient's CT scan was initially interpreted as normal, and he was discharged home from the ED. This patient was notified to return to the ED the following day after the CT scan was reinterpreted to have a small extra-axial hematoma. A repeat CT scan demonstrated a decrease in the size of the hematoma, and he was discharged home from the ED after neurosurgical consultation. The second patient with a traumatic brain injury not identified by this rule had a CT scan revealing a small subarachnoid hemorrhage, and he was admitted for 1 night of observation. Neither of these 2 patients met the criteria for traumatic brain injury requiring acute intervention.

The binary recursive partitioning analysis for traumatic brain injury requiring acute intervention identified clinical signs of skull fracture as the most important variable (Figure 2). The other variables in this tree were abnormal mental status, a history of vomiting, and headache. The presence of any of these 4 findings correctly identified all 105 of the children with traumatic brain injury requiring acute intervention (sensitivity 100%; 95% CI 97.2% to 100%). Of the 900 patients without any of the 4 findings, none had traumatic brain injury requiring acute intervention (negative predictive value 100%; 95% CI 99.7% to 100%), although 5 had traumatic brain injury identified on CT scan (including 4 infants ≤2 years with scalp hematomas). The risk estimate of this model with our data was 0.508, and the cross-validation risk estimate was 0.507.


View full-size image.

Figure 2. Decision tree for predicting children with traumatic brain injury requiring acute intervention.


We combined the predictors selected in the decision trees for recognizing traumatic brain injury identified on CT scan and traumatic brain injury requiring acute intervention (which differed by only 1 predictor variable) to generate a conservative decision rule for both outcomes (Figure 3). This rule, consisting of abnormal mental status, clinical evidence of a skull fracture, a history of vomiting, scalp hematoma (for patients ≤2 years), and headache, identified 97 (99%; 95% CI 94.4% to 100%) of the 98 children with traumatic brain injuries identified on CT scan and all 105 of children with traumatic brain injuries requiring acute intervention (100%; 95% CI 97.2% to 100%). Of the 304 (24%) children evaluated with CT scans who had none of these 5 predictors, only 1 (0.3%; 95% CI 0% to 1.8%) had a traumatic brain injury identified on CT scan (the previously described patient discharged home from the ED). Of the 827 patients without any of the 5 predictors, none had traumatic brain injuries requiring acute intervention (negative predictive value 100%; 95% CI 99.6% to 100%). Application of this rule to the children imaged by CT would have eliminated approximately one quarter of the CT scans obtained.


View full-size image.

Figure 3. Constructed decision rule for predicting children with traumatic brain injury identified on CT or traumatic brain injury requiring acute intervention (combining decision trees).


We performed a subanalysis on the 1,098 children with GCS scores of 14 and 15 who were evaluated with CT scan, of whom 39 (3.6%) had traumatic brain injury identified on CT scan. The decision tree for traumatic brain injury identified on CT scan included the same 4 predictor variables as in the main analysis, although the order of the variables in the resulting tree was different (Figure 4). The presence of any of these 4 predictor variables correctly identified 37 of 39 children with traumatic brain injury on CT scan (sensitivity 94.9%; 95% CI 82.7% to 99.4 %). Of the 526 patients who had none of the 4 findings, 524 did not have traumatic brain injury on CT scan (negative predictive value 99.6%; 95% CI 98.6% to 100%).


View full-size image.

Figure 4. Decision tree for predicting traumatic brain injury identified on CT in children with GCS scores of 14 and 15.


In the subanalysis of the 194 children aged 2 years and younger who were evaluated with CT scan, the decision tree for traumatic brain injury identified on CT scan included scalp hematoma and abnormal mental status (Figure 5), which identified all 15 (7.7%) children with traumatic brain injuries on CT scan (sensitivity 100%; 95% CI 81.9% to 100%). Fourteen of these 15 young children had scalp hematomas. Of the 60 children aged 2 years and younger who underwent CT and who had normal mental status and no scalp hematomas, none had a traumatic brain injury identified on CT scan (negative predictive value 100%; 95% CI 95.1% to 100%). Of the 194 children aged 2 years and younger who underwent CT, 15 (7.7%) had skull fractures on CT scan. Of these 15 children, 7 (46.7%) had traumatic brain injuries identified on CT.


View full-size image.

Figure 5. Decision tree for predicting traumatic brain injury identified on CT in children aged 2 years and younger.


Finally, in the analysis using the requirement for a neurosurgical procedure as the outcome, the 3 predictor variables in the decision tree included focal neurologic deficits, abnormal mental status, and a history of vomiting (Figure 6). These 3 variables identified all 29 children who required a neurosurgical procedure (sensitivity 100%; 95% CI 90.2% to 100%). Of the 1,295 children with none of the 3 variables, none required a neurosurgical procedure (negative predictive value 100%; 95% CI 99.8% to 100%).


View full-size image.

Figure 6. Decision tree for predicting the need for a neurosurgical procedure (a subset of individuals with traumatic brain injury requiring acute intervention). NSG, neurosurgical procedure.


4. Discussion 

return to Article Outline

In this study, we derived a decision rule with high sensitivity for traumatic brain injury and high negative predictive value for identifying children without traumatic brain injury after blunt head trauma. This rule uses abnormal mental status, clinical evidence of skull fracture, a history of vomiting, scalp hematoma (in children ≤2 years), and headache. These variables are routinely assessed by emergency physicians and have a high degree of interobserver agreement. These predictors identified all but 1 of the patients with traumatic brain injuries identified on CT scan and all patients with traumatic brain injuries requiring acute intervention.

Head trauma is a common and serious childhood health problem,1, 2, 3, 4, 41 and evaluation of children with head trauma has been identified by several agencies and organizations as a priority area of research.8, 24, 42, 43 Most children sustaining blunt head trauma, however, do not have traumatic brain injury.7, 8, 9, 10 Although CT is used frequently to evaluate children with head trauma, there is little consensus regarding appropriate indications for its use.22, 23 The benefits of information gained by CT imaging must be balanced by its disadvantages, which include exposure to ionizing radiation,15, 16, 17, 18 transport of the child away from the ED, the frequent requirement for pharmacologic sedation,19, 20, 21 additional health care costs, and increased time spent in the ED.

Identification of a reliable set of clinical predictors of traumatic brain injury in children with head trauma has been the goal of previous studies; however, the results have been inconclusive.7, 9, 10, 11, 12, 13, 14 Previous investigations have identified several signs and symptoms associated with traumatic brain injury in children7, 9, 10, 11, 12, 13, 14, 44, 45, 46 similar to those identified in the univariable analyses of the current study. None of these previous studies, however, derived a decision rule that identified all children with traumatic brain injury. These previous studies were frequently retrospective and enrolled relatively small numbers of children with traumatic brain injury, and only 1 used multivariable statistical analyses.10 Recently, 2 large prospective studies generated decision rules for obtaining CT scans in patients with mild head injuries.47, 48 One of these studies was limited to adults.48 In the second study, the mean age of patients was 36 years, and children younger than 3 years were excluded.47 Decision rules resulting from these studies, therefore, are unlikely to apply to children, particularly preverbal children. Given the conflicting nature of studies on this topic to date, there is limited consensus regarding the indications for use of CT scan for the evaluation of children with blunt head trauma. As a consequence, physicians' practice patterns vary.22, 23

Children younger than 2 years and with traumatic brain injuries may have subtle clinical presentations.33 Among these infants and young children, scalp hematoma is an important predictor of traumatic brain injury,33, 34, 35, 36, 37 and therefore we included scalp hematoma as a predictor of traumatic brain injury in children aged 2 years and younger. Scalp hematomas were present in 93% of children aged 2 years and younger with traumatic brain injuries identified on CT scan in our study and was the most important predictor variable in the subanalysis in this age group.

The current study differs from previous work in several important ways. The study sample size was relatively large, therefore allowing a powerful analysis. In addition, because our study was prospective, we were able to accurately determine the presence or absence of important clinical variables. We also defined a novel clinical outcome variable, traumatic brain injury requiring acute intervention. This clinical outcome variable is relevant to clinical decisionmaking, not dependent on neuroimaging modality, and independent of physician accuracy in interpreting the imaging study. Therefore, the decision rule for this outcome will likely be relevant in the foreseeable future, despite advances in neuroimaging technology. Finally, we used binary recursive partitioning, a multivariable analytic technique that may be preferable to multiple logistic regression for generating decision rules.32

Our study has several potential limitations. We included children with head trauma of various degrees of severity because it allowed for the generation of a decision rule applicable to all children who have sustained nontrivial blunt head trauma. In the subanalysis of patients with mild head injury (GCS scores of 14 and 15), however, the variables in the resulting decision tree for traumatic brain injury identified on CT scan were identical to those in our main analysis. Although recognition of a scalp hematoma in a child aged 2 years or younger had only a “moderate” κ value (0.53),40 this variable was included in the recursive partitioning analysis because of the known association between scalp hematoma and traumatic brain injury. The importance of this variable in the decision trees may serve to remind physicians of the importance of a careful scalp examination, particularly in the evaluation of children aged 2 years and younger.

Although evaluators were strictly instructed to complete the study data sheet before the CT results were known, we did not verify that these instructions were uniformly followed, which may have introduced some evaluator bias into the study. We did not feel it ethically justifiable, however, to delay CT testing to complete study data sheets. Ethical concerns also precluded our obtaining CT imaging on all patients. Most patients who were not imaged with CT, however, had telephone follow-up to identify missed traumatic brain injuries. Although clinical follow-up is an acceptable endpoint when more definitive testing is not feasible or ethical,28 some nonimaged patients may have had clinically silent but radiographically visible traumatic brain injuries.

The potential reduction in CT use resulting from the application of this rule at our center may not be replicated at all centers and may not result in a large net decrease in CT use of all children sustaining blunt head trauma. Application of this evidence-based rule to patients currently imaged with CT at our center would result in a substantial net decrease in CT use. Nevertheless, because of the imperfect specificity of the rule, it is possible that CT use among children not currently imaged may increase. The potential increase in CT use in patients not currently imaged is likely limited, however, because of idiosyncrasies in our variable definitions. For example, our rule treated children with ongoing vomiting the same as children who had vomited only once. This distinction was not captured by our dichotomous variable definition and in our decision rules but would likely be used in clinical decisionmaking by emergency physicians. We chose dichotomous variable definitions, however, to simplify data collection and to generate a simple decision rule.

Although this study had a relatively large sample size, the 95% CIs for the sensitivity of the decision rule may be wider than some physicians would accept.49 A large, multicenter study is needed to further narrow the CIs. Finally, although the decision trees were constructed and validated by using internal 10-fold cross-validation, external validation with a large, diverse sample of pediatric head trauma patients is necessary.

In conclusion, we created a clinical decision rule with high sensitivity for traumatic brain injury and high negative predictive value for identifying children without traumatic brain injuries after blunt head trauma. Important variables include abnormal mental status, clinical signs of skull fracture, a history of vomiting, scalp hematoma (in children ≤2 years), and headache. Use of this rule may decrease CT use in patients without an appreciable risk of traumatic brain injury.

Acknowledgments 

return to Article Outline

We thank Rahman Azari, PhD, for helpful discussions about the analysis of the data and comments on the manuscript, and Nicole Glaser, MD, for her thoughtful reviews of the manuscript.

References 

return to Article Outline
References

1. 1 National Vital Statistics System . Ten Leading Causes of Death, United States. 1999. Atlanta, GA: National Center for Injury Prevention and Control, Centers for Disease Control; 1999;.

2. 2 Hoyert DL, Arias E, Smith B, et al.  In: Final Data for 1999: National Vital Statistics Reports. Vol. 49:Hyattsville, MD: National Center for Health Statistics; 2001;.

3. 3 National Center for Injury Prevention and Control . Traumatic Brain Injury in the United States: A Report to Congress. Atlanta, GA: Centers for Disease Control and Prevention; 1999;.

4. 4 Kraus JF, Rock R, Hemyari P. Brain injuries among infants, children, adolescents and young adults. Am J Dis Child. 1990;144:684–691.

5. 5 Centers for Disease Control and Prevention . 2000 National Hospital Ambulatory Medical Care Survey, Emergency Department File 2002 [on CD-ROM]. Hyattsville, MD: National Center for Health Statistics; 2002; Vital Health Stat Series 13, No. 33..

6. 6 National Center for Injury Prevention and Control . Traumatic Brain Injury in the United States: Assessing Outcomes in Children. Atlanta, GA: Centers for Disease Control and Prevention; 2002;.

7. 7 Davis RL, Mullen N, Makela M, et al.  Cranial computed tomography scans in children after minimal head injury with loss of consciousness. Ann Emerg Med. 1994;24:640–645. Abstract | Full Text | CrossRef

8. 8 Homer CJ. American Academy of Pediatrics technical report: blunt head injury in children. Pediatrics. 1999;104:1–7.

9. 9 Schunk JE, Rodgerson JD, Woodward GA. The utility of head computed tomographic scanning in pediatric patients with normal neurologic examination in the emergency department. Pediatr Emerg Care. 1996;2:160–165.

10. 10 Quayle KS, Jaffe DM, Kuppermann N, et al. Diagnostic testing for acute head injury in children: when are head computed tomography and skull radiographs indicated? Pediatrics. 1997;99:e1-8.

11. 11 Hennes H, Lee M, Smith D, et al.  Clinical predictors of severe head trauma in children. Am J Dis Child. 1988;142:1045–1047.

12. 12 Ramundo M, McKnight T, Kempf J, et al.  Clinical predictors of computed tomographic abnormalities following pediatric traumatic brain injury. Pediatr Emerg Care. 1995;11:27–30. MEDLINE | CrossRef

13. 13 Simon B, Letourneau P, Vitorino E, et al.  Pediatric minor head trauma: indications for computed tomographic scanning revisited. J Trauma. 2001;51:231–238. MEDLINE

14. 14 Rivera F, Tanaguchi D, Parish RA. Poor prediction of positive computed tomographic scans by clinical criteria in symptomatic pediatric head trauma. Pediatrics. 1986;80:579–584.

15. 15 Brenner DJ, Elliston C, Hall E, et al.  Estimated risks of radiation-induced fatal cancer from pediatric CT. AJR Am J Roentgenol. 2001;176:289–296.

16. 16 Brody AS, Guillerman RP. Radiation risk from diagnostic imaging. Pediatr Ann. 2002;31:643–647. MEDLINE

17. 17 Hall EJ. Lessons we have learned from our children: cancer risks from diagnostic radiology. Pediatr Radiol. 2002;32:700–706. MEDLINE | CrossRef

18. 18 Infante-Rivard C, Mathonnet G, Sinett D. Risk of childhood leukemia associated with diagnostic irradiation and polymorphisms in DNA repair genes. Environ Health Perspect. 2000;108:495–498. MEDLINE

19. 19 Conners GP, Sacks WK, Leahey NF. Variations in sedating uncooperative, stable children for post-traumatic head CT. Pediatr Emerg Care. 1999;15:241–244. MEDLINE | CrossRef

20. 20 Hoffman GM, Nowakowski R, Troshynski TJ, et al.  Risk reduction in pediatric procedural sedation by application of an American Academy of Pediatrics/American Society of Anesthesiologists process model. Pediatrics. 2002;109:236–243.

21. 21 Moro-Sutherland DM, Algren JT, Louis PT, et al.  Comparison of intravenous midazolam with pentobarbital for sedation for head computed tomography imaging. Acad Emerg Med. 2000;7:1370–1375. MEDLINE | CrossRef

22. 22 Aitken ME, Herrerias CT, Davis RL, et al.  Blunt head injury in children. Arch Pediatr Adolesc Med. 1998;152:1176–1180. MEDLINE

23. 23 Klassen TP, Reed MH, Stiell IG, et al.  Variation in utilization of computed tomography scanning for the investigation of minor head trauma in children: a Canadian experience. Acad Emerg Med. 2000;7:739–744. MEDLINE | CrossRef

24. 24 Committee on Quality Improvement, American Academy of Pediatrics, and Commission on Clinical Policies and Research, American Academy of Family Physicians . The management of minor closed head injury in children. Pediatrics. 1999;104:1407–1415.

25. 25 Schutzman SA, Barnes P, Duhaime AC, et al.  Evaluation and management of children younger than two years old with apparently minor head trauma: proposed guidelines. Pediatrics. 2001;107:983–993.

26. 26 Schutzman SA, Greenes DS. Pediatric minor head trauma. Ann Emerg Med. 2001;37:65–74. Abstract | Full Text | Full-Text PDF (85 KB) | CrossRef

27. 27 James HE. Neurologic evaluation and support in the child with an acute brain insult. Pediatr Ann. 1986;15:16–22. MEDLINE

28. 28 Jaeschke R, Guyatt G, Sackett DL. User's guides to the medical literature, III: How to use an article about a diagnostic test: A: are the results of the study valid?. JAMA. 1994;271:389–391. MEDLINE

29. 29 Kadish HA, Schunk JE. Pediatric basilar skull fracture: do children with normal neurologic findings and no intracranial injury require hospitalization?. Ann Emerg Med. 1995;26:37–41. Abstract | Full Text | Full-Text PDF (477 KB) | CrossRef

30. 30 Greenes DS, Schutzman SA. Infants with isolated skull fracture: what are their clinical characteristics, and do they require hospitalization?. Ann Emerg Med. 1997;30:253–259. Abstract | Full Text | Full-Text PDF (679 KB) | CrossRef

31. 31 Brieman L, Friedman JH, Olshen RA, et al.  Classification and Regression Trees. Washington, DC: Champan & Hall; 1994;.

32. 32 Stiell IG, Wells GA. Methodologic standards for the development of clinical decision rules in emergency medicine. Ann Emerg Med. 1999;33:437–447. Abstract | Full Text | Full-Text PDF (85 KB) | CrossRef

33. 33 Greenes DS, Schutzman SA. Occult intracranial injury in infants. Ann Emerg Med. 1998;32:680–686. Abstract | Full Text | Full-Text PDF (40 KB) | CrossRef

34. 34 Greenes DS, Schutzman SA. Infants with isolated skull fracture: what are their clinical characteristics, and do they require hospitalization?. Ann Emerg Med. 1997;30:253–259. Abstract | Full Text | Full-Text PDF (679 KB) | CrossRef

35. 35 Greenes DS, Schutzman SA. Clinical indicators of intracranial injury in head-injured infants. Pediatrics. 1999;104:861–867.

36. 36 Greenes DS, Schutzman SA. Clinical significance of scalp abnormalities in asymptomatic head-injured infants. Pediatr Emerg Care. 2001;17:88–92. MEDLINE | CrossRef

37. 37 Gruskin KD, Schutzman SA. Head trauma in children younger than 2 years: are there predictors for complications?. Arch Pediatr Adolesc Med. 1999;153:15–20. MEDLINE

38. 38 Peduczzi R, Concato J, Feinstein AR, et al.  Importance of events per independent variable in proportional hazards regression analysis, II: Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48:1503–1510. Abstract | Full-Text PDF (575 KB) | CrossRef

39. 39 Peduczzi R, Concato J, Kemper E, et al.  A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373–1379. Abstract | Full-Text PDF (684 KB) | CrossRef

40. 40 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. CrossRef

41. 41 Langlois JA. In: Traumatic Brain Injury in the United States: Assessing Outcomes in Children. Atlanta, GA: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention; 2001;p. 1–50.

42. 42 Durch JS, Lohr KN. Emergency Medical Services for Children. Washington, DC: National Academy Press; 1993;.

43. 43 Seidel JS, Henderson D, Tittle S, et al.  Priorities for research in emergency medical services for children: results of a consensus conference. Ann Emerg Med. 1999;33:206–210. Abstract | Full Text | Full-Text PDF (57 KB) | CrossRef

44. 44 Mitchell KA, Fallat ME, Raque GH, et al.  Evaluation of minor head injury in children. J Pediatr Surg. 1994;29:851–854. Abstract | CrossRef

45. 45 Dietrich AM, Bowman MJ, Ginn-Pease ME. Pediatric head injuries: can clinical factors reliably predict an abnormality on computed tomography?. Ann Emerg Med. 1993;22:1535–1540. Abstract | Full-Text PDF (585 KB) | CrossRef

46. 46 Bonadio WA, Smith DS, Hillmann S. Clinical indicators of intracranial lesion on computed tomographic scan in children with parietal skull fracture. Am J Dis Child. 1989;143:194–196.

47. 47 Haydel MJ, Preston CA, Mills TJ, et al.  Indications for computed tomography in patients with minor head trauma. N Engl J Med. 2000;343:100–105. MEDLINE | CrossRef

48. 48 Stiell IG, Wells GA, Vandemheen K, et al.  The Canadian CT head rule for patients with minor head injury. Lancet. 2001;357:1391–1396. Abstract | Full Text | Full-Text PDF (95 KB) | CrossRef

49. 49 Graham ID, Stiell IG, Laupacis A, et al.  Emergency physicians' attitudes toward and use of clinical decision rules for radiography. Acad Emerg Med. 1998;5:134–140. MEDLINE | CrossRef

a Division of Emergency Medicine, Department of Internal Medicine, University of California–Davis School of Medicine, Davis, CA, USA

b Department of Pediatrics, University of California–Davis School of Medicine, Davis, CA, USA

c Department of Radiology, University of California–Davis School of Medicine, Davis, CA, USA

d Department of Emergency Medicine, Oregon Health Sciences University, School of Medicine, Portland, OR, USA

Corresponding Author InformationAddress for reprints: Nathan Kuppermann, MD, MPH, University of California–Davis Medical Center, PSSB 2100, 2315 Stockton Boulevard, Sacramento, CA 95817-2282; 916-734-1535, fax 916-734-7950

 This article is dedicated to the memory of our beloved friend and colleague, James Seidel, MD, PhD, who was a tireless and vocal advocate for the health and welfare of children.

Author contributions: MJP and NK conceived the study and obtained funding for the study. MJP, NK, REG, JFH, JWS, and RWD designed the study. MJP, NK, JFH, CWV, REG, BAS, and MJH participated in data collection, SLWG participated in radiographic interpretation, NK and MJP analyzed and interpreted the data, and MJP and NK drafted the manuscript. All authors participated in manuscript review and revision. MJP takes responsibility for the paper as a whole.

Presented in part at the 3rd National Congress for Emergency Medical Services for Children, Dallas, TX, April 2002, the Pediatric Academic Society national meeting, Baltimore, MD, May 2002, and the Society of Academic Emergency Medicine national meeting, St. Louis, MO, May 2002.

Supported by a Hibbard E. Williams Grant, University of California–Davis School of Medicine; Faculty Research Grant, University of California–Davis School of Medicine; and a Children's Miracle Network Grant.

PII: S0196-0644(03)00425-6

doi:10.1067/S0196-0644(03)00425-6


View previous. 17 of 50 View next.