An effectiveness-implementation hybrid trial study protocol targeting posttraumatic stress disorder and comorbidity
© Zatzick et al. 2016
Received: 7 April 2016
Accepted: 20 April 2016
Published: 30 April 2016
Each year in the USA, 1.5–2.5 million Americans are so severely injured that they require inpatient hospitalization. Multiple conditions including posttraumatic stress disorder (PTSD), alcohol and drug use problems, depression, and chronic medical conditions are endemic among physical trauma survivors with and without traumatic brain injuries.
The trauma survivors outcomes and support (TSOS) effectiveness-implementation hybrid trial is designed to test the delivery of high-quality screening and intervention for PTSD and comorbidities across 24 US level I trauma center sites. The pragmatic trial aims to recruit 960 patients. The TSOS investigation employs a stepped wedge cluster randomized design in which sites are randomized sequentially to initiate the intervention. Patients identified by a 10-domain electronic health record screen as high risk for PTSD are formally assessed with the PTSD Checklist for study entry. Patients randomized to the intervention condition will receive stepped collaborative care, while patients randomized to the control condition will receive enhanced usual care. The intervention training begins with a 1-day on-site workshop in the collaborative care intervention core elements that include care management, medication, cognitive behavioral therapy, and motivational-interviewing elements targeting PTSD and comorbidity. The training is followed by site supervision from the study team. The investigation aims to determine if intervention patients demonstrate significant reductions in PTSD and depressive symptoms, suicidal ideation, alcohol consumption, and improvements in physical function when compared to control patients. The study uses implementation science conceptual frameworks to evaluate the uptake of the intervention model. At the completion of the pragmatic trial, results will be presented at an American College of Surgeons’ policy summit. Twenty-four representative US level I trauma centers have been selected for the study, and the protocol is being rolled out nationally.
The TSOS pragmatic trial simultaneously aims to establish the effectiveness of the collaborative care intervention targeting PTSD and comorbidity while also addressing sustainable implementation through American College of Surgeons’ regulatory policy. The TSOS effectiveness-implementation hybrid design highlights the importance of partnerships with professional societies that can provide regulatory mandates targeting enhanced health care system sustainability of pragmatic trial results.
ClinicalTrials.gov NCT02655354. Registered 27 July 2015.
KeywordsTraumatic injury Multiple chronic conditions Posttraumatic stress disorder Depression Suicidal ideation Substance abuse Effectiveness-implementation hybrid Pragmatic clinical trial American College of Surgeons Policy
The overarching goal of the trauma survivors outcomes and support (TSOS) effectiveness-implementation hybrid clinical trial is to develop and implement a large scale, cluster randomized pragmatic demonstration project that directly informs national trauma care system policy targeting injured patients with presentations of posttraumatic stress disorder (PTSD) and related comorbidity. Physical injury occurs frequently in the USA and constitutes both a substantial source of individual suffering and a significant public health burden. Each year in the USA, over 30 million individuals present to acute care medical trauma center and emergency department settings for the treatment of traumatic physical injury [1–5]. Injured trauma survivors present to acute care medical settings after both intentional (e.g., gunshots, stabbings, physical assaults) and unintentional (natural disasters, motor vehicle crashes) injury events . Annually, 1.5–2.5 million Americans are so severely injured that they require inpatient hospitalization [1–5]. Estimates suggest that approximately 1.5 million American youth and adults experience traumatic brain injury (TBI) annually [7, 8]. Physical injury with and without TBI constitutes a major public health problem for both civilian and veteran patient populations [9, 10]. Globally, traumatic injury accounts for approximately 16 % of the world’s burden of disease [11–13].
Multiple chronic conditions appear to be endemic among physical trauma survivors treated in US trauma care systems [14–16]. Recent commentary has explicated chronic conditions as conditions that last 1 year or more and require ongoing medical attention and/or limit activities of daily living [17–19]. Highly prevalent comorbidities include enduring PTSD, depression, and associated suicidal ideation, alcohol, and drug use problems, TBI, and chronic medical conditions such as hypertension, coronary artery disease, diabetes, and pulmonary disease [14, 20, 21].
Evidence-based, collaborative care intervention models for PTSD and related comorbidities exist [16, 22–25]. Collaborative care treatment models however, have yet to be broadly implemented throughout US trauma care systems; prior investigation by members of the interdisciplinary study team suggest that less than 10 % of US trauma centers routinely provide post-injury screening or integrated care management treatment targeting the cluster of PTSD and related comorbidities . The enduring challenges presented by the chronic disease cluster of PTSD and comorbidities after injury require innovative research approaches that cut across the traditional domains of multiple NIH institutes (https://www.nihcollaboratory.org).
The investigation is designed as an effectiveness-implementation hybrid pragmatic trial that simultaneously aims to assess the treatment outcomes of the collaborative care intervention targeting PTSD and comorbidity, while also assessing the potential utility of the implementation strategy . The study aims to determine if injured patients receiving the collaborative care intervention demonstrate significant reductions in PTSD symptoms when compared to control patients receiving care as usual. The study also aims to determine if intervention patients, when compared to control patients, will demonstrate significant reductions in depressive symptoms and associated suicidal ideation, alcohol use problems, and improvements in physical function.
Over the past decade, the study team has established a stakeholder partnership with the American College of Surgeons’ Committee on Trauma, whereby the results of pragmatic comparative effectiveness trials can be directly translated into policy mandates and best practice guidelines for the regulation of US trauma care systems [26, 28–31]. The investigative team will employ implementation science conceptual frameworks to better understand the potential uptake of the intervention model by trauma care systems nationwide.
Implementation science and randomized clinical trial conceptual frameworks informing the TSOS trial
Recent commentary has noted a proliferation of models and conceptual frameworks that can potentially inform the design of investigations that target the widespread dissemination and implementation of health care interventions; in reviewing this literature, commentary suggests a systematic selection of optimal approaches for a particular investigation or health care delivery system [32–34].
The implementation science conceptual frameworks influencing study design begin with the reach effectiveness adoption implementation maintenance (RE-AIM) evaluation framework that outlines clear stages of assessment for both effectiveness and implementation outcomes (Fig. 1). The RE-AIM framework provides a model for the integration of pragmatic trial results into routine trauma center practice . Diffusion of innovation theory, which emphasizes the factors related to the intervention and setting characteristics, aids in the framing of the population-based sampling and adoption of trauma centers as well as descriptions of maintenance, based on the trial’s ability to target American College of Surgeons’ policy in order to shift “S-shaped” adopter curves nationally .
Clinical trial specific constructs and design features also contribute to the conceptual framework informing the TSOS study (Fig. 1). These include the emerging effectiveness-implementation hybrid design construct . The TSOS trial simultaneously aims to determine the effectiveness of the stepped collaborative care intervention model in reducing PTSD symptoms and comorbid conditions, while also assessing the potential utility of the implementation strategy that uses American College of Surgeons’ policy to target regulatory mandates for trauma care systems nationally [37, 44].
The pragmatic-explanatory continuum indicator summary (PRECIS) pragmatic trial framework also informs the TSOS study . Gold standards for pragmatic trial design and implementation include broad participant eligibility criteria, flexible intervention delivery, application by the full range of practitioners, and incorporation of rigorous prospective controls, preferably by randomization. Usual practice comparison conditions are frequently used in pragmatic trials [39, 44–48]. The optimal pragmatic trial is characterized by an intent-to-treat data analytic approach that includes all patients regardless of adherence . The TSOS trial encompasses these pragmatic trial attributes by fielding a readily implementable collaborative care intervention that targets injured patients with the full spectrum of PTSD and related comorbidity with minimal exclusionary criteria.
Pragmatic trial process and outcome assessments have been conceptualized to be centrally measured, clinically meaningful, and require minimal adjudication [39, 44–48]. With regard to pragmatic trials in US trauma care systems, no one or even multiple administrative databases can be used to track outcomes among injured trauma survivors; thus for trauma care system pragmatic trials, scheduled telephone outcome assessments may by necessity occur as an addition to naturalistic follow-up. The PRECIS framework suggests that for some trials, outcome assessments must by necessity be obtained through contact with participants . Similarly, the PRECIS framework takes into consideration the observation that in some trials that rely heavily on patient reported outcomes, some training in the assessment and adjudication may be desirable .
As an integrative model (Fig. 1), the Robust, Sustainable, Implementation Systems Framework  aids in combining the implementation science, pragmatic trial, and health care systems change conceptual frameworks that inform the TSOS study; conceptually the Robust, Sustainable, Implementation Systems Framework integrates elements of process and implementation models, determinant frameworks, and clinical trial frameworks (e.g., multiple comorbid condition targets and critical intervention elements) as well as the RE-AIM evaluation framework [32, 37] (Fig. 1). A further advantage of the framework is the flexible integration of recent work on barriers and facilitators of acute care medical screening and intervention guideline implementation ([49–51]). Policy relevance that ultimately enhances clinical trial population impact is also relevant to the Robust, Sustainable, Implementation Systems Framework [37, 52, 53]).
The TSOS trial aims to recruit 960 patients, 40 at each trauma center site. The TSOS investigation employs a stepped wedge cluster randomized design in which sites are randomized sequentially to initiate the intervention. Patients are assessed at baseline in the emergency department or as trauma inpatients and again 3, 6, and 12 months after the injury. All sites have worked with the study team to implement an electronic health record (EHR) initial PTSD risk evaluation. Patients identified by the EHR evaluation as high risk for PTSD are formally assessed with the PTSD Checklist for study entry. Patients in the control condition will receive enhanced trauma center care as usual. Patients in the intervention condition will receive a stepped collaborative care intervention targeting PTSD and related comorbidities. The intervention begins with a 1-day workshop training in the collaborative care intervention core elements that include care management, medication, cognitive behavioral therapy (CBT), and motivational interviewing targeting PTSD and comorbidity. After the 1-day workshop, the site will receive supervision from the study team. Outcome analyses will incorporate both effectiveness and implementation spectrum assessments.
Injury cohort definition, exclusions, and PTSD risk screening
Prior to the initiation of recruitment for the TSOS study, the investigative team worked with each trauma center site to define injury cohorts, characterize inclusion and exclusion phenotypes within the EHR , and implement the 10 domain EHR PTSD risk screen [16, 55]. The procedures used to define injury cohorts and characterize potential emergency department and trauma inpatient subjects for the recruitment process varied across sites depending on the capacity of individual sites to automate the screening procedure within or external to the EHR . The automated form of the evaluation can be performed using EHR data queries or scheduled reports, while the manual form of the abstraction procedure involves reviewing individual health records; many sites have combined automated and manual procedures into a partially automated (i.e., hybrid) 10-domain risk screen.
Patients identified by EHR evaluation as at-risk for high early PTSD symptom levels with a score of >3 risk domains positive will then be formally screened for study entry with the PTSD Checklist Civilian Version [57, 58]. Patients scoring >35 on the PTSD Checklist will be followed longitudinally in the clinical trial portion of the investigation.
Enhanced usual care control condition
The control patient subjects will receive enhanced usual trauma center care. Prior investigation suggests that usual posttraumatic care includes routine surgical, primary care, and emergency department visits, as well as the occasional use of specialty mental health services. The enhanced aspect of the usual care will consist of the recruiting provider informing the ward nurse currently covering the patient subject’s care of any distress they are experiencing as identified by a PTSD Checklist score of >35 or Patient Health Questionnaire (PHQ-9) item 9 > 1 indicating suicidal ideation, administered during the baseline interview.
Core elements of collaborative care intervention targeting PTSD and comorbidity after injury
Which disorders targeted
MCC strategic framework goals addresseda
Population-based EHR PTSD and comorbidity risk prediction
PTSD, depression, suicidal ideation, alcohol and drug use problems, TBI and chronic medical conditions after acute injury
Goal 1 objective D implement and efficiently use health information technology; EHR screening efficiently identifies constellation of PTSD and comorbidity in injured populations
Care management with trauma center to primary care linkage
Coordination of acute injury mental health and pre-existing chronic medical condition care
Goal 2 facilitate use of community based services and self-care management
Early post-injury medication history, reconciliation, and care coordination
PTSD, depression, pain, and TBI symptoms prevention. Chronic medical condition reconciliation and coordination
Goal 1 objective E prevent occurrence of new chronic conditions and mitigate the consequences of existing conditions
Goal 2 objective C provide tools for medication management
Evidence-based MI embedded within care management
Targets alcohol and drug use problems and enhanced patient engagement
Goal 1 objective E prevent occurrence of new chronic conditions and mitigate the consequences of existing conditions
Evidence-based CBT embedded within care management
Targets PTSD, depression, pain, and TBI symptoms. Also targets enhanced patient self-efficacy
Goal 1 objective E prevent occurrence of new chronic conditions and mitigate the consequences of existing conditions
Goal 2 objective A facilitate self-care management
Patient and caregiver-centered posttraumatic concern elicitation and improvement
Patient-centered concerns elicitation and improvement targets patient and family engagement in care of full MCC constellation
Goal 2 optimize self-care management and coordinated use of services by patient and caregivers
Caseload supervision and stepped measurement-based care implementation
PTSD, depression and associated suicidal ideation, alcohol and drug use problems, chronic medical conditions and acute physical injury
Goal 3 provide better information and education on treatment of MCCs to health care workers
A large body of research has established the effectiveness of integrated care delivery models such as collaborative care in reducing depressive, anxiety, pain, and other somatic symptom presentations in conjunction with comorbid medical conditions in primary care settings [22, 23, 25, 61, 64–78]. Collaborative care treatments bring together effective medication and psychotherapeutic intervention elements with care management strategies that target reductions in care fragmentation and enhanced care coordination for patients with multiple chronic conditions (Table 1). A series of single site acute care medical studies now support the effectiveness of collaborative care models in targeting the PTSD and comorbidity chronic condition cluster [16, 22–25].
Study staff will visit the trauma center sites in order to perform a 1-day intervention workshop training. The workshop will provide an overview of the core elements of the PTSD and comorbidity intervention (Table 1). The trainers will review the intervention elements including care management, medications, motivational interviewing (MI) and CBT elements, and community linkage. Specific intervention procedures have been detailed previously [16, 22–25].
After the 1-day workshop training, the study team will initiate regular site care management supervisory calls in which the site interventionists will present cases to the supervisory team [16, 79]. These sessions will include coaching in concern elicitation, CBT, and MI elements embedded within care management, as well as problem-solving barriers to screening and intervention implementation for PTSD and related comorbidity. These calls will also include coaching on evidence-based medication prescription and supervisory team written feedback. The care managers will be able to contact MD and PhD study team members on a 24-h study cell phone or study assistance email should more urgent questions arise. While final patient subject follow-up interviews take place approximately 12 months post-consent, intervention activities are anticipated to conclude approximately 6 months after patient subjects consent into the trial. During the final months of treatment, the interventionist will discuss with the patient strategies for maintaining treatment gains. This means proper handoff of medication prescription management to a patient subject’s preferred primary care or other medical provider, linkage to community resources, engaging family and community support, and when indicated psychotherapy referrals.
The PTSD Checklist is a 17-item self-report questionnaire that will be used to assess PTSD symptoms. A series of investigations have demonstrated the reliability and validity of the PTSD Checklist across trauma-exposed populations. PTSD Checklist scores of >35 in the days and weeks after injury admission have been shown to be associated with the development of higher PTSD symptom levels over the course of the year after injury .
Secondary study patient-reported outcomes: depressive symptoms, suicidal ideation, alcohol use problems, and physical function
Depressive symptoms. The 9-item Patient Health Questionnaire (PHQ-9) brief depression severity measure will be used to assess depressive symptoms . The PHQ-9 has established reliability and validity in acute and primary care medical patients [16, 25, 83].
Suicidal ideation. The PHQ-9, item 9, will be used to assess for suicidal ideation .
Alcohol use problems. The Alcohol Use Disorder Identification Test (AUDIT), a ten-item screening instrument for the early identification of problem drinkers will be used to assess alcohol use problems before and after the injury hospitalization . The AUDIT’s reliability and validity are well established, and the scale has been widely used in acute and primary care medical settings [16, 25, 85–87].
Limitations in physical function. The investigation will use the Medical Outcomes Study Short Form (MOS SF) SF-12 at baseline and SF-36 at 3-, 6-, and 12-month follow-up to assess physical, role, and social functional outcomes. The SF-12/36 has established reliability and validity , and the measure has been used extensively with traumatically injured populations [89–91].
Baseline patient trauma center/emergency department electronic health record (EHR) assessment
EHR data will be collected from each of the 24 sites during the recruitment of study patients. Similarly, trauma registry data will be obtained from each of the 24 sites that will contain EHR derived international classification of diseases (ICD) codes and other clinical data.
EHR 10 item PTSD risk factor screen. A previously developed EHR screen will be used to assess admitted injured trauma survivors at risk for the development of PTSD . The screen utilized ten data elements that are both associated with increased risk for PTSD and that are readily available in any robust EHR system. When the ten data elements were used to predict scores on the PTSD Checklist of >35, the EHR screen demonstrated adequate sensitivity (0.71), specificity (0.66), and area under the ROC curve (0.72) .
Injury severity. Injury severity will be abstracted from the medical record using a conversion software program that transforms recognized ICD codes into the Abbreviated Injury Scale (AIS) and subsequent injury severity scores (ISS) .
Traumatic brain injury (TBI). Mild, moderate, and severe TBI will be identified and categorized from electronic record abstracted ICD codes indicative of traumatic injury.
Medical conditions. Comorbid chronic medical conditions will also be taken from medical record and trauma registry data and will be derived from ICD diagnostic codes [93, 94]. Chronic medical comorbidity will also be assessed through patient self-report during the follow-up interviews.
Trauma center organizational assessments [95–100]. The study will modify previously developed organizational culture and climate assessment scales to evaluate trauma center organizational characteristics related to PTSD and comorbidity service implementation [95, 101, 102]. Organizational implementation scales will assess the extent to which trauma centers were able to adapt to the changes required by PTSD and comorbidity screening and intervention service development [96, 101]. Trauma center provider attrition from the study and turnover will also be examined. Following the procedure established in the study team’s previous Disseminating Organizational Screening and Brief Intervention Services (DO-SBIS) pragmatic trial, ten providers from each of the 24 sites will be identified through an organizational mapping procedure to be part of the organizational work unit impacted by screening and intervention service delivery [101, 103]. These ten providers will complete the organizational assessment prior to beginning intervention activities and again in study year 4 after all patient intervention is complete.
Trauma center provider exposure to critical incidents and job stress [104, 105]. Previously developed items will be used to assess trauma center provider job-related stress (e.g., call frequency, work volume) . Provider secondary traumatic stress, lifetime trauma, and PTSD symptoms will also be assessed [6, 58, 81, 106, 107].
Intervention provider standardized patient assessments . In the study team’s prior DO-SBIS pragmatic trial focusing on alcohol screening and intervention, standardized patient fidelity assessments were used to assess fidelity to MI interventions delivered by front-line trauma center providers. Each standardized patient interview was scored using the Motivational Interviewing Treatment Integrity (MITI) coding system. The MITI will again be used to code patient standardized interviews in the current TSOS study.
Exploratory health economic evaluation
The cost assessments are intended to contribute to an understanding of the resource implications of the intervention and to American College of Surgeons’ and other national policy dialogues of post-injury health service utilization and costs to support subsequent intervention scale-up and spread [109–118]. The investigation will collect detailed information on the following: (1) the costs of intervention implementation and delivery, (2) post-injury health service utilization costs (e.g., inpatient, skilled nursing facility, emergency room, and outpatient utilization), and (3) the costs of patient medications post-injury. Costs of intervention are likely to be dwarfed by the total costs of post-injury care, which would make it difficult to estimate the incremental costs of intervention precisely, given our sample size. The health care resource utilization and cost analyses constitute an important exploratory aim of the investigation.
Study team logging procedures
The approach to trial logging simultaneously aimed to satisfy the pragmatic trial requisite for the minimization of time intensive research methods that require extensive adjudication  and the implementation science goal of understanding and documentation of trial processes that could yield sustainable maintenance of screening and intervention procedures .
Because pragmatic trials tacitly aim to provide health care delivery settings with readily implementable intervention models, logging procedures that differentiate study team activities related to (1) the fielding of the trial, (2) the implementation of evidence-based interventions, (3) costing and economic analyses, and (4) regulatory procedures may be critical for pragmatic trial design and implementation. Previously articulated procedures for the logging of clinical trial and implementation activities were adapted for the current pragmatic trial approach [119, 120]. A pragmatic trial framework that emphasized time efficiency and minimal adjudication of logged activities argued for optimizing parsimony in the logging approach . All study research team site contacts, including email, phone, and in-person site contacts, and all study team consultant (e.g., trauma surgery champion) contact with sites are logged. Both 24 site specific logs and domain specific logs (i.e., trial specific activities, evidence-based intervention implementation, sustainability, and economic considerations) will be maintained. As part of the study’s mixed method assessment procedures, the logs and field notes will be reviewed on an approximately monthly basis with the investigation’s mixed methods consultant [70, 121–123].
After the completion of recruitment and intervention activities, semi-structured interviews will be conducted with interventionists from each of the 24 trauma center sites. The interviews will explore barriers and facilitators of implementation of screening, intervention, and quality documentation procedures for PTSD and comorbidity at trauma center sites. The interviews will also explore the potential sustainability of study procedures.
Effectiveness assessments and timing of administration
EHR 10 item PTSD evaluation 
ICD injury severity
ICD TBI severity
ICD/self-report chronic medical conditions
EHR and self-reported demographics
Depression (PHQ-9) 
Alcohol (AUDIT) 
Illegal and prescription drug use (DAST) 
Functioning (MOS SF12/36) 
Violence risk behaviors 
Reactions to research participation 
Ongoing automated data
TSOS implementation assessments and corresponding RE-AIM framework domains
Patient, provider or site assessment
RE-AIM domain, level
Characteristics of 24 study sites versus all other US sites 
Trauma center providers
Implementation, provider and site
Clinical notes in decision support tool 
Decision support tool
Patient 12-month follow-up
Implementation and maintenance, provider and site
All US level I centers
Statistical analysis plan
Study aims and hypotheses
The primary hypothesis is that the intervention group when compared to the control group will demonstrate significant reductions in PTSD symptoms over the course of the year after injury. Secondary hypotheses are that intervention patients when compared to control patients will demonstrate significant reductions in depressive symptoms and associated suicidal ideation, significant reductions in alcohol use problems, and improved post-injury physical function.
All primary statistical analyses will be conducted using intent-to-treat methods. The primary goal of the statistical analyses is to examine and compare trends over time in the symptoms of PTSD. This analytic approach will be replicated for all secondary outcomes; secondary analyses will examine trends over time for depression, alcohol use, and physical function. The major outcome variables are the continuous and dichotomous assessments of PTSD (PTSD Checklist ), depression (PHQ-9 ), alcohol use problems (AUDIT ), and physical function (MOS SF-36 PCS [88, 126]).
The study team will use mixed effects regression models to test the hypotheses. The investigative group has extensive experience with these analytic approaches in the analyses of longitudinal data after injury. These analytic approaches allow for the modeling of longitudinal data on patients, nested within trauma center sites (see also sample size and power discussion below for a more in-depth explanation of clustering). An important potential advantage of using longitudinal mixed models is the ability to use partial data on those subjects with missing data, and therefore potentially ameliorate selection bias due to drop out. In addition, mixed models naturally structure patient and trauma center heterogeneity specifically allowing for random effects such as individual intercepts and slopes over time. Longitudinal regression models also allow the use of baseline covariates that may be prognostic or reflective of the study design.
Exploratory analyses will assess the impact of the intervention on primary and secondary outcomes for patients with and without pre-injury chronic medical conditions and those with and without TBI. Exploratory analyses will also assess for significant reductions in suicidal ideation, pain, and drug use problems in intervention patients when compared to control patients.
The study team will use a stepped wedge cluster randomized design for the TSOS protocol [40–43] (Fig. 3). Variability in multiple trauma center characteristics can impact rates of recruitment (e.g., admission volumes, EHR capacity), rates of PTSD (e.g., percentages of patients with violent injury admissions, intensive care unit admission rates), and the ability to follow patients longitudinally (e.g., patient demographic characteristics such as being homeless, clinical characteristics such as substance use problems). The stepped wedge design randomizes level I trauma center sites to sequentially initiate the intervention, thus allowing within site pre- and post-intervention comparisons, as well as between site comparisons. An additional advantage of the stepped wedge design for the protocol is that it would be impractical to roll out the entire intervention at 24 sites simultaneously. Finally, from an implementation science perspective, there is an advantage to having the intervention ongoing at the end of the study at every site, should the intervention demonstrate a significant impact on PTSD and comorbidity (Fig. 1). Given that there is little threat of contamination at each site across intervention and control patients and that the UH3 can accommodate the increased potential length of active recruitment and follow-up, the stepped wedge design appears to be an optimal choice for the TSOS protocol.
Sample size and power
Stepped wedge power for TSOS outcomes
Cluster size at baseline
Cluster size estimation at 12-month (25 % attrition)
Total number of clusters
Baseline mean (SD)
Follow-up time points (including baseline)
Minimal detectable effect size
Some attrition is expected in the study sample due to the research context and the population under study (i.e., low income, ethnoculturally diverse, injured trauma survivors). Prior studies by the investigative group have consistently achieved follow-up completion rates >75–80 % at 6–12 months post-injury with this population [16, 24, 25, 132]. Estimates derived from these rates are incorporated into the descriptions of subject flow and power analyses. Table 4 delineates the parameters used to estimate power for the PTSD Checklist, PHQ-9, AUDIT, and MOS SF-PCS. Sample size estimates were derived using the STATA statistical package . With each of the 24 trauma center sites recruiting 40 patients into the study, the study has 80 % power to detect effect sizes of 0.23. These effect sizes are smaller than our previously observed treatment effect for PTSD symptoms of 0.34. In prior investigations, PTSD treatment effects of 0.34 have been associated with clinically significant and policy relevant functional outcome improvements .
Mixed method analysis
Mixed methods will be used to integrate the findings from the key informant interviews with pragmatic trial results. The design taxonomy follows a sequential (QUAN → qual) structure in which qualitative data collected from key informants will be used to explain quantitative data results from the pragmatic trial [134, 135]. Qualitative data will therefore be used to expand upon the results of the pragmatic trial in order to understand the implementation and policy processes as experienced by key stakeholders. Second, the sequential QUAN → qual mixed methods design will be used to provide an understanding of pragmatic trial results that require further explanation (e.g., control patients that demonstrate substantial improvement in outcomes, despite not receiving intervention). Results of the mixed method analyses will be presented through a number of modalities that may include key informant narratives, tabular representation of themes with illustrative quotes, and thematic counts [136–139].
Organizational characteristics of TSOS study versus other US level I trauma centers (N = 222)a
TSOS TC n = 24 n (%)
Other TCs n = 198 n (%)
American College of Surgeons accredited
Region of country
Adult and pediatrics
Council of teaching hospitals
Number of interns/residents
Number of hospital beds
Number of inpatient admits
The current effectiveness-implementation hybrid is innovative in its combination of pragmatic trial and implementation science conceptual frameworks. The effectiveness-implementation trial is a “hybrid type II” design that uses a novel, yet time-tested, American College of Surgeons’ policy mechanism as a targeted implementation strategy . Curran and colleagues note that to enhance the relevance of pragmatic studies, comparative effectiveness trials may require modification in order to have increased policy relevance . Curran and colleagues also critique pragmatic comparative effectiveness studies for exclusively targeting effectiveness outcomes with little attention to the implementation processes relevant to general practice settings; these authors note that in contrast, implementation trials focus on the uptake and adoption of clinical interventions by providers and systems of care .
As part of the study’s emphasis on implementation, an American College of Surgeons’ policy summit is scheduled in the final years of the trial. The aim of the policy summit is to facilitate rapid translation of trial results into national policy. The College oversees the development of national policy mandates and clinical best practice guidelines that inform the integrated operation of US trauma centers and affiliated trauma care systems [28, 29, 140]. The College has successfully linked trauma center funding to verification site visits and other quality indicators [28, 141, 142].
In January of 2005, the College made a landmark policy decision to mandate health services targeting screening and intervention for alcohol-related disorders as a requisite for trauma center accreditation . Prior pragmatic randomized clinical trial investigations from the study team provided evidence supporting the College’s alcohol mandate [22, 30, 143]. In May of 2011, the investigators presented results from effective, NIH funded, PTSD screening and intervention trials at a College policy summit [22–24, 70]. For the first time, the College has included PTSD screening and intervention as a best practice level recommendation in national guidelines for trauma center care. These new College clinical guidelines set the stage for the current effectiveness-implementation hybrid trial that tests high quality, feasibly implemented, screening and intervention procedures for PTSD and related comorbidity. Simultaneously, as the investigation is being conducted, the study team will be actively developing a policy agenda targeting the use of pragmatic trial results to directly inform the policy discussion in the final years of the grant.
The potential for a policy target sets up a novel staged implementation context whereby the fielding of the trial and the implementation of the evidence-based intervention can yield insight into the sustainable delivery of PTSD screening and intervention procedures for trauma centers nationwide. In this context, previously described Rapid Assessment Procedures that harness clinical ethnographic methods to embed participant observation within front-line implementation teams have great potential utility [70, 121–123]. These methods rely on the study team collection of implementation logs and field notes; these logs and field notes can be productively reviewed on a regular basis with the study mixed method consultant in order to maximally harness field observations. This Rapid Assessment Procedures approach simultaneously satisfies the pragmatic trial requisite for minimization of time intensive research methods that require extensive adjudication and the implementation science goal of understanding and documentation of trial processes that could yield sustainable maintenance of screening and intervention procedures.
In summary, a hybrid effectiveness-implementation spectrum pragmatic trial targeting screening and intervention for PTSD and comorbidity can be readily designed and feasibly implemented across US level I trauma centers. These findings highlight the importance of partnerships with professional societies such as the American College of Surgeons’ that can provide regulatory mandates in order to enhance widespread implementation of pragmatic trials results.
cognitive behavioral therapy
disseminating organizational screening and brief intervention services
diagnostic and statistical manual
electronic health record
international classification of diseases
pragmatic-explanatory continuum indicator summary
posttraumatic stress disorder
reach effectiveness adoption implementation maintenance
traumatic brain injury
trauma survivors outcomes and support
We thank Research Coordinator Jeff Love for his help in setting up the study. The investigators also wish to acknowledge participating trauma centers and site champions, including Baylor University Medical Center (Michael Foreman, MD, and Ann Marie Warren, PhD); Cedars-Sinai Medical Center (Megan Harada, BA, Heidi Hotz, RN, and Dan Margulies, MD); Eskenazi Health (Gerardo Gomez, MD, and Michelle Laughlin, MD); Georgia Regents University (Steven Holsten, MD); Harbor University of California Los Angeles Medical Center (Dennis Kim, MD); Hartford Hospital (D’Andrea Joseph, MD); Honor Health (Melanie Brewer, DNSc, RN, and Charles Hu, MD); Inova Regional Trauma Center (Maggie Griffin, MD, and Jill Watras, MD); Jacobi Medical Center (Noe Romo, MD, and Sheldon Teperman, MD); Louisiana State University (Erich Conrad, MD, and Alan Marr, MD); North Memorial Medical Center (Greg Beilman, MD); Ohio State University Wexner Medical Center (David Evans, MD); Regions Hospital (Michael McGonigal, MD, and Keith Moench, MD); Santa Clara Valley Medical Center (John Sherck, MD); University of California Davis Medical Center (Joseph Galante, MD, and Gregory Jurkovich, MD); University of Cincinnati (Jason Schrager, MD); University of Iowa (Gerald Kealey, MD, and Dionne Skeete, MD); University of Kentucky Chandler Medical Center (Andrew Bernard, MD); University of Rochester Medical Center (Julius Cheng, MD); University of Texas Medical Branch at Galveston (Bill Mileski, MD); University of Texas Southwestern Medical Center (Joseph Minei, MD, and Brian Williams, MD); University of Utah (Giavonni Lewis, MD, and Ram Nirula, MD); University of Vermont Medical Center (Bill Cheresh, MD, and Matthew Price, PhD); University of Wisconsin Madison (Suresh Agarwal, MD); and Wake Forest University Health Sciences (Preston Miller, MD, and Laura Veach, PhD).
This work is supported by the National Institutes of Health (NIH) Common Fund, through cooperative agreements (U54 AT007748, 1UH2MH106338-01/4UH3MH106338-02) from the Office of Strategic Coordination within the Office of the NIH Director, and the National Institute of Mental Health (1 K24MH086814-01A1). The views presented here are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Bonnie RJ, Fulco CE, Liverman CT, editors. Reducing the burden of injury: advancing prevention and treatment. Washington, DC: National Academy Press; 1999.Google Scholar
- McCaig LF. National hospital ambulatory medical care survey: 1992 emergency department summary. Advance data from vital and health statistics. Hyattsville: National Center for Health Statistics; 1994.Google Scholar
- Rice DP, MacKenzie EJ, Jones AS, Associates. Cost of injury in the United States: a report to congress. San Francisco: Institute for Health and Aging, University of California. Baltimore, Md: Injury Prevention Center, The Johns Hopkins University; 1989.Google Scholar
- Bergen GS, National Center for Health Statistics (U.S.). Injury in the United States: 2007 chartbook. DHHS publication no. 2008–1033, U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, . Hyattsville: National Center for Health Statistics; 2008.Google Scholar
- National Center for Injury Prevention. CDC 2012. In: Office of Statistics and Programming. Atlanta, GA: Center for Disease Control and Prevention; 2012.Google Scholar
- Ramstad SM, Russo J, Zatzick D. Is it an accident? Recurrent traumatic life events in level I trauma center patients compared to the general population. J Trauma Stress. 2004;17(6):529–34.PubMedGoogle Scholar
- Bergman K, Maltz S, Fletcher J. Evaluation of moderate traumatic brain injury. J Trauma Nurs. 2010;17(2):102–8. doi:10.1097/JTN.0b013e3181ecc452.PubMedGoogle Scholar
- Faul M, Xu L, Wald MM, Coronado VG. Traumatic brain injury in the United States: emergency department visits, hospitalizations, and deaths 2002–2006. Atlanta, GA: Center for Disease Control and Prevention. National Center for Injury Prevention and Control. 2010.Google Scholar
- United States. President’s Commission on Care for America’s Returning Wounded Warriors. Serve, support, simplify: report of the President’s Commission on Care for America’s Returning Wounded Warriors. Washington, DC: President’s Commission on Care for America’s Returning Wounded Warriors; 2007.Google Scholar
- National Institute of Neurological Disorders and Stroke. Traumatic brain injury: hope through research. Bethesda: National Institute of Health; 2009.Google Scholar
- Krug EG, Sharma GK, Lozano R. The global burden of injuries. Am J Public Health. 2000;90(4):523–6.PubMedPubMed CentralGoogle Scholar
- World Health Organization. Disease and injury country estimates. 2012. http://www.who.int/healthinfo/global_burden_disease/estimates_country/en/index.html. Accessed 5 Jul 2013.
- Norton R, Kobusingye O. Injuries. N Engl J Med. 2013;368(18):1723–30. doi:10.1056/NEJMra1109343.PubMedGoogle Scholar
- MacKenzie EJ, Rivara FP, Jurkovich GJ, Nathens AB, Frey KP, Egleston BL, et al. A national evaluation of the effect of trauma-center care on mortality. N Engl J Med. 2006;354(4):366–78. doi:10.1056/NEJMsa052049.PubMedGoogle Scholar
- Zatzick D, Rivara FP, Nathens AB, Jurkovich GJ, Wang J, Fan MY, et al. A nationwide US study of post-traumatic stress after hospitalization for physical injury. Psychol Med. 2007;37(10):1469–80. doi:10.1017/S0033291707000943.PubMedGoogle Scholar
- Zatzick D, O’Connor SS, Russo J, Wang J, Bush N, Love J, et al. Technology enhanced stepped collaborative care targeting posttraumatic stress disorder and comorbidity after injury: a randomized controlled trial. J Trauma Stress. 2015;28(5):391–400. doi:10.1002/jts.22041.PubMedGoogle Scholar
- Parekh AK, Goodman RA, Gordon C, Koh HK. Managing multiple chronic conditions: a strategic framework for improving health outcomes and quality of life. Public Health Rep. 2011;126(4):460–71.PubMedPubMed CentralGoogle Scholar
- U. S. Department of Health and Human Services. Multiple chronic conditions—a strategic framework: optimum health and quality of life for individuals with multiple chronic conditions. Washington, DC. 2010.Google Scholar
- Wallace RB, Salive ME. The dimensions of multiple chronic conditions: where do we go from here? A commentary on the special collection of preventing chronic disease. Cent Dis Control Prev. 2013;10:5.Google Scholar
- Soderstrom CA, Smith GS, Dischinger PC, McDuff DR, Hebel JR, Gorelick DA, et al. Psychoactive substance use disorders among seriously injured trauma center patients. JAMA. 1997;277(22):1769–74.PubMedGoogle Scholar
- Zatzick D, Donovan D, Dunn C, Russo J, Wang J, Jurkovich G, et al. Substance use and PTSD in trauma center patients receiving mandated alcohol SBI. J Subst Abuse Treat. 2012;43(4):410–7.PubMedPubMed CentralGoogle Scholar
- Zatzick D, Roy-Byrne P, Russo J, Rivara F, Droesch R, Wagner A, et al. A randomized effectiveness trial of stepped collaborative care for acutely injured trauma survivors. Arch Gen Psychiat. 2004;61(5):498–506. doi:10.1001/archpsyc.61.5.498.PubMedGoogle Scholar
- Zatzick D, Roy-Byrne P, Russo J, Rivara FP, Koike A, Jurkovich GJ, et al. Collaborative interventions for physically injured trauma survivors: a pilot randomized effectiveness trial. Gen Hosp Psychiat. 2001;23(3):114–23.Google Scholar
- Zatzick D, Russo J, Lord SP, Varley C, Wang J, Berliner L, et al. Collaborative care intervention targeting violence risk behaviors, substance use, and posttraumatic stress and depressive symptoms in injured adolescents: a randomized clinical trial. JAMA Pediatr. 2014;168(6):532–9. doi:10.1001/jamapediatrics.2013.4784.PubMedGoogle Scholar
- Zatzick D, Jurkovich G, Rivara FP, Russo J, Wagner A, Wang J, et al. A randomized stepped care intervention trial targeting posttraumatic stress disorder for surgically hospitalized injury survivors. Ann Surg. 2013;257(3):390–9. doi:10.1097/SLA.0b013e31826bc313.PubMedPubMed CentralGoogle Scholar
- Love J, Zatzick D. Screening and intervention for comorbid substance disorders, PTSD, depression, and suicide: a trauma center survey. Psychiatr Serv. 2014;65(7):918–23. doi:10.1176/appi.ps.201300399.PubMedPubMed CentralGoogle Scholar
- Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. doi:10.1097/MLR.0b013e3182408812.PubMedPubMed CentralGoogle Scholar
- American College of Surgeons Committee on Trauma. Resources for optimal care of the injured patient. Washington DC: American College of Surgeons; 2006.Google Scholar
- American College of Surgeons Committee on Trauma. Resources for optimal care of the injured patient. Washington, DC. 2014.Google Scholar
- Terrell F, Zatzick DF, Jurkovich GJ, Rivara FP, Donovan DM, Dunn CW, et al. Nationwide survey of alcohol screening and brief intervention practices at US Level I trauma centers. J Am Coll Surg. 2008;207(5):630–8. doi:10.1016/j.jamcollsurg.2008.05.021.PubMedPubMed CentralGoogle Scholar
- Johnson KE, Tachibana C, Coronado GD, Dember LM, Glasgow RE, Huang SS, et al. A guide to research partnerships for pragmatic clinical trials. BMJ. 2014;349:g6826. doi:10.1136/bmj.g6826.PubMedPubMed CentralGoogle Scholar
- Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53. doi:10.1186/s13012-015-0242-0.PubMedPubMed CentralGoogle Scholar
- Grol RP, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.PubMedPubMed CentralGoogle Scholar
- Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.PubMedPubMed CentralGoogle Scholar
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. doi:10.2105/AJPH.89.9.1322.PubMedPubMed CentralGoogle Scholar
- Rogers EM. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.Google Scholar
- Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin Transl Sci. 2012;5(1):48–55. doi:10.1111/j.1752-8062.2011.00383.x.PubMedGoogle Scholar
- Institute of Medicine. Learning healthcare systems concept. Washington D.C. 2008.Google Scholar
- Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009;62(5):464–75. doi:10.1016/j.jclinepi.2008.12.011.PubMedGoogle Scholar
- Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91. doi:10.1016/j.cct.2006.05.007.PubMedGoogle Scholar
- Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48. doi:10.1016/j.jclinepi.2010.12.003.PubMedGoogle Scholar
- Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8. doi:10.1016/j.jclinepi.2013.01.009.PubMedGoogle Scholar
- Hughes JP, Granston TS, Heagerty PJ. Current issues in the design and analysis of stepped wedge trials. Contemp Clin Trials. 2015;45(Pt A):55–60. doi:10.1016/j.cct.2015.07.006.PubMedPubMed CentralGoogle Scholar
- National Center for Complementary and Alternative Medicine. NIH Health Care Systems Research Collaboratory—Pragmatic Clinical Trials Demonstration Projects (UH2/UH3): National Center for Complementary and Alternative Medicine, 2012 Contract No.: RFA-RM-12-002.Google Scholar
- Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003;290(12):1624–32.PubMedGoogle Scholar
- March J, Kraemer HC, Trivedi M, Csernansky J, Davis J, Ketter TA, et al. What have we learned about trial design from NIMH-funded pragmatic trials? Neuropsychopharmacology. 2010;35(13):2491–501. doi:10.1038/npp.2010.115.PubMedPubMed CentralGoogle Scholar
- Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.PubMedPubMed CentralGoogle Scholar
- Federal Coordinating Council for Comparative Effectiveness Research. Report to the President and the Congress. In: US Department of Health and Human Services, editor. Washington, D. C. 2009.Google Scholar
- Bosch M, McKenzie JE, Mortimer D, Tavender EJ, Francis JJ, Brennan SE, et al. Implementing evidence-based recommended practices for the management of patients with mild traumatic brain injuries in Australian emergency care departments: study protocol for a cluster randomised controlled trial. Trials. 2014;15:281. doi:10.1186/1745-6215-15-281.PubMedPubMed CentralGoogle Scholar
- Tavender EJ, Bosch M, Gruen RL, Green SE, Knott J, Francis JJ, et al. Understanding practice: the factors that influence management of mild traumatic brain injury in the emergency department—a qualitative study using the Theoretical Domains Framework. Implement Sci. 2014;9(8).Google Scholar
- Tavender EJ, Bosch M, Gruen RL, Green SE, Michie S, Brennan SE, et al. Developing a targeted, theory-informed implementation intervention using two theoretical frameworks to address health professional and organisational factors: a case study to improve the management of mild traumatic brain injury in the emergency department. Implement Sci. 2015;10(74):22. doi:10.1186/s13012-015-0264-7.Google Scholar
- Koepsell TD, Zatzick DF, Rivara FP. Estimating the population impact of preventive interventions from randomized trials. Am J Prev Med. 2011;40(2):191–8. doi:10.1016/j.amepre.2010.10.022.PubMedPubMed CentralGoogle Scholar
- Zatzick D, Koepsell T, Rivara FP. Using target population specification, effect size, and reach to estimate and compare the population impact of two PTSD preventive interventions. Psychiatry. 2009;72(4):346–59.PubMedGoogle Scholar
- Richesson RL, Hammond WE, Nahm M, Wixted D, Simon GE, Robinson JG, et al. Electronic health records based phenotyping in next-generation clinical trials: a perspective from the NIH Health Care Systems Collaboratory. J Am Med Inform Assoc. 2013. doi:10.1136/amiajnl-2013-001926.Google Scholar
- Russo J, Katon W, Zatzick D. The development of a population-based automated screening procedure for PTSD in acutely injured hospitalized trauma survivors. Gen Hosp Psychiatry. 2013;35(5):485–91. doi:10.1016/j.genhosppsych.2013.04.016.PubMedPubMed CentralGoogle Scholar
- Van Eaton EG, Zatzick D, Gallagher T, Flum D, Tarczy-Hornoch P, Rivara F, et al. A nationwide survey of trauma center information technology and electronic medical record leverage capacity. J Am Chem Soc. 2014;219(3):505–10. doi:10.1016/j.jamcollsurg.2014.02.032.Google Scholar
- Weathers F, Ford J. Psychometric review of PTSD Checklist (PCL-C, PCL-S. PCL-M, PCL-PR). In: Stamm B, editor. Measurement of stress, trauma, and adaptation. Lutherville: Sidran Press; 1996. p. 250–1.Google Scholar
- Weathers FW, Huska JA, Keane TM. The PTSD checklist-civilian version, The National Center For PTSD. Boston, Ma: Boston VA Medical Center; 1991.Google Scholar
- Katon W. Health reform, research pave way for collaborative care for mental illness. JAMA. 2013;309(23):2425–6. doi:10.1001/jama.2013.6494. Interview by Bridge M Kuehn.PubMedGoogle Scholar
- Peek CJ. A collaborative care lexicon for asking practice and research development questions. Rockville: Agency for Healthcare Research and Quality; 2011.Google Scholar
- Dobscha SK, Corson K, Perrin NA, Hanson GC, Leibowitz RQ, Doak MN, et al. Collaborative care for chronic pain in primary care: a cluster randomized trial. JAMA. 2009;301(12):1242–52. doi:10.1001/jama.2009.377.PubMedGoogle Scholar
- Finley EP, Bollinger M, Noel PH, Amuan ME, Copeland LA, Pugh JA, et al. A national cohort study of the association between the polytrauma clinical triad and suicide-related behavior among US Veterans who served in Iraq and Afghanistan. Am J Public Health. 2015;105(2):380–7. doi:10.2105/AJPH.2014.301957.PubMedPubMed CentralGoogle Scholar
- Pugh MJ, Finley EP, Copeland LA, Wang CP, Noel PH, Amuan ME, et al. Complex comorbidity clusters in OEF/OIF veterans: the polytrauma clinical triad and beyond. Med Care. 2014;52(2):172–81. doi:10.1097/mlr.0000000000000059.PubMedGoogle Scholar
- Zatzick D, Simon GE, Wagner AW. Developing and implementing randomized effectiveness trials in general medical settings. Clin Psychol: Sci Pr. 2006;13:53–68. doi:10.1111/j.1468-2850.2006.00006.x.Google Scholar
- Rollman BL, Belnap BH, LeMenager MS, Mazumdar S, Houck PR, Counihan PJ, et al. Telephone-delivered collaborative care for treating post-CABG depression: a randomized controlled trial. JAMA. 2009;302(19):2095–103. doi:10.1001/jama.2009.1670.PubMedPubMed CentralGoogle Scholar
- Rollman BL, Belnap BH, Mazumdar S, Houck PR, Zhu F, Gardner W, et al. A randomized trial to improve the quality of treatment for panic and generalized anxiety disorders in primary care. Arch Gen Psychiatry. 2005;62(12):1332–41. doi:10.1001/archpsyc.62.12.1332.PubMedGoogle Scholar
- Bruce ML, Ten Have TR, Reynolds 3rd CF, Katz II, Schulberg HC, Mulsant BH, et al. Reducing suicidal ideation and depressive symptoms in depressed older primary care patients: a randomized controlled trial. JAMA. 2004;291(9):1081–91. doi:10.1001/jama.291.9.1081291/9/1081.PubMedGoogle Scholar
- Katon W, Von Korff M, Lin E, Walker E, Simon GE, Bush TB, et al. Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA. 1995;273(13):1026–31.PubMedGoogle Scholar
- Katon WJ, Lin EH, Von Korff M, Ciechanowski P, Ludman EJ, Young B, et al. Collaborative care for patients with depression and chronic illnesses. N Engl J Med. 2010;363(27):2611–20.PubMedPubMed CentralGoogle Scholar
- Zatzick D, Rivara F, Jurkovich G, Russo J, Trusz SG, Wang J, et al. Enhancing the population impact of collaborative care interventions: mixed method development and implementation of stepped care targeting posttraumatic stress disorder and related comorbidities after acute trauma. Gen Hosp Psychiatry. 2011;33(2):123–34. doi:10.1016/j.genhosppsych.2011.01.001.PubMedPubMed CentralGoogle Scholar
- Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA. 2010;303(19):1921–8.PubMedPubMed CentralGoogle Scholar
- Katon W, Von Korff M, Lin E, Simon G, Walker E, Unutzer J, et al. Stepped collaborative care for primary care patients with persistent depression: a randomized trial. Arch Gen Psychiatry. 1999;56(12):1109–15.PubMedGoogle Scholar
- Katon W, Von Korff M, Lin E, Unutzer J, Simon G, Walker E, et al. Population-based care of depression: effective disease management strategies to decrease prevalence. Gen Hosp Psychiatry. 1997;19(3):169–78.PubMedGoogle Scholar
- Katon W, Rutter C, Ludman EJ, Von Korff M, Lin E, Simon G, et al. A randomized trial of relapse prevention of depression in primary care. Arch Gen Psychiatry. 2001;58(3):241–7.PubMedGoogle Scholar
- Wells KB, Sherbourne C, Schoenbaum M, Duan N, Meredith L, Unutzer J, et al. Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. JAMA. 2000;283(2):212–20.PubMedGoogle Scholar
- Unutzer J, Katon W, Callahan CM, Williams Jr JW, Hunkeler E, Harpole L, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA. 2002;288(22):2836–45.PubMedGoogle Scholar
- Katon W, Von Korff M, Lin EH, Simon G, Ludman E, Russo J, et al. The pathways study: a randomized trial of collaborative care in patients with diabetes and depression. Arch Gen Psychiatry. 2004;61(10):1042–9.PubMedGoogle Scholar
- Kroenke K, Theobald D, Wu J, Norton K, Morrison G, Carpenter JF, et al. Effect of telecare management on pain and depression in patients with cancer: a randomized trial. JAMA. 2010;304(2):163–71. doi:10.1001/jama.2010.944.PubMedPubMed CentralGoogle Scholar
- Unützer J, Choi Y, Cook IA, Oishi S. A web-based data management system to improve care for depression in a multicenter clinical trial. Psychiatr Serv. 2002;53(6):671–3. doi:10.1176/ps.53.6.671.PubMedGoogle Scholar
- Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2010; Epub ahead of print.Google Scholar
- Weathers FW, Litz BT, Herman DS, Huska JA, Keane TM. The PTSD checklist: reliability, validity, and diagnostic utility. San Antonio, TX: The 9th Annual Meeting of the International Society for Traumatic Stress Studies; 1994.Google Scholar
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. doi:10.1046/j.1525-1497.2001.016009606.x.PubMedPubMed CentralGoogle Scholar
- Richardson LP, McCauley E, Grossman DC, McCarty CA, Richards J, Russo JE, et al. Evaluation of the patient health questionnaire-9 item for detecting major depression among adolescents. Pediatrics. 2010;126(6):1117–23.PubMedPubMed CentralGoogle Scholar
- O’Connor SS, Dinsio K, Wang J, Russo J, Rivara FP, Love J, et al. Correlates of suicidal ideation in physically injured trauma survivors. Suicide Life Threat Behav. 2014. doi:10.1111/sltb.12085.PubMedPubMed CentralGoogle Scholar
- Babor TF, De La Fuente JR, Saunders J, Grant M. The alcohol use disorders identification test: guidelines for use in primary health care. Geneva: World Health Organization; 1989.Google Scholar
- Reinert DF, Allen JP. The alcohol use disorders identification test: an update of research findings. Alcohol Clin Exp Res. 2007;31(2):185–99. doi: ACER29510.1111/j.1530-0277.2006.00295.x.PubMedGoogle Scholar
- Bradley K, Lapham G, Richards J, Merrill J, Williams E, Lee A, et al. Results of population-based, proactive outreach to non-treatment seeking primary care patients at high risk for AUD in the choice trial. 2014.Google Scholar
- Ware JE, Snow KK, Kosinski M. SF-36 health survey: manual and interpretation guide. Boston, MA: The Health Institute, New England Medical Center; 1993.Google Scholar
- Zatzick D, Jurkovich GJ, Gentilello LM, Wisner DH, Rivara FP. Posttraumatic stress, problem drinking, and functioning 1 year after injury. Arch Surg. 2002;137(2):200–5.PubMedGoogle Scholar
- MacKenzie EJ, McCarthy ML, Ditunno JF, Forrester-Staz C, Gruen GS, Marion DW, et al. Using the SF-36 for characterizing outcome after multiple trauma involving head injury. J Trauma. 2002;52(3):527–34.PubMedGoogle Scholar
- Michaels AJ, Michaels CE, Moon CH, Smith JS, Zimmerman MA, Taheri PA, et al. Posttraumatic stress disorder after injury: impact on general health outcome and early risk assessment. J Trauma. 1999;47(3):460–7.PubMedGoogle Scholar
- The Johns Hopkins Health Services Research and Development Center. Determining injury severity from hospital sischarges: a program to map ICD-9DM diagnoses into AIS, and ISS severity scores. Baltimore, MD. 1989Google Scholar
- MacKenzie EJ, Morris JA, Edelstein SL. Effect of pre-existing disease on length of hospital stay in trauma patients. J Trauma. 1989;29:757–64.PubMedGoogle Scholar
- Zatzick D, Kang SM, Muller HG, Russo JE, Rivara FP, Katon W, et al. Predicting posttraumatic distress in hospitalized trauma survivors with acute injuries. Am J Psychiatry. 2002;159(6):941–6.PubMedGoogle Scholar
- Hogan SJ, Coote LV. Organizational culture, innovation, and performance: a test of Schein’s model. J Bus Res. 2014;67(8):1609–21. doi:10.1016/j.jbusres.2013.09.007.Google Scholar
- Caldwell SD, Herold DM, Fedor DB. Toward an understanding of the relationships among organizational change, individual differences, and changes in person-environment fit: a cross-level study. J Appl Psychol. 2004;89:868–82.PubMedGoogle Scholar
- Zatzick CD, Zatzick DF. The effects of job impact and person-job fit on employee attitudes towards change in trauma centers. San Antonio, TX: Academy of Management Annual Meeting; August 16, 2011.Google Scholar
- Hom P, Griffeth R. Employee turnover. Reading, MA: Addison-Wesley; 1995.Google Scholar
- Mobley WH. Employee turnover: causes, consequences, and control. Reading, MA: Addison-Wesley; 1982.Google Scholar
- Zatzick CD, Elvira MM, Cohen LE. When is more better? The effects of racial composition on voluntary turnover. Organ Sci. 2003;14(5):483–96.Google Scholar
- Zatzick CD, Zatzick DF. The effect of perceived person-job fit on employee attitudes toward change in trauma centers. Health Care Manage Rev. 2012;38(2):115–24. doi:10.1097/HMR.0b013e318249aa60.Google Scholar
- Adams GA, Beehr TA. Turnover and retirement: a comparison of their similarities and differences. Pers Psychol. 1998;51(3):643–65.Google Scholar
- Zatzick D, Donovan DM, Dunn C, Jurkovich GJ, Wang J, Russo J, et al. Disseminating Organizational Screening and Brief Intervention Services (DO-SBIS) for alcohol at trauma centers study design. Gen Hosp Psychiat. 2013;35(2):174–80. doi:10.1016/j.genhosppsych.2012.11.012.Google Scholar
- Bellal J, Pandit V, Hadeed G, Kulvatunyou N, Zangbar B, Tang A, et al. Unveiling posttraumatic stress disorder in trauma surgeons: a national survey. J Trauma Acute Care Surg. 2014;77(1):148–54. doi:10.1097/TA.0000000000000271.Google Scholar
- Bride BE, Robinson MM, Yegidis B, Figley CR. Development and validation of the secondary traumatic stress scale. Res Social Work Prac. 2004;14(1):27–35. doi:10.1177/1049731503254106.Google Scholar
- Kessler R, Sonnega A, Bromet E, Hughes M, Nelson CB. Posttraumatic stress disorder in the National Comorbidity Survey. Arch Gen Psychiatry. 1995;52(12):1048–60. doi:10.1001/archpsyc.1995.03950240066012.PubMedGoogle Scholar
- Kessler R, Berglund P, Demler O, Jin R, Merikangas K, Walters E. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602.PubMedGoogle Scholar
- Darnell D, Dunn C, Atkins D, Ingraham L, Zatzick D. A randomized evaluation of motivational interviewing training for mandated implementation of alcohol screening and brief intervention in trauma centers. J Subst Abuse Treat. 2015. doi:10.1016/j.jsat.2015.05.010.PubMed CentralGoogle Scholar
- Services CfMM. Bundled payments for care improvement (BPCI) initiative: general information. http://innovation.cms.gov/initiatives/bundled-payments/. Accessed 28 Oct 2013.
- Vashi AA, Fox JP, Carr BG, D’Onofrio G, Pines JM, Ross JS, et al. Use of hospital-based acute care among patients recently discharged from the hospital. JAMA. 2013;309(4):364–71. doi:10.1001/jama.2012.216219.PubMedPubMed CentralGoogle Scholar
- Adams JG. Emergency department overuse: perceptions and solutions. JAMA. 2013;309(11):1173–4. doi:10.1001/jama.2013.2476.PubMedGoogle Scholar
- Burke RE, Coleman EA. Interventions to decrease hospital readmissions keys for cost-effectiveness. JAMA Intern Med. 2013;173(8):695–8. doi:10.1001/jamainternmed.2013.171.PubMedGoogle Scholar
- Shafi S, Barnes S, Nicewander D, Ballard D, Nathens AB, Ingraham AM, et al. Health care reform at trauma centers—mortality, complications, and length of stay. J Trauma. 2010;69(6):1367–71. doi:10.1097/TA.0b013e3181fb785d.PubMedGoogle Scholar
- Shafi S, Ogola G, Fleming N, Rayan N, Kudyakov R, Barnes SA, et al. Insuring the uninsured: potential impact of Health Care Reform Act of 2010 on trauma centers. J Trauma Acute Care Surg. 2012;73(5):1303–7. doi:10.1097/TA.0b013e318265d219.PubMedGoogle Scholar
- Bindman AB, Blum JD, Kronick R. Medicare payment for chronic care delivered in a patient-centered medical home. JAMA. 2013. doi:10.1001/jama.2013.276525.PubMedGoogle Scholar
- Khoury AL, Charles AG, Sheldon GF. The trauma safety-net hospital under the Affordable Care Act: will it survive? J Trauma Acute Care Surg. 2013. doi:10.1097/TA.0b013e3182924977.PubMedGoogle Scholar
- Frankel HL, Butler KL, Cuschieri J, Friese RS, Huynh T, Mohr AM, et al. The role and value of surgical critical care, an essential component of Acute Care Surgery, in the Affordable Care Act: a report from the Critical Care Committee and Board of Managers of the American Association for the Surgery of Trauma. J Trauma Acute Care Surg. 2012;73(1):20–6. doi:10.1097/TA.0b013e31825a78d5.PubMedGoogle Scholar
- Sacks GD, Hill C, Rogers Jr SO. Insurance status and hospital discharge disposition after trauma: inequities in access to postacute care. J Trauma. 2011;71(4):1011–5. doi:10.1097/TA.0b013e3182092c27.PubMedGoogle Scholar
- Saldana L, Chamberlain P, Bradford WD, Campbell M, Landsverk J. The Cost of Implementing New Strategies (COINS): a method for mapping implementation resources using the stages of implementation completion. Child Youth Serv Rev. 2014;39:177–82. doi:10.1016/j.childyouth.2013.10.006.PubMedGoogle Scholar
- Raghavan R. The role of economic evaluation in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2012. p. 94–113.Google Scholar
- Palinkas LA, Prussing E, Reznik VM, Landsverk JA. The San Diego East County school shootings: a qualitative study of community-level post-traumatic stress. Prehosp Disaster Med. 2004;19(1):113–21.PubMedGoogle Scholar
- Scrimshaw NS. Rapid assessment procedures—qualitative methodologies for planning and evaluation of health related programmes. Boston, Mass: International Nutrition Foundation for Developing Countries (INFDC); 1992.Google Scholar
- English M, Nzinga J, Mbindyo P, Ayieko P, Irimu G, Mbaabu L. Explaining the effects of a multifaceted intervention to improve inpatient care in rural Kenyan hospitals—interpretation based on retrospective examination of data from participant observation, quantitative and qualitative studies. Implement Sci. 2011;6:124. doi:10.1186/1748-5908-6-124.PubMedPubMed CentralGoogle Scholar
- Benner PE. Interpretive phenomenology. Thousand Oaks. CA: Sage; 1994.Google Scholar
- Creswell J. Qualitative inquiry and research design: choosing among five traditions. SAGE Publications: Thousand Oaks; 1998.Google Scholar
- Ware JE, Kosinski M, Keller SD. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–3.PubMedGoogle Scholar
- Donner A, Klar N. Design and analysis of cluster randomization trials in health research. London: Arnold Publishers; 2000.Google Scholar
- Murray DM, Pals SL, Blitstein JL, Alfano CM, Lehman J. Design and analysis of group-randomized trials in cancer: a review of current practices. J Natl Cancer Inst. 2008;100(7):483–91. doi:10.1093/jnci/djn066.PubMedGoogle Scholar
- Murray DM, Varnell SP, Blitstein JL. Design and analysis of group-randomized trials: a review of recent methodological developments. Am J Public Health. 2004;94(3):423–32.PubMedPubMed CentralGoogle Scholar
- Murray DM. Design and analysis of group-randomized trials. New York: Oxford University Press; 1998.Google Scholar
- Raudenbush SW, Liu X. Statistical power and optimal design for multisite randomized trials. Psychol Methods. 2000;5(2):199–213.PubMedGoogle Scholar
- Zatzick D, Donovan DM, Jurkovich G, Gentilello L, Dunn C, Russo J, et al. Disseminating alcohol screening and brief intervention at trauma centers: a policy-relevant cluster randomized effectiveness trial. Addiction. 2014;109(5):754–65. doi:10.1111/add.12492.PubMedPubMed CentralGoogle Scholar
- Hemming K, Girling A. A menu-driven facility for power and detectable-difference calculations in stepped-wedge cluster-randomized trials. Stata J. 2014;14(2):363–80.Google Scholar
- Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health. 2011;38(1):44–53.PubMedGoogle Scholar
- Palinkas LA, Horwitz SM, Chamberlain P, Hurlburt MS, Landsverk J. Mixed-methods designs in mental health services research: a review. Psychiatr Serv. 2011;62(3):255–63. doi:10.1176/appi.ps.62.3.255.PubMedGoogle Scholar
- Miles MB, Huberman M. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks: SAGE Publications; 1994.Google Scholar
- Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. 2nd ed. Los Angeles: SAGE Publications; 2011.Google Scholar
- Zatzick D, Kang SM, Hinton WL, Kelly RH, Hilty DM, Franz CE, et al. Posttraumatic concerns: a patient-centered approach to outcome assessment after traumatic physical injury. Med Care. 2001;39(4):327–39.PubMedGoogle Scholar
- Zatzick D, Russo J, Rajotte E, Uehara E, Roy-Byrne P, Ghesquiere A, et al. Strengthening the patient-provider relationship in the aftermath of physical trauma through an understanding of the nature and severity of posttraumatic concerns. Psychiatry. 2007;70(3):260–73.PubMedGoogle Scholar
- American College of Surgeons Committee on Trauma. Resources for the optimal care of the injured patient: 1999. Chicago, IL: Committee on Trauma, The American College of Surgeons; 1999.Google Scholar
- United States Congress. The Patient Protection and Affordable Care Act. 2010.Google Scholar
- Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network; 2005.Google Scholar
- Gentilello LM, Rivara FP, Donovan DM, Jurkovich GJ, Daranciang E, Dunn CW, et al. Alcohol interventions in a trauma center as a means of reducing the risk of injury recurrence. Ann Surg. 1999;230(4):473–80.PubMedPubMed CentralGoogle Scholar
- Teasdale G, Jennet B. Assessment of coma and impaired consciousness: a practical scale. Lancet. 1974;2(7872):81–4.PubMedGoogle Scholar
- Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiat Res. 1975;12(3):189–98.PubMedGoogle Scholar
- Skinner HA. The drug abuse screening test. Addict Behav. 1982;7(4):363–71.PubMedGoogle Scholar
- Krebs EE, Bair MJ, Damush TM, Tu W, Wu J, Kroenke K. Comparative responsiveness of pain outcome measures among primary care patients with musculoskeletal pain. Med Care. 2010;48(11):1007–14.PubMedPubMed CentralGoogle Scholar
- Krebs EE, Lorenz KA, Bair MJ, Damush TM, Wu J, Sutherland JM, et al. Development and initial validation of the PEG, a three-item scale assessing pain intensity and interference. J Gen Intern Med. 2009;24(6):733–8.PubMedPubMed CentralGoogle Scholar
- Zatzick D, Rivara F, Jurkovich G, Hoge C, Wang J, Fan M, et al. Multi-site investigation of traumatic brain injuries, posttraumatic stress disorder, and self-reported health and cognitive impairments. Arch Gen Psychiatry. 2010;67(12):1291–300.PubMedPubMed CentralGoogle Scholar
- Hoge C, McGurk D, Thomas J, Cox A, Engel CC, Castro CA. Mild traumatic brain injury in U.S. soldiers returning from Iraq. N Engl J Med. 2008;358(5):453–63.PubMedGoogle Scholar
- Zatzick D, Jurkovich G, Rivara F, Wang J, Fan MY, Joesch J, et al. A national US study of posttraumatic stress disorder, depression, and work and functional outcomes after injury hospitalization. Ann Surg. 2008;248(3):429–37.PubMedGoogle Scholar
- Boye KS, Matza LS, Feeny DH, Johnston JA, Bowman L, Jordan JB. Challenges to time trade-off utility assessment methods: when should you consider alternative approaches? Expert Rev Pharmacoecon Outcomes Res. 2014;14(3):437–50.PubMedGoogle Scholar
- Badia X, Monserrat S, Roset M, Herdman M. Feasibility, validity and test–retest reliability of scaling methods for health states: the visual analogue scale and the time trade-off. Qual Life Res. 1999;8(4):303–10.PubMedGoogle Scholar
- Wright DR, Wittenberg E, Swan JS, Miksad RA, Prosser LA. Methods for measuring temporary health states for cost-utility analyses. Pharmacoeconomics. 2009;27(9):713–23.PubMedGoogle Scholar