Table 1 Measurement strategy for implementation study by the component of the Process Redesign Framework
Constructs | Method |
|---|---|
(1) Int. Chars | |
What is the intervention designed to achieve? What are the features of the intervention? Who is the intended target group? | |
Intervention description | Validated 20-item survey of staff/provider views of intervention [27] |
(2) Outer setting | |
What components of the environment will impact the implementation? | |
External policies and incentives | Partner interviews and focus groups at implementation sites |
Inter-organizational network structures | |
(3) Inner setting | |
What components of structure and process within the inner setting will impact the implementation? [28] | |
Implementation Climate | Validated 18-item survey of staff/providers assessing climate [29] |
Implementation Leadership | Validated 12-item survey of staff/providers assessing leadership [30] |
(4) Ind./ Team Chars. | |
What individual or team characteristics of those engaged in the intervention will impact the implementation success and outcomes? | |
Implementer knowledge, attitudes, and beliefs | Clinic and community partner interviews; semi-structured guide adapted from Damschroder [31] |
(5) Process of Implementation | |
What implementation processes are required to achieve individual- and organizational-level use of the intervention? What roles will individuals and teams carry out? | |
Planning [32] | Meeting notes, document artifacts (e.g., emails), focus groups |
Partner engagement [32] | |
Executing [32] | |
6) Measures of Implementation | |
What attributes of the implementation process demonstrate it was carried out well and can be replicated, scaled, and sustained? | |
Acceptability | Validated (4-item scale) survey of staff/providers at intervention sites [33] |
Appropriateness | |
Feasibility | |
Intervention cost | Project administrative data, surveys to assess additional costs |
Fidelity | Structured observations of subset of sessions, using SOPLAY [34] |
Referrals | Program tracking materials and EHR |
Reach | - |
a. Reach within the population | Referral, enrollment, and attendance |
b.Reach with the organization | Structured interviews with sites |
Sustainability | 40-item survey of partner covering 8 domains of sustainability [35]. |
(7) Outcomes | |
What specific, measurable outcomes will result from the intervention? | |
Patient experience – Acceptability and Satisfaction | Parent and child satisfaction and acceptability surveys |
Health care utilization – Dose/Adherence | EHR records; program participation logs; proportion reaching 26 hours |
Cost effects/impact | Project administrative data, surveys to assess additional costs |
Unintended consequences | Adverse event reporting |
Effectiveness (BMI change) | BMI from clinic records, change in BMI P95 primary, change in BMIz secondary |
Effectiveness (Diet and Activity) | Garmin Activity Tracking, diet and physical activity screeners [36,37,38] |
Effectiveness (Quality of Life) | Sizing Them Up [39] |