Table 2 Data collection components
Instrument | Description | Timing | Participant investment |
|---|---|---|---|
START UP | |||
Pre-implementation checklist | Documents, orientations, memos of understanding, necessary approvals. | Month 1 (baseline) | Research staff; 1 h |
INTERVENTION ACTIVITIES | |||
Core components | |||
Needs assessment group interview | Staff focus group (audio recorded and transcribed) designed to explore existing services along the Cascade, identification of strengths and gaps in services, creation of systems map; documentation of inner and outer context | Month 3 (baseline), month 21 (post-experiment) | Research staff; interagency workgroup (JJ and BH staff); 3 h |
Site feedback report fidelity checklist | Documents the degree to which the intervention steps are followed and training content is covered | Month 7 (baseline), month 26 (project end) | Research staff; 10 min |
Behavioral health training pre-post-test | Survey on the acquisition of knowledge gathered during behavioral health training sessions. Questions are asked before and immediately after each module | Month 6 (baseline) | JJ and BH staff; 5 min per module |
Behavioral health training—live sessions fidelity checklist | Documents the degree to which the intervention steps are followed and training content is covered | Month 7 (baseline) | Research staff; 10 min per session |
Goal achievement training fidelity checklist | Documents the degree to which the intervention steps are followed and training content is covered | Month 7 (baseline) | Research staff; 10 min |
Goal achievement training pre-post-test | Survey of best practices for determining and defining goals, identification of site-selected goals along the Cascade, strategies for measuring progress toward goals, strategies for implementing and sustaining change | Month 7 (baseline) | JJ and BH staff; 10 min |
Enhanced components (Enhanced condition only) | |||
Pre-implementation fidelity checklist | Documents the degree to which preparations for facilitation are followed | Month 8 (experiment) | RC facilitator; 10 min |
Local change team (LCT) start-up fidelity checklist | Documents the degree to which plans for establishing LCTs and initiating facilitation are followed | Month 8 (experiment) | RC facilitator; 10 min |
Meeting level facilitator reflection fidelity checklist (RC facilitator and local champion versions) | Documents the degree to which the facilitation protocol is followed and LCT discussions/progress toward goals | Month 8-19 (experiment) | RC Facilitator and Local Champion; 10 minutes per meeting |
LCT fidelity checklist | Survey of LCT members regarding facilitation of their meetings | Months 8, 13, and 19 (experiment) | LCT; 10 min |
Close-out meeting fidelity checklist | Documents the degree to which the close-out meeting plans are followed (including study debriefing) | Month 26 (at conclusion of post-experiment) | Research staff; 10 min |
DATA COLLECTION | |||
Extraction of youth service records | |||
Community supervision survey | A subset of the JJ-TRIALS National Survey items (JJ version) used to elicit site characteristics and information about services provided | Month 1 (baseline), month 20 (sustainment) | JJ agency leadership; 2 h |
Service provider survey | A subset of the JJ-TRIALS National Survey items (service provider version) used to elicit site characteristics and information about services provided | Month 1 (baseline), month 20 (sustainment) | BH agency leadership |
Monthly site check-in form | Documents site activities that reflect progress toward achieving selected goals, collect information about process improvement efforts, and monitor changes to services based on data systems, staffing, and policy modifications | Months 8–25 (experiment, post-experiment) | Research staff interview site liaison; 30 min, monthly |
Staff survey | The survey asks individuals about attitudes toward their workplace, services their agency provides, relationships between JJ and BH agencies in providing services, perceived value and use of substance use services (specific strategies for screening, assessment, referral, and treatment), and perceived value of HIV-STI and substance use prevention | Month 5 (baseline), months 9 and 19 (experiment), month 25 (post-experiment) | JJ and BH staff; 45 min, each administration |