Skip to main content

Table 3 Study assessments

From: Protocol for a quasi-experimental, 950 county study examining implementation outcomes and mechanisms of Stepping Up, a national policy effort to improve mental health and substance use services for justice-involved individuals

Construct Measures and indicators Time point
Baseline 8 months 36 months
Target implementation mechanisms
 Use of/capacity for performance monitoring Performance Monitoring measure (primary)
Adapted Routine Decision-Making scale [37]
X
X
X
X
X
X
 Use and functioning of nteragency teams Adapted NCJTP Relationship Assessment Inventory [38] X X X
 Common goals and mission across agencies Adapted NCJTP Goals/Mission scale [38] (primary)
Agreement (kappa) among respondents within counties on ratings of the importance of providing mental health treatment services for justice-involved individuals
X
X
X
X
X
X
 System integration (vs. single programs) Use of same screening/assessment instruments across agencies in the county X X X
  Total score of 18+ on the NCJTP Relationship Assessment Inventory [38] X X X
Implementation outcomes
 Number of justice-involved clients who received behavioral health services (primary) How many justice-involved individuals received any mental health service and how many received any substance use service in the agency in the past year X X X
 Number of behavioral health EBPP available Questions asking whether each listed EBPP is available to justice-involved individuals in the county X X X
 Resources for behavioral health EBPP Funding increases and decreases
Staff numbers, roles, training
NCJTPS’s Assess Your Resources scale [38]
X
X
X
X
X
X
X
X
X
Covariates
 Baseline values of dependent variables As assessed above X   
 Months since county joined Stepping Up Self-report and Stepping Up records X   
 Matching score Matching score used to choose matched comparison counties X   
 Indicators of whether the county shares (a) their mental health administrator, and/or (b) justice administrators with other counties Questions asking whether the county shares (a) their mental health administrator, and/or (b) justice administrators with other counties X   
Descriptors and moderators
 Type of agency NCJTP About Your Organization scale [38] X X X
 Staffing (type, number, urnover) Adapted NCJTP Staffing scales [38] X X X
 Organizational support for innovation Adapted NCJTP Assess Your Organizational Culture scale [38] X X X
 Policy context State mental health diversion funding, legislative reforms X X X