Skip to main content

Table 3 Study assessments

From: Protocol for a quasi-experimental, 950 county study examining implementation outcomes and mechanisms of Stepping Up, a national policy effort to improve mental health and substance use services for justice-involved individuals

Construct

Measures and indicators

Time point

Baseline

8 months

36 months

Target implementation mechanisms

 Use of/capacity for performance monitoring

Performance Monitoring measure (primary)

Adapted Routine Decision-Making scale [37]

X

X

X

X

X

X

 Use and functioning of nteragency teams

Adapted NCJTP Relationship Assessment Inventory [38]

X

X

X

 Common goals and mission across agencies

Adapted NCJTP Goals/Mission scale [38] (primary)

Agreement (kappa) among respondents within counties on ratings of the importance of providing mental health treatment services for justice-involved individuals

X

X

X

X

X

X

 System integration (vs. single programs)

Use of same screening/assessment instruments across agencies in the county

X

X

X

 

Total score of 18+ on the NCJTP Relationship Assessment Inventory [38]

X

X

X

Implementation outcomes

 Number of justice-involved clients who received behavioral health services (primary)

How many justice-involved individuals received any mental health service and how many received any substance use service in the agency in the past year

X

X

X

 Number of behavioral health EBPP available

Questions asking whether each listed EBPP is available to justice-involved individuals in the county

X

X

X

 Resources for behavioral health EBPP

Funding increases and decreases

Staff numbers, roles, training

NCJTPS’s Assess Your Resources scale [38]

X

X

X

X

X

X

X

X

X

Covariates

 Baseline values of dependent variables

As assessed above

X

  

 Months since county joined Stepping Up

Self-report and Stepping Up records

X

  

 Matching score

Matching score used to choose matched comparison counties

X

  

 Indicators of whether the county shares (a) their mental health administrator, and/or (b) justice administrators with other counties

Questions asking whether the county shares (a) their mental health administrator, and/or (b) justice administrators with other counties

X

  

Descriptors and moderators

 Type of agency

NCJTP About Your Organization scale [38]

X

X

X

 Staffing (type, number, urnover)

Adapted NCJTP Staffing scales [38]

X

X

X

 Organizational support for innovation

Adapted NCJTP Assess Your Organizational Culture scale [38]

X

X

X

 Policy context

State mental health diversion funding, legislative reforms

X

X

X