Table 4 Psychometric ratings according to PAPERS* for identified measures of sustainability as an outcome and measures of sustainability determinants
Measure name | Internal consistency Median (range; n) | Convergent validity Median (range; n) | Discriminant validity Median (range; n) | Known-groups validity Median (range; n) | Predictive validity Median (range; n) | Concurrent validity Median (range; n) | Structural validity Median (range; n) | Responsiveness Median (range; n) | Norms Median (range; n) | Total psychometric score |
|---|---|---|---|---|---|---|---|---|---|---|
Measures of sustainability as an outcome | ||||||||||
 Provider Report of Sustainment Scale (PRESS) [32] | 4 (n=1) | 4 (n=1) | 0 | 2 (n=1) | 0 | 0 | 4 (n=1) | 0 | 4 (n=1) | 18 |
 Stages of implementation completion (SIC) – original [34]a | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Measures of sustainability determinants | ||||||||||
 Assessment of Barriers to Implementation and Sustainability in Schools (ABISS) [36] | 2 (n=1) | 0 | 0 | 3 (n=1) | 0 | 1 (n=1) | 2 (n=1) | 0 | 2 (n=1) | 10 |
 Advanced Level Tier Interventions Treatment Utilization and Durability (ALTITUDE) [37] | 4 (n=1) | 0 | 0 | 0 | 0 | 1 (n=1) | 2 (n=1) | 0 | 0 | 7 |
 A measurement instrument for sustainability of work practices in in long-term care – long version [38, 77] | 3 (3, 4; n=2) | 4 (n=1) | 0 | 0 | 0 | 0 | 2 (n=1) | 0 | 1 (n=1) | 10 |
 A measurement instrument for sustainability of work practices in in long-term care – short version [38] | 3 (n=1) | 0 | 0 | 0 | 0 | 0 | 2 (n=1) | 0 | 1 (n=1) | 6 |
 Change Process Capability Questionnaire (CPCQ) [39] | 4 (n=1) | 0 | 0 | 0 | 0 | 1 (n=1) | 0 | 0 | −1 (n=1) | 4 |
Clinical Sustainability Assessment Tool (CSAT) [40] | 4 (n=1) | 0 | 0 | 2 (n=1) | 0 | 0 | 2 (n=1) | 0 | 2 (n=1) | 10 |
 Faith-Based Organization Health Integration Inventory (FBO-HII) [41] | 3 (n=1) | 0 | 0 | 0 | 0 | 0 | −1 (n=1) | 0 | 0 | 2 |
2 (2, 2; n=2) | 0 | 0 | 0 | 0 | 3 (2, 3; n=3) | 0 | 4 (4,4; n=2) | −1 (−1, −1; n=2) | 8 | |
2 (1, 3; n=2) | 3 (n=1) | 0 | 1 (n=1) | 0 | 1 (n=1) | 1 (1, 2; n=2) | 0 | −1 (n=1) | 7 | |
 National Health Service (NHS) Sustainability Model and Guide [47] | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
 The Normalisation Measure Development questionnaire (NoMAD) [48, 49, 51] | 2 (1, 3; n=2) | 4 (n=1) | 0 | 0 | 0 | 0 | 2 (n=1) | 0 | 0 | 8 |
 The Normalisation Measure Development questionnaire – Dutch (NoMAD) [50] | 3 (n=1) | 2 (n=1) | 0 | 0 | 0 | 0 | −1 (n=1) | 0 | 2 (n=1) | 6 |
 The Normalisation Measure Development questionnaire - Portuguese (NoMAD) [52] | 2 (n=1) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 |
 The Normalisation Measure Development questionnaire - Swedish (S-NoMAD) [53] | 3 (n=1) | 0 | 0 | 0 | 0 | 0 | 4 (n=1) | 0 | 0 | 7 |
 New South Wales Sustainability Checklist [55] | 1 (n=1) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 (n=1) | 2 |
 Office of Adolescent Health (OAH) Sustainability Assessment [56] | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
 Office of Population Affairs (OPA) Sustainability Assessment Tool [57] | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
 Prevention Program Assessment [58] | 2 (n=1) | 2 (n=1) | 0 | 4 (n=1) | 0 | 0 | 2 (n=1) | 0 | 2 (n=1) | 12 |
 Program Sustainability Assessment Tool (PSAT) [10] | 3 (n=1) | 0 | 0 | 0 | 0 | 3 (n=1) | 2 (n=1) | 0 | 0 | 8 |
 Program Sustainability Assessment Tool (PSAT) – adapted for elementary setting [59] | 4 (n=1) | −1 (n=1) | 0 | 0 | 0 | 0 | −1 (n=1) | 0 | 2 (n=1) | 4 |
 Program Sustainability Index [60] | 2 (n=1) | 2 (n=1) | 0 | 0 | 0 | 0 | 2 (n=1) | 0 | 2 (n=1) | 8 |
 School-wide Universal Behaviour Sustainability Index- School Teams (SUBSIST) [61,62,63,64,65] | 4 (n=1) | 3 ( n=1) | 0 | 3 (2, 4; n=2) | −1 (n=1) | 1 (1, 2; n=2) | 2 (2, 3; n=2) | 0 | 2 (−1, 4; n=3) | 14 |
 Sustainability Formative Self-Assessment Tool [66] | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
 Sustainable Implementation Scale (SIS) [67] | 4 (n=1) | 0 | 0 | 2 (n=1) | 0 | 4 (n=1) | 0 | 0 | −1 (n=1) | 9 |
 Sustained Implementation Support Scale [68] | 4 (n=1) | 0 | 0 | 0 | 0 | 1 (n=1) | 2 (n=1) | 0 | 0 | 7 |
 Sustaining Innovation Through Education (SITE): Extended Behavioral [69] | 4 (n=1) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 |
 Sustaining Innovation Through Education (SITE): Short Behavioral [69] | 4 (n=1) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 |
 Sustainment Leadership Scale [70] | 4 (n=1) | 0 | 0 | 0 | 0 | 0 | 3 (n=1) | 0 | 2 (n=1) | 9 |
 Sustainment Measurement System Scale (SMSS) [72] | 3 (n=1) | 2 (n=1) | 4 (n=1) | 0 | 0 | 0 | 2 (n=1) | 0 | 2 (n=1) | 13 |