Skip to main content

Table 6 Empirical use of identified measures of sustainability as an outcome and measures of determinants of sustainability

From: Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review

Measures of  sustainability as an outcome

Measure (year of initial publication)

Number of studies

Country

Settings

Perspectives

Constructs other than sustainability

Adaptations made

Provider Report of Sustainment Scale (PRESS) (2021) [32]

0

     

Stages of implementation completion (SIC) (2006) [33]

27

Australia

Canada

Denmark

Mozambique

Switzerland

USA

Clinics

Community

Department of Veterans Affairs sites

Juvenile justice

Housing providers

Primary care

Public service systems

Substance use disorder treatment agencies

Administrators/executives

Champions

Purveyor

Providers

Research staff

Implementation process/phases

N=14

Removed items

Additional items

Changed wording

New domain

Change response scale

Measures of sustainability determinants

 Assessment of Barriers to Implementation and Sustainability in Schools (ABISS) (2016) [36]

0

     

 Advanced Level Tier Interventions Treatment Utilization and Durability (ALTITUDE) (2021) [37]

0

     

 A measurement instrument for sustainability of work practices in in long-term care (2011)a [38]

6

Netherlands

USA

Community

Hospital

Long term care organisations

Executives

Frontline staff

None

N = 6

Removed items

Additional items

Changed wording

Deleted domains

Changed response scale

 Change Process Capability Questionnaire (CPCQ) (2008) [39]

34

Europe

Japan

Spain

USA

Vietnam

College

Community

Outpatient Substance Use Disorder Treatment Clinics

Primary care

Dental clinics/practices

Radiology health care organizations

Executives

Frontline staff

Capacity to change

Change process

Implementation

Organizational capacity

Readiness to change

Readiness to manage change

Quality improvement

Adoption of new interventions

N = 19

Removed items

Additional items

Changed wording

Deleted domains

Other

 Clinical Sustainability Assessment Tool (CSAT) (2021) [40]

5

Europe

USA

Health care

Hospital

General practice

Executives

Frontline staff

None

N = 0

 Faith-Based Organization Health Integration Inventory (FBO-HII) (2020) [41]

1

USA

Churches

Frontline staff

None

N = 0

General Organizational Index (GOI) (2009) [42, 43]

9

Netherlands

Norway

USA

Community mental health

Primary care

Medical centre

Frontline staff

Implementation monitors

Research staff

Trained raters

Implementation fidelity

Operating characteristics of an organization

Organizational change

Penetration and general integration

Quality of clinical care

Quality improvement

N = 2

Additional items

Changed wording

Deleted domains

Other

 Levels of Institutionalization (Loln) (1993) [44, 45]

14

Australia

Belgium

Canada

Uganda

USA

Community

Department of Veterans Affairs sites

Health facilities

Hospitals

Public health and sports services department

School

Executive

Frontline staff

Institutionalisation

N = 7

Removed items

Changed wording

Deleted domains

Changed response scale

Other

 National Health Service (NHS) Sustainability Model and Guide (2010) [47]

18

Canada

South Africa

Tanzania

UK

USA

Department of Veterans Affairs sites

Hospital

Primary care

Patient homes

University Medical center

Executive staff

Frontline staff

Implementation teams

None

N = 2

Deleted domains

Changed response scale

 The Normalisation Measure Development questionnaire(NoMAD) (2018) [48,49,50,51,52,53]

29

Albania

Australia

Brazil

Canada

Denmark

France

Germany

Kosovo

Netherlands

Scotland

Spain

Sweden

UK

USA

Wales

Community health

General practice

Health care service

Hospital

Mental health organizations

Primary care

Rural health services

School

University

 Executive staff

Frontline staff

Acceptance

Adoption

Contextual factors impacting the implementation

Implementation process

Perceptions of implementation

Normalization

Maintenance

N = 13

Removed items

Additional items

Changed wording

New domains

Deleted domains

Changed response scale

Other

 New South Wales Sustainability Checklist (2009) [55]

1

Australia

School

Stakeholders/partners

None

N = 1

Removed items

 Office of Adolescent Health (OAH) Sustainability Assessment (2014) [56]

0

     

 Office of Population Affairs (OPA) Sustainability Assessment Tool (2019) [57]

0

     

 Prevention Program Assessment (2012) [58]

2

USA

Community health clinics

Clinical care and practice settings

Frontline staff

Readiness for evidence-based intervention

N = 0

 Program Sustainability Assessment Tool (PSAT) (2014) [10]

20

Malaysia

Philippines

Puerto Rico

Spain

USA

Criminal courthouse/justice settings

Fire department

Government health departments and non-government or support groups with HIV advocacy

Pharmacy

Prenatal clinics

Primary care

Home settings

School

State and community health settings

State agencies and coalitions

Supportive housing agencies

Executives

Frontline staff

Research staff

Stakeholders

None

N = 4

Additional items

Changed wording

Deleted domains

Changed response scale

 Program Sustainability Assessment Tool (PSAT) – adapted for elementary setting (2021) [59]

0

     

 Program Sustainability Index (2004) [60]

12

USA

Child welfare systems

Community settings

Department of Veterans Affairs sites

Medical centers

Executives

Frontline staff

Stakeholders

None

N = 10

Removed items

Additional items

Changed wording

Deleted domains

Changed response scale

Other

 School-wide Universal Behaviour Sustainability Index- School Teams (SUBSIST) (2010) [61,62,63,64,65]

6

New Zealand

USA

School

Executives

Frontline staff

None

N = 2

Removed items

Additional items

Other

 Sustainability Formative Self-Assessment Tool (2011) [66]

0

     

 Sustainable Implementation Scale (SIS) (2018) [67]

4

Sweden

Community mental health services

Public employment services

Research staff

None

N = 0

 Sustained Implementation Support Scale (2018) [67]

1

Australia

Aboriginal and Torres Strait Islander child welfare agencies

Frontline staff

None

N = 0

 Sustaining Innovation Through Education (SITE): Extended Behavioural (2020) [69]

0

     

 Sustaining Innovation Through Education (SITE): Short Behavioural ( 2020) [69]

0

     

 Sustainment Leadership Scale (2018) [70]

0

     

 Sustainment Measurement System Scale (SMSS) (2020) [72]

0

     
  1. aEmpirical use of the long and short version of this measure were assessed together