Skip to main content
Download PDF
Download ePub

Safer Care for Older Persons in (residential) Environments (SCOPE): a pragmatic controlled trial of a care aide-led quality improvement intervention

Implementation Science volume 18, Article number: 9 (2023) Cite this article

Abstract

Background

The increased complexity of residents and increased needs for care in long-term care (LTC) have not been met with increased staffing. There remains a need to improve the quality of care for residents. Care aides, providers of the bulk of direct care, are well placed to contribute to quality improvement efforts but are often excluded from so doing. This study examined the effect of a facilitation intervention enabling care aides to lead quality improvement efforts and improve the use of evidence-informed best practices. The eventual goal was to improve both the quality of care for older residents in LTC homes and the engagement and empowerment of care aides in leading quality improvement efforts.

Methods

Intervention teams participated in a year-long facilitative intervention which supported care aide-led teams to test changes in care provision to residents using a combination of networking and QI education meetings, and quality advisor and senior leader support.

This was a controlled trial with random selection of intervention clinical care units matched 1:1 post hoc with control units. The primary outcome, between group change in conceptual research use (CRU), was supplemented by secondary staff- and resident-level outcome measures. A power calculation based upon pilot data effect sizes resulted in a sample size of 25 intervention sites.

Results

The final sample included 32 intervention care units matched to 32 units in the control group. In an adjusted model, there was no statistically significant difference between intervention and control units for CRU or in secondary staff outcomes. Compared to baseline, resident-adjusted pain scores were statistically significantly reduced (less pain) in the intervention group (p=0.02). The level of resident dependency significantly decreased statistically for residents whose teams addressed mobility (p<0.0001) compared to baseline.

Conclusions

The Safer Care for Older Persons in (residential) Environments (SCOPE) intervention resulted in a smaller change in its primary outcome than initially expected resulting in a study underpowered to detect a difference. These findings should inform sample size calculations of future studies of this nature if using similar outcome measures. This study highlights the problem with measures drawn from current LTC databases to capture change in this population. Importantly, findings from the trial’s concurrent process evaluation provide important insights into interpretation of main trial data, highlight the need for such evaluations of complex trials, and suggest the need to consider more broadly what constitutes “success” in complex interventions.

Trial registration

ClinicalTrials.gov, NCT03426072, registered August 02, 2018, first participant site April, 05, 2018.

Peer Review reports

Introduction

As a greater proportion of our population survives into late life, the number of people living with chronic and co-existing medical conditions and cognitive impairment has increased [1,2,3,4,5]. Despite policy designed to allow people to age in place, the need for long-term care (LTC) has grown. Annually, 1.7 million older adults in North America reside in LTC homes [6]. Over half of this medically complex, vulnerable population has an accompanying age-related dementia [7,8,9].

Dementia is one of the most distressing and burdensome health problems encountered by the LTC home workforce [10,11,12,13,14]. Caregivers often associate dementia with increased job strain, reduced job satisfaction, and increased staff turnover [11, 15,16,17,18,19]. This is an ongoing source of concern for families [20,21,22] and has also resulted in LTC home staff reporting increased workloads and decreased quality of working life [16, 23].

Over recent decades, national and international reports have highlighted concerns about the quality of LTC provided to residents [24,25,26,27,28]. These concerns have been heightened during the COVID-19 pandemic, where residents were disproportionately affected both by the illness itself and by the restrictions placed upon their freedoms, resulting in significant adverse effects [29, 30]. Despite the increasingly complex needs of this highly vulnerable population, increasing proportions of residents with high physical dependency, cognitive impairment, and increasing numbers of co-existing medical conditions [31], LTC home staff levels and skills have not significantly changed over recent years [32, 33]. There is also a long-standing staffing shortfall and difficulty with staff retention which has been exacerbated during the COVID-19 pandemic [34,35,36].

The vast majority of direct care to residents in LTC homes, including personal care such as bathing, dressing, assistance with mobility and activities of daily living, and increasingly managing bladder and bowel incontinence, wound care and assessment of vital signs, is provided by care aides (also known as personal support workers, nursing aides, nursing assistants) [37, 38]. These unregulated workers seldom have standardized training and have a widely diverse racial composition, often with English as a second language. Among front-line workers, care aides are critically placed to observe, interpret, and respond to residents’ daily needs. They are integral to the provision of quality care [39,40,41]. Despite calls to include them in care planning and quality improvement initiatives, however, they are routinely excluded, contributing to their beliefs that they are under-valued by others on the team [42,43,44]. Evidence demonstrates that empowering care aides enhances their work performance and quality of work life [45,46,47]. However, it is unclear how best to accomplish this and robust intervention studies using systematic, evidence-informed approaches are lacking.

This study examined the effectiveness of the SCOPE (Safer Care for Older Persons in (residential) Environments) intervention. SCOPE is a facilitation and quality improvement intervention which aimed to empower and enable care aides to lead quality improvement (QI) efforts and to improve the quality of care for older residents in LTC homes. We examined whether SCOPE resulted in increased use of best practices in care and improved care aide’s quality of work life. The intervention stemmed from a proof of principle study with care aide led teams [48] which was subsequently subjected to refinement, with care aides, prior to pilot testing [49] in the registered trial reported here (NCT03426072).

Intervention

The SCOPE intervention is based on a modified Institute for Healthcare Improvement (IHI) Breakthrough Collaborative Series model designed around successful collaborative learning approaches for quality improvement [50, 51]. The intervention was developed, tested, and subsequently refined in an initial pilot study and a subsequent larger test for refinement for use with care aide led teams prior to this formal trial [48, 49]. The components were also informed by knowledge translation theory, with specific focus on the role that facilitation plays in implementation success [52, 53]. The intervention, including the facilitation activities in it described below, was delivered by regional Quality Advisors, supported by an overall study Coordinator that we called a Quality Coordinator. As shown in Fig. 1, the intervention comprised the following:

  1. 1.

    A “Getting Started Kit”: Teams and Sponsors (unit and facility managers) received baseline performance data on their selected clinical area, one of three—reducing pain, maintaining mobility, reducing responsive behaviours, selected by care aides as the most pressing problem within their LTC home in a Delphi process [54], information about how to modify the outcome (evidence from published literature supported by content written by experts in each area), and a SCOPE Change Package that introduced the Plan-Do-Study-Act (PDSA) cycle and QI concepts in the context of using best practice to improve resident care along with examples and models from the IHI collaborative model.

  2. 2.

    Four face-to-face “Learning Congresses” (LCs) brought together team members and sponsors from each region for one to one-and-a-half days every three months for networking and short plenary sessions and activities on the improvement model, measurement in PDSA cycles, team dynamics and function, engagement of colleagues in implementing ideas, and overcoming barriers to spread. The final congress was a celebration meeting, allowing teams to showcase their achievements and share experiences. Learning congresses were delivered primarily by the regional Quality Advisors and the Quality Coordinator.

  3. 3.

    Three “action periods” (improvement activity with ongoing coaching from Quality Advisors and the Quality Coordinator between LCs) when teams made small tests of change using Plan-Do-Study-Act (PDSA) cycles to improve care delivery in their selected clinical area and conducted small-scale measurement to gauge improvement. Teams used the IHI model for improvement comprising elements of successful process improvement: specific and measurable improvement aims, measures of improvement tracked over time, changes resulting in the desired improvement, and a series of testing “cycles” during which unit teams learned how to apply their ideas across their care unit. Teams implemented their change ideas with increasing numbers of residents on the unit during this time. PDSA cycles continued to adapt, adopt, or abandon change ideas throughout these action periods.

  4. 4.

    Participation in several facilitation activities to support QI during the action periods. Teams participated in a minimum of monthly teleconferences and a site visit facilitated by the regional Quality Advisors. Teams were supported in adoption and use of best practices, idea generation, measurement tools, analysis of results, and implementation challenges, with the degree of support tailored to the needs of each team.

  5. 5.

    A program of in-person learning sessions and online discussions on leadership, focused on “supporting and enabling change” for sponsors, delivered by the Quality Co-ordinator.

Fig. 1
figure 1

The SCOPE intervention

Full size image

Theoretical framing

The study was theoretically informed by the Promoting Action on Research Implementation in Health Services (PARiHS) framework [55]. This framework argues that successful implementation is a function of optimizing organizational context, facilitation (role or process), and evidence. The success of both QI collaboratives [56, 57] and implementation [58,59,60,61,62,63] depends on an optimized work environment (context) and sufficient facilitation, and here, implementation success was defined as the uptake and increased use of best practices by care aides [64,65,66]. In SCOPE, we defined facilitation capacity and its implied processes as the capacity in an organization, specifically at the care home unit level, to engage in deliberate processes of interactive problem-solving in the context of a recognized need for improvement and supportive interpersonal and intra-organizational relationships. The SCOPE intervention uses (1) facilitation (as a bundled set of activities) to support literacy in the language and tools of quality improvement, (2) relationship building to develop unit-based quality improvement teams that engage and are led by care aides, and (3) interconnectedness of these teams with other care providers on the unit, with senior management support and leadership. SCOPE also encouraged networking between teams from participating LTC sites as a form of collaborative learning.

Facilitation has been described both as a single intervention and as part of a multifaceted intervention [67]. A recent definition identified three elements of facilitation: project management, leadership and tailoring of facilitation efforts to the local context, and an emphasis on evaluation linking outcomes to actions [68]. Seers et al. [69] describe facilitation as existing on a continuum from technical to enabling. Technical facilitation focuses particularly on issues of implementation at the level of clinical teams. It encompasses designing systems and processes of care that enhance the transfer of evidence into day-to-day practice, and making use of techniques such as toolkits, both of which are features of the SCOPE intervention. A meta-analysis conducted in primary care found a relationship between intensity of facilitation and effect size in intervention studies [70]. However, we lack empirical evidence for the effectiveness of facilitation (as a role or process) on implementation, as well as knowledge about its operational mechanisms. The parallel process evaluation undertaken as part of SCOPE [71] attempted to generate real-world evidence and shed light on how change happened in SCOPE.

Methods

SCOPE was a pragmatic controlled trial with each randomly selected LTC home identifying a care unit to participate in the intervention. Care aides and residents of these units (clustered within the units) formed the units of analysis. Control (usual care) units in non-intervention LTC homes were matched to intervention units post hoc (see below).

Setting

This study was part of a larger research program examining modifiable contextual factors that influence implementation and improvement efforts in LTC homes in British Columbia, Alberta, and Manitoba, the Translating Research in Elder Care (TREC) program. TREC is a longitudinal research program comprised of many studies (including SCOPE). Its overall aim is to improve the quality of care and quality of life for LTC home residents and quality of work life for the staff who care for them [72]. TREC focuses on the level of the clinical microsystem (resident care units) where quality is created [73, 74]. The overall TREC cohort includes 94 urban homes and was created using a stratified (owner-operator model, size, region) random sample [72]. Homes participating in the SCOPE study were selected using a stratified random sample [72] of TREC homes in Alberta and British Columbia.

Outcomes and measures

SCOPE was situated between two routinely occurring waves of TREC data collection and used variables from these sources for its quantitative outcome measurement. The primary outcome measure for this study aimed at improving use of best practices for resident care was between group change in care aide-reported conceptual use of best practices (Conceptual Research Use, CRU). CRU is defined as the cognitive, reflective use of research (best practices) where the knowledge may change one’s opinion or mindset about a specific practice area but not necessarily one’s direct actions. This scale asks about how often on a typical workday best practice knowledge helped with conceptual thinking about resident care, for example, by making sense of things related to resident care. It is an indirect application of research [75,76,77,78] measured using the five-item CRU scale. In reliability testing with care aides, Cronbach’s alpha for the 5-item CRU scale exceeded the accepted standard for scales intended to compare groups (alpha = 0.894) as well as acceptable response process, content, factorial, and construct validity [79,80,81].

Secondary outcomes

Secondary outcomes included validated measures of care aide-reported outcomes on work engagement, job satisfaction, and burnout, and resident outcomes on clinical indicators for pain, mobility, and responsive behaviours collected as part of the Resident Assessment Instrument – Minimum Data Set (version 2.0) (RAI-MDS) [82]. All outcomes were collected at baseline and at the end of the SCOPE trial. Measures of the implementation fidelity, measured at the SCOPE team level in a concurrent process evaluation [71], were also collected. Only fidelity enactment data are incorporated into the main trial analysis reported here. Full details are shown in Table 1.

Table 1 Secondary outcome measures
Full size table

Sample size and power calculation

The primary outcome measure was change in Conceptual Research Use (CRU), from baseline to post intervention, compared between intervention and control (usual care) units. Initial modeling was based on unit aggregate expected change in the primary outcome, dictating a sample size of 34 units to be matched to usual care units, but was replaced by a care aide level analytical model, deviating from the original published trial protocol (NCT03426072). Thus, for an effect size of d=0.22 (based on a mean difference of 0.11 in the CRU score between the intervention and control group at follow-up and a standard deviation of 0.5 in both groups, informed by our pilot data [40]), the required sample size was 652 CA surveys, n=326 in each study group (based on a two-tailed test for independent study groups, at 80% power, with an alpha of 0.05). Considering possible clustering effects, we multiplied this required sample size by a variance inflation factor (VIF=1+ [cluster size – 1] *intra-cluster correlation). Based on previous TREC data, we assumed a cluster size of 15 care aide surveys per unit and an intracluster coefficient of 0.01. Therefore, our required sample size was 652*1.14=744 care aides (n=372 per study group) or 50 care units (25 in each study group, each providing an average number of 15 care aide surveys).

Sampling

To be eligible to participate, LTC homes had to (a) be a part of the TREC cohort in Alberta and British Columbia; (b) have units comprising general nursing care for older adults, rather than those co-managed with acute care; (c) have the majority of residents over the age of 65; (d) have more than 35 beds in total; (e) be geographically located within 100km of either Edmonton: Edmonton Health Zone (EH) or Calgary: Calgary Health Zone (CH) in Alberta (AB), or Kelowna: Interior Health (IH), or New Westminster: Fraser Health (FH) in British Columbia (BC); (f) use the Resident Assessment Instrument-Minimum Data Set 2-0 (RAI-MDS) to gather resident level care indicators; and (g) have 8 or more care aide responses to the baseline trial data collection survey.

Eligible LTC homes were stratified by region (EH, CH, IH, FH), owner operator model (for profit, not for profit), and size (small: <80 beds, medium: eight-120 beds, large: >120 beds), and randomly selected for participation. Based upon feedback from decision-makers and LTC home administrators, it was decided that randomization to intervention or control at the outset would not be feasible because of the likelihood of bias favouring refusal to participate as an inactive “control” site. Thus, random selection was undertaken only for intervention sites, with replacement for refusals. Once the number of LTC homes within the same stratum was exhausted, a replacement home was randomly selected from the remaining homes in that region.

Because of the limited number of eligible LTC homes in the cohort, homes which declined to participate were returned to the main TREC cohort to act as usual care (control) comparators. After removing ineligible units (those who did not participate in both the baseline and follow up data collections and those with fewer than eight care aide responses to the TREC care aide survey) to ensure stability of measures at either the baseline or follow up data collections, we randomly matched a control unit to each intervention unit, based on the unit type: general long-term care versus dementia care unit, number of beds on unit, facility size category (small: <80 beds, medium: eight-120 beds, large: >120 beds), ownership model (for-profit, not-for-profit), and region.

Directors of care in charge of each selected home were invited to participate, provided with information about the study, and included if they consented to participate. Homes were provided with $3000 as partial compensation for the time and resources required to participate. Following discussion of trial requirements, Directors of Care were given the task of identifying one care unit within their home to participate in the intervention and to identify staff as members of their SCOPE team.

Participants

SCOPE teams comprised four to seven members, at least two of which were care aides. Each team was either led by a care aide or co-led by two care aides. Other team members consisted of unit-based care aides and/or professional staff (e.g., registered nurse, physiotherapist, occupational therapist, recreation therapist). A team sponsor (usually a unit-level clinical nurse manager) was responsible for supporting day-to-day project activities. A senior sponsor, normally at the facility Director of Care or the care manager level in large units, agreed to actively support each team, removing barriers to change, and supporting time spent on quality improvement.

Analysis

SAS® 9.4 (SAS Institute Inc., Cary, NC, USA) was used for all statistical analyses. Using descriptive statistics, baseline characteristics of LTC homes, care units, care aides, and residents were compared between study arms. To assess intervention effectiveness, mixed effects regression models were used [99, 100]. All models were adjusted for sampling strata, baseline differences of the outcome variables, care aide characteristics (sex, age, English as first language [yes/no]), and care unit staffing (total care hours per resident day and percentage of total hours per resident day provided by care aides). A unit-level random intercept was added to account for dependencies of responses provided by care aides on the same care unit. Similar models were used to assess the impact of the intervention on resident outcomes but adjusted for resident characteristics (age, sex, case mix index). Finally, to assess whether improvements in outcome scores were higher in intervention facilities with higher (above median) enactment scores, mixed effects regression models were used, adjusted for the same variables as above, and included an interaction term between the dichotomous enactment variables (high/low) and data collection (baseline/follow-up).

Results

A total of 31 LTC homes were randomly selected to form the intervention group. The intervention took place between May 2018 and May 2019. While facilities were asked to select only one care unit to participate in the study, one home included three of their care units and another included two units, so the intervention group baseline sample was 34 care units in 31 LTC homes. Two facilities withdrew their participation during the study, citing external pressures. The final sample included 32 care units in 29 LTC homes (total of 1221 beds) in the intervention group and 32 care units in 30 LTC homes (total of 1258 beds) in the control group. From these care units, 1719 surveys from care aides (866 at baseline and 853 at follow-up) were collected. Seven SCOPE homes (two AB, five BC) engaged with quality improvement projects on pain, seven (five AB, two BC) on maintaining mobility, and 17 (seven AB, ten BC) addressed responsive behaviours. Descriptions of participating LTC homes are in Table 2. Twenty-seven of the 32 teams (84%) participated in all four learning congresses [details of team participation and implementation processes are provided in the companion paper [71].

Table 2 Facility, care unit, and care aide characteristics at baseline by study arm
Full size table

There was no statistically significant difference in any of the outcome measures between intervention units and control units at baseline: all p>0.05 (Table 3).

Table 3 Study outcomes (unadjusted M ± SD) by study arm at baseline and follow-up
Full size table

Primary outcome

In the adjusted model (Table 4), there was no statistically significant difference between intervention and control units for CRU at follow-up. However, the CRU score in the intervention group increased by 0.09 points at follow-up (p=0.07) but remained constant in the control group.

Table 4 Adjusted mean differences [95% confidence interval] of study outcomes based on mixed effects models
Full size table

Secondary staff outcomes

There was no statistically significant difference in any of the secondary staff outcomes, based on adjusted mean scores at follow-up between the intervention and control group (Table 4). A post hoc analysis of item two of the Organizational Citizenship Behaviours (OCB) scale: “I often suggest to my co-workers new ways about how to improve the work on the unit” revealed a statistically significant decrease in score (worsened) at follow-up, compared to the baseline, in the intervention group (p=0.04). Analysis of the intervention units including an interaction term between high/low intervention fidelity enactment and time of data collection showed that, over the duration of the intervention, the score on this OCB item decreased statistically significantly only on intervention units with low levels of enactment, while on care units with high levels of enactment the decrease was not statistically significant (Fig. 2). Enactment was not associated with other study outcome.

Fig. 2
figure 2

Change in scores measuring how often care aides suggested ways to improve performance to their colleagues by level of enactment based on mixed effects models

Full size image

Resident care outcomes

No intervention effects were found for those teams working on responsive behaviors. However, the adjusted level of resident dependency significantly decreased for residents whose teams addressed mobility (p<0.0001) at follow-up, compared to the baseline, in the intervention group. While adjusted follow-up scores in the intervention group for those teams working on resident pain were higher than at baseline (p=0.01), adjusted pain scores at follow-up were lower (indicating less pain) in the intervention group compared to the control group (p=0.02).

Discussion

SCOPE was a multicomponent intervention designed to facilitate the use of best practices in care for older LTC home residents. SCOPE incorporated elements of design to support sustainability and address the need for programs of research on implementation and improvement in healthcare [101, 102]. The facilitated SCOPE intervention aimed to empower and enable care aides to lead QI initiatives using PDSA cycles as the vehicle with which to test small changes in care processes, increasingly considering and therefore using best practices. Our expectation was that this would also lead to improvements in our secondary outcomes—care aide job satisfaction, work engagement, and ultimately to improvements in the quality of resident care delivered [103,104,105,106].

Primary outcome

SCOPE was initially planned as a randomized clinical trial, attempting to take the complex nature of the system in which it was implemented into account. Using quantitative measures, SCOPE’s primary aim, improvement in the conceptual use of best practices, was not demonstrated. The intention was that teams would implement what they had learned by taking part in SCOPE, developing, and testing small changes in care practices, based upon best practices in care, which would then be spread across the unit and embedded in usual care. The outcome, Conceptual Research Use (use of best practices), was thought to best capture the essence of the change in thinking resulting from the team quality improvement collaborative and theoretically links beliefs regarding research use being predictive of actual best practice use [107]. SCOPE resulted in a smaller change in its primary outcome than initially expected, with an effect size smaller than that obtained in our pilot project [40], resulting in a study statistically underpowered to detect a difference.

Secondary outcomes—staff

There were no statistically significant group differences in staff-related secondary outcomes. These findings should inform sample size calculations of future studies of this nature for example, if based on the size of effects we report using similar outcomes measures.

A post hoc analysis revealed a statistically significant improvement in care aide perspectives on new ways of working on the unit (one element of OCB) and a positive relationship between SCOPE fidelity enactment and these behaviors. This last finding reinforces the importance of recent Medical Research Council guidance [108] and a systematic review [109] which suggests that conducting process evaluations and considering implementation are important in complex trials such as SCOPE and may well be mandatory to describe resulting change.

In addition to the, retrospectively, smaller than needed sample size, our concurrent process evaluation [71, 108] affords valuable and rarely available insights into other possible explanations for finding no measurable difference between intervention and control units for most of our outcomes [110]. Firstly, the primary outcome, conceptual research use, relied on teams using best practices (with facilitation) to inform their small tests of change. However, many tested changes on the ground were more pragmatic (such as removing a door in the dining room to address disruption) and may have only been indirectly related to best practices.

Secondly, SCOPE teams consisted of four—six members, actively working on their PDSA cycles, and attempting to improve quality of care; the team members had to spread their improvement efforts across the entire unit, ensuring that “new ways of doing” were adopted by care providers who were not part of the SCOPE team. It is possible that adoption was not spread sufficiently across staff on the unit who provided data on the primary and secondary outcomes. Outcome data were also collected from care aides on the unit who may not have been SCOPE team care aide members. Our process evaluation data [71] suggested that SCOPE teams often had difficulty spreading SCOPE to all staff on a SCOPE unit. Given increasing recognition of the minimal impact of QI, insights from concurrent process studies are important [111].

Secondary outcomes—residents

Examination of two of the three resident care indicators from the RAI-MDS showed no difference in change between groups over the period of observation. The finding in pain assessment is however, encouraging, suggesting that teams were successful in improving the quality of care for residents in pain, but this is a single finding in need of replication. There may be several reasons for the inability to detect a change in resident outcome measures. Firstly, the SCOPE intervention was implemented over a year and most teams took time to function effectively, to design their aim statements and conduct tests of small changes to improve quality [71]. Effects relating to these changes conceivably may take far longer to be detectable in RAI-MDS data [102]. Secondly, teams addressing, for example, responsive behaviours often targeted specific times of the day when they found these more problematic (e.g., mealtimes). Such endeavours were likely insufficient to result in a degree of decline in behaviours across the unit to move the RAI-MDS 2.0 indicator. Thirdly, in many units, teams felt only a proportion of residents were appropriate with whom to work, potentially leaving most residents with “usual care,” further diluting the effect of the intervention. Finally, given the nature of the LTC home resident population (near end of life with a progressive set of chronic conditions, such as dementia), avoidance of a decline in mobility, rather than an improvement, is likely a more meaningful indication of success.

For all outcomes and teams, SCOPE was dependent upon leadership sufficiently able to support change. Leaders were called upon to remove obstacles, provide sufficient time for QI initiatives and to allow the care aide leaders to lead the team. This was variably achieved, with some leaders adopting and maintaining a more authoritarian approach to SCOPE implementation, providing less than sufficient resources and time for teams to meet, potentially adding to work life pressures, rather than relieving them [71]. “Top-down” approaches have markedly different effects to “bottom-up” methods in improvement collaboratives [112]. Other findings from the concurrent process evaluation provide important insights into SCOPE implementation that can help with interpretation of the main trial data presented here and deepen our understanding of how teams implement complex interventions in LTC home settings [71, 108]. The process evaluation results also suggest the need to consider more broadly what constitutes “success” in complex interventions.

Limitations

We note above limitations related to the primary and secondary outcomes. There are additional important limitations. While initially intended as a randomized controlled trial with propensity matching to TREC units not participating in SCOPE, two problems were encountered that were eventually insurmountable, resulting in the quasi-experimental design reported here. Firstly, the number of LTC homes in the sampling frame was exhausted before the intended sample size was reached. Secondly, to maintain the size of our control cohort in a potential 1:1 match, we had to return homes that had declined to participate to the general pool, potentially introducing a bias to the comparator group. Despite the close working relationships established with many of the homes, and our previous experience with this intervention, recruitment was more challenging than originally anticipated [113]. Because of these factors and the fact that, to avoid refusal bias, as advised by our nursing home leaders, we were unable to randomize a priori, selection of control units was less than optimal. However, variables did not vary across all TREC units at baseline, and matching was carefully performed at the analytical stage. The trial was also methodologically limited in that although intervention homes were randomized, and the care units where SCOPE was implemented (the units of analysis) were not. The selection of care units was at the discretion of Directors of Care, who best knew their units and staff, potentially introducing selection bias and perhaps bias to trial success. The variability in achieved results across the intervention cohort suggests that local knowledge in unit selection did not produce such bias.

Conclusion

In conventional terms, SCOPE was a negative study further contributing to the file drawer problem [114] and highlights the problem with measures drawn from current LTC databases to capture change in this population. However, our concurrent process evaluation and its attention to important concepts such as fidelity and implementation, as well as its attention to how the trial was experienced by care staff, suggests a markedly different picture in which staff interpreted their participation positively and evaluated its success quite differently. This causes us to question how we define and measure success in such trials. The process evaluation enables us to draw conclusions about the true value of SCOPE that would have previously gone unrecognized. Consequently, we can consider critical questions that are generally poorly examined, such as how and why the SCOPE intervention worked, or failed to work.

Availability of data and materials

The data used for this article are housed in the secure and confidential Health Research Data Repository (HRDR) in the Faculty of Nursing at the University of Alberta (https://www.ualberta.ca/nursing/research/supports-and-services/hrdr), in accordance with the health privacy legislation of participating TREC jurisdictions. These health privacy legislations and the ethics approvals covering TREC data do not allow public sharing or removal of completely disaggregated data from the HRDR, even if de-identified. The data were provided under specific data sharing agreements only for approved use by TREC within the HRDR. Where necessary, access to the HRDR to review the original source data may be granted to those who meet pre-specified criteria for confidential access, available at request from the TREC data unit manager (https://trecresearch.ca/about/people), with the consent of the original data providers and the required privacy and ethical review bodies. Statistical and anonymous aggregate data, the full dataset creation plan, and underlying analytic code associated with this paper are available from the authors upon request, understanding that the programs may rely on coding templates or macros that are unique to TREC.

Abbreviations

AB:

Alberta

ABS:

Aggressive Behaviour Scale

ADL-H:

Activities of Daily Living Hierarchy

BC:

British Columbia

CH:

Calgary Health Zone

CRU:

Conceptual research use

EH:

Edmonton Health Zone

FH:

Fraser health

IH:

Interior health

IHI:

Institute for Healthcare Improvement

LTC:

Long-term care

RAI-MDS:

Resident Assessment Instrument - Minimum Data Set

OCB:

Organizational citizenship behaviors

PARiHS:

Promoting Action on Research Implementation in Health Services

PDSA:

Plan-do-Study Act

QA:

Quality advisor

QI:

Quality improvement

SCOPE:

Safer Care for Older Persons in residential Care Environments

TREC:

Translating Research in Elder Care

References

  1. Stephan BCM, Birdi R, Tang EYH, Cosco TD, Donini LM, Licher S, et al. Secular trends in dementia prevalence and incidence worldwide: a systematic review. J Alzheimers Dis. 2018;66(2):653–80.

    Article  PubMed  Google Scholar 

  2. World Health Organization. Dementia: fact sheet 2017. Available from: http://www.who.int/mediacentre/factsheets/fs362/en/.

    Google Scholar 

  3. 2020 Alzheimer's disease facts and figures. Alzheimer's & dementia: the journal of the Alzheimer's Association. 2020.

  4. Chatterji S, Byles J, Cutler D, Seeman T, Verdes E. Health, functioning, and disability in older adults-present status and future implications. Lancet. 2015;385(9967):563–75.

    Article  PubMed  Google Scholar 

  5. Prince MJ, Wu F, Guo Y, Gutierrez Robledo LM, O'Donnell M, Sullivan R, et al. The burden of disease in older people and implications for health policy and practice. Lancet. 2015;385(9967):549–62.

    Article  PubMed  Google Scholar 

  6. Organisation for Economic Co-operation and Development. Long-term care resources and utilisation: long-term care recipients. 2020. Available from: https://stats.oecd.org/Index.aspx? DatasetCode=HEALTH_STAT.

    Google Scholar 

  7. Slaughter SE, Jones CA, Eliasziw M, Ickert C, Estabrooks CA, Wagg AS. The changing landscape of continuing care in Alberta: staff and resident characteristics in supportive living and long-term care. Healthc Policy. 2018;14(1):44–56.

    PubMed  PubMed Central  Google Scholar 

  8. Doupe M, St. John P, Chateau D, Strang D, Smele S, Bozat-Emre S, et al. Profiling the multidimensional needs of new nursing home residents: evidence to support planning. J Am Med Dir Assoc. 2012;13(5):487–17.

    Article  Google Scholar 

  9. Canadian Institute for Health Information. Dementia in Canada Ottawa, Ontario. 2018. Available from: https://www.cihi.ca/en/dementia-in-canada/dementia-across-the-health-system/dementia-in-long-term-care.

    Google Scholar 

  10. Canadian Study of Health and Aging Working Group. Canadian study of health and aging: study methods and prevalence of dementia. Can Med Assoc J. 1994;150(6):899–913.

    Google Scholar 

  11. WHO. Dementia: a public health priority. Geneva: World Health Organization; 2012.

    Google Scholar 

  12. Morgan DG, Stewart NJ, D'Arcy C, Forbes D, Lawson J. Work stress and physical assault of nursing aides in rural nursing homes with and without dementia special care units. J Psychiatr Ment Health Nurs. 2005;12(3):347–58.

    Article  CAS  PubMed  Google Scholar 

  13. Tornatore JB, Hedrick SC, Sullivan JH, Gray SL, Sales A, Curtis M. Community residential care: Comparison of cognitively impaired and noncognitively impaired residents. Am J Alzheimers Dis Other Dement. 2003;18(4):240–6.

    Article  Google Scholar 

  14. Albers G, Van den Block L, Vander SR. The burden of caring for people with dementia at the end of life in nursing homes: a postdeath study among nursing staff. Int J Older People Nurs. 2014;9(2):106–17.

    Article  PubMed  Google Scholar 

  15. Bostick JE, Rantz MJ, Flewner MK, Riggs CJ. Systematic review of studies of staffing and quality in nursing homes. J Am Med Dir Assoc. 2006;7(6):366–76.

    Article  PubMed  Google Scholar 

  16. McGilton KS, McGillis Hall L, Wodchis WP, Petroz U. Supervisory support, job stress, and job satisfaction among long-term care nursing staff. J Nurs Adm. 2007;37(7/8):366–72.

    Article  PubMed  Google Scholar 

  17. Morgan DG, Semchuk KM, Stewart NJ, D'Arcy C. Job strain among staff of rural nursing homes: a comparison of nurses, aides, and activity workers. J Nurs Adm. 2002;32(3):152–61.

    Article  PubMed  Google Scholar 

  18. Staw B. The consequences of turnover. J Occup Behav. 1980;1(4):253–73.

    Google Scholar 

  19. Fujisawa R, Colombo F. The long-term care workforce: overview and strategies to adapt supply to a growing demand. OECD Health Working Papers, No. 44: OECD Publishing; 2009.

    Google Scholar 

  20. Feng Z, Grabowski DC, Intrator O, Zinn J, Mor V. Medicaid payment rates, case-mix reimbursement, and nursing home staffing--1996-2004. Med Care. 2008;46(1):33–40.

    Article  PubMed  Google Scholar 

  21. McGregor MJ, Tate RB, Ronald LA, McGrail KM, Cox MB, Berta W, et al. Trends in long-term care staffing by facility ownership in British Columbia, 1996 to 2006. Health Rep. 2010;21(4):27–33.

    PubMed  Google Scholar 

  22. News C. Nursing home survey finds understaffing tops concerns 2015. Available from: http://www.cbc.ca/news/canada/edmonton/nursing-home-survey-finds-understaffing-tops-concerns-1.2935662.

    Google Scholar 

  23. Bostick JE. Relationship of nursing personnel and nursing home care quality. J Nurs Care Qual. 2004;19:130–6.

    Article  PubMed  Google Scholar 

  24. Castle NG, Ferguson JC. What is nursing home quality and how is it measured? Gerontologist. 2010;50(4):426–42.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Rantz MJ, Zwygart-Stauffacher M, Flesner M, Hicks L, Mehr D, Russell T, et al. Challenges of using quality improvement methods in nursing homes that “need improvement”. J Am Med Dir Assoc. 2012;13(8):732–8.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Temkin-Greener HP, Zheng N, Katz PMD, Zhao HS, Mukamel DBP. Measuring work environment and performance in nursing homes. Med Care. 2009;47(4):482–91.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Tolson D, Rolland Y, Andrieu S, Aquino J-P, Beard J, Benetos A, et al. International association of gerontology and geriatrics: a global agenda for clinical research and quality of care in nursing homes. J Am Med Dir Assoc. 2011;12(3):184–9.

    Article  PubMed  Google Scholar 

  28. Wong EKC, Thorne T, Estabrooks C, Straus SE. Recommendations from long-term care reports, commissions, and inquiries in Canada. F1000Res. 2021;10:87.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Williams CS, Zheng Q, White AJ, Bengtsson AI, Shulman ET, Herzer KR, et al. The association of nursing home quality ratings and spread of COVID-19. J Am Geriatr Soc. 2021;69(8):2070–8.

    Article  PubMed  PubMed Central  Google Scholar 

  30. De Vito A, Fiore V, Princic E, Geremia N, Panu Napodano CM, Muredda AA, et al. Predictors of infection, symptoms development, and mortality in people with SARS-CoV-2 living in retirement nursing homes. PLoS One. 2021;16(3):e0248009.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Ng R, Lane N, Tanuseputro P, Mojaverian N, Talarico R, Wodchis WP, et al. Increasing complexity of new nursing home residents in Ontario, Canada: a serial cross-sectional study. J Am Geriatr Soc. 2020;68(6):1293–300.

    Article  PubMed  Google Scholar 

  32. Ontario RNAo. Long-term care systemic failings: two decades of staffing and funding recommendations: Registered nurses' Association of Ontario; 2020.

    Google Scholar 

  33. OECD. “Long-term care workers”, in health at a glance 2021. Paris: OECD Indicators; 2021.

    Book  Google Scholar 

  34. Scales K. It is time to resolve the direct care workforce crisis in long-term care. Gerontologist. 2021;61(4):497–504.

    Article  PubMed  Google Scholar 

  35. Jump P, Floen C, Baruth K. Developing solutions to the direct care worker shortage. Caring. 2001;20(7):6–9.

    CAS  PubMed  Google Scholar 

  36. McGilton KS, Escrig-Pinol A, Gordon A, Chu CH, Zuniga F, Sanchez MG, et al. Uncovering the devaluation of nursing home staff during COVID-19: are we fuelling the next health care crisis? J Am Med Dir Assoc. 2020;21(7):962–5.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Price Waterhouse Coopers. Report on a study to review the levels of service and responses to need in a sample of ontario long-term care facilities and selected comparators. 2001. Available from: http://longtermcareinquiry.ca/wp-content/uploads/Exhibit-158_Price-Waterhouse-Coopers-Report-of-a-Study-to-Review-Levels-of-Service-and-Responses-January-11-2001.pdf.

    Google Scholar 

  38. Afzal A, Stolee P, Heckman GA, Boscart VM, Sanyal C. The role of unregulated care providers in Canada-a scoping review. Int J Older People Nurs. 2018;13(3):e12190.

    Article  PubMed  Google Scholar 

  39. Boockvar K, Brodie HD, Lachs M. Nursing assistants detect behavior changes in nursing home residents that precede acute illness: development and validation of an illness warning instrument. J Am Geriatr Soc. 2000;48(9):1086–91.

    Article  CAS  PubMed  Google Scholar 

  40. Kontos PC, Miller KL, Mitchell GJ, Cott CA. Dementia care at the intersection of regulation and reflexivity: a critical realist perspective. J Gerontol B Psychol Sci Soc Sci. 2011;66(1):119–28.

    Article  PubMed  Google Scholar 

  41. Estabrooks CA, Squires JE, Carleton HL, Cummings GG, Norton PG. Who is looking after mom and dad? Unregulated workers in Canadian long-term care homes. Can J Aging. 2015;34(1):47–59.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Barry TT, Brannon D, Mor V. Nurse aide empowerment strategies and staff stability: effects on nursing home resident outcomes. Gerontologist. 2005;45(3):309–17.

    Article  PubMed  Google Scholar 

  43. Hamann DJ. Does empowering resident families or nursing home employees in decision making improve service quality? J Appl Gerontol. 2014;33(5):603–23.

    Article  PubMed  Google Scholar 

  44. Yeatts DE, Cready CM. Consequences of empowered CNA teams in nursing home settings: a longitudinal assessment. Gerontologist. 2007;47(3):323–39.

    Article  PubMed  Google Scholar 

  45. Castle NG, Engberg J. The influence of staffing characteristics on quality of care in nursing homes. Health Serv Res. 2007;42(5):1822–47.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Hamelin Brabant L, Lavoie-Tremblay M, Viens C, Lefrançois L. Engaging health care workers in improving their work environment. J Nurs Manag. 2007;15(3):313–20.

    Article  PubMed  Google Scholar 

  47. Caspar S, Cooke HA, O'Rourke N, MacDonald SW. Influence of individual and contextual characteristics on the provision of individualized care in long-term care facilities. Gerontologist. 2013;53(5):790–800.

    Article  PubMed  Google Scholar 

  48. Norton PG, Cranley L, Cummings GG, Estabrooks CA. Report of a pilot study of quality improvement in nursing homes led by healthcare aides. Eur J Pers Cent Healthc. 2013;1(1):255–64.

    Google Scholar 

  49. Doupe M, Brunkert T, Wagg A, Ginsburg L, Norton P, Berta W, et al. SCOPE: safer care for older persons (in residential) environments-a pilot study to enhance care aide-led quality improvement in nursing homes. Pilot Feasibility Stud. 2022;8(1):26.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Kilo CM. A framework for collaborative improvement: lessons from the Institute for Healthcare Improvement's Breakthrough Series. Qual Manag Healthc. 1998;6(4):1–13.

    Article  CAS  Google Scholar 

  51. Berwick DM. Developing and testing changes in delivery of care. Ann Intern Med. 1998;128(8):651–6.

    Article  CAS  PubMed  Google Scholar 

  52. Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. Why (we think) facilitation works: insights from organizational learning theory. Implement Sci. 2015;10:141.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Cranley LA, Norton PG, Cummings GG, Barnard D, Batra-Garga N, Estabrooks CA. Identifying resident care areas for a quality improvement intervention in long-term care: a collaborative approach. BMC Geriatr. 2012;12:59.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B. What counts as evidence in evidence-based practice? J Adv Nurs. 2004;47(1):81–90.

    Article  PubMed  Google Scholar 

  56. Dixon-Woods PM. Perspectives on context: the problem of context in quality improvement. London: The Health Foundation; 2014.

    Google Scholar 

  57. Groene O, Sunol R. Quality improvement is complex and contextual. BMJ. 2019;367:l6155.

    Article  PubMed  Google Scholar 

  58. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Healthc. 1998;7(3):149–58.

    Article  CAS  Google Scholar 

  59. Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, et al. Ingredients for change: revisiting a conceptual framework. Qual Saf Healthc. 2002;11(2):174–80.

    Article  CAS  Google Scholar 

  61. Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37(6):577–88.

    Article  PubMed  Google Scholar 

  62. McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of `context'. J Adv Nurs. 2002;38(1):94–104.

    Article  PubMed  Google Scholar 

  63. Rycroft-Malone J, Harvey G, Kitson A, McCormack B, Titchen A. Getting evidence into practice: Ingredients for change. Nurs Stand. 2002;16(37):38–43.

    Article  PubMed  Google Scholar 

  64. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14(2):117–23.

    Article  PubMed  Google Scholar 

  66. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.

    Article  Google Scholar 

  67. Stetler C, Legro M, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006;1:23.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Dogherty EJ, Harrison MB, Graham ID. Facilitation as a role and process in achieving evidence-based practice in nursing: a focused review of concept and meaning. Worldviews Evid-Based Nurs. 2010;7(2):76–89.

    PubMed  Google Scholar 

  69. Seers K, Cox K, Crichton N, Edwards R, Eldh A, Estabrooks C, et al. FIRE (Facilitating Implementation of Research Evidence): a study protocol. Implement Sci. 2012;7:25.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Ginsburg L, Easterbrook A, Seguin Massie A, Berta W, Doupe M, Hoben M, Norton P, Reid R, Song Y, Wagg A, Estabrooks C. Building a program theory of implementation using process evaluation of a complex quality improvement trial in nursing homes. The Gerontologist. In press. 

  72. Estabrooks CA, Squires JE, Cummings GG, Teare GF, Norton PG. Study protocol for the translating research in elder care (TREC): building context - an organizational monitoring program in long-term care project (project one). Implement Sci. 2009;4:52.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Estabrooks CA, Morgan DG, Squires JE, Boström AM, Slaughter SE, Cummings GG, et al. The care unit in nursing home research: evidence in support of a definition. BMC Med Res Methodol. 2011;11:46.

    Article  PubMed  PubMed Central  Google Scholar 

  74. Norton PG, Murray M, Doupe MB, Cummings GG, Poss JW, Squires JE, et al. Facility versus unit level reporting of quality indicators in nursing homes when performance monitoring is the goal. BMJ Open. 2014;4(2):e004488.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Estabrooks CA. The conceptual structure of research utilization. Res Nurs Health. 1999;22(3):203–16.

    Article  CAS  PubMed  Google Scholar 

  76. Beyer J, Trice H. The utilization process: a conceptual framework and synthesis of empirical findings. Adm Sci Q. 1982;27:591–622.

    Article  Google Scholar 

  77. Stetler CB. Research utilization: defining the concept. Image. J Nurs Scholarsh. 1985;17(2):40–4.

    Article  CAS  Google Scholar 

  78. Weiss C. The many meanings of research utilization. Public Adm Rev. 1979;39(5):426–31.

    Article  Google Scholar 

  79. Estabrooks CA, Hutchinson AM, Squires JE, Birdsell J, Cummings GG, Degner L, et al. Translating research in elder Care: an introduction to a study protocol series. Implement Sci. 2009;4:51.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Squires J, Estabrooks CA, Newburn-Cook C, Gierl M. Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare. BMC Health Serv Res. 2011;11:107.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Squires JE, Estabrooks CA, Hayduk L, Gierl M, Newburn-Cook CV. Precision of the conceptual research utilization scale. J Nurs Meas. 2014;22(1):145–63.

    Article  PubMed  Google Scholar 

  82. Information. CIfH. Resident assessment instrument (RAI) MDS 2.0 and RAPs, Canadian Version: user’s manual. 2nd ed. Ottawa: Canadian Institute for Health Information; 2005.

    Google Scholar 

  83. Maslach C. Burnout: The cost of caring. Englewood Cliffs: Prentice-Hall; 1982.

    Google Scholar 

  84. Beckstead JW. Confirmatory factor analysis of the Maslach Burnout Inventory among Florida nurses. Int J Nurs Stud. 2002;39:785–92.

    Article  PubMed  Google Scholar 

  85. Barnett RC, Brennan RT, Gareis KC. A closer look at the measurement of burnout. J Appl Biobehav Res. 1999;4(2):65–78.

    Article  Google Scholar 

  86. Nagy MS. Using a single-item approach to measure job satisfaction. J Occup Organ Psychol. 2002;75:77–86.

    Article  Google Scholar 

  87. Wanous JP, Reichers AE, Hudy MJ. Overall job satisfaction: How good are single item measures? J Appl Psychol. 1997;82:247–52.

    Article  CAS  PubMed  Google Scholar 

  88. Schaufeli WB, Bakker AB, Salanova M. The measurement of work engagement with a short questionnaire: A cross-national Survey. Educ Psychol Meas. 2006;66(4):701–16.

    Article  Google Scholar 

  89. Spreitzer GM. Psychological empowerment in the workplace: dimensions, measurement, and validation. Acad Manage J. 1995;38(5):1442–65.

    Article  Google Scholar 

  90. Choi JN. Change-oriented organizational citizenship behavior: effects of work environment characteristics and intervening psychological processes. J Organ Behav. 2007;28(4):467–84.

    Article  Google Scholar 

  91. Ginsburg L, Berta W, Baumbusch J, Rohit Dass A, Laporte A, Reid RC, et al. Measuring work engagement, psychological empowerment, and organizational citizenship behavior among health care aides. Gerontologist. 2016;56(2):e1–11.

    Article  PubMed  Google Scholar 

  92. Poss JW, Jutan NM, Hirdes JP, Fries BE, Morris JN, Teare GF, et al. A review of evidence on the reliability and validity of Minimum Data Set data. Healthc Manage Forum. 2008;21(1):33–9.

    Article  CAS  PubMed  Google Scholar 

  93. Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999;54(11):M546–53.

    Article  CAS  PubMed  Google Scholar 

  94. Perlman CM, Hirdes JP. The aggressive behavior scale: a new scale to measure aggression based on the minimum data set. J Am Geriatr Soc. 2008;56(12):2298–303.

    Article  PubMed  Google Scholar 

  95. Knopp-Sihota JA, Hoben M, Poss JW, Squires JE, Estabrooks C. Improving assessment of pain in nursing home residents with moderate to severe Alzheimer’s disease and related dementias.  Alzheimers Dement. 2018:P1324.

  96. Knopp-Sihota JAP. Developing a RAI-MDS 2.0 behavior-based pain assessment scale for long-term care residents with advanced dementia. Innov Aging. 2019;4:622–3.

  97. Ginsburg LR, Hoben M, Easterbrook A, Andersen E, Anderson RA, Cranley L, et al. Examining fidelity in the INFORM trial: a complex team-based behavioral intervention. Implement Sci. 2020;15(1):78.

    Article  PubMed  PubMed Central  Google Scholar 

  98. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443–51.

    Article  PubMed  Google Scholar 

  99. Hoben M, Ginsburg LR, Easterbrook A, Norton PG, Anderson RA, Andersen EA, et al. Comparing effects of two higher intensity feedback interventions with simple feedback on improving staff communication in nursing homes-the INFORM cluster-randomized controlled trial. Implement Sci. 2020;15(1):75.

    Article  PubMed  PubMed Central  Google Scholar 

  100. Hoben M, Ginsburg LR, Norton PG, Doupe MB, Berta WB, Dearing JW, et al. Sustained effects of the INFORM cluster randomized trial: an observational post-intervention study. Implement Sci. 2021;16(1):83.

    Article  PubMed  PubMed Central  Google Scholar 

  101. Lanham HJ, Leykum LK, Taylor BS, McCannon CJ, Lindberg C, Lester RT. How complexity science can inform scale-up and spread in health care: understanding the role of self-organization in variation across local contexts. Soc Sci Med. 2013;93(9):194–202.

    Article  PubMed  Google Scholar 

  102. Wensing M, Grol R. Knowledge translation in health: how implementation science could contribute more. BMC Med. 2019;17(1):88.

    Article  PubMed  PubMed Central  Google Scholar 

  103. Choi SL, Goh CF, Adam MB, Tan OK. Transformational leadership, empowerment, and job satisfaction: the mediating role of employee empowerment. Hum Resour Health. 2016;14(1):73.

    Article  PubMed  PubMed Central  Google Scholar 

  104. Spence Laschinger HK, Finegan JE, Shamian J, Wilk P. A longitudinal analysis of the impact of workplace empowerment on work satisfaction. J Organ Behav. 2004;25(4):527–45.

    Article  Google Scholar 

  105. Amor AM, Xanthopoulou D, Clavo N, Abeal Vazquez JP. Structural empowerment, psychological empowerment, and work engagement: a cross-country study. Eur Manag J. 2021;39(6):779–89.

    Article  Google Scholar 

  106. Boamah S. Linking nurses' clinical leadership to patient care quality: the role of transformational leadership and workplace empowerment. Can J Nurs Res. 2018;50(1):9–19.

    Article  PubMed  Google Scholar 

  107. Fishbein M, Ajzen I. Belief, attitude, intention, and behavior: an introduction to theory and research. Reading: Addison Wesley Publishing Co; 1975.

    Google Scholar 

  108. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: medical research council guidance. BMJ. 2015;350:h1258.

    Article  PubMed  PubMed Central  Google Scholar 

  109. Peryer G, Kelly S, Blake J, Burton JK, Irvine L, Cowan A, et al. Contextual factors influencing complex intervention research processes in care homes: a systematic review and framework synthesis. Age Ageing. 2022;51(3):afac014.

    Article  PubMed  PubMed Central  Google Scholar 

  110. (ICEBeRG)TICEtBRG. Designing theoretically-informed implementation interventions. Implement Sci. 2006;1:4.

    Article  Google Scholar 

  111. Shojania KG. What problems in health care quality should we target as the world burns around us? CMAJ. 2022;194(8):E311–E2.

    Article  PubMed  PubMed Central  Google Scholar 

  112. Kaltoft R, Boer H, Caniato F, Gertsen F, Middel R, Steendahl Nielsen J. Implementing collaborative improvement – top-down, bottom-up or both? Int J Technol Manag. 2007;37(3):306–21.

    Article  Google Scholar 

  113. Hoffmann-Vold AM, Maher TM, Philpot EE, Ashrafzadeh A, Distler O. Assessment of recent evidence for the management of patients with systemic sclerosis-associated interstitial lung disease: a systematic review. ERJ Open Res. 2021;7(1):00235–2020.

    Article  PubMed  PubMed Central  Google Scholar 

  114. Rosenthal R. The file drawer problem and tolerance for null results. Psychol Bull. 1979;86(3):638–41.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank the LTC homes and their care teams who participated in this study. We would also like to thank Don McLeod for facilitating the Learning Congresses and contributing to the development of the SCOPE materials for participants; the Quality Advisors (Carolyn Brandly, Fiona MacKenzie, Barb Stolee) for supporting the SCOPE teams and keeping them engaged; Judith Palfreyman for administrative support and the TREC data unit manager, Joseph Akinlawon for his expertise.

Funding

This study was funded by a Canadian Institutes of Health Research (CIHR) Operating Grant CIHR PS 148582 Wagg and funds from the Muhlenfeld Family Trust held by Dr. Wagg.

Author information

Authors and Affiliations

  1. Division of Geriatric Medicine, Department of Medicine, University of Alberta, Edmonton, Alberta, Canada

    Adrian Wagg

  2. Faculty of Nursing, University of Alberta, Edmonton, Alberta, Canada

    Matthias Hoben, Yuting Song & Carole Estabrooks

  3. School of Health Policy & Management, Faculty of Health, York University, Toronto, Ontario, Canada

    Liane Ginsburg

  4. Departments of Community Health Sciences, Emergency Medicine, Max Rady College of Medicine, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada

    Malcolm Doupe

  5. Institute of Health Policy, Management & Evaluation, Dalla Lana School of Public Health, University of Toronto, ON, Toronto, Canada

    Whitney Berta

  6. Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada

    Peter Norton

  7. Faculty of Health Disciplines, Athabasca University & Faculty of Nursing, University of Alberta, Edmonton, Alberta, Canada

    Jennifer Knopp-Sihota

Authors
  1. Adrian Wagg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias Hoben
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liane Ginsburg
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Malcolm Doupe
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Whitney Berta
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yuting Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Peter Norton
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jennifer Knopp-Sihota
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Carole Estabrooks
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AW led the study and led the writing of the protocol. AW, MH, LG, WB, MD, JK-S, YS, PN, and CE were all involved in the conduct of the study. AW, PN, LG, and MH developed the data analysis plan, conducted the analysis, and interpreted the results. MH drafted all tables. AW wrote the first draft of the manuscript and led revisions. AW, MH, LG, WB, MD, JK-S, YS, PN, and CE all revised the paper critically for intellectual content and approved the final version.

Corresponding author

Correspondence to Adrian Wagg.

Ethics declarations

Ethics approval consent to participate

This study was approved by the Research Ethics Boards of the University of Alberta (Pro00012517) and University of British Columbia (H14-03286). Operational approval was obtained from all included facilities as required. SCOPE sponsors and team members were asked for oral informed consent before participating in any primary data collection (evaluation surveys, focus groups, interviews).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wagg, A., Hoben, M., Ginsburg, L. et al. Safer Care for Older Persons in (residential) Environments (SCOPE): a pragmatic controlled trial of a care aide-led quality improvement intervention. Implementation Sci 18, 9 (2023). https://doi.org/10.1186/s13012-022-01259-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-022-01259-8

Keywords

Implementation Science

ISSN: 1748-5908