Skip to main content
Download PDF
Download ePub

Effects of de-implementation strategies aimed at reducing low-value nursing procedures: a systematic review and meta-analysis

Implementation Science volume 15, Article number: 38 (2020) Cite this article

Abstract

Background

In the last decade, there is an increasing focus on detecting and compiling lists of low-value nursing procedures. However, less is known about effective de-implementation strategies for these procedures. Therefore, the aim of this systematic review was to summarize the evidence of effective strategies to de-implement low-value nursing procedures.

Methods

PubMed, Embase, Emcare, CINAHL, PsycINFO, Cochrane Central Register of Controlled Trials, Web of Science, and Google Scholar were searched till January 2020. Additionally, reference lists and citations of the included studies were searched. Studies were included that described de-implementation of low-value nursing procedures, i.e., procedures, test, or drug orders by nurses or nurse practitioners. PRISMA guideline was followed, and the ‘Cochrane Effective Practice and Organisation of Care’ (EPOC) taxonomy was used to categorize de-implementation strategies. A meta-analysis was performed for the volume of low-value nursing procedures in controlled studies, and Mantel–Haenszel risk ratios (95% CI) were calculated using a random effects model.

Results

Twenty-seven studies were included in this review. Studies used a (cluster) randomized design (n = 10), controlled before-after design (n = 5), and an uncontrolled before-after design (n = 12). Low-value nursing procedures performed by nurses and/or nurse specialists that were found in this study were restraint use (n = 20), inappropriate antibiotic prescribing (n = 3), indwelling or unnecessary urinary catheters use (n = 2), ordering unnecessary liver function tests (n = 1), and unnecessary antipsychotic prescribing (n = 1). Fourteen studies showed a significant reduction in low-value nursing procedures. Thirteen of these 14 studies included an educational component within their de-implementation strategy. Twelve controlled studies were included in the meta-analysis. Subgroup analyses for study design showed no statistically significant subgroup effect for the volume of low-value nursing procedures (p = 0.20).

Conclusions

The majority of the studies with a positive significant effect used a de-implementation strategy with an educational component. Unfortunately, no conclusions can be drawn about which strategy is most effective for reducing low-value nursing care due to a high level of heterogeneity and a lack of studies. We recommend that future studies better report the effects of de-implementation strategies and perform a process evaluation to determine to which extent the strategy has been used.

Trial registration

The review is registered in Prospero (CRD42018105100).

Peer Review reports

Background

Health care professionals intentionally or unintentionally order tests, treatments, and perform procedures on a daily basis that offer little or no benefit to patient care. This low-value care is proven to be ineffective or has not been proven to be effective, can even harm patients, and waste valuable resources [1,2,3]. In addition, it wastes time that the health care professional can spend on more effective practices or care that is left undone [4, 5]. The Institute of Medicine estimates that up to 30% of care provided in the USA is wasted on low-value care [6]. If even a fraction of this low-value care could be eliminated, the resulting quality improvement and cost savings would be transformational [7].

Most initiatives to eliminate low-value care are mainly focused on care provided by doctors [8], but many low-value procedures are also routinely performed by nurses [4, 9]. Well-known examples of low-value nursing procedures include the use of physical restraints in patients with a delirium, the use of bandages for wounds closed by primary intention, and performing a bladder washout [4]. Since nurses are the largest group of health care providers [4], there is a great potential in improving quality of care by involving and targeting them in de-implementation initiatives [4, 10]. As a first step to reduce low-value nursing procedures, ‘Choosing Wisely’ lists of nursing procedures are recently created in several countries [1, 4, 11, 12]. The next step is to translate these ‘Choosing Wisely’ lists into action [13]. To actually reduce the use of low-value nursing procedures, awareness should be created for the ‘Choosing Wisely’ lists and effective de-implementation strategies need to be developed and executed [7, 14, 15]. These de-implementation strategies should be theory- and evidence-based and informed by analysis of barriers and facilitators that influence the use of low-value care, since this is expected to increase the adherence, adoption, and effectiveness of these de-implementation strategies [5, 16, 17].

A previous systematic review performed by Colla et al. [7] already reveals that multifaceted de-implementation strategies targeted at health care providers and patients have the greatest potential to reduce the use of low-value care. Besides, clinical decision support tools, performance feedback and education (alone or as part of a multifaceted strategy), are promising strategies for reducing low-value care. However, Colla et al. [7] also noted that little is known about interventions directed at non-physician staff members such as nurses, and that most interventions targeted at non-physician staff are aimed at assisting physician’s decision-making. So, it is still unknown whether the conclusions about effective de-implementation strategies also apply for the reduction of low-value nursing procedures. Since nurses might have other learning styles than physicians [18], other strategies could be more effective to de-implement low-value nursing procedures. Therefore, the aim of this systematic review is to summarize the evidence of effective de-implementation strategies aiming to reduce or eliminate low-value nursing procedures.

Methods

This systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) [19]. The review protocol was registered in the PROSPERO database of systematic reviews (registration number: CRD42018105100, (www.crd.york.ac.uk/prospero/display_record.php?RecordID=105100).

Search strategy

To identify all eligible studies reporting on effective de-implementation strategies aiming to reduce low-value nursing procedures, a systematic literature search was performed in PubMed, Embase, Emcare, CINAHL, PsycINFO, Cochrane Central Register of Controlled Trials, Web of Science, and Google Scholar. The full search strategy is included in Additional file 1. The search was limited to the literature published till January 2020. Search terms were based on 43 unique terms for de-implementation that were used for the process of reducing low value care found by Niven et al. [20], and there were no language or other search filter limits. After the initial search, the reference lists and citations of all included studies were explored to find more relevant studies. An expert health librarian at the Leiden University Medical Center guided the search.

Selection of studies

Two researchers (TR, AB, or LvB) first independently reviewed title and abstract of the studies, followed by full texts review. If there was no consensus between the two reviewers and differences could not be solved by discussion, a third reviewer was consulted.

Studies were eligible for inclusion in the systematic review if they fulfilled the following inclusion criteria:

  • Focus of the study: reduction of low-value nursing procedures. Low-value nursing procedures were in this review defined as actual treatments and actions that are unlikely to benefit the patient given the harms, costs, available alternatives, or preferences of patients, and are initiated independently by a nurse and/or nurse specialist (i.e., without an order of another health care provider).

  • Type of study: all studies that use a reference group (including pre-post comparisons), i.e., randomized controlled trials, cluster randomized trials, quasi-randomized controlled trials, non-randomized controlled trials, controlled before-after studies, interrupted time series studies, or uncontrolled before-after studies.

  • Setting: hospitals, nursing homes, long-term care facilities, and community settings.

  • Outcome: the study had to report on the effect of the de-implementation strategy on the volume of low-value nursing procedures.

Case studies of individual patients, letters, and editorials were excluded. Controlled studies were included in the meta-analysis if they reported data on the change in volume of low-value nursing procedures or if this data was available to the researchers after sending a request to the authors of the included paper.

Data extraction

Data of the included studies was extracted in a standardized data extraction form in Microsoft Access (version 2016) by one researcher (TR or AB). A second researcher (TR, AB, or DS) independently checked the extracted data. Any discrepancy was resolved by discussion between the researchers until consensus was reached. If this was not possible, a third researcher (LvB) made a judgment on the data entered. The following information was collected from all included studies: country of origin, design, setting, location of care, type of low-value nursing procedure, de-implementation strategy based on barrier assessment, de-implementation strategies, participants, reimbursement and funding, primary and secondary outcomes. The primary outcome was the change in volume of the low-value nursing procedure. The secondary outcomes were adherence to the de-implementation strategy, changes in patient outcomes (e.g., pain), changes in patient satisfaction with care, changes in costs due to de-implementation of low-value nursing procedures, and changes in costs of the delivery of care. Authors of the included studies were contacted when more information was needed about unreported or missing data, and about the bias issues. If they did not respond, we sent a reminder after 2 to 6 weeks. We used the ‘Cochrane Effective Practice and Organisation of Care’ (EPOC) taxonomy [21] to categorize the different types of de-implementation strategies. The EPOC taxonomy includes four categories of strategies: (a) delivery arrangements, (b) financial arrangements, (c) governance arrangements, and (d) implementation strategies.

The quality of the studies was assessed by using two risk of bias tools by two independent researchers (TR, AB, or DS). The Cochrane Effective Practice and Organisation of Care (EPOC) [22] was used for studies with a separate control group (randomized trails, and controlled before-after studies), and the Newcastle-Ottawa Scale (NOS) [23] was used for uncontrolled studies. The EPOC tool consists of nine suggested risk of bias criteria: random sequence generation, allocation concealment, baseline outcome measurements similar, baseline characteristics similar, incomplete outcome data, knowledge of the allocated interventions adequately prevented during the study, protection against contamination, selective outcome reporting, and other risks of bias. Every criterion was scored with low, high, or unclear risk. The NOS consists of three categories: (a) selection, (b) comparability, and (c) outcome. A certain number of stars could be given for each category, resulting in a score of good, fair, or poor quality of the studies. Disagreements in the risk of bias scoring were resolved by consensus or by discussion with a third researcher (TR, LvB, or DS).

Statistical analyses

To summarize the overall evidence of de-implementation strategies aiming to reduce low-value nursing procedures in a descriptive and narrative synthesis, the data from all included studies was extracted in Microsoft Access (version 2016) and analyzed in Microsoft Excel (version 2016). The synthesis is performed separately for controlled and uncontrolled studies to reduce the risk of selection bias. To assess the effectiveness of de-implementation strategies to reduce low-value nursing procedures, data of the controlled studies on the use of low-value care was analyzed in Review Manager 5.3. Data about the use of low-value nursing procedures was pooled using a random effects model of Mantel-Haenszel [24], and risk ratios were calculated with 95% confidence intervals. The I2 statistics of Higgins [25] was used to measure heterogeneity between the included studies, which can be interpreted as the percentage of the total variability in a set of effect sizes between trials in a meta-analysis. When the I2 was 50% or higher, we considered the results as a moderate or high level of heterogeneity [25]. If heterogeneity was present, subgroup analyses were performed. Subgroup analyses were performed by design of the study (RCT, Cluster RCT, and controlled studies), type of low-value care, and type of de-implementation strategy (single versus multifaceted, and type of strategy). Subgroup analyses by type of design were performed because failure to use adequately concealed random allocation can distort the apparent effects of care in either direction [26]. Subgroup analyses for type of low-value nursing procedure were performed because the characteristics of the type of low-value nursing procedure that needs to be de-implemented (including underlying evidence, advantages of practice, credibility, attractiveness, feasibility) could be of influence on the effectiveness of the de-implementation strategy. Subgroup analyses for type of de-implementation strategy (including single versus multifaceted strategies and type of strategy according to EPOC taxonomy) were performed since we wanted to learn which strategy is most effective. A subgroup for type of design, low-value nursing procedure, or de-implementation strategy was only performed when at least two studies with respectively the same design, low-value nursing procedure, or de-implementation strategy could be included in each subgroup. Finally, sensitivity analyses for the subgroups were performed without studies with a high-risk score on 3 or more risk of bias criteria of the EPOC tool. Funnel plots were created to assess the publication bias.

Results

Study selection

The search strategy resulted in 4278 studies. The reference and citation search resulted in an additional 586 studies. After removing 64 duplicates, 4800 abstracts remained. After screening on title and abstract, 162 full texts were reviewed. A total of 27 studies were found to be eligible for inclusion (Fig. 1), including 12 uncontrolled studies [9, 27,28,29,30,31,32,33,34,35,36,37] and 15 controlled studies [38,39,40,41,42,43,44,45,46,47,48,49,50,51,52]. Reasons for exclusion were (1) de-implementation strategy was not directed at reducing low-value nursing procedures (but at low-value care provided by other health care professionals or at low-value nursing procedures that require an order of other health care professionals (n = 84) such as medication prescribing or requests for lab testing by physicians), (2) study does not include an assessment of the effectiveness of a de-implementation strategy (n = 26), (3) full text was not available (n = 13), and (4) other (e.g., non-response authors and no results reported on volume of low-value care) (n = 12).

Fig. 1
figure 1

PRISMA flow diagram

Full size image

Quality of the included studies

The risk of bias of the uncontrolled studies (n = 12), estimated with the Newcastle-Ottawa scale, is shown in Table 1. Overall, the quality of the included uncontrolled studies was poor, mainly due to a low score on the comparability domain due to lack of matching of exposed and non-exposed individuals in the study design and/or a lack of correction for confounders in the analyses.

Table 1 Risk of Bias Newcastle-Ottawa Scale (NOS) of uncontrolled studies (n=12)
Full size table

The risk of bias of the controlled studies (n = 15), scored with EPOC, showed that nine studies scored low risk on seven of the nine risk of bias criteria (Fig. 2). For only five studies [41,42,43, 50, 52], the missing outcomes were unlikely to bias the results. For the other studies, there was an unclear or high risk for missing outcomes that were likely to bias the results [38,39,40, 44,45,46,47,48,49, 51]. Three studies did not perform statistical tests for measuring the effect of their de-implementation strategy [9, 28, 36].

Fig. 2
figure 2

Risk of bias Cochrane Effective Practice and Organisation of Care (EPOC) of controlled studies (n = 15). Randomization: low risk if randomization method is described. Allocation concealment: low risk if unit of allocation was by team/institution OR by patient with some kind of randomization method. Baseline measurement similar: low risk if baseline measurements were performed and no important difference present across groups OR imbalanced but appropriate adjusted. Baseline characteristics similar: low risk if characteristics were reported and similar. Incomplete outcome data: low risk if missing outcomes were unlikely to bias the results. Blinding: low risk if the authors stated blind assessment OR objective outcomes. Contamination: low risk if allocation was by team/ institution/practice and unlikely control group received intervention. Selective reporting: low risk if there is no evidence that outcomes were selectively reported. Other: low risk if there is no evidence of other risk of bias. Green circle: low risk of bias, red circle: High risk of bias, empty box: unclear risk of bias

Full size image

Study characteristics

Uncontrolled studies

Twelve of the 27 studies (44%) [9, 27,28,29,30,31,32,33,34,35,36,37] had an uncontrolled before-after design (Table 2). Of these 12 studies, six focused their intervention on reducing restraint use [9, 28, 29, 31, 32, 34], three on reducing inappropriate antibiotic prescribing [30, 33, 37], two on reducing time of indwelling urinary catheters [27, 36], and one on reducing unnecessary liver function tests [35]. The de-implementation strategy used within the uncontrolled studies were directed at nursing staff working in a hospital (n = 10) [9, 27,28,29,30,31,32, 34,35,36] and in an urgent care center (n = 2) [33, 37]. Most of the uncontrolled studies had a single center design (n = 9) and were performed in North America (n = 9) [9, 27, 28, 30, 32,33,34, 36, 37]. Most uncontrolled studies did not report on the characteristics of the patients and/or on the characteristics of the health care providers. Four uncontrolled studies (33%) have not clearly described the duration of the intervention [37, 38, 48, 50]. For the uncontrolled studies that mentioned the duration of the intervention, it differed from 2 to 14 months. The follow up time after de-implementation of the studies that reported these results differed from 1 month follow up till 12 months.

Table 2 Design and characteristics of uncontrolled studies (N = 12)
Full size table

Controlled studies

Fifteen of the 27 studies (56%) had a controlled design, including three RCTs (11%), seven cluster RCTs (26%), and five controlled before-after designs (19%) (Table 3). Of the controlled studies, 14 studies focused their intervention on reducing restraint use [39,40,41,42,43,44,45,46,47,48,49,50,51,52], and one on reducing inappropriate antipsychotic prescribing [38]. The de-implementation strategy used within the controlled studies were directed at nursing staff working in a nursing home (n = 10) [38, 39, 41, 42, 44,45,46,47, 51, 52], in a hospital (n = 4) [40, 43, 48, 49], and in a residential care facility (n = 1) [50]. Most of the controlled studies had a multicenter design (n = 12) and were performed in Europe (n = 9). Not all controlled studies reported on the patients’ characteristics and/or on the characteristics of the health care providers. Three controlled studies (20%) have not clearly described the duration of the intervention [27, 31, 39]. For the controlled studies that mentioned the duration of the intervention, it differed from 1 to 12 months. The follow up time after de-implementation of the studies that reported these results differed from no follow up till 24 months.

Table 3 Design and characteristics of controlled studies (N = 15)
Full size table

Strategies to reduce low-value care

Uncontrolled studies

The de-implementation strategies of six uncontrolled studies resulted in a positive significant effect on the volume of low-value nursing procedures (Table 2). The reduction in volume of low-value nursing procedure in the uncontrolled studies with a positive significant effect and with available data (n = 5) ranged from 0.4% [34] reduction of low-value nursing care till 61.9% [33]. Four of the positive significant studies had a single de-implementation strategy [31, 33, 35, 37], which means that the strategies consisted of only one strategy component (Table 4). Five of the six studies used an educational component (meetings and/or materials) as an intervention strategy [31,32,33,34, 37]. However, none of the studies with a positive significant effect on the primary outcome based their de-implementation strategy on a barrier assessment. Only one uncontrolled study without a positive significant effect performed a barrier assessment [9].

Table 4 Type of intervention of the uncontrolled studies (n = 12)
Full size table

None of the uncontrolled studies reported about adherence to the de-implementation strategy, changes in patient satisfaction with care, changes in costs made by the de-implementation strategy, and changes in costs of the delivery of care.

Controlled studies

The de-implementation strategies of eight of the 15 controlled studies resulted in a positive significant effect on volume of low-value nursing procedures (Table 3). The reduction in volume of low-value nursing procedure in the controlled studies with a positive significant effect who measured patient outcomes (n = 7) ranged from 6.5% [47] till 28.7% [39]. Seven of the eight positive significant studies had a multifaceted de-implementation strategy (Table 5) and all eight studies focused their strategy at reducing the use of restraints [39, 41,42,43, 47, 50,51,52]. Besides, the eight studies with a positive significant effect had an educational component (educational meetings, educational materials, educational outreach visits, and educational games) in their de-implementation strategy. However, none of the studies with a positive significant effect on the primary outcome based their de-implementation strategy on a barrier assessment. Only one controlled study without a positive significant effect performed a barrier assessment [38].

Table 5 Type of intervention of the controlled studies (n = 15)
Full size table

None of the studies reported about adherence to the de-implementation strategy, changes in patient satisfaction with care, changes in costs made by the de-implementation strategy, and changes in costs of the delivery of care. Five studies aiming to reduce restraint use, reported about falls [39, 46,47,48,49]. However, different outcome measurements (e.g., risk of falls, total number of falls, fall related injuries, the proportion of those who suffered from one or more falls, and the percentages of falls) have been used for these studies.

Effectiveness of de-implementation strategies (meta-analysis) of controlled studies

The effectiveness of de-implementation strategies to reduce low-value nursing procedures is only assessed for the controlled studies. Twelve of the 15 controlled studies were eligible for inclusion in the meta-analyses [38,39,40,41,42, 44,45,46,47, 49, 50, 52]. Two controlled studies were excluded after no response of the author after sending a request for missing data [48, 51], and one study was excluded because the volume of low-value nursing procedures was not measured at patient level [43]. The relative risk ratio for the use of low-value nursing procedures for all 12 studies was 0.95 [95% CI 0.80, 1.13]. Considerable heterogeneity was present in the effect estimate (I2 = 89%) (Fig. 3). Subgroup analyses could only be performed for type of design (Fig. 3). A subgroup analysis for type of de-implementation strategy could not be performed due to a lack of studies with the same strategy. Also, a subgroup analyses for single vs. multifaceted strategies could not be performed due to a lack of studies with a single component strategy. A subgroup analyses for type of low-value care could not be performed due to a lack of studies assessing de-implementation strategies to reduce types of low-value nursing procedures other than restraint use.

Fig. 3
figure 3

Subgroup analyses controlled studies: design study. *All studies included in the meta-analysis targeted their intervention at restraint use

Full size image

Subgroup analyses for the type of design of the studies (RCT, Cluster RCT, and controlled studies) showed no statistically significant subgroup effect (χ2 = 3.26, p = 0.20), a moderate level of heterogeneity between the studies (I2 = 39%), and a high level of heterogeneity within the subgroups (RCT = 92%, Cluster RCT = 71%, controlled studies = 96%) (Fig. 3). Based on the funnel plots, we suggest that there is no publication bias (Fig. 4).

Fig. 4
figure 4

Funnel plot: design study

Full size image

Discussion

To our knowledge, this is the first systematic review on de-implementation strategies for low-value nursing procedures. This systematic review identified both uncontrolled and controlled studies for the reduction of a limited range of low-value nursing procedures, namely physical restraint use, antibiotic and antipsychotic prescribing, requests for liver function tests, and urinary catheter use. The majority of the controlled and uncontrolled studies with a positive significant effect used a de-implementation strategy with an educational component (educational meetings, educational materials, educational outreach visits, and educational games) and focused their de-implementation strategy at reducing the use of restraints. An important difference between the controlled and uncontrolled studies with a positive significant effect is that the majority of the controlled studied used a multifaceted de-implementation strategy, and the majority of the positive significant uncontrolled studies used a single faceted de-implementation strategy. However, the use of educational components cannot be directly linked to successful de-implementation since both studies with a positive significant effect and studies without an effect or with a negative effect included these components. Due to heterogeneity and a lack of same strategies in the controlled studies, no conclusions can be drawn from the meta-analyses about the effectiveness of de-implementation strategies for low-value nursing procedures.

Despite increasing attention for the de-implementation of low-value nursing procedures, we only found 27 articles that we could include in our systematic review. However, the number of studies increased within the last decade. Only one study was found in the nineties, where seven studies were found from 2000 till 2010, and 18 studies from 2010 till 2020. This shows the attention for this important topic; however, more variation in the strategies to be evaluated is needed to get a full picture of effective or non-effective de-implementation strategies for nurses. Additionally, this study showed from the high number of excluded studies in which dependent nursing procedures are de-implemented, i.e., nursing procedures that require an order of another health care professional, that nurses have an important role in the de-implementation of low-value care. Due to differences in responsibilities in different countries, some nursing procedures are in some countries independently and in other countries dependently performed, for example the use of urinary catheters. As a consequence, some studies on this kind of topics are included in this review (as nurses are allowed independently to decide) or excluded (as nurses need an order for the nursing procedure).

The results of this systematic review showed some similarities and differences with previous findings in the literature regarding effective types of de-implementation strategies. A similarity is that our review showed as in a previous study of Colla et al. [7] that most studies used multifaceted strategies including an educational component. A difference with the study of Colla et al. [7] is that our review did not identify successful multifaceted de-implementation strategies that included a clinical decision support tool and/or performance feedback in their strategy. This may be the result of different inclusion criteria and focus of the study. While Colla et al. [7] focused on successful de-implementation strategies in health services, we only included studies that assessed the effectiveness of strategies to de-implement low-value nursing procedures.

To increase the effectiveness of de-implementation strategies, it is recommended in the literature to use a strategy which is geared at barriers and facilitators that influence the use of low-value care [5, 16, 17]. However, this review was not able to support this recommendation since only two studies included in this review performed a barrier and facilitator assessment before executing their de-implementation strategy [9, 38]. The other studies did not describe whether they have based their de-implementation strategy on prior barrier and facilitator assessment. One study that performed a barrier assessment showed a reduction of low-value nursing care (no statistical testing) [9] and the other did not show an effective de-implementation strategy [38]. The absence of de-implementation strategies that are fully connected toward factors influencing the use of low-value nursing procedures could have contributed to ineffective de-implementation strategies in this review [17].

Another way to increase the effectiveness of de-implementation strategies may be to match de-implementation strategies to the target action (stop, replace, reduce, restrict the low-value nursing procedure) for de-implementation as different actions are underpinned by different theories, frameworks, and models for change as proposed by Norton and Chambers [17]. In this review, most studies aimed to reduce the use of restraints. Theories of habit transformation and disruption suggest that the most effective way to reduce the use of inappropriate interventions may be to change the context and environmental cues. However, studies included in this review that aimed to reduce the use of low-value restraints mostly used educational interventions (including skills training). According to theories of individual and organizational learning and unlearning strategies, this better fits with the replacement of low-value nursing procedures. Future studies should reveal whether a better match between de-implementation strategies and target actions result in more significant reductions.

This review has several strengths and limitations. The first strength is that we performed a meta-analysis to assess the effectiveness of the de-implementation strategies while Colla et al. [7] only reported whether studies were effective or not. This may have caused an overestimation of the results of the used de-implementation strategies in the review of Colla et al. [7], because the quality of the uncontrolled studies could be poor as shown in our study. Another strength is that that the number of ‘missed’ studies is limited because our search strategy was based on the 43 unique terms referring to the process of de-implementation found by Niven et al. [20] and these terms are also used in implementation studies such as ‘reduce, stop and avoid.’ Implementation studies may have the same purpose as de-implementation studies. An example of this is an implementation study that aims to implement a guideline recommendation that states ‘not to use of bandages for wounds closed by primary intention.’ In future research, the search strategy may be further improved by adding nursing procedures that are marked as low-value nursing procedures in guidelines [1, 4, 11, 12].

A limitation of this review is the quality of the included studies. The uncontrolled studies had a poor quality, which resulted in an overall low evidence based, precluding drawing conclusions. In addition, the included studies lacked measurements of patient-reported outcomes. As a result, it was not possible to determine whether the reduction of low-value nursing procedures has adverse effects on patient outcomes. Furthermore, the included studies did not report on the adherence to the intended de-implementation strategy. As a consequence, it was not possible to determine whether the de-implementation strategy has been executed as planned and the effect can be attributed to the de-implementation strategy. Therefore, further research should not only focus on developing and evaluating the effectiveness of de-implementation strategies but also to evaluate the process of the de-implementation including the identification of changes in multi-level barriers and facilitators that should be the target of the strategies [17, 53, 54]. Finally, not all controlled studies could be included in the meta-analysis due to missing data. Although we contacted the authors of the two papers with missing data on the change in volume of low-value nursing procedures, we were not able to obtain the data of two studies due to non-response of the authors.

Conclusions

Most controlled and uncontrolled studies with a positive significant effect used a de-implementation strategy with an educational component (educational meetings, educational materials, educational outreach visits, and/or educational games) and focused their de-implementation strategy at reducing the use of restraints. Unfortunately, no conclusions can be drawn about which strategy is most effective for reducing low-value nursing.

Future studies are needed that assess whether de-implementation strategies that fully connect their strategy toward influencing factors and match their strategy to the target action (stop, replace, reduce, restrict the low value nursing procedure) are more effective for de-implementation. In order to improve future appraisal of available evidence on de-implementation strategies in nursing, we recommend that future studies should report the results on the change in the volume of low-value nursing procedures more extensively and should perform a process evaluation.

Availability of data and materials

Abstracted data collected and analyzed during this study and described in this systematic review will be available from the corresponding author upon reasonable request.

Abbreviations

NOS:

Newcastle-Ottawa Scale

EPOC:

Effective Practice and Organisation of Care

NP:

Nurse practitioner

APM:

Antipsychotic prescribing

LFT:

Liver function test

References

  1. Shellian B, Levinson W. When More is not always better: choosing nursing interventions wisely. Nursing leadership (Toronto, Ont). 2016;29(4):8-9.

    Article  Google Scholar 

  2. Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet (London, England). 2017;390(10090):156-168.

    Article  Google Scholar 

  3. Miller G, Rhyan C, Beaudin-Seiler B, Hughes-Cromwick P. A Framework for measuring low-value care. Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2018;21(4):375–9.

    Article  Google Scholar 

  4. Verkerk EW, Huisman-de Waal G, Vermeulen H, Westert GP, Kool RB, van Dulmen SA. Low-value care in nursing: a systematic assessment of clinical practice guidelines. Int J Nurs Stud. 2018;87:34–9.

    Article  PubMed  Google Scholar 

  5. Eskes AM, Chaboyer W, Nieuwenhoven P, Vermeulen H. What not to do: choosing wisely in nursing care. Int J Nurs Stud. 2019.

  6. Committee on the Learning Health Care System in A, Institute of M. In: Smith M, Saunders R, Stuckhardt L, McGinnis JM, editors. Best care at lower cost: the path to continuously learning health care in America. Washington (DC): National Academies Press (US) Copyright 2013 by the National Academy of Sciences. All rights reserved.; 2013.

  7. Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden N. Interventions aimed at reducing use of low-value health services: a systematic review. Medical Care Research and Review. 2017;74(5):507–50.

    Article  PubMed  Google Scholar 

  8. Levinson W, Born K, Wolfson D. Choosing wisely campaigns: a work in progressevolution in the ability of choosing wisely campaigns to reduce health care overuse evolution in the ability of choosing wisely campaigns to reduce health care overuse. JAMA. 2018;319(19):1975–6.

    Article  PubMed  Google Scholar 

  9. Mitchell DA, Panchisin T, Seckel MA. Reducing use of restraints in intensive care units: a quality improvement project. Crit Care Nurse. 2018;38(4):e8–e16.

    Article  PubMed  Google Scholar 

  10. Shamian J, Ellen ME. The role of nurses and nurse leaders on realizing the clinical, social, and economic return on investment of nursing care. Healthcare management forum. 2016;29(3):99–103.

    Article  PubMed  Google Scholar 

  11. Nursing AAo. Twenty-five things nurses and patients should question [updated July 12, 2018. Available from: https://www.choosingwisely.org/wp-content/uploads/2015/02/AANursing-Choosing-Wisely-List.pdf.

  12. Association CN. Nine things nurses and patients should question [updated May 2017. Available from: https://choosingwiselycanada.org/nursing/.

  13. van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ. Implementation and de-implementation: two sides of the same coin? 2017;26(6):495-501.

  14. Osorio D, Zuriguel-Perez E, Romea-Lecumberri S, Tinena-Amoros M, Martinez-Munoz M, Barba-Flores A. Selecting and quantifying low-value nursing care in clinical practice: a questionnaire survey. J Clin Nurs. 2019;28(21-22):4053–61.

    Article  PubMed  Google Scholar 

  15. Bourgault AM, Upvall MJ. De-implementation of tradition-based practices in critical care: a qualitative study. 2019;25(2):e12723.

  16. van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ. Implementation and de-implementation: two sides of the same coin? BMJ quality & safety. 2017;26(6):495–501.

    Article  Google Scholar 

  17. Norton WE, Chambers DA. Unpacking the complexities of de-implementing inappropriate health interventions. Implementation Science. 2020;15(1):2.

    Article  PubMed  Google Scholar 

  18. Goossens A, Bossuyt PMM, de Haan RJ. Physicians and nurses focus on different aspects of guidelines when deciding whether to adopt them: an application of conjoint analysis. 2008;28(1):138-45.

  19. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. International journal of surgery (London, England). 2010;8(5):336-41.

    Article  PubMed  Google Scholar 

  20. Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Medicine. 2015;13(1):255.

    Article  PubMed  PubMed Central  Google Scholar 

  21. (EPOC) EPaOoC. EPOC Taxonomy 2015 [Available from: epoc.cochrane.org/epoc-taxonomy.

  22. Care. EPaOo. Suggested risk of bias criteria for EPOC reviews. [Available from: http://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/suggested_risk_of_bias_criteria_for_epoc_reviews.pdf.

  23. Wells G SB, O’Connell D, Peterson J, Welch V, Losos M, Tugwell P. The Newcastle-Ottawa scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses 2013 [Available from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp.

  24. Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. JNCI: Journal of the National Cancer Institute. 1959;22(4):719–48.

    CAS  PubMed  Google Scholar 

  25. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. 2003;327(7414):557-60.

  26. Kunz R, Oxman AD. The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials. BMJ (Clinical research ed). 1998;317(7167):1185–90.

    Article  CAS  PubMed Central  Google Scholar 

  27. Alexaitis I, Broome B. Implementation of a nurse-driven protocol to prevent catheter-associated urinary tract infections. J Nurs Care Qual. 2014;29(3):245–52.

    Article  PubMed  Google Scholar 

  28. Amato S, Salter JP, Mion LC. Physical restraint reduction in the acute rehabilitation setting: a quality improvement study. Rehabil Nurs. 2006;31(6):235–41.

    Article  PubMed  Google Scholar 

  29. Andersen C, Kolmos A, Andersen K, Sippel V, Stenager E. Applying sensory modulation to mental health inpatient care to reduce seclusion and restraint: a case control study. Nord J Psychiatry. 2017;71(7):525–8.

    Article  PubMed  Google Scholar 

  30. Davis A, Whyte J. A community health nursing approach to the problem of antibiotic over-prescribing. Journal of Community Health Nursing. 2008;25(3):161–74.

    Article  Google Scholar 

  31. Eskandari F, Abdullah KL, Zainal NZ, Wong LP. The effect of educational intervention on nurses' knowledge, attitude, intention, practice and incidence rate of physical restraint use. Nurse Educ Pract. 2018;32:52–7.

    Article  PubMed  Google Scholar 

  32. Hevener S, Rickabaugh B, Marsh T. Using a decision wheel to reduce use of restraints in a medical-surgical intensive care unit. American Journal of Critical Care. 2016;25(6):479–86.

    Article  PubMed  Google Scholar 

  33. Link TL, Townsend ML, Leung E, Kommu S, Vega RY, Hendrix CC. Reducing inappropriate antibiotic prescribing for adults with acute bronchitis in an urgent care setting: a quality improvement initiative. Adv Emerg Nurs J. 2016;38(4):327–35.

    Article  PubMed  Google Scholar 

  34. McCue RE, Urcuyo L, Lilu Y, Tobias T, Chambers MJ. Reducing restraint use in a public psychiatric inpatient service. J Behav Health Serv Res. 2004;31(2):217–24.

    Article  PubMed  Google Scholar 

  35. Sinitsky L, Brierley J. Reducing the number of unnecessary liver function tests requested on the Paediatric Intensive Care Unit. BMJ Qual Improv Rep. 2017;6:1.

    Article  Google Scholar 

  36. Thakker A, Briggs N, Maeda A, Byrne J, Davey JR, Jackson TD. Reducing the rate of post-surgical urinary tract infections in orthopedic patients. BMJ Open Qual. 2018;7(2):e000177.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Weddle G, Goldman J, Myers A, Newland J. Impact of an educational intervention to improve antibiotic prescribing for nurse practitioners in a pediatric urgent care center. J Pediatr Health Care. 2016;31(2):184–8.

    Article  PubMed  Google Scholar 

  38. Desveaux L, Saragosa M, Rogers J, Bevan L, Loshak H, Moser A, et al. Improving the appropriateness of antipsychotic prescribing in nursing homes: a mixed-methods process evaluation of an academic detailing intervention. Implement Sci. 2017;12(1):71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Evans LK, Strumpf NE, Allen-Taylor SL, Capezuti E, Maislin G, Jacobsen B. A clinical trial to reduce restraints in nursing homes. J Am Geriatr Soc. 1997;45(6):675–81.

    Article  CAS  PubMed  Google Scholar 

  40. Fitzpatrick MAC. Restraint reduction among the hospitalized elderly in intensive care units: Effects of education and restraint decision guide; 1997.

    Google Scholar 

  41. Gulpers MJ, Bleijlevens MH, Ambergen T, Capezuti E, van Rossum E, Hamers JP. Belt restraint reduction in nursing homes: effects of a multicomponent intervention program. J Am Geriatr Soc. 2011;59(11):2029–36.

    Article  PubMed  Google Scholar 

  42. Gulpers MJ, Bleijlevens MH, Ambergen T, Capezuti E, van Rossum E, Hamers JP. Reduction of belt restraint use: long-term effects of the EXBELT intervention. J Am Geriatr Soc. 2013;61(1):107–12.

    Article  PubMed  Google Scholar 

  43. Huang HT, Chuang YH, Chiang KF. Nurses' physical restraint knowledge, attitudes, and practices: the effectiveness of an in-service education program. J Nurs Res. 2009;17(4):241–8.

    Article  PubMed  Google Scholar 

  44. Huizing AR, Hamers JP, Gulpers MJ, Berger MP. Preventing the use of physical restraints on residents newly admitted to psycho-geriatric nursing home wards: a cluster-randomized trial. Int J Nurs Stud. 2009;46(4):459–69.

    Article  PubMed  Google Scholar 

  45. Huizing AR, Hamers JP, Gulpers MJ, Berger MP. A cluster-randomized trial of an educational intervention to reduce the use of physical restraints with psychogeriatric nursing home residents. J Am Geriatr Soc. 2009;57(7):1139–48.

    Article  PubMed  Google Scholar 

  46. Koczy P, Becker C, Rapp K, Klie T, Beische D, Buchele G, et al. Effectiveness of a multifactorial intervention to reduce physical restraints in nursing home residents. J Am Geriatr Soc. 2011;59(2):333–9.

    Article  PubMed  Google Scholar 

  47. Kopke S, Muhlhauser I, Gerlach A, Haut A, Haastert B, Mohler R, et al. Effect of a guideline-based multicomponent intervention on use of physical restraints in nursing homes: a randomized controlled trial. JAMA. 2012;307(20):2177–84.

    Article  PubMed  Google Scholar 

  48. Kwok T, Mok F, Chien WT, Tam E. Does access to bed-chair pressure sensors reduce physical restraint use in the rehabilitative care setting? J Clin Nurs. 2005;15(5):581–7.

    Article  Google Scholar 

  49. Lai CK, Chow SK, Suen LK, Wong IY. The effect of a restraint reduction program on physical restraint rates in rehabilitation settings in Hong Kong. Rehabil Res Pract. 2011;2011:284604.

    PubMed  PubMed Central  Google Scholar 

  50. Pellfolk TJ, Gustafson Y, Bucht G, Karlsson S. Effects of a restraint minimization program on staff knowledge, attitudes, and practice: a cluster randomized trial. J Am Geriatr Soc. 2010;58(1):62–9.

    Article  PubMed  Google Scholar 

  51. Testad I, Ballard C, Bronnick K, Aarsland D. The effect of staff training on agitation and use of restraint in nursing home residents with dementia: a single-blind, randomized controlled trial. J Clin Psychiatry. 2010;71(1):80–6.

    Article  PubMed  Google Scholar 

  52. Testad I, Mekki TE, Forland O, Oye C, Tveit EM, Jacobsen F, et al. Modeling and evaluating evidence-based continuing education program in nursing home dementia care (MEDCED)—training of care home staff to reduce use of restraint in care home residents with dementia. A cluster randomized controlled trial. Int J Geriatr Psychiatry. 2016;31(1):24–32.

    Article  PubMed  Google Scholar 

  53. Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ (Clinical research ed). 2006;332(7538):413–6.

    Article  PubMed Central  Google Scholar 

  54. Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Quality & safety in health care. 2003;12(1):40–6.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work is funded by the Netherlands Organization for Health Research and Development (ZonMw) (Grant number 516004017).

Author information

Authors and Affiliations

  1. Department of Biomedical Data Sciences, Section Medical Decision Making, Leiden University Medical Center, Leiden, The Netherlands

    Tessa Rietbergen & Leti van Bodegom-Vos

  2. Department of Internal Medicine, Nursing Science, Erasmus MC University Medical Center, Rotterdam, The Netherlands

    Denise Spoon, Monique van Dijk & Erwin Ista

  3. Department of Quality and Patient Safety, Leiden University Medical Center, Leiden, The Netherlands

    Anja H. Brunsveld-Reinders

  4. Leiden University Medical Center, Walaeus Library, Leiden, The Netherlands

    Jan W. Schoones

  5. Department of Primary and Community Care, Radboud Institute for Health Sciences, Scientific Institute for Quality of Healthcare, Radboud University Medical Center, Nijmegen, The Netherlands

    Anita Huis, Maud Heinen, Anke Persoon & Hester Vermeulen

  6. Faculty of Health and Social Studies, HAN University of Applied Sciences, Nijmegen, The Netherlands

    Hester Vermeulen

Authors
  1. Tessa Rietbergen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Denise Spoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anja H. Brunsveld-Reinders
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jan W. Schoones
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Anita Huis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Maud Heinen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Anke Persoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Monique van Dijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Hester Vermeulen
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Erwin Ista
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Leti van Bodegom-Vos
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LvB, EI, TR, and DS conceived the design of the study. TR, AB, and LvB led the review of abstracts, titles, and full texts. The data extraction was performed by TR or AB. A second researcher TR, AB, or DS independently checked the extracted data. TR led the drafting of the manuscript, with input from LvB. All authors read several versions of the article, provided feedback, and approved the final version.

Corresponding author

Correspondence to Leti van Bodegom-Vos.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Electronic Database Search for “Effects of de-implementation strategies aimed at reducing low-value nursing procedures: a systematic review and meta-analysis”.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rietbergen, T., Spoon, D., Brunsveld-Reinders, A.H. et al. Effects of de-implementation strategies aimed at reducing low-value nursing procedures: a systematic review and meta-analysis. Implementation Sci 15, 38 (2020). https://doi.org/10.1186/s13012-020-00995-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-020-00995-z

Keywords

Implementation Science

ISSN: 1748-5908