- Open Access
Changing behaviour, ‘more or less’: do implementation and de-implementation interventions include different behaviour change techniques?
Implementation Science volume 16, Article number: 20 (2021)
Decreasing ineffective or harmful healthcare practices (de-implementation) may require different approaches than those used to promote uptake of effective practices (implementation). Few psychological theories differentiate between processes involved in decreasing, versus increasing, behaviour. However, it is unknown whether implementation and de-implementation interventions already use different approaches. We used the behaviour change technique (BCT) taxonomy (version 1) (which includes 93 BCTs organised into 12 groupings) to investigate whether implementation and de-implementation interventions for clinician behaviour change use different BCTs.
Intervention descriptions in 181 articles from three systematic reviews in the Cochrane Library were coded for (a) implementation versus de-implementation and (b) intervention content (BCTs) using the BCT taxonomy (v1). BCT frequencies were calculated and compared using Pearson’s chi-squared (χ2), Yates’ continuity correction and Fisher’s exact test, where appropriate. Identified BCTs were ranked according to frequency and rankings for de-implementation versus implementation interventions were compared and described.
Twenty-nine and 25 BCTs were identified in implementation and de-implementation interventions respectively. Feedback on behaviour was identified more frequently in implementation than de-implementation (Χ2(2, n=178) = 15.693, p = .000057). Three BCTs were identified more frequently in de-implementation than implementation: Behaviour substitution (Χ2(2, n=178) = 14.561, p = .0001; Yates’ continuity correction); Monitoring of behaviour by others without feedback (Χ2(2, n=178) = 16.187, p = .000057; Yates’ continuity correction); and Restructuring social environment (p = .000273; Fisher’s 2-sided exact test).
There were some significant differences between BCTs reported in implementation and de-implementation interventions suggesting that researchers may have implicit theories about different BCTs required for de-implementation and implementation. These findings do not imply that the BCTs identified as targeting implementation or de-implementation are effective, rather simply that they were more frequently used. These findings require replication for a wider range of clinical behaviours. The continued accumulation of additional knowledge and evidence into whether implementation and de-implementation is different will serve to better inform researchers and, subsequently, improve methods for intervention design.
The problem of overuse of ineffective or harmful care which can lead to poor patient outcomes due to adverse events of treatments or unwarranted secondary tests and inefficient use of scarce healthcare resources threatening the sustainability of healthcare systems, has led to an increasing need to identify effective de-implementation interventions of low-value care [1,2,3]. For example, the BMJ’s Too Much Medicine campaign noted that identifying strategies to reduce unnecessary tests, diagnoses and treatments (i.e. de-implementation) will benefit patients by directly avoiding harm and helping create a more sustainable healthcare system [4, 5]. Projects such as Choosing Wisely have noted the importance of addressing de-implementation strategies to improve the care patients receive whilst eliminating wasteful spending [6,7,8,9]. Policy interest in de-implementation with programmes such as Choosing Wisely and Too Much Medicine campaigns advocate for more effective de-implementation interventions but remain unclear what the effective strategies should be.
Decreasing ineffective or harmful healthcare practices (de-implementation) may require different approaches than those used to promote uptake of new procedures (implementation) [10, 11]. However, there is little to no guidance on how to de-implement low-value or harmful healthcare practices or what types of interventions are better suited for de-implementation . Investigation into the theoretical basis for designing implementation and de-implementation interventions differently has indicated that theories of behaviour change generally do not distinguish between implementation and de-implementation . The one theory that does make the distinction (Operant Learning Theory ) may be difficult to apply in healthcare settings .
The term de-implementation is relatively new in the field of implementation research, having been discussed for only the last 8 years [10, 11, 14,15,16]. However, researchers have been designing implementation and de-implementation interventions for decades but rarely explicitly distinguished between them. It is unclear what approaches are being used and whether implementation and de-implementation interventions do require different strategies. It is thus important to describe the content of both implementation and de-implementation interventions and unpack their ‘active ingredients’ or behaviour change techniques to (1) determine what is actually included in both kinds of interventions and (2) provide a theoretical perspective to inform guidance for designing de-implementation interventions.
Behaviour change techniques (BCTs) are defined as ‘observable, replicable and irreducible components of an intervention designed to alter or redirect causal processes that regulate behaviour; that is, a technique is proposed to be an “active ingredient”’ . Taxonomies of BCTs provide standard definitions and labels for intervention components that allow for systematic comparison of common components in intervention descriptions from a variety of clinical settings, behaviours and professional groups. The most comprehensive taxonomy is the BCT taxonomy (version 1), which consists of 93 techniques  which are hierarchically organised into 16 groupings. Each technique has a definition and an example to aid in designing interventions or coding of pre-existing intervention descriptions. The majority of the examples provided within the taxonomy are directed at changing health behaviours of patients and members of the public but can and have been applied to describe behaviour change interventions relating to clinical practice. Whilst there are a number of taxonomies that permit the identification of intervention components such as the Expert Recommendations of Implementation Strategies (ERIC)  or the Effective Practice and Organisation of Care (EPOC)  taxonomies, these taxonomies do not possess the granularity and specificity the BCT taxonomy contains. This granularity permits for an in-depth investigation of the potentially subtle differences in implementation and de-implementation that may be overlooked with other taxonomies.
Investigation of the BCTs used in implementation and de-implementation interventions to identify whether they are different will clarify the content of current interventions and may help to explain a theoretical base for designing de-implementation interventions. The objectives of the current study were to use the BCT taxonomy (v1)  to (1) determine what intervention components are included in both kinds of interventions and (2) whether these components differ.
Design and review selection
We conducted a secondary analysis of a subset of intervention studies included in three Cochrane systematic reviews. We sampled from systematic reviews completed under the auspices of the Cochrane Effective Practice and Organisation of Care group in the Cochrane Library. Titles, abstracts and plain language summaries of EPOC systematic reviews were screened for inclusion. The key eligibility criterion was that the reviews described the behaviour change as a change in frequency. We identified 142 potentially eligible EPOC systematic reviews and protocols on the date of extraction. Of these, 48 were protocols and 4 were withdrawn. Three reviews contained no studies. Of the 87 remaining reviews, 31 were excluded because the abstract or summary did not clearly indicate that health professionals were participants or report health professional behaviour as a study outcome. For example, in the review, ‘Effectiveness of intermediate care in nursing-led inpatients units’ the intervention focused on having nurses, rather than physicians, manage inpatient units; the behaviour was not a change in frequency (change in HCP role). Similarly, in the review titled ‘Dietary advice given by a dietician versus other health professionals or self-help to reduce blood cholesterol’, the outcomes were reported as patient blood cholesterol, body weight and high-density lipoprotein cholesterol levels, which were not measures of health professional behaviours.
Pragmatically, it would not have been possible to include studies from 56 reviews. Through a purposive selection process, reviews selected for inclusion in this study were Audit and feedback: effects on professional practice and healthcare outcomes , Interventions for improving antibiotic prescribing practices for hospital inpatients  and Interventions for improving the appropriate use of imaging in people with musculoskeletal conditions . Criteria for purposive selection were (1) the reviews selected should include interventions that may target both implementation and de-implementation (i.e. increasing the frequency of high-value clinical behaviours and decreasing the frequency of low-value clinical behaviours) and (2) the reviews selected should not be limited to one professional group or setting but include various clinical settings and healthcare professions (e.g. primary care physicians, nurses, internists and other healthcare professionals in secondary and tertiary care facilities) to diversify the population of healthcare professional groups.
Screening and selection of articles
Titles and abstracts of the included studies from the systematic reviews were screened for eligibility. Studies were excluded if the intervention was not delivered directly to healthcare professionals, the behaviour change was not described as a change in frequency, or the desired change in frequency was unclear. In instances where eligibility was unclear, the articles were retained for full-text screening. The same eligibility criteria were applied in screening of full-text articles.
Two members of the research team (CSH, JJF) independently applied the inclusion criteria of 10% randomly selected articles initially screened by lead researcher (AMP). Agreement (Cohen’s kappa; κ) [23, 24] was calculated and any discrepancies were discussed with the lead researcher to clarify the coding of behaviour change frequency and to better inform the screening of remaining articles.
Data extracted from the articles included (1) desired change in behaviour frequency (implementation versus de-implementation); (2) health professional group (research participants); (3) sample size; (4) study design; (5) description of behaviour; (6) presence or absence of control group (y/n); and (7) intervention details as published.
Coding of intervention descriptions into behaviour change techniques
Using the BCT taxonomy (v1) definitions and examples from the coding manual , one researcher (AMP, who had completed formal training in BCT coding) coded the published intervention descriptions in all the included studies. Coding was conducted by assigning a BCT label from the taxonomy to passages of text of the intervention description from the article. All 93 techniques were considered for each intervention description. Content was coded for both the active intervention and the control condition. Two independent researchers with expertise in health psychology and training in the BCT taxonomy (v1) (HM and KM) coded the intervention descriptions of a subset of the included articles (20% each). Five coding assumptions were made to ensure consistency throughout the coding (see Table 1). Inter-rater reliability for identifying the same BCTs from intervention descriptions was assessed using percentage agreement; agreement above 80% was considered ‘satisfactory’ [25, 26]. Discrepancies between raters were resolved through discussion or consultation with a member of the BCT taxonomy research team (JJF).
Identified BCTs for both implementation and de-implementation interventions were counted and ranked according to frequency. Chi-squared (χ2) tests (Yates’ continuity correction for cells less than 5; and Fisher’s exact tests for cells equal to 0) were used to compare frequencies of BCTs between implementation and de-implementation interventions [27, 28], with significance (p value) adjusted for multiple comparison.
Selection of intervention articles
The three reviews included 255 articles describing interventions to change health professionals’ behaviour. Screening of titles, abstract and summaries resulted in the exclusion of 63 articles (see Supplemental file #1 for list of excluded articles). Articles were excluded because either the behaviour change was not described as a change in frequency or the desired direction of the change was unclear.
Inter-rater reliability of 26 double-screened articles was ‘substantial’ or ‘very good’ [25, 26] (κ = 0.839; 95% CI 0.626 to 1.000).
Full-text screening and data extraction
Full-text screening and data extraction of the remaining 192 articles resulted in the exclusion of seven articles. These articles reported interventions designed to change multiple behaviours and, from the published intervention descriptions, it was unclear which behaviour change techniques were targeting which behaviours. Figure 1 presents the flowchart for the identification of articles to be coded for BCTs. Supplemental File #2 contains characteristics of the included studies.
Of the 185 articles, 84 described implementation interventions and 101 described de-implementation interventions (see Table 2). The majority of studies for both implementation and de-implementation targeted a single healthcare professional group (n=56 and n=55, respectively; e.g. primary care physicians, internists, dentists). The remaining interventions targeted multiple professional groups (e.g. physicians and nurses in a practice, physicians in various hospital departments) or included the entire hospital population in the intervention. For the most part, study designs were either cluster-randomised controlled trials (implementation n = 59; de-implementation n = 31) or randomised control trials (implementation n = 16; de-implementation n = 16). However, interrupted time series (implementation n = 5; de-implementation n = 52), controlled before-and-after (implementation n = 2; de-implementation n = 1), and clustered controlled trials (implementation n = 1; de-implementation n = 1), were also reported. In study descriptions that identified a control group (n = 123), only 20 implementation interventions and eight de-implementation interventions described the control condition. The remaining studies with control groups reported that the control group ‘did not receive an intervention’ or ‘received usual care’.
Coding of intervention descriptions into behaviour change techniques
Agreement for BCT coding was 85% (AMP and HM) and 91% (AMP and KM). Sample BCT coding of an intervention description is provided in Supplemental file #3. Seven interventions descriptions could not be coded because there was not enough information to code [29,30,31,32,33,34,35].
In the remaining 178 articles, 25 of 93 possible BCTs (26%) were coded in de-implementation interventions and 29 (32%) were identified in implementation interventions. Table 3 provides a list of BCTs identified as well as definitions. Supplemental file #4 provides lists of BCTs coded in each implementation and de-implementation intervention descriptions.
Frequency of BCTs in implementation versus de-implementation interventions
Comparisons were made between implementation and de-implementation interventions across all studies (Fig. 2) and within each review (Figs. 3, 4, and 5 present the frequencies of BCTs identified in the implementation and de-implementation interventions in Audit and feedback, Antibiotic prescribing, and Image ordering reviews, respectively).
The most frequent BCTs in the implementation interventions were Feedback on behaviour (1st), Instruction on how to perform the behaviour (2nd), Social comparison (3rd), Credible source (4th), and Prompts/cues (5th). In the de-implementation interventions, the most frequent BCTs were Instruction on (how) to perform the behaviour (1st), Feedback on behaviour (2nd), Behaviour substitution (3rd), Monitoring of behaviour by others without feedback (4th) and Social comparison (5th). BCTs that were identified in implementation interventions and not in de-implementation were Goal setting (outcome) (n = 5), Material reward (behaviour) (n = 4), Behavioural contract (n =3), Action planning (n=2), Non-specific incentive (n = 2), Behavioural practice/rehearsal (n = 1) and Comparative imagining of future outcomes (n = 1). BCTs that were identified in de-implementation interventions and not in implementation were Restructuring the social environment (n = 13), Monitoring of outcomes of behaviour without feedback (n =3) and Demonstration of the behaviour (n=1).
Audit and feedback interventions
Twenty-seven BCTs were identified in implementation interventions and 19 were identified in de-implementation interventions (Fig. 3). The most frequent BCTs in the implementation interventions were Feedback on behaviour (1st), Instruction on (how) to perform the behaviour (2nd), Social comparison (3rd), Credible source (4th) and Goal setting (behaviour) (5th). In the de-implementation interventions, the most frequent BCTs were Feedback on behaviour (1st), Instruction on (how) to perform the behaviour (2nd), Social comparison (3rd), Feedback on outcomes of behaviour (4th) and Information about social and environmental consequences (5th).
Antibiotic prescribing interventions
Thirteen BCTs were identified in implementation interventions whilst 21 were identified in de-implementation interventions (Fig. 4). The most frequent BCTs in implementation interventions were Instruction on (how) to perform the behaviour (1st), Feedback on behaviour (2nd), Goal setting (behaviour) (2nd), Restructuring physical environment (3rd), Credible source (3rd) and Pros and cons (4th). In the de-implementation interventions, the most frequent BCTs were Instruction on (how) to perform the behaviour (1st), Behaviour substitution (2nd), Monitoring of behaviour by others without feedback (3rd), Restructuring physical environment (4th) and Feedback on behaviour (5th) and Restructuring physical environment (5th).
Image ordering interventions
Fifteen BCTs were identified in implementation interventions and 11 BCTs were identified in de-implementation interventions (Fig. 5). The most frequent BCTs identified in implementation interventions were Instruction on (how) to perform the behaviour (1st), Prompts and cues (2nd), Information about health consequences (3rd), and Credible source (4th). In the de-implementation interventions, the most frequent BCTs identified were Instruction on (how) to perform the behaviour (1st), Feedback on behaviour (2nd), Social support (unspecified) (3rd) and Credible source (4th).
Comparison BCTs of implementation and de-implementation interventions at the level of taxonomy hierarchical grouping showed no grouping of BCTs was consistently reported more frequently in implementation or de-implementation interventions (see Fig. 6). No intervention descriptions contained BCTs within the groupings: Regulation, Identity, Scheduled consequences, Self-belief and Covert learning.
Table 4 reports the significant associations between direction of change (implementation versus de-implementation) and the BCTs reported in intervention description (p <.0015 adjusted for 32 comparisons; applying the Yates’ continuity correction for cells less than 5 and Fisher’s exact test for cells equal to 0). Specifically, Feedback on behaviour was identified more frequently in implementation than de-implementation (Χ2(2, n=178) = 15.693, p = .000057). Three BCTs were identified more frequently in de-implementation than implementation; Behaviour substitution (Χ2(2, n=178) = 14.561, p = .0001; Yates’ continuity correction); Monitoring of behaviour by others without feedback (Χ2(2, n=178) = 16.187, p = .000057; Yates’ continuity correction); and Restructuring social environment (p = .000273; Fisher’s 2-sided exact test).
This study investigated whether implementation and de-implementation interventions as described in three purposively sampled Cochrane reviews contain different BCTs. Three of the BCTs reported more frequently in de-implementation interventions (Behaviour substitution, Restructuring social environment and Monitoring of behaviour by others without feedback) if associated with effective de-implementation interventions may help refine methods (and theory) for the design of de-implementation interventions.
Behaviour substitution is a technique that may be helpful in some de-implementation intervention designs. When designing theory-informed interventions, substitute behaviours were often introduced and the theories applied were used to increase the frequency of the substitute behaviour in order to de-implement the undesired or incompatible behaviour [12, 13]. When investigating determinants of behaviours in which the behaviour under investigation was a behaviour the HCP should avoid doing, researchers tended to frame the behaviour as ‘managing [clinical patient] without doing “x”’ [36,37,38]. Whilst permitting the respondents to reflect on the management of the patient rather than the specific behaviour under investigation, the framing of the question implies that the respondents could be doing something else.
One of the main benefits of using Behaviour substitution to de-implement behaviour is that it permits the healthcare professional (HCP) to focus on doing something, rather than doing nothing for the care of their patients. However, there are also potential challenges to using Behaviour substitution. Currently, we do not have methods for selecting appropriate substitute behaviours and the rationale for selection of substitute behaviour is rarely reported . Researchers may have resorted to intuitive or pragmatic ideas within each context, resulting in no cumulative learning on how best to identify the behaviour to promote in Behaviour substitution. There is also the challenge of what to do in clinical contexts where there is no sensible substitute behaviour. This is probably less common in healthcare because, in the absence of performing the undesired behaviour, HCPs will likely decide to monitor the patient more closely or use strategies to address patient concerns. Example substitute behaviours in these cases are (a) for reducing unnecessary blood transfusions, the clinician continues monitoring the patient and orders additional tests ; (b) for deciding not to order an X-ray, the physician discusses their reasoning with the patient who has acute low back pain [39, 40]; (c) for deciding not to prescribe antibiotics in respiratory tract infections, the clinician could provide a viral prescription to the patients with symptom management strategies . Further investigation is needed to clarify when Behaviour substitution would be effective (for what clinical behaviours and in what contexts).
Restructuring social environment may also be a candidate BCT for refining methods for de-implementation. For example, in many of the interventions for de-implementing antibiotic prescribing, HCPs were required to get approval from a senior or secondary clinician, or directly from the pharmacy, when requesting an antibiotic to be de-implemented. Seeking another clinician’s approval may be just enough of an inconvenience to deter the HCP from requesting the low-value care and the ease of order/prescribing is no longer there due to the added actions required. However, there may be unintended consequences of using this technique. Clinicians may perceive that their autonomy and clinical expertise is being challenged and there may be resistance. Additionally, applying this BCT would require additional labour resources that may not be available. Personnel would have to be willing to take on the added role and be available to review the requests. Identifying available resources to support application of this technique as well as addressing potential unintended consequences may be key factors its effectiveness and requires further study.
Monitoring of behaviour by others without feedback was reported more frequently in de-implementation than implementation. It is unclear why this is the case. One possibility is that de-implementation interventions historically have focused on quality improvement or cost saving measures and this BCT may have been applied as an organisational measure to document reduction in wasteful practice and cost as well as restrict clinicians’ practice behaviours. In addition, this BCT may work in the same manner as Restructuring social environment because clinicians would require other individuals to record and perhaps evaluate their practice behaviour. However, the unintended consequences of HCPs perceiving their autonomy and clinical expertise being challenged resulting in resistance, may be a concern when using this technique.
Strengths and limitations
This study was the first to apply the BCT taxonomy (v1) to compare implementation and de-implementation interventions that support HCP behaviour change. The taxonomy provided a relatively precise, ‘shared language’  to describe a diverse range of implementation and de-implementation interventions. However, there were limitations to the current study.
It is important to note that our findings do not imply the effectiveness of the BCTs for implementation or de-implementation, rather simply that they were more frequently used and suggest that researchers who designed the interventions may have ‘implicit theories’ [42, 43] about different BCTs required for de-implementation and implementation. Whilst we would have liked to include effectiveness, we were unable to undertake any formal meta-analysis because studies across the three reviews were not sufficiently similar in terms of interventions evaluated and outcomes measured for the findings to be meaningful. Additionally, effectiveness reported in the Cochrane reviews included in this study, could not be attributed to a single BCT (whether used of de-implementation or implementation) but to the cluster of BCTs identified in the intervention. Therefore, we believe it would be premature to include reported effectiveness of these interventions without being able to attribute effectiveness to the specific BCT, as well as before fully understanding the intervention components and the fidelity of intervention delivery.
We found that 32 of the 93 possible BCTs were used in the interventions included in this study. Although it is possible that not all 93 BCTs would be appropriate in the settings investigated, this does suggest that there may be additional potentially effective techniques that researchers have not yet explored. Additionally, as we have indicated in the introduction, the BCT taxonomy is one of a number of taxonomies that could have been used to identify intervention strategies. We chose to use the BCT taxonomy for its granularity and specificity of techniques but recognise that, whilst a comprehensive list, it is not a complete list of all possible techniques and may omit techniques relevant to identify difference between implementation and de-implementation. The BCT taxonomy is currently in its first version and opportunities exist to add to or refine the taxonomy as new evidence and research emerges.
Whilst the number of studies in both implementation (n=81) and de-implementation (n=97) were similar, the number of studies in the reviews were skewed to either implementation or de-implementation. For example, the Audit and Feedback review included twice as many implementation studies as de-implementation studies (n=59, n=26 respectively). In the Antibiotic Prescribing review, the number of implementation studies was considerably smaller than de-implementation studies (n=8, n=60 respectively). BCTs in implementation interventions were found in a large number of audit and feedback studies and BCTs in de-implementation interventions were found in the majority of antibiotic prescribing studies. Whilst we have identified differences in the BCTs used for implementation and de-implementation interventions, these findings are limited to three Cochrane reviews and require replication for a wider range of clinical behaviours.
In addition, multiple statistical comparisons reduce power and therefore require that the significance criterion be adjusted to control for type 1 error. For this study, we applied a conservative approach and adjusted significance criterion to p<.00015 for the 32 comparisons. It could be argued that the significant criterion may have been too conservative and a number of comparisons that were not statistically significant (.05<p>.00015) would be significant without the adjusted significant criterion, including Goal setting (behaviour), Goal setting (outcome), Social comparison, Prompts and cues and Material reward identified more frequently in implementation and Restructuring physical environment identified more frequently in de-implementation. However, our conservative approach strengthens the confidence with which inferences can be made about the BCTs that distinguish between increasing and decreasing behaviour frequency, indicating a robust level of evidence that interventions contain some different techniques for implementation and de-implementation.
Implications for future work
As previously mentioned, we did not investigate effectiveness of identified BCTs. This is clearly a next logical step in understanding the differences between the processes of implementation and de-implementation. A recent study has proposed links from groups of commonly used BCTs in interventions to behaviour change theories, suggesting that there is a possible common theorising about how BCTs may work together which is grounded in behaviour change theories . Our findings suggest that common theorising (even if implicit) may also exist in selecting different BCTs for de-implementation than implementation. Future work should include linking the BCTs used for de-implementation and their effectiveness to behaviour theories, which could guide further theoretical understanding about de-implementation.
Additionally, there is considerable opportunity to utilise the BCT Taxonomy (v1)  in other systematic reviews to determine if our findings are consistent with other comparisons of implementation and de-implementation interventions. Applying the same methods to intervention descriptions from other reviews, may identify whether these underreported BCTs were used more frequently or if they are consistently underused regardless of nature of the clinical behaviour or the clinical context. Because of the limited range of BCTs reported in the intervention descriptions of 187 published articles, there is opportunity to develop novel interventions that contain BCTs for the groups not reported and measure the effectiveness of those interventions to de-implement low-value care. It is also possible that the BCTs reported may not have been appropriate for the interventions because the majority of BCTs originated in context of clinical psychology, in which one-on-one interventions are delivered to people who have already acknowledged a need to change. Delivering the same BCTs in HCP behaviour change interventions may not be appropriate because of the different contexts and populations. Future research could develop novel interventions that contain BCTs for the underused BCT groupings. Investigating the application and effectiveness of less utilised BCTs may prove informative in interventions for de-implementation.
Policy interest in de-implementation has raised the question of whether the approaches to implement and de-implement are similar or different [4,5,6, 9, 11]. Implementation research has not yet addressed this question. This study has found that BCTs Behaviour substitution, Restructuring social environment and Monitoring of behaviour by others without feedback are frequent techniques for de-implementing low-value behaviours, and Feedback on behaviour was identified more frequently for implementing high-value care. Whilst there were some significant associations between BCTs reported in interventions and the direction of desired behaviour change (i.e. more or less, or implementation and de-implementation, respectively), there was also variation in BCTs included in these two kinds of interventions. These findings require replication for a wider range of clinical behaviours. The continued accumulation of knowledge and evidence into differences between the processes of implementation and de-implementation will serve to better inform researchers and, subsequently, improve methods for designing de-implementation interventions.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Behaviour Change Techniques
Effective Practice and Organization of Care
Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. The Lancet. 2017;390(10090):156–68.
Grimshaw JM, Patey AM, Kirkham KR, Hall A, Dowling SK, Rodondi N, et al. De-implementing wisely: developing the evidence base to reduce low-value care. BMJ Quality & Safety. 2020:bmjqs-2019-010060.
Information; CIfH. Unnecessary care in Canada: technical report. . Ottawa, ON: CIHI; 2017.
Moynihan R, Glasziou P, Woloshin S, Schwartz L, Santa J, Godlee F. Winding back the harms of too much medicine. BMJ (Clinical research ed). 2013;346:f1271.
Glasziou P, Moynihan R, Richards T, Godlee F. Too much medicine; too little care. British Medical Journal Publishing Group; 2013.
Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA, et al. ‘Choosing Wisely’: a growing international campaign. BMJ quality & safety. 2014:bmjqs-2014-003821.
Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. Jama. 2012;307(17):1801–2.
Malhotra A, Maughan D, Ansell J, Lehman R, Henderson A, Gray M, et al. Choosing Wisely in the UK: reducing the harms of too much medicine. British Journal of Sports Medicine. 2016;50(13):826–8.
Bhatia RS, Levinson W, Shortt S, Pendrith C, Fric-Shamji E, Kallewaard M, et al. Measuring the effect of Choosing Wisely: an integrated framework to assess campaign impact on low-value care. BMJ Qual Saf. 2015;24(8):523–31.
Gifford EV, Tavakoli S, Weingardt KR, Finney JW, Pierson HM, Rosen CS, et al. How do components of evidence-based psychological treatment cluster in practice?: a survey and cluster analysis. Journal of substance abuse treatment. 2012;42(1):45–55.
Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implementation Science. 2014;9(1):1–5.
Patey AM, Hurt CS, Grimshaw JM, Francis JJ. Changing behaviour ‘more or less’—do theories of behaviour inform strategies for implementation and de-implementation? A critical interpretive synthesis. Implementation Science. 2018;13(1):134.
Skinner BF. Science and human behavior. Cambridge, Massachusettes: B.F. Skinner Foundation; 2005.
Eccles M, Foy R, Sales AE, Wensing M, Mittman B. Implementation Science six years on—our evolving scope and common reasons for rejection without review. Implement Sci. 2012;7:71.
Olds D, Øvretveit J. Innovations in quality improvement research for more useful answers to research users’ questions. Implementation Science. 2013;8(Suppl 1):S7.
Nieuwlaat R, Schwalm J-D, Khatib R, Yusuf S. Why are we failing to implement effective therapies in cardiovascular disease? European heart journal. 2013;34(17):1262–9.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science. 2015;10(1):21.
(EPOC); EPaOoC. EPOC Taxonomy 2015 [Available from: https://epoc.cochrane.org/epoc-taxonomy.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6.
Davey P, Brown E, Fenelon L, Finch R, Gould I, Hartman G. Interventions to improve antibiotic prescribing practices for hospital inpatients. Cochrane Database Syst Rev. 2013;19.
French SD, Green S, Buchbinder R, Barnes H. Interventions for improving the appropriate use of imaging in people with musculoskeletal conditions. Cochrane Database Syst Rev. 2010;1.
Fleiss JL, Cohen J, Everitt B. Large sample standard errors of kappa and weighted kappa. Psychological Bulletin. 1969;72(5):323.
Graphpad S. Graphpad QuckCals Website 2014 [Quantify agreement with Kappa]. Available from: http://graphpad.com/quickcalcs/kappa1/.
Fleiss JL. The measurement of interrater agreement. Statistical methods for rates and proportions. 1981;2:212–36.
Fleiss JL. Measuring nominal scale agreement among many raters. Psychological Bulletin. 1971;76(5):378.
Moore DS, McCabe GP. Introduction to the practice of statistics: WH Freeman/Times Books/Henry Holt & Co; 1989.
McHugh ML. The chi-square test of independence. Biochemia Medica. 2013;23(2):143–9.
Climo MW, Israel DS, Wong ES, Williams D, Coudron P, Markowitz SM. Hospital-wide restriction of clindamycin: effect on the incidence of Clostridium difficile-associated diarrhea and cost. Annals of Internal Medicine. 1998;128(12_Part_1):989-95.
Meyer KS, Urban C, Eagan JA, Berger BJ, Rahal JJ. Nosocomial outbreak of Klebsiella infection resistant to late-generation cephalosporins. Annals of internal medicine. 1993;119(5):353–8.
Christ-Crain M, Stolz D, Bingisser R, Muller C, Miedinger D, Huber PR, et al. Procalcitonin guidance of antibiotic therapy in community-acquired pneumonia: a randomized trial. American journal of respiratory and critical care medicine. 2006;174(1):84–93.
Wyatt JC, Paterson-Brown S, Johanson R, Altman DG, Bradburn MJ, Fisk NM. Randomised trial of educational visits to enhance use of systematic reviews in 25 obstetric units. BMJ. 1998;317(7165):1041–6.
Ferguson TB Jr, Peterson ED, Coombs LP, Eiken MC, Carey ML, Grover FL, et al. Use of continuous quality improvement to increase use of process measures in patients undergoing coronary artery bypass graft surgery: a randomized controlled trial. Jama. 2003;290(1):49–56.
Majumdar SR, Beaupre LA, Harley CH, Hanley DA, Lier DA, Juby AG, et al. Use of a case manager to improve osteoporosis treatment after hip fracture: results of a randomized controlled trial. Archives of internal medicine. 2007;167(19):2110–5.
Himmelberg CJ, Pleasants RA, Weber DJ, Kessler JM, Samsa GP, Spivey JM, et al. Use of antimicrobial drugs in adults before and after removal of a restriction policy. American Journal of Health-System Pharmacy. 1991;48(6):1220–7.
Eccles MP, Grimshaw JM, Johnston M, Steen N, Pitts NB, Thomas R, et al. Applying psychological theories to evidence-based clinical practice: identifying factors predictive of managing upper respiratory tract infections without antibiotics. Implementation Science. 2007;2(1):26.
Francis JJ, Tinmouth A, Stanworth SJ, Grimshaw JM, Johnston M, Hyde C, et al. Using theories of behaviour to understand transfusion prescribing in three clinical contexts in two countries: development work for an implementation trial. Implementation Science. 2009;4(1):70.
Islam R, Tinmouth AT, Francis JJ, Brehaut JC, Born J, Stockton C, et al. A cross-country comparison of intensive care physicians’ beliefs about their transfusion behaviour: a qualitative study using the Theoretical Domains Framework. Implementation Science: IS. 2012;7:93-.
Bussieres AE, Patey AM, Francis JJ, Sales AE, Grimshaw JM. Identifying factors likely to influence compliance with diagnostic imaging guideline recommendations for spine disorders among chiropractors in North America: a focus group study using the Theoretical Domains Framework. Implementation Science. 2012;7(1):82.
McKenzie JE, French SD, O’Connor DA, Grimshaw JM, Mortimer D, Michie S, et al. IMPLEmenting a clinical practice guideline for acute low back pain evidence-based manageMENT in general practice (IMPLEMENT): cluster randomised controlled trial study protocol. Implement Sci. 2008;3(1):11.
Lee C, Jafari M, Brownbridge R, Phillips C, Vanstone JR. The viral prescription pad-a mixed methods study to determine the need for and utility of an educational tool for antimicrobial stewardship in primary health care. BMC family practice. 2020;21(1):1–12.
Dweck CS. Implicit theories as organizers of goals and behavior. In: Gollwitzer PM, Bargh JA, editors. The psychology of action: Linking cognition and motivation to behavior: The Guilford Press; 1996. p. 69-90.
The Improved Clinical Effectiveness through Behavioural Research G. Designing theoretically- informed implementation interventions. Implementation Science. 2006;1(4).
Bohlen LC, Michie S, de Bruin M, Rothman A, Kelly MP, Groarke H, et al. Do combinations of behaviour change techniques that occur frequently in interventions reflect underlying theory? Annals of Behavioral Medicine. 2020;XX:1-16.
The views expressed in this paper are those of the authors and may not be shared by the funding body. We would like to thank Hayley McBain (HM) and Kathleen Mulligan (KM) for assistance in the coding interventions of articles. We would also like to thank Catherine Hurt (CSH) for guidance, support and supervision throughout the doctoral project.
This study was part of a doctoral programme of research (AMP), funded by City, University of London Doctoral Scholarship. JMG holds a Canada Research Chair in Health Knowledge Transfer and Uptake.
Ethics approval and consent to participate
Consent for publication
All other authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
Supplemental File 1 List of intervention articles excluded from BCT coding
Additional file 2.
Supplemental File 2 Characteristics of included intervention articles for BCT coding
Additional file 3.
Supplemental File 3 Sample of BCT coding of intervention description
Additional file 4.
Supplemental File 4 BCTs identified in intervention descriptions
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Patey, A.M., Grimshaw, J.M. & Francis, J.J. Changing behaviour, ‘more or less’: do implementation and de-implementation interventions include different behaviour change techniques?. Implementation Sci 16, 20 (2021). https://doi.org/10.1186/s13012-021-01089-0
- De-implementation versus implementation
- Behaviour change
- Intervention content
- Intervention design