- Systematic review
- Open Access
- Open Peer Review
Trends in guideline implementation: a scoping systematic review
- Anna R Gagliardi1Email author,
- Samia Alhabib2 and
- and the members of the Guidelines International Network Implementation Working Group
https://doi.org/10.1186/s13012-015-0247-8
© Gagliardi and Alhabib; licensee BioMed Central. 2015
- Received: 31 January 2015
- Accepted: 13 April 2015
- Published: 21 April 2015
Abstract
Background
There is currently no reliable way to choose strategies that are appropriate for implementing guidelines facing different barriers. This study examined trends in guideline implementation by topic over a 10-year period to explore whether and how strategies may be suitable for addressing differing barriers.
Methods
A scoping systematic review was performed. MEDLINE and EMBASE were searched from 2004 to 2013 for studies that evaluated the implementation of guidelines on arthritis, diabetes, colorectal cancer and heart failure. Data on study characteristics, reason for implementation (new guideline or quality improvement), implementation strategy used, rationale for selecting that strategy and reported impact were extracted and summarized. Interventions were mapped against a published taxonomy of guideline implementation strategies.
Results
The search resulted in 1,709 articles; 156 were retrieved and 127 were excluded largely because they did not evaluate guideline implementation, leaving 32 eligible for review (4 arthritis, 3 colorectal cancer, 21 diabetes, 4 heart failure). Six of 7 randomized trials and 8 of 25 observational studies had a low risk of bias. Most studies promoted guideline use for quality improvement (78.0%). Few studies rationalized strategy choice (18.8%). Most employed multiple approaches and strategies, most often educational meetings and print material for professionals or patients. Few studies employed organizational, financial or regulatory approaches. Strategies employed that were unique to the published taxonomy included professional (print material, tailoring guidelines, self-audit training or material) and patient strategies (education, counselling, group interaction, print material, reminders). Most studies achieved positive impact (87.5%). This did not appear to be associated with guideline topic, use of theory or barrier assessment, or number or type of implementation approaches and strategies.
Conclusions
While few studies were eligible, limiting insight on how to choose implementation strategies that address guideline-specific barriers, this review identified other important findings. Education for professionals or patients and print material were the most commonly employed strategies for translating guidelines to practice. Mapping of strategies onto the published taxonomy identified gaps in guideline implementation that represent opportunities for future research and expanded the taxonomy.
Keywords
- Guidelines
- Implementation
- Implementation planning
- Implementation strategies
- Quality improvement
- Systematic review
Background
Guidelines are considered an essential “foundation” for healthcare policy, planning, delivery, evaluation and quality improvement by clinicians, managers and policy-makers [1]. As noted in the Institute of Medicine report Clinical Practice Guidelines We Can Trust, guidelines translate the complexity of scientific research findings into recommendations that can enhance healthcare quality and outcomes [2]. Despite widespread recognition of their crucial function, guidelines are not always translated to policy or practice [3-5]. Limited use of guidelines contributes to omission of beneficial therapies, preventable harm, suboptimal patient outcomes or experiences or waste of resources [6,7]. This is, in part, a result of multiple factors that often interact to challenge guideline implementation and use and are commonly and collectively referred to as “barriers” to change or more broadly as “determinants of practice” in the guideline implementation literature [8-10]. These include characteristics of the recommended practice and patient, provider, institutional and system-level factors. It is considered important to identify barriers and choose and tailor implementation strategies accordingly so that impact can be optimized. A systematic review of 26 randomized controlled trials found that interventions that had been selected and tailored to address identified barriers were more likely to improve professional practice compared with either no intervention or dissemination of guidelines [11]. However, most studies included in the review provided little information or justification about how interventions were chosen and tailored, so the review concluded that there was insufficient evidence on the most effective approaches for doing so.
Guidance or tools for identifying barriers and choosing interventions have been developed to support guideline implementation planning. For example, guideline implementation taxonomies are available, and numerous systematic reviews have synthesized primary research on the effectiveness of guideline implementation strategies [12,13]. Krause et al. evaluated different methods for identifying barriers and found that brainstorming by the team responsible for guideline implementation and interviews with health professionals identified the largest number of barriers. Interviews with patients identified many different barriers, so the authors concluded that a combination of methods should be used [14]. Another striking finding from the same study was the identification of 601 discrete barriers by the participants from five European countries, underscoring the complex and challenging nature of implementation planning. A number of checklists or questionnaires have been developed to assess organizational readiness to change, implementation capacity or factors that influence the adoption of innovations [15-17]. For example, Michie et al. generated the Theoretical Domains Framework by compiling 12 behaviour change domains reflecting 14 motivational, 11 action and 8 organizational theories which can be used to design implementation interventions [18]. However, these resources do not offer definitive guidance on which implementation strategies best address particular barriers. For example, the BARRIERS scale was found to be reliable when tested, but a systematic review of 63 studies in which it was used showed that information about identified barriers was not used to select or tailor interventions, and in many studies, desired changes were not achieved [19].
Intervention mapping is a five-step process that is meant to support the selection of interventions that address identified barriers [20]. It is a methodological framework to guide implementation planning once a needs assessment has been undertaken that describes a healthcare problem and its cause, including barriers and the capacity of stakeholders to support the desired change. In step one, objectives are established given the identified barriers, stakeholder characteristics and desired outcome. In step two, a list of potential interventions is created through brainstorming, searching the empirical literature to identify the effectiveness of those interventions and deciding how to apply the interventions chosen to match objectives. However, the choice of intervention is subjective and may not necessarily be the most appropriate solution for a given scenario. While a variety of tools and methods exist by which to identify implementation barriers and potentially relevant interventions, there is currently no reliable way to match an intervention to identified implementation barriers. Guideline developers and users have expressed the need for guidance by which to choose, tailor and operationalize implementation strategies, and empirical research has also demonstrated that users are often aware and accepting of guidelines but struggle with their implementation [8-10,21]. Further research is needed to develop objective mechanisms by which to choose implementation strategies that match identified barriers. This would complement and extend the usefulness of existing tools and processes and provide implementation support to guideline developers, implementers and users. Ultimately, this may improve the implementation and use of guidelines, leading to improved healthcare planning, delivery, efficiency and outcomes.
As a preliminary step in establishing a means by which to match interventions with barriers of guideline implementation and use, it would be useful to explore trends in implementation for guidelines on different topics. This may reveal whether particular strategies are feasible and effective for guidelines whose use might be challenged by factors unique to the users or environment within which they are applied. If such trends are identified, they may lead to the development of a matrix or other framework for matching implementation strategies to barriers. If instead gaps in research are identified, that would establish avenues for ongoing primary research. The purpose of this study was to examine published, peer-reviewed research on guideline implementation to describe the strategies that were used and identify trends in use over time or by clinical topic which may suggest implementation strategies that suit different barriers or circumstances.
Methods
Approach
We conducted a scoping review of studies that evaluated guideline implementation or use [22]. A scoping review examines whether and how different types of strategies were operationalized and studied. A scoping review also identifies gaps in the literature that can only be addressed through ongoing research. While similar in rigour to a traditional systematic review, a scoping review addresses broader, more complex topics where different study designs may be relevant and selection criteria are developed post hoc based on increasing familiarity with the literature. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria guided reporting of the methods and findings (Additional file 1) [23]. A protocol for this review was not registered.
Search
MEDLINE and EMBASE were searched from 2004 to 2013 inclusive for studies that evaluated guideline implementation planning, processes or outcomes. A 10-year time span was used as, over this period, recognition of the need for tailoring the design of implementation strategies according to barriers or determinants emerged, so studies published later in the time frame may have reflected this. These are key indexed databases featuring the largest volume of published medical research. Searches were executed in January 2014 and updated in June 2014 to ensure that we captured all studies published in 2013. The search strategy was purposefully broad to be as inclusive as possible (Additional file 2). Search terms were informed by research that generated search strategies for implementation topics which optimized sensitivity and specificity and included Medical Subject Headings and keywords [24,25]. Guideline topics included arthritis, colorectal cancer, diabetes and heart failure. These conditions affect both men and women and are major causes of disability and death worldwide. Furthermore, they reflect both primary (arthritis, diabetes) and acute (colorectal cancer, heart failure) settings of care to account for differing institutional and system-level factors, involve different types of providers and patients and recommend different processes of care, thereby addressing remaining factors known to challenge guideline implementation and use [7-9]. Focusing on a few topics also enhanced feasibility of conducting this scoping review. Searches were limited to English language to avoid the cost of translation.
Screening
Titles and abstracts of search results were reviewed independently by both authors and a research assistant. All items selected by at least one reviewer were retrieved for further assessment since judgment about eligibility must often be reserved until the full text can be reviewed. If more than one publication described a single study and each presented the same data, the most recent was included. Preliminary selection criteria included observational studies, randomized trials, case studies or programme evaluations that described the methods used to implement new guidelines or promote compliance with guidelines on relevant topics. As search results were reviewed, selection criteria were expanded to specify studies that were not eligible. These included studies that evaluated clinical interventions for patient care or behavioural interventions for an issue other than guideline implementation; condition-specific prevalence, risk factors or complications; practice patterns based on audits or population-based data; barriers or facilitators influencing guideline adherence; guideline development strategies; or strategies targeted to trainees only or where the strategy was not sufficiently described. Guidelines, anecdotal reports, protocols, abstracts, letters, commentaries or editorials were not eligible.
Data collection and analysis
A data extraction form was developed to capture information from each article on year of publication, country of origin, study design, guideline topic, reason for implementation (new guideline or quality improvement based on an existing guideline), implementation strategy or strategies used, theory or identification of barriers used to inform the selection or tailoring of implementation strategy and impact according to measures reported in individual studies. The implementation strategy was described according to content, mode, duration, frequency, audience and personnel. Implementation strategies were labelled according to the Mazza et al. taxonomy which categorizes 49 distinct strategies as higher level professional, organizational, financial and regulatory approaches [12]. For example, professional approaches included the strategy of “advertise guideline material”, and organizational approaches included the strategy of “reallocated or new role” targeted to health professionals and the strategy of “consumer participation in governance” targeted to patients. This mapping strategy also identified strategies employed in eligible studies but not listed in the Mazza et al. taxonomy. The form was pilot tested independently by ARG and a research assistant in two iterations for three randomly selected articles to achieve high congruence of data extraction. Data were independently extracted by two research assistants and then checked for accuracy by ARG. Study quality was assessed using criteria relevant to study design, but was not used to exclude studies. This included the Cochrane Risk of Bias tool for randomized controlled trials and a modified version of the Downs and Black instrument for observational studies [26,27]. Search results were depicted with a PRISMA flow diagram [23]. Summary statistics were used to describe the number of articles by topic, country, year of publication, reason for implementation and those in which the intervention was informed by theory or otherwise rationalized. The number of implementation strategies was summarized by implementation approach and guideline topic. The number of single or multiple approaches and strategies was also summarized. Tabulated data were observed for trends or possible links between guideline topic (which reflected barriers relevant to different types of care processes, providers, patients and settings), reason for implementation and type and number of implementation approaches or strategies. Studies included a wide range of designs and measures, and pooling of data was not possible. Impact was described as the number of studies by topic and type of implementation strategy that achieved intended outcomes.
Results
Characteristics of eligible studies
PRISMA flow diagram of search results.
Implementation approaches
The majority of studies were undertaken to promote compliance with existing guidelines for quality improvement (25); fewer studies implemented a newly developed or updated guideline (7). Of 32 eligible studies, 6 (5 quality improvement, 1 new guideline implementation) explicitly described a rationale for the implementation strategy used (2 arthritis, 2 colorectal cancer, 2 diabetes) by referring to models or theories including the Knowledge to Action cycle [28], Chronic Care Model [43,51], Precaution Adoption Process Model [33], Social Cognitive Theory [29,34] and the Theory of Reasoned Action [34]. Two diabetes studies referred to other rationale for the implementation strategy used. One of these studies mentioned the identification of barriers, but not how this was done [48], and the other mentioned that the guideline was tailored, but not why or how [49]. No other studies explicitly noted whether or how barriers were identified or whether barriers influenced the selection or tailoring of implementation strategies.
Implementation approaches and strategies used in eligible studies
Strategya | Arthritis (4) | Colorectal Cancer (3) | Diabetes (21) | Heart Disease (4) | Total |
|---|---|---|---|---|---|
Professional | |||||
Identify barriers | -- | -- | 2 | -- | 2 |
Distribute guideline material | -- | -- | 2 | -- | 2 |
Advertise guideline material | -- | -- | -- | -- | 0 |
Present guideline materials at meetings | -- | -- | -- | -- | 0 |
Educate individuals about guideline intent/benefits | -- | 1 | 2 | -- | 3 |
Educate groups about guideline intent/benefits | 2 | -- | 13 | 3 | 18 |
Recruit an opinion leader who recommends implementation | -- | -- | -- | -- | 0 |
Achieve consensus that guideline should be implemented | -- | -- | -- | -- | 0 |
Provide reminders to individuals/groups about intent/benefits | 2 | 1 | 7 | 1 | 11 |
Provide alerts when practice deviates | -- | -- | -- | -- | 0 |
Provide feedback on compliance | -- | 1 | 1 | 1 | 3 |
Provide feedback about patients (outcome data, self-report) | -- | -- | 3 | -- | 3 |
Provide feedback from patients | -- | -- | -- | -- | 0 |
Provide feedback from healthcare professionals | -- | -- | -- | -- | 0 |
Print material (summary, algorithm, referral forms, etc.) | 2 | 3 | 6 | 2 | 13 |
Tailor guideline | -- | -- | 1 | -- | 1 |
Enable self-audit (training, material) | -- | -- | 1 | -- | 1 |
Subtotal | 6 | 6 | 38 | 7 | 57 |
Financial | |||||
Health professional | |||||
Incentive (individual financial reward or benefit for compliance) | -- | -- | -- | -- | 0 |
Incentive (group or institutional financial reward or benefit) | -- | -- | -- | -- | 0 |
Grant or allowance to individual (not tied to compliance) | -- | -- | 4 | -- | 4 |
Grant or allowance to group/institution (not tied to compliance) | -- | -- | -- | 1 | 1 |
Penalty (individual, for non-compliance) | -- | -- | -- | -- | 0 |
Penalty (group/institution, for non-compliance) | -- | -- | -- | -- | 0 |
Change in reimbursement (add/remove/substitute) | -- | -- | -- | -- | 0 |
Patient | |||||
Incentive (individual financial reward/benefit for compliance) | -- | -- | -- | -- | 0 |
Grant or allowance (not tied to compliance) | -- | -- | -- | -- | 0 |
Penalty (for non-compliance) | -- | -- | -- | -- | 0 |
Incentive (individual non-financial reward/benefit for compliance) | -- | -- | 1 | 1 | |
Subtotal | 0 | 0 | 5 | 1 | 6 |
Organizational | |||||
Health professional | |||||
Additional human resources (number/type) | -- | -- | 2 | -- | 2 |
Reallocated or new role | -- | -- | 1 | -- | 1 |
Create an implementation/multidisciplinary team | -- | -- | 1 | -- | 1 |
Communication between distant health professionals | -- | -- | -- | -- | 0 |
Improve health professional satisfaction (non-financial) | -- | -- | -- | -- | 0 |
Patient | |||||
Consumer participation in governance | -- | -- | -- | -- | 0 |
Consumer feedback, suggestions, complaints | -- | -- | -- | -- | 0 |
Structural changes | |||||
Organizational structure (including reorganization) | -- | -- | -- | -- | 0 |
Setting/site of service delivery | -- | -- | -- | -- | 0 |
Physical structure, facilities or equipment | -- | -- | -- | -- | 0 |
Information/communication technology | -- | -- | 3 | 1 | 4 |
Quality improvement, performance measurement system | -- | -- | -- | -- | 0 |
Method of service delivery | -- | -- | -- | -- | 0 |
Integration of services | -- | -- | 1 | -- | 1 |
Risk management provisions (including insurance coverage) | -- | -- | -- | -- | 0 |
Subtotal | 0 | 0 | 8 | 1 | 9 |
Regulatory | |||||
Legislation or regulation (which enforces or mandates) | -- | -- | -- | -- | 0 |
Ownership or affiliation | -- | -- | -- | -- | 0 |
Licensing, credentialing or accreditation | -- | -- | -- | -- | 0 |
Subtotal | 0 | 0 | 0 | 0 | 0 |
Patient/consumer | |||||
Education (single or group) | 1 | -- | 7 | 1 | 9 |
Counselling | -- | 1 | 4 | 1 | 6 |
Group interaction (via social media) | 1 | -- | -- | -- | 1 |
Print material (summary, etc.) | -- | 1 | 5 | 1 | 7 |
Reminder | -- | 1 | 1 | -- | 2 |
Sub-total | 2 | 3 | 17 | 3 | 25 |
Total | 8 | 9 | 68 | 12 | 97 |
Five studies (one arthritis [30], one colorectal cancer [32], three diabetes [37,46,54]) employed a single-implementation approach based on a single strategy, for example, professional education. Four diabetes studies employed multiple implementation approaches, each comprised of a single strategy [35,39,42,53], for example, a professional approach involving reminders combined with an organizational approach involving a new professional role. Fourteen studies (three arthritis [28,29,31], two colorectal cancer [33,34], five diabetes [36,38,41,44,48], four heart failure [56-59]) employed a single-implementation approach comprised of multiple strategies, for example, a professional approach involving education via workshop, print material and a reminder. Nine diabetes studies employed interventions comprised of multiple approaches where at least one of the approaches involved multiple strategies [40,43,45,47,49-52,55]. With respect to topic, diabetes studies appeared to employ more strategies across all approaches (70.1%) compared with arthritis (8.2%), colorectal (9.3%) and heart disease studies (12.4%) though this may reflect the higher number of eligible studies based on diabetes guidelines.
Overall, there were no observable trends in implementation approaches or strategies by setting (primary/community care or otherwise) or by guideline topic since the most frequently employed strategies were education, reminders and print material for professionals, and education, print material and counselling for patients across all topics. The types of implementation approaches and strategies did not appear to change over time. Two arthritis [28,29] and two colorectal [33,34] studies that employed theory both used single approaches involving multiple strategies though the approaches and strategies varied. Two diabetes studies that employed theory, the chronic care model in both cases, used multiple approaches and strategies which differed in the two studies [43,51]. The diabetes study that identified barriers used a single approach with multiple strategies [48], and the diabetes study that tailored a guideline used multiple approaches and strategies [49].
Impact on knowledge, behaviour and outcomes
All four arthritis studies achieved positive impact on patient and professional knowledge and behaviour. Two of three colorectal cancer studies achieved mixed results. In one study that involved distribution of a referral form to general practitioners, use of the form and appropriate use of the form were variable; however, compared with patients referred as usual, use of the referral form was associated with higher rates of cancer detection [32]. In another study involving telephone counselling, a reminder and print material, 39% of eligible patients in the observational cohort were compliant with screening recommendations [33]. In the third colorectal cancer study which used a randomized controlled trial (RCT) design to test a professional approach involving educational outreach, feedback, print material and a reminder, follow-up of abnormal faecal occult blood test results improved compared with the control group [34]. Of 21 diabetes studies, 19 studies achieved positive impact in measures assessed. Diabetes and hypertension control did not change in 9 intervention sites compared with 9 control sites following professional educational outreach, print material and a reminder [38] or among 50 physicians who received education, print material and reminders plus print material for patients compared with 49 control physicians [40]. Three of four heart failure studies achieved positive impact. In one study involving professional education, print material and feedback prescribing behaviour and patient outcomes such as readmission and morbidity improved [57]. In an RCT testing use of a structural approach involving an information system, reimbursement and training of physicians, recommendations for rehabilitation improved among intervention hospitals compared with control hospitals [58]. Another heart failure study involving patient education, counselling and print material improved their knowledge, behaviour and outcomes [59]. A fourth study did not improve use of stress echocardiography from baseline after professional education, print material and a reminder [56]. While most studies (28/32, 87.5%) achieved positive impact, they employed a variety of types and numbers of approaches and strategies; studies that employed a single approach and strategy and achieved positive impact were few, and all four employed a different strategy [30,37,46,54], so it is difficult to discern the impact of single or combined approaches or strategies. With respect to the group of six studies that used theory-informed strategies, one did not achieve the desired impact. This was a colorectal study that failed to improve motivation for screening [33]. The study that assessed barriers improved diabetes care delivery for 50% of indicators measured [48]. Study design and risk of bias did not appear to be associated with intervention impact.
Discussion
Numerous strategies have been used to implement guidelines, but their impact is inconsistent. There is currently no reliable way to choose strategies that are most appropriate for implementing guidelines to address determinants of practice in different contexts. To generate knowledge that would provide guidance for choosing and tailoring implementation strategies, this study examined trends in guideline implementation over a 10-year period to identify whether and how strategies and their impact differed by guideline topic as a proxy for context-specific determinants. Overall, few studies were identified, and most focused on the implementation of diabetes guidelines, so the identification of trends in guideline implementation by comparing the use and impact of strategies by guideline topic was not possible. Most studies employed either professional or patient education though these were often combined with other strategies. Choice of strategy did not appear to be associated with guideline topic or change over time. The majority of studies achieved positive impact on patient and professional knowledge and behaviour and on patient outcomes. This did not appear to be associated with guideline topic, use of theories or barrier assessment, or number or type of implementation approaches and strategies.
Few studies reported selecting or tailoring implementation strategies based on theory, assessing barriers or any other rationale. This finding also emerged in other systematic reviews on implementation [60,61] despite the existence of reporting standards that require a justification for strategy selection and clear description of intervention design [62-64]. Therefore, it could not be ascertained if this was associated with choice or tailoring of strategy or impact. Moreover, this did not change over time despite increasing awareness of the need to assess barriers or determinants and tailor strategies according to these factors [10] and a plethora of systematic reviews, taxonomies, theories, models and instruments for doing so [11-18]. Such resources may not be easy to use or broadly relevant [19] and do not objectively or reliably suggest appropriate implementation strategies, so further research is needed to generate guidance for identifying barriers and choosing implementation strategies suitable for addressing those barriers. The responsibility for implementation planning, of which barrier assessment is a part, also remains unclear. Most of the studies aimed to improve compliance with guidelines in the context of quality improvement rather than implementing new guidelines, and in most studies, personnel were either not specified or were health professionals. None of the studies explicitly mentioned involving knowledge brokers or facilitators, individuals with expertise in implementation, in the planning or delivery of interventions [65]. Our group recently generated a framework for implementation planning which also recommends that individuals with expertise in implementation be involved in guideline development from the outset [66].
This study and other research showed that most often guidelines are implemented using educational approaches such as workshops [13,21]. This is not surprising because, in comparison with more complex interventions such as organizational, financial or regulatory strategies which were rarely used by studies included in this review and require large-scale change and/or considerable funding, educational approaches may be less resource intensive and more easily employed by guideline developers or implementers with limited funding [21]. Educational meetings are known to have a small impact on practice [67]. Most studies included in this review achieved desired impact even though they did not report using theories or barrier assessment to inform strategies and employed educational materials and meetings directed at health professionals or patients. This may be due to the fact that educational approaches were often combined with other approaches and strategies. The use of single versus multiple implementation approaches and strategies remains controversial. For example, a recent systematic review found that multiple strategies were more likely to achieve beneficial outcomes, in particular when they combined strategies meant to reach many individuals in a wide variety of settings (post, email, electronic, mass media), motivate interest in the evidence (champions, opinion leaders, social networks) and enhance ability to apply the evidence (additional information or tools that show how to incorporate the evidence into practice) [68]. Yet another rigorous meta-review of 25 systematic reviews that compared direct and indirect effect size and dose–response of single and multifaceted strategies showed no benefit of multifaceted over single strategies [69].
Implementation approaches and strategies were categorized according to the Mazza et al. taxonomy of guideline implementation strategies [12]. It was generated by mapping strategies employed by those whose research was presented in posters or presentations at conferences hosted by the Guidelines International Network onto the Effective Practice and Organisation of Care (EPOC) group’s data collection checklist [70]. The Mazza et al. taxonomy was easy to apply, and most strategies used in eligible studies could be readily categorized according to its components. This research added to the Mazza et al. taxonomy by identifying additional professional (print material, tailored guideline, self-audit) and patient (education, counselling, social networks, print material, reminders) strategies employed in eligible studies. The extended taxonomy that appears in Table 1 can be used by guideline developers, implementers, users or researchers to plan and undertake implementation. Another useful resource that identified and defined 68 discrete strategies for implementing not only guidelines, but a range of evidence-based health innovations, was generated by Powell et al. who compiled a framework from the components of 41 reviews published between 1995 and 2011 [71]. This was further refined and expanded to 73 discrete implementation strategies using a three-round expert Delphi process [72].
Print material aimed at both professionals and patients emerged as a commonly used strategy distinct from the distribution of guideline material which was already included in the Mazza et al. taxonomy. Research on print material offers conflicting evidence of their impact. For example, a systematic review found that print material such as medical journals or guidelines have a small impact on provider behaviour [73]. Yet, other research shows that providers and patients are most likely to benefit from guidelines that offer summaries or other tools that support guideline implementation [68], and experts have called upon those who generate guidelines to develop implementation tools [6,7]. International developers that we interviewed said that they required guidance for developing implementation tools [21]. Our analysis of instructional manuals for developing and implementing guidelines found an absence of such guidance [74]. Therefore, we consulted with members of the international guideline community to generate criteria, methods and considerations for developing guideline implementation tools [75,76].
This study features both strengths and limitations. This study is unique among other systematic reviews that examined the effectiveness of particular implementation strategies [13]. In comparison, this study attempted to identify the types of strategies that were used to implement guidelines on particular topics that may be challenged by unique barriers. Most studies provided sufficient detail about interventions such that the implementation approaches and strategies could be readily ascertained. Screening and data extraction were undertaken independently by multiple individuals to optimize reliability. However, several issues may limit the interpretation and use of these findings. Few studies were eligible, limiting the comparison of implementation approaches and strategies across clinical topics and limiting the pooling of data to assess determinants of strategies used or the impact of those interventions. Other systematic reviews of guideline implementation included a larger number of studies but spanned many more years and healthcare diseases or issues [13,60]. Of 32 eligible studies, 14 were assessed to have a low risk of bias. Since more than half of the studies had a moderate or high risk of bias, findings must be interpreted with some caution. Although we searched the two most relevant medical databases, the literature search may not have identified all relevant studies. We did not search the grey literature, assuming that most empirical research on guideline implementation would be found in indexed databases. Publication bias, or the tendency for journals to publish positive results, may have influenced the number and type of studies that were retrieved. No trends in implementation over time or by guideline characteristics were identified. Since the examination of guideline characteristics was based on guideline topic (hence, indirectly on guideline users), it was therefore limited to details that were reported in eligible studies. Other guideline characteristics may be relevant, but their influence on use and reported impact of implementation strategies would need to be assessed through primary data collection. The focus on four guideline topics may also have limited the ability to identify trends in the use and impact of guideline implementation strategies, so future research could repeat this study for additional guideline topics. However, given the limited yield of this scoping review, it is unclear whether similar reviews on additional clinical topics are warranted. Instead, rigorous primary research should be undertaken to optimize the design of interventions that would ultimately offer insight on the ideal implementation approaches and strategies. Such research may pursue two broad themes. This review identified numerous approaches and strategies that have not been used to implement guidelines on the topics examine in this study but warrant further investigation. This review also identified that, despite the availability of evidence, taxonomies, theories, models and instruments by which to plan implementation, guidelines are most often implemented using educational strategies and print material. Most of the studies reviewed here achieved positive impact, which perhaps conflicts with the results of systematic reviews demonstrating that educational meetings and print material have a small impact on professional behaviour [67,73]. Therefore, ongoing research might focus on ways to optimize the design of educational strategies and print material.
Conclusions
While few studies were eligible, limiting the identification of trends in guideline implementation and insight on how to choose implementation strategies that address guideline-specific barriers, this review identified other important findings. Education for professionals or patients and print material were the most commonly employed strategy for translating guidelines to practice. Mapping of strategies identified in eligible studies onto the Mazza et al. taxonomy [12] identified gaps in guideline implementation that represent opportunities for future research and expanded the Mazza et al. taxonomy which is a useful tool for classifying implementation strategies. Few interventions were planned based on theory, barrier assessment or other rationale. Most studies employed multiple approaches and strategies and achieved the desired impact. This did not appear to be associated with guideline topic or number or type of implementation approaches and strategies.
Declarations
Acknowledgements
Members of the Guidelines International Network Guideline Implementation Working Group reviewed this manuscript to further refine the interpretation of findings and enhance communication of the findings. They include the following: Melissa Armstrong, University of Maryland, United States; Sue Huckson, Australian and New Zealand Intensive Care Society; Roberta James, Scottish Intercollegiate Guidelines Network; Jorma Kormulainen, Finnish Medical Society Duodecim; Catherine Marshall, Guideline and Health Sector Consultant, New Zealand; Danielle Mazza, Monash University, Australia; Val Moore, National Institute for Health and Care Excellence, United Kingdom; and Sandra Zelman Lewis, EBQ Consulting, United States.
Funding
This study was undertaken with no funding.
Authors’ Affiliations
References
- Shekelle P, Woolf S, Grimshaw JM, Schunemann H, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.View ArticlePubMedPubMed CentralGoogle Scholar
- Institute of Medicine. Clinical practice guidelines we can trust. Washington, DC: National Academies Press; 2013.Google Scholar
- McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. NEJM. 2003;348:2635–45.View ArticlePubMedGoogle Scholar
- Sheldon TA, Cullum N, Dawson D, Lankshear A, Lowson K, Watt I, et al. What’s the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients’ notes, and interviews. BMJ. 2004;329:999.View ArticlePubMedPubMed CentralGoogle Scholar
- Runciman WB, Hunt TD, Hannaford NA, Hibbert PD, Westbrook JI, Coiera EW, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197:100–5.View ArticlePubMedGoogle Scholar
- Greenhalgh T, Howick J, Maskrey N. for the Evidence Based Renaissance Group. Evidence based medicine: a movement in crisis? BMJ. 2014;348:g37225.Google Scholar
- Pronovost PJ. Enhancing physicians’ use of clinical guidelines. JAMA. 2013;310:2501–2.View ArticlePubMedGoogle Scholar
- Francke AL, Smit MC, de Veer AJE, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals. BMC Med Inform Dec Mak. 2008;8:38.View ArticleGoogle Scholar
- Mickan S, Burls A, Glasziou P. Patterns of “leakage” in the utilization of clinical guidelines: a systematic review. Postgrad Med J. 2011;87:670–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:1–11.View ArticleGoogle Scholar
- Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3:CD005470.PubMedGoogle Scholar
- Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, et al. Refining a taxonomy of guideline implementation. Implement Sci. 2013;8:32.View ArticlePubMedPubMed CentralGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8:1–72.View ArticleGoogle Scholar
- Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9:102.View ArticlePubMedPubMed CentralGoogle Scholar
- Hagedorn HJ, Heidman PW. The relationship between baseline Organizational Readiness to Change Assessment subscale scores and implementation of hepatitis prevention services in substance use disorders treatment clinics: a case study. Implement Sci. 2010;5:46.View ArticlePubMedPubMed CentralGoogle Scholar
- Simpson KM, Porter K, McConnell ES, Colon-Emeric C, Daily KA, Stalzer A, et al. Tool for evaluating research implementation challenges. Implement Sci. 2013;8:2.View ArticlePubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Squires JE, Cummings GG, Birdsell JM, Norton PG. Development and assessment of the Alberta Context Tool. BMC Health Serv Res. 2009;9:234.View ArticlePubMedPubMed CentralGoogle Scholar
- Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Kajermo KN, Bostrom AM, Thompson DS, Hutchinson AM, Estabrooks CA, Wallin L. The BARRIERS scale – the barriers to research utilization scale: a systematic review. Implement Sci. 2010;5:32.View ArticlePubMedPubMed CentralGoogle Scholar
- Bartholomew LK, Parcel GS, Kok G. Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ Behav. 1998;25:545–63.View ArticlePubMedGoogle Scholar
- Gagliardi AR. “More bang for the buck”: exploring optimal approaches for guideline implementation through interviews with international developers. BMC Health Serv Res. 2012;12:404.Google Scholar
- Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.View ArticleGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. BMJ. 2009;339:b2535.View ArticlePubMedPubMed CentralGoogle Scholar
- McKibbon KA, Lokker C, Wilczynski NL, Cilisak D, Dobbins M, Davis DA, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel? Implement Sci. 2010;5:16.View ArticlePubMedPubMed CentralGoogle Scholar
- McKibbon KA, Lokker C, Wilczynski NL, Haynes RB, Ciliska D, Dobbins M, et al. Search filters can find some but not all knowledge translation articles in MEDLINE: an analytic survey. J Clin Epi. 2012;65:651–9.View ArticleGoogle Scholar
- Higgins JPT, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomized trials. BMJ. 2011;343:d5928.View ArticlePubMedPubMed CentralGoogle Scholar
- Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomized and non-randomized studies of health care interventions. J Epidemiol Community Health. 1998;52:377–84.View ArticlePubMedPubMed CentralGoogle Scholar
- Brosseau L, Wells GA, Brooks S, DeAngelis G, Bell M, Egan M, et al. People getting a grip on arthritis II. An innovative strategy to implement clinical practice guidelines for rheumatoid arthritis and osteoarthritis patients through Facebook. Health Edu J. 2013;73:109–25.View ArticleGoogle Scholar
- Lineker SC, Bell MJ, Badley EM. Evaluation of an inter-professional educational intervention to improve the use of arthritis best practices in primary care. J Rheumatol. 2011;38:931–7.View ArticlePubMedGoogle Scholar
- Laine L, Connors L, Griffin MR, Curtis SP, Kaur A, Cannons CP. Prescription rates of protective co-therapy for NSAID users at high GI risk and results of attempts to improve adherence to guidelines. Aliment Pharmacol Ther. 2009;30:767–74.View ArticlePubMedGoogle Scholar
- Rahme E, Choquette D, Beaulieu M, Bessette L, Joseph L, Toubouti Y, et al. Impact of a general practitioner educational intervention on osteoarthritis treatment in an elderly population. Am J Med. 2005;118:1262–70.View ArticlePubMedGoogle Scholar
- Jani A, Jenner L, Ma F, Dutton S, Stevens R, Sharma RA. Referral proformas improve compliance to national colorectal 2-week wait targets: does this affect cancer detection rates? Colorectal Dis. 2012;14:1351–6.View ArticlePubMedGoogle Scholar
- White MJ, Stark JR, Luckmann R, Rosal MC, Clemow L, Costanza ME. Implementing a computer-assisted telephone interview (CATI) system to increase colorectal cancer screening: a process evaluation. Patient Educ Counsel. 2006;61:419–28.View ArticleGoogle Scholar
- Myers RE, Turner B, Weinberg D, Hyslop T, Hauck WW, Brigham T, et al. Impact of a physician-oriented intervention on follow-up in colorectal cancer screening. Prev Med. 2004;38:375–81.View ArticlePubMedGoogle Scholar
- Butala NM, Chang H, Horwitz LI, Bartlett M, Ellis P. Improving quality of preventive care at a student-run free clinic. PLoS One. 2013;8:e81441.View ArticlePubMedPubMed CentralGoogle Scholar
- Hager KK, Loprinzi P, Stone D. Implementing diabetes care guidelines in long term care. J Am Med Dir Assoc. 2013;851:e7–15.Google Scholar
- Kuhne-Eversmann L, Fischer MR. Improving knowledge and changing behavior towards guideline based decisions in diabetes care: 1 controlled intervention study of a team-based learning approach for continuous professional development of physicians. BMC Res Notes. 2013;6:14.View ArticlePubMedPubMed CentralGoogle Scholar
- Steyn K, Lombard C, Gwebushe N, Fourie JM, Everett-Murphy K, Zwarenstein M, et al. Implementation of national guidelines, incorporated within structured diabetes and hypertension records at primary level care in Cape Town South Africa: a randomized controlled trial. Glob Health Action. 2013;6:20796.PubMedGoogle Scholar
- Flamm M, Panisch S, Winkler H, Johansson T, Weitgasser R, Sonnichsen AC. Effectiveness of the Austrian disease management programme “Therapie Aktiv” for type 2 diabetes regarding the improvement of metabolic control, risk profile and guideline adherence: 2 years of follow up. Wien Klin Wochenschr. 2012;124:639–46.View ArticlePubMedGoogle Scholar
- Reutens AT, Hutchinson R, Van Binh T, Cockram C, Deerochanawong C, Ho LT, et al. The GIANT study, a cluster-randomised controlled trial of efficacy of education of doctors about type 2 diabetes mellitus management guidelines in primary care practice. Diabetes Res Clin Pract. 2012;98:38–45.View ArticlePubMedGoogle Scholar
- Wallgren S, Berry-Cabán CS, Bowers L. Impact of clinical pharmacist intervention on diabetes-related outcomes in a military treatment facility. Ann Pharmacother. 2012;46:353–7.View ArticlePubMedGoogle Scholar
- Barcelo A, Cafiero E, de Boer M, Mesa AE, Lopez MG, Jiminez RA, et al. Using collaborative learning to improve diabetes care and outcomes: the VIDA project. Prim Care Diabetes. 2010;4:145–53.View ArticlePubMedGoogle Scholar
- Ciccone MM, Aquilino A, Cortese F, Scicchitano P, Sassara M, Mola E, et al. Feasibility and effectiveness of a disease and care management model in the primary health care system for patients with heart failure and diabetes (Project Leonardo). Vasc Health Risk Manag. 2010;6:297–305.View ArticlePubMedPubMed CentralGoogle Scholar
- Ena J, Casan R, Lozane T, Leach A, Algado JT, Navarro-Diaz FJ. Long-term improvements in insulin prescribing habits and glycaemic control in medical inpatients associated with the introduction of a standardized educational approach. Diabetes Res Clin Pract. 2009;85:159–65.View ArticlePubMedGoogle Scholar
- Guzek J, Guzek S, Murphy K, Patricia G, Lesneski C. Improving diabetes care using a multitiered quality improvement model. Am J Med Qual. 2009;24:505–11.View ArticlePubMedGoogle Scholar
- Hahn KA, Ferrante JM, Crosson JC, Hudson SV, Crabtree BF. Diabetes flow sheet use associated with guideline adherence. Ann Fam Med. 2008;5:235–8.View ArticleGoogle Scholar
- Rothe U, Muller G, Schwarz PEH, Seifert M, Kunath H, Koch R, et al. Evaluation of a diabetes management system based on practice guidelines, integrated care, and continuous quality management in a federal state of Germany. Diabetes Care. 2008;31:863–8.View ArticlePubMedGoogle Scholar
- Davies B, Edwards N, Ploeg J, Virani T. Insights about the process and impact of implementing nursing guidelines on delivery of care in hospitals and community settings. BMC Health Serv Res. 2008;8:29.View ArticlePubMedPubMed CentralGoogle Scholar
- Sipila R, Ketola E, Tala T, Kumpusalo E. Facilitating as a guidelines implementation tool to target resources for high risk patients – The Helsinki Prevention Programme (HPP). J Interprof Care. 2008;22:31–44.View ArticlePubMedGoogle Scholar
- Jones D, Curry W. Impact of a PDA-based diabetes electronic management system in a primary care office. Am J Med Qual. 2006;21:401–7.View ArticlePubMedGoogle Scholar
- Siminerio LM, Piatt G, Zgibor JC. Implementing the chronic care model for improvements in diabetes care and education in a rural primary care practice. Diabetes Educ. 2005;31:225–34.View ArticlePubMedGoogle Scholar
- Dijkstra RF, Niessen LW, Braspenning JCC, Adang E, Grol RTPM. Patient-centred and professional-directed implementation strategies for diabetes guidelines: a cluster-randomized trial-based cost-effectiveness analysis. Diabet Med. 2005;23:164–70.View ArticleGoogle Scholar
- O’Connor PJ, Crain AL, Rush WA, Sperl-Hillen JM, Gutenkauf JJ, Duncan JE. Impact of an electronic medical record on diabetes quality of care. Ann Fam Med. 2005;3:300–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Abbasi AA, Grumberger G, Parikh S, Nicola M, Gherlan C, Turan A, et al. Diabetes care credit system: a model for comprehensive and optimal diabetes care. Endocr Pract. 2004;10:187–94.View ArticlePubMedGoogle Scholar
- Zgibor JC, Rao H, Wesche-Thobaben J, Gallagher N, McWillinms J, Korytkozuski MT. Improving the quality of diabetes care in primary care practice. J Healthc Qual. 2004;26:14–21.View ArticlePubMedGoogle Scholar
- Willens HJ, Nelson K, Hendel RC. Appropriate use criteria for stress echocardiography: impact of updated criteria on appropriateness ratings, correlation with pre-authorization guidelines, and effect on temporal trends and an educational initiative on utilization. JACC Cardiovasc Imaging. 2013;6:297–309.View ArticlePubMedGoogle Scholar
- Aziz EF, Pratap B, De Benedetti Zunino ME, Tormey D, Javed F, Frankenberger O, et al. Success in implementing a hospital-wide evidence-based clinical pathways system for the management of cardiac patients. Crit Pathw Cardiol. 2011;10:22–8.View ArticlePubMedGoogle Scholar
- Goud R, de Keizer NF, ter Riet G, Wyatt JC, Hasman A, Hellemans IM, et al. Effect of guideline based computerized decision support on decision making of multidisciplinary teams: cluster randomized trial in cardiac rehabilitation. BMJ. 2009;338:b1440.View ArticlePubMedPubMed CentralGoogle Scholar
- Lainscak M. Implementation of guidelines for management of heart failure in heart failure clinic: effects beyond pharmacological treatment. Int J Cardiol. 2004;97:411–6.View ArticlePubMedGoogle Scholar
- Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:1–6.View ArticleGoogle Scholar
- Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, et al. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci. 2013;8:1–8.View ArticleGoogle Scholar
- Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:1–11.View ArticleGoogle Scholar
- Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S. Publication guidelines for quality improvement in health care: evolution of the SQUIRE project. Qual Saf Health Care. 2008;17 Suppl 1:i3–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Albrecht L, Archibald M, Arseneau D, Scott SD. Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013;8:1–5.View ArticleGoogle Scholar
- Thompson GN, Estabrooks CA, Degner LF. Clarifying the concepts in knowledge transfer: a literature review. J Adv Nurs Pract. 2006;53:691–701.View ArticleGoogle Scholar
- Gagliardi AR, Marshall C, Huckson S, James R, Moore V. Developing a checklist for guideline implementation planning: review and synthesis of guideline development and implementation advice. Implement Sci. 2015 (in press)Google Scholar
- Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;2:CD003030.PubMedGoogle Scholar
- McCormack L, Sheridan S, Lewis M, Boudewyns V, Melvin CL, Kistler C, et al. Communication and dissemination strategies to facilitate the use of health-related evidence. Evidence Report/Technology Assessment No. 213. AHRQ Publication No. 13(14)-E003-EF. Agency for Healthcare Research and Quality: Rockville, MD; 2013.Google Scholar
- Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single component interventions in changing healthcare professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014, 9:.Google Scholar
- Cochrane Effective Practice and Organisation of Care Review Group. Data Collection Checklist. Ottawa, Canada: Effective Practice and Organisation of Care Review Group, 2002. https://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf
- Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57.View ArticlePubMedGoogle Scholar
- Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.View ArticlePubMedPubMed CentralGoogle Scholar
- Giguere A, Legare F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;10:CD004398.PubMedGoogle Scholar
- Gagliardi AR, Brouwers MC. Integrating guideline development and implementation: analysis of guideline development manual instructions for generating implementation advice. Implement Sci. 2012;7:67.View ArticlePubMedPubMed CentralGoogle Scholar
- Gagliardi AR, Brouwers MC, Bhattacharyya O. A framework of the desirable features of guideline implementation tools (GItools): Delphi survey and assessment of GItools. Implement Sci. 2014;9:98.View ArticlePubMedPubMed CentralGoogle Scholar
- Gagliardi AR, Brouwers MC, Bhattacharyya O. Developing implementation tools: contributing to an identified gap in the guideline enterprise. CMAJ Open. 2015 (in press).Google Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
