Refining a taxonomy for guideline implementation: results of an exercise in abstract classification

  • Danielle Mazza1Email author,

    Affiliated with

    • Phillip Bairstow2,

      Affiliated with

      • Heather Buchan3,

        Affiliated with

        • Samantha Paubrey Chakraborty1,

          Affiliated with

          • Oliver Van Hecke1,

            Affiliated with

            • Cathy Grech1 and

              Affiliated with

              • Ilkka Kunnamo4

                Affiliated with

                Implementation Science20138:32

                DOI: 10.1186/1748-5908-8-32

                Received: 21 September 2012

                Accepted: 27 February 2013

                Published: 15 March 2013



                To better understand the efficacy of various implementation strategies, improved methods for describing and classifying the nature of these strategies are urgently required. The aim of this study was to develop and pilot the feasibility of a taxonomy to classify the nature and content of implementation strategies.


                A draft implementation taxonomy was developed based on the Cochrane Effective Practice and Organisation of Care (EPOC) data collection checklist. The draft taxonomy had four domains (professional, financial, organisational and regulatory) covering 49 distinct strategies. We piloted the draft taxonomy by using it to classify the implementation strategies described in the conference abstracts of the implementation stream of the 2010 Guideline International Network Conference. Five authors classified the strategies in each abstract individually. Final categorisation was then carried out in a face-to-face consensus meeting involving three authors.


                The implementation strategies described in 71 conference abstracts were classified. Approximately 15.5% of abstracts utilised strategies that could not be categorised using the draft taxonomy. Of those strategies that could be categorised, the majority were professionally focused (57%). A total of 41% of projects used only one implementation strategy, with 29% using two and 31% three or more. The three most commonly used strategies were changes in quality assurance, quality improvement and/or performance measurement systems, changes in information and communication technology, and distribution of guideline materials (via hard-copy, audio-visual and/or electronic means).


                Further refinement of the draft taxonomy is required to provide hierarchical dimensions and granularity, particularly in the areas of patient-focused interventions, those concerned with audit and feedback and quality improvement, and electronic forms of implementation, including electronic decision support.


                Guideline implementation Taxonomy Interventions EPOC checklist Ontology


                Effective implementation strategies are necessary for improving the uptake and use of clinical practice guidelines by the intended guideline audience [1, 2]. We define ‘implementation strategy’ as a purposeful procedure to achieve clinical practice compliance with a guideline recommendation. There are, however, a number of barriers to consider when selecting which implementation strategies to pursue; chief among these is the dearth of systematic evidence to support effective guideline implementation, and a lack of a purposeful, rigorously developed framework for the planning, implementing and reporting of intervention strategies [3].

                The lack of such a framework inhibits the shared understanding of the exact nature of specific implementation strategies, which makes it difficult to design and conduct effectiveness studies to investigate differences between strategies [46]. This is amplified by a number of factors, such as the variability in reported structure and definition of the nature of the strategies [6], the level of detail used to describe the strategies, lack of specification regarding the intended user of the strategy, and variability in the language used to describe the design of the strategy [4]. Difficulties in assessing the effectiveness of implementation strategies could also be due to variations in the designs of implementation strategies. For example, the effectiveness of audit and feedback strategies in healthcare settings is related to features such as providing correct solution information in the feedback, providing written feedback, and more frequent feedback being incorporated into the feedback strategy [7].

                The lack of clarity with regards to the nature of implementation strategies obscures the understanding of study outcomes, making it difficult to correlate findings from a range of data sets or to pool data from several studies in a systematic review to determine the effectiveness of a specific strategy [4]. The lack of an agreed and consistent taxonomy for describing the available strategies in the literature also poses a difficulty for those wishing to publish their findings about the effectiveness of various implementation strategies [8].

                Why develop a taxonomy?

                Taxonomies are effective modes of information management that have been used successfully in medicine, business systems, and information technology to describe, classify, and organise items on the basis of shared characteristics [9, 10]. A taxonomy of implementation strategies would provide a standardised framework for the consideration of strategies to improve the uptake of evidence into practice. Specifically, it could improve the clarity of definitions of specific implementation strategies, provide researchers with criteria with which to improve the quality of reporting of research, provide those involved in implementation with the tools to find and assess the effectiveness of various strategies, and assist end users to undertake purposefully defined steps to ensure behavioural change [11]. There is a growing body of literature describing implementation strategies [12], and these descriptions can inform a scheme for the categorisation of these strategies [13].

                Value of current reporting systems and structures for reporting implementation research

                A number of strategies have been developed to provide authors with publication guidelines for reporting the outcomes of implementation research. While these are widely used, they do not provide the level of detail required for defining and reporting the nature of implementation strategies [14, 15]. The most commonly used publication guidelines are the Consolidated Standards Of Reporting Trials (CONSORT) [16], Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) [17], and STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) [18] statements, which have been used to guide the reporting of randomised controlled trials, non-randomised trials, or cohort, case–control, and cross-sectional studies, respectively.

                While these guidelines and other statements have been widely used to provide researchers with a concise and practical method to assess and report implementation strategies, there is still a need for improved reporting of implementation strategies and for more sophisticated guidelines for reporting different strategies [6, 8]. Some guidelines do not provide sufficient information on the definition or design of individual strategies; instead, there is a reliance on authors to be specific, detailed, and to use terminology that is consistent with other researchers [6, 14, 15, 19]. The Workgroup for Intervention Development and Evaluation Research (WIDER) group have proposed a set of recommendations to journal editors for improving the reporting of behaviour change interventions and their evaluations in accordance with CONSORT statements [20]. While these recommendations are yet to be widely implemented, they could improve the understanding and replication of behaviour change interventions reported in literature.

                Taxonomies in development

                Numerous topic-specific taxonomies of implementation strategies have been reported in the literature [2123]; however, their specificity prevents them from offering a comprehensive view of strategies for effective guideline implementation. Two additional tools that provide broad guidance on implementation strategies are the Intervention Taxonomy (ITAX) [24] and Effective Practice and Organisation of Care (EPOC) Data Collection Checklist [25]. The ITAX provides a comprehensive list of features that make up an implementation strategy (e.g., mode, materials, location, schedule, scripting sensitivity to participant characteristics, intervention characteristics, adaptability, and treatment implementation); however, each of these aspects is addressed separately [24]. In contrast, the EPOC checklist enables considerations of combinations of factors involved in implementation by distinguishing between four domains: professional strategies, organisational strategies, financial strategies, and regulatory strategies [25]. The EPOC checklist was created for the purpose of assisting a group of reviewers to select papers for inclusion in a systematic review [25], rather than for guideline implementers to select the appropriate implementation strategy. Nevertheless, these domains are in line with the intervention categories described in the literature [2, 26] and, as such, were used as a starting point to develop the taxonomy described in this paper.


                The aim of our study was to draft an implementation taxonomy and to pilot its usefulness and feasibility as a tool for classifying implementation strategies.


                Development of the taxonomy

                The development of the taxonomy occurred after correspondence between two of the authors (IK, PB) about taxonomies that could be applied in the implementation of the Diagnostic Imaging Pathways Application (http://​www.​imagingpathways.​health.​wa.​gov.​au). The EPOC Data Collection checklist was used as a starting point, which led to an interest in a broader approach of using the EPOC checklist items (see EPOC Data Collection Checklist) to classify the abstracts from the 2008 and 2009 Guidelines International Network (G-I-N) Conferences. G-I-N is a network of guideline organisations, implementers, end-users, researchers, students, and other stakeholders who are working towards improving the efficiency and effectiveness of evidence-based guideline development, adaptation, dissemination and implementation (http://​www.​g-i-n.​net/​). The classification of abstracts using the EPOC checklist led to some difficulties, which included difficulty in relating the prose of the checklist items to guideline implementation, repeated efforts to read and re-read checklist items because of the length of the definition and inclusion criteria, some checklist items were irrelevant to guideline implementation, lack of a logical order with checklist items within major categories, checklist items inappropriately categorised, and the absence of checklist items that describe some well-established methods of guideline implementation. Consequently, a revised taxonomy was drafted based on the EPOC checklist, which included 49 items listed under four broad domains: professional, financial, organisational, and regulatory.

                Summary of items from the EPOC Data Collection Checklist in the category of ‘Type of intervention’ (excluding definitions and inclusion criteria)

                Types of interventions

                Professional interventions

                Distribution of educational materials

                Educational meetings

                Local consensus processes

                Educational outreach visits

                Local opinion leaders

                Patient mediated interventions

                Audit and feedback



                Mass media


                Financial interventions

                Provider interventions




                Provider salaried service

                Prospective payment

                Provider incentives

                Institutional incentives

                Provider grant/allowance

                Institution grant/allowance

                Provider penalty

                Institution penalty



                Patient interventions




                Patient incentives

                Patient grant/allowance

                Patient penalty


                Organisational interventions

                Provider orientated interventions

                Revision of professional roles

                Clinical multidisciplinary teams

                Formal integration of services

                Skill mix changes

                Continuity of care

                Satisfaction of providers

                Communication and case discussion


                Patient orientated interventions

                Mail order pharmacies

                Presence and functioning of adequate mechanisms for dealing with patients’ suggestions and complaints

                Consumer participation in governance of health care organisation


                Structural interventions

                Changes in the setting/site of service delivery

                Changes in physical structure, facilities and equipment

                Changes in medical records systems

                Changes in scope and nature of benefits and services

                Presence and organisation of quality monitoring mechanisms

                Ownership, accreditation, and affiliation status of hospitals and other facilities

                Staff organisation


                Regulatory interventions

                Changes in medical liability

                Management of patient complaints

                Peer review



                Pilot and feasibility testing of the updated taxonomy

                To test its utility and comprehensiveness, we applied our draft taxonomy to a convenience sample of conference abstracts from the implementation stream of the 2010 G-I-N Conference. Abstracts were independently classified by five reviewers (DM, IK, PB, OVH, CG) using the draft taxonomy.

                Reviewers utilised a classification template developed by HB that assessed whether the abstract referred to a research study, whether the study described strategies used to implement a guideline, which of the strategies in the draft taxonomy could be used to categorise the reported interventions, and whether the study described a method for measuring the impact/outcome of implementation. Three of the reviewers (DM, OVH, CG) then met face-to-face to establish a consensus regarding the exact implementation strategies used in the relevant abstracts and to highlight areas of the taxonomy requiring further refinement.

                The draft taxonomy and outcomes from the pilot study were presented to a self-selected group of interested participants who attended a G-I-N meeting workshop in 2011, and feedback was sought from this group about the purpose, design and content of the draft taxonomy.


                Components of the taxonomy

                Our draft taxonomy comprises four domains of intervention types: professional, financial, organizational, and regulatory. These domains were preserved from the original EPOC checklist. Within the taxonomy, 49 implementation strategies are described: 15 strategies targeting health professionals; 12 strategies involving financial incentives for guideline implementers (eight) and for patients (four); 18 involving organisational strategies at an implementer level (six), at a patient level (three), and at a structural level (nine); and 4 strategies involving structural change. The draft taxonomy is provided as Additional File 1.

                Results of pilot testing

                The following findings relate to the application of the updated draft taxonomy to the abstracts from the implementation stream of the G-I-N 2010 Conference.

                Overview of abstracts

                A total of 85 abstracts were available for inclusion in the pilot study. Of these, 71 abstracts included a description of guideline implementation strategies and were, therefore, used in the study. Fifty-six abstracts described original research studies involving guideline implementation, and 15 abstracts described non-research studies (projects) involving guideline implementation.

                Number of strategies described in each study

                A total of 170 implementation strategies were described in the 71 abstracts. Figure 1 shows the variability in the number of guideline implementation strategies described in abstracts. The majority of abstracts (60%) reported using two or more strategies in their study. The most common strategies used were single-strategy (41%) or a combination of two strategies (29%).
                Figure 1

                Number of interventions described in each study (n = 71).

                Use of the domains of the taxonomy

                All four domains of the taxonomy were utilised in the assessment of the abstracts. However, the implementation strategies were spread disproportionately across the four domains (Figure 2). Strategies focusing on ‘professional’ aspects were employed most often, followed by ‘organisational’ strategies, while ‘financial’ and ‘regulatory’ strategies were utilised minimally in the activities described by the abstracts.
                Figure 2

                Distribution of interventions by domains of the taxonomy (n = 170).

                Use of strategies within domains of the taxonomy

                The most commonly used strategies are presented in Table 1. Similar to the characterisation of strategies by domain, all of the top 10 strategies for guideline implementation referred to either professional (seven strategies) or organisational changes (three strategies). The frequency at which each implementation strategy was reported is presented in Table 2. Of the list comprising 49 possible strategies, 18 of these were not utilised at all by researchers presenting their work in the implementation stream of the G-I-N meeting in 2010. A number of other strategies involving the financial and regulatory domains or strategies involving patients were also minimally utilised.
                Table 1

                Hierarchy of top 10 most used strategies

                Strategy (Domain)

                Number of abstracts (%)

                Change in quality assurance, quality improvement and/or performance measurement systems (Organisational)

                23 (32)

                Change in information & communication technology (Organisational)

                21 (30)

                Distribute guideline materials (Professional)

                17 (24)

                Identify barriers to guideline implementation (Professional)

                15 (21)

                Educate groups of health care professionals (Professional)

                15 (21)

                Creation of an implementation team (Organisational)

                10 (14)

                Other (Professional)

                10 (14)

                Feedback guideline compliance data and information (Professional)

                9 (13)

                Educate individual health care professionals (Professional)

                6 (8)

                Provide reminders (Professional)

                6 (8)

                Table 2

                Number of abstracts identifying each implementation strategy

                Item No.


                Number of abstracts

                1 Professional Strategies



                Distribute guideline materials



                Identify barriers to guideline implementation



                Educate groups of health care professionals






                Feedback guideline compliance data and information



                Educate individual health care professionals



                Provide reminders



                Recruit an opinion leader



                Advertise guideline materials



                Present guideline materials at meetings



                Achieve consensus



                Provide alerts



                Feedback data and information about



                Feedback data and information from patients



                Feedback information from health care professionals


                2.1 Financial Strategies (implementer)



                Grant or allowance provided to a health care professional



                Incentive applicable available to the institution



                Grant or allowance provided to the institution



                Incentive applicable to a health care professional



                Penalty applicable to a health care professional



                Penalty applicable to the institution



                Change in reimbursement





                2.2 Financial Strategies (patient)



                Incentive applicable to a patient



                Grant or allowance provided to a patient



                Penalty applicable to a patient





                3.1 Organisational Strategies (implementer)



                Creation of an implementation team



                Additional human resources



                Reallocated roles



                Communication between distant health professionals



                Improved health care professional satisfaction





                3.2 Organisational Strategies (patient)



                Consumer participation



                Consumer feedback, suggestions and complaints





                3.3 Organisational Strategies (structure)



                Change in quality assurance, quality improvement and/or performance measurement systems Change in the method



                Change in information & communication technology



                Change in the method



                Change in organizational structure



                Change in the integration of services



                Change to the setting or site



                Change in the physical structure, facilities or equipment



                Change in risk management provisions





                4 Regulatory Strategies



                Change in legislation or regulation






                Change in the ownership or affiliation



                Change in licensing, credentialing or accreditation


                Appropriateness of nomenclature used in the taxonomy

                The distribution of reported implementation strategies among the domains of the taxonomy are presented in Table 2. Of note was the inability of the taxonomy to accurately classify strategies described in a large number of abstracts in this study beyond that of the broad domains. A total of 11 of the 71 abstracts (15.5%) utilised strategies that could not be categorised using the draft taxonomy. Ten of these were ‘other’ professional strategies, which included ‘a bundle of care approach,’ ‘development of resources,’ and ‘algorithm,’ while one referred to an ‘other’ organisational structure-related strategy.


                Using the EPOC checklist as a starting point to code strategies described in abstracts from the 2008 and 2009 G-I-N Conferences, we drafted an implementation taxonomy, which was subsequently used to classify implementation strategies described in the abstracts from the implementation stream of the 2010 G-I-N Conference. Although all four domains (professional, financial, organisation, and regulatory) were utilised in the assessment of the abstracts, our draft taxonomy proved inadequate when attempting to further classify some of the implementation strategies using the subgroups within these domains.

                Content-related issues

                All of the domains in our draft taxonomy were successfully applied to the abstracts, which supports their usefulness as broad categorisations. However, further classification of the abstracts using the categories within each domain yielded a high number of strategies that were classified as ‘other’. Use of the ‘other’ category is likely due to the level of detail available in abstracts, which could be overcome by reviewing a full-text article. However, it may also point to the need for better granularity within the taxonomy to allow more accurate classification of strategies. Further investigation is required to identify and understand the types of strategies that have not been included in the current version of the EPOC taxonomy.

                The language and clarity of our draft taxonomy were assessed using feedback received from attendees at a workshop on the taxonomy, which was held at the G-I-N 2011 meeting. In general, the taxonomy was found to be sufficiently detailed to enable classification. However, in some instances, items were found to be less explicit. For example, the strategy ‘identify barriers’ does not specify the type of barrier or the method used for identification.

                Design-related issues

                A number of design-related issues were also identified by the authors when the draft taxonomy was used to classify the abstracts. The level of detail included in each subgroup of the taxonomy was, in some instances, not sufficiently detailed to distinguish differences between two items on the checklist. For example, problems arose when trying to differentiate reminders and recalls from other forms of electronic implementation and when differentiating audit and feedback from other quality improvement activities. These issues support the need for improving the granularity of the taxonomy.

                The focus on interventions for health professionals in this taxonomy also overlooks other groups of individuals, such as patients and key decision makers, who play a critical role in the health system. There is an increasing recognition of the benefits of patient involvement in healthcare, particularly in patient-centred health care and shared decision-making [2730]. As such, it is important to consider implementation strategies aimed at improving the role of consumers in the implementation of guidelines. For example, the draft taxonomy, at present, provides only seven possibilities for patient-directed strategies, which fit within the ‘Financial’ or ‘Structural’ domains, while a substantial portion of the taxonomy describes strategies for health professionals. The scarcity of consumer-related implementation strategies in the EPOC taxonomy may be supplemented with strategies identified by the EPOC Consumers and Communication Group and published via the Cochrane Library, as well as other current literature.

                In addition to health professionals and patients, knowledge translation in health care involves other groups such as policy makers, government officials, membership bodies, and non-government organisations. The present structure of the taxonomy does not permit consideration of the specific roles of these groups within the healthcare system and, as such, would require revision to ensure that implementation strategies aimed at behaviour change in a range of participants within the healthcare system are included in the framework.

                Multifaceted strategies

                Following the process of classifying implementation strategies using our draft taxonomy, we found that the majority of abstracts reported the use of two or more strategies. The use of multiple strategies by some guideline implementers (with some abstracts describing six or more activities) suggests that implementers are cautious about confining themselves to a select number of strategies. Alternatively, it suggests that the use of multiple strategies is assumed to be more effective because it addresses more barriers [31]. Nevertheless, the use of multiple strategies highlights the difficulty in determining causality and, in turn, the effectiveness of individual implementation strategies when more than one is used.

                It is also currently unclear how guideline implementers select the number of strategies required to facilitate the implementation of a guideline. While a number of studies have demonstrated improved patient outcomes after multifaceted interventions [32], more evidence is required to demonstrate the optimal number or combination of strategies for guideline implementation and the circumstances under which the number of strategies is most beneficial.

                Professional and organisational strategies

                The results of our study showed that the commonly used implementation strategies described within the abstracts were either professional or organisational. These results may reflect the fact that: there is more evidence to support the use of these strategies; these strategies are more accessible to guideline implementers in general; or these strategies are more accessible to the cohort of presenters at the G-I-N Conference who are likely to be researchers [33]. Conversely, the low utilisation of financial and regulatory interventions in the selected abstracts may reflect the fact that research involving these implementation strategies is not being sufficiently reported in scientific fora. Low usage of financial and regulatory interventions may also reflect the capabilities of the authors of these research papers, who may be clinicians or academics working in healthcare settings, to access these strategies.

                Limitations of the study

                We identified a few limitations in our study. The review of abstracts provided a lower level of detail compared to that of a full-text article. In some instances, this lower level of detail made it difficult to accurately classify the implementation strategies described in the abstract. In these instances, it is difficult to ascertain if the inability to classify a strategy is due to the detail and accuracy of the abstract or the draft taxonomy itself. Nevertheless, abstracts are usually the first ‘screening point’ for published papers and, therefore, it is important that abstracts, as well as full-text articles, include a sufficient level of detail to inform the reader about strategies that were used.

                Another limitation of this study is the use of abstracts from the G-I-N Conference. Applying the taxonomy on these abstracts may yield optimistic depictions of guideline implementation, because the participants at this conference are likely to be more conscientious about the implementation of guidelines than people in the broader academic or healthcare community. Nevertheless, these abstracts provide a good basis for testing our draft taxonomy as they are screened and selected by an expert panel and, therefore, the reporting of details in these abstracts is likely to be of a higher standard than those published in the wider literature. Further development of our draft taxonomy will include its application on full-text articles, which would greatly enhance its utility, validity, and relevance.

                Next steps

                This first draft of the taxonomy utilised a flat structure to create a blueprint of a potential hierarchical format of the taxonomy. Knowledge translation can, however, occur in three dimensions: linear, cyclic, and multi-dimensional [34], and guideline implementation requires a complex assessment of considerations of different interventions, levels of intervention, target groups, and contextual differences [8, 11]. Our draft taxonomy could be altered so that strategies can be classified across many dimensions or elements. For example, a patient-based implementation tool that is also information technology-based and gives feedback to a doctor may be viewed as having three dimensions. This multi-dimensional approach to implementation could be supported by expanding the taxonomy into a multi-dimensional framework or an ontology to aid guideline developers and implementers to consider the relationships between components that make up implementation strategies [35, 36]. A taxonomy of interventions could also be used in conjunction with an appropriate reporting structure, as it complements current reporting guidelines by providing definitions for a broad categorisation of intervention strategies.

                Behavioural change techniques may also intersect with guideline implementation strategies. It is therefore important to consider the reliability of language and coding for implementation strategies used within the guideline, as these could contribute to guideline implementation but could also be classified as behavioural change [37]. Future iterations of the taxonomy should, therefore, consider whether behavioural change techniques need to be differentiated from guideline implementation strategies and if so, how this can be done.


                Further development of our draft implementation taxonomy should include a review of other taxonomies for supplementary items that may be relevant to our current taxonomy and the inclusion of strategies that were classified as ‘other’ in the current draft. This could result in a more useful tool for guideline implementers and researchers. A discussion of the strengths and weaknesses of our taxonomy in comparison to other published taxonomies, including those related to specific healthcare settings [38], would also increase its validity. Specific revisions to the taxonomy will need to consider the expansion of professional strategies to include the range of professionals, consumers, and other groups involved in implementation and the development of a hierarchical structure or possibly a multi-dimensional ontological framework. Further investigation is also required as to which strategies should be included in the ‘other’ category; and the feasibility study needs to be replicated using published research papers instead of abstracts. Input from other implementation science experts should also be sought to strengthen the validity of our draft taxonomy. Nevertheless, we believe that our draft taxonomy is likely to be applicable to other settings, given that the development process involved the use of abstracts from the G-I-N Conference, which attracts implementations researchers from various settings.

                While there continue to be issues relating to the reporting of interventions (e.g., the rigour of design and reporting of research versus evaluation), the availability of a taxonomy moves us one step closer to providing structure for reporting and assessing implementation strategies. Guideline implementers and researchers would also benefit from the availability of a well-indexed database of implementation studies, which would facilitate the search for and identification of suitable implementation strategies. One such example is the Health Evidence Database Classification (http://​www.​mcmasterhealthfo​rum.​org/​healthsystemsevi​dence-en), which is a database that contains research evidence about governance, finance, and delivery arrangements of healthcare systems, as well as implementation strategies. Improving the accuracy and granularity of the MeSH vocabulary [39] for describing implementation research would also facilitate the indexing of implementation strategies.

                However, the use of a taxonomy in research reports does not, by any means, reduce the need to describe the implementation strategy in detail. Sufficient information is still needed to enable implementers to replicate the strategy in other locations and settings, which is often not the case even in treatment trials [40]. Recommendations and checklists such as the Guideline for Reporting EBP Educational interventions and Teaching (GREET) statement, which is being developed for educational interventions, will be helpful [41].


                Further refinement of the draft taxonomy is required to provide hierarchical dimensions and granularity, particularly in the areas of patient-focused interventions, those concerned with audit and feedback, quality improvement, electronic forms of implementation, and reminders and alerts which might arise from electronic decision support. Also, as several groups and organizations develop implementation taxonomies, better collaboration between them is urgently needed. Groups such as G-I-N and the EPOC Review Group could provide leadership in this area and facilitate collaborations to produce an implementation taxonomy that has been reached by consensus and applies to all areas of implementation research.



                Consolidated Standards Of Reporting Trials


                Transparent Reporting of Evaluations with Nonrandomized Designs


                Strengthening the Reporting of OBservational studies in Epidemiology


                Standards for Quality Improvement Reporting Excellence


                Reach Effectiveness Adoption Implementation Maintenance


                Intervention Taxonomy


                Effective Practice and Organisation of Care


                Guidelines International Network.



                The Guidelines International Network (G-I-N) is an international not-for-profit association of organisations and individuals involved in the development and use of clinical practice guidelines. G-I-N is a Scottish Charity, recognised under Scottish Charity Number SC034047. More information on the Network and its activities are available on its website: http://​www.​g-i-n.​net. This paper/presentation reflects the views of its authors, and G-I-N is not liable for any use that may be made of the information contained therein.

                Dr Amir Qaseem provided critical review and valuable feedback on the manuscript. Dr Maria de Leon-Santiago provided assistance in the preparation of this manuscript.

                Authors’ Affiliations

                Department of General Practice, School of Primary Health Care, Faculty of Medicine Nursing and Health Sciences, Monash University
                Diagnostic Imaging Pathways, Royal Perth Hospital
                Australian Commission on Safety and Quality in Health Care
                The Finnish Medical Society Duodecim


                1. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA 1999,282(15):1458–1465.PubMedView Article
                2. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003,362(9391):1225–1230.PubMedView Article
                3. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE: Knowledge translation of research findings. Implement Sci 2012, 7:50.PubMedView Article
                4. Michie S, Abraham C, Eccles M, Francis J, Hardeman W, Johnston M: Strengthening evaluation and implementation by specifying components of behaviour change interventions: a study protocol. Implement Sci 2011,6(10):10.PubMedView Article
                5. Greenhalgh T, Wong G, Westhorp G, Pawson R: Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES). BMC Med Res Meth 2011, 11:115.View Article
                6. Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Glasziou P, Ilott I, Kinmonth AL, Leng G: An implementation research agenda. Implement Sci 2009, 4:18.PubMedView Article
                7. Hysong SJ: Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care 2009,47(3):356–363.PubMedView Article
                8. Michie S, Fixsen D, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009, 4:40.PubMedView Article
                9. Su WM, Osisek PJ, Starnes B: Using the revised bloom's taxonomy in the clinical laboratory: thinking skills involved in diagnostic reasoning. Nurse Educat 2005,30(3):117–122.View Article
                10. Venkatesh V, Morris MG, Gordon BD, Davis FD: User Acceptance of Information Technology: Toward a Unified View. MIS Q 2003,27(3):425–478.
                11. Ward V, House A, Hamer S: Developing a framework for transferring knowledge into action: a thematic analysis of the literature. J Health Serv Res Pol 2009, 14:156–164.View Article
                12. Mitton C, Adair C, McKenzie E, Patten S, Waye Perry B: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q 2007, 85:729–768.PubMedView Article
                13. Abraham C, Michie S: A taxonomy of behavior change techniques used in interventions. Heal Psychol 2008,27(3):379–387.View Article
                14. Mann E, Meyer G: Reporting quality of conference abstracts on randomised controlled trials in gerontology and geriatrics: a cross-sectional investigation. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen 2011,105(6):459–462.PubMedView Article
                15. Wang L, Li Y, Li J, Zhang M, Xu L, Yuan W, Wang G, Hopewell S: Quality of reporting of trial abstracts needs to be improved: using the CONSORT for abstracts to assess the four leading Chinese medical journals of traditional Chinese medicine. Trials 2010, 11:75.PubMedView Article
                16. Schulz KF, Altman DG, Moher D: CONSORT statement: Updated guidelines for reporting parallel group randomised trials. J Pharmacol Pharmacother 2010,1(2):100–107.PubMedView Article
                17. Des Jarlais DC, Lyles C, Crepaz N, Group T: Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health 2004,94(3):361–366.PubMedView Article
                18. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 2007,370(9596):1453–1457.PubMedView Article
                19. McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus SE: A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel? Implement Sci 2010, 5:16.PubMedView Article
                20. WIDER: Recommendations to Improve Reporting of the Content of Behaviour Change Interventions. [http://​interventiondesi​gn.​co.​uk/​wp-content/​uploads/​2009/​02/​wider-recommendations.​pdf]
                21. Lamb SE, Becker C, Gillespie LD, Smith JL, Finnegan S, Potter R, Pfeiffer K, Taxonomy I: Reporting of complex interventions in clinical trials: development of a taxonomy to classify and describe fall-prevention interventions. Trials 2011, 12:125.PubMedView Article
                22. Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP: A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Heal 2011,26(11):1479–1498.View Article
                23. Michie S, Hyder N, Walia A, West R: Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav 2011,36(4):315–319.PubMedView Article
                24. Schulz R, Czaja SJ, McKay JR, Ory MG, Belle SH: Intervention taxonomy (ITAX): describing essential features of interventions. Am J Heal Behav 2010,34(6):811–821.
                25. Cochrane Effective Practice and Organisation of Care Review Group: Data Collection Checklist. Ontario: Institute of Population Health. University of Ottawa; 2011.
                26. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Tech Assess 2004,8(6):1–72.
                27. Hahn SR: Adherence to antidepressant medication: patient-centered shared decision making communication to improve adherence. CNS spectrums 2009,14(12 Suppl 14):6–9.PubMed
                28. Politi MC, Clark MA, Ombao H, Dizon D, Elwyn G: Communicating uncertainty can lead to less decision satisfaction: a necessary cost of involving patients in shared decision making? Heal. Expect 2010,14(1):84–91.View Article
                29. Siegel RM: Acute otitis media guidelines, antibiotic use, and shared medical decision-making. Pediatrics 2010,125(2):384–386.PubMedView Article
                30. Wilson SR, Strub P, Buist AS, Knowles SB, Lavori PW, Lapidus J, Vollmer WM: Better Outcomes of Asthma Treatment Study G: Shared treatment decision making improves adherence and outcomes in poorly controlled asthma. Am J Respir Crit Care Med 2009,181(6):566–577.PubMedView Article
                31. Wensing M, Bosch M, Grol R, In: Knowledge translation in health care: Moving from evidence to practice. 1st edition edn: Selecting, tailoring, and implementing knowledge translation interventions. West Sussex: Blackwell Publishing Ltd: Edited by Straus SE; 2009:94–113.
                32. Medves J, Godfrey C, Turner C, Paterson M, Harrison M, Mackenzie L, Durando P: Systematic review of practice guideline dissemination and implementation strategies for healthcare teams and team-based practice. Int J Evid Base Health 2010,8(2):79–89.
                33. Guidelines International Network: Guidelines International Network Conference 2010 Abstract Supplement. Operat Tech Otolaryngol Head Neck Surg 2010.,143(1S1):
                34. Ward VL, House AO, Hamer S: Knowledge brokering: exploring the process of transferring knowledge into action. BMC Heal Serv Res 2009, 9:12.View Article
                35. Isern D, Sanchez D, Moreno A: Ontology-driven execution of clinical guidelines. Comput Meth Programs Biomed 2012,107(1):122–139.View Article
                36. Weber R: Conceptual Modelling and Ontology: Possibilities and Pitfalls. J Database Manag 2003,14(3):1–20.View Article
                37. Webb TL, Sniehotta FF, Michie S: Using theories of behaviour change to inform interventions for addictive behaviours. Addiction 2010,105(11):1879–1892.PubMedView Article
                38. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL: A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev 2012,69(2):123–157.PubMedView Article
                39. Medical Subject Headings[http://​www.​ncbi.​nlm.​nih.​gov/​mesh]
                40. Schroter S, Glasziou P, Heneghan C: Quality of descriptions of treatments: a review of published randomised controlled trials. BMJ Open 2012.,2(6):
                41. Phillips AC, Lewis LK, McEvoy MP, Galipeau J, Glasziou P, Hammick M, Moher D, Tilson J, Williams MT: Protocol for development of the guideline for reporting evidence based practice educational interventions and teaching (GREET) statement. BMC Med Educ 2013,13(1):9.PubMedView Article


                © Mazza et al.; licensee BioMed Central Ltd. 2013

                This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.