A scoping review of frameworks in empirical studies and a review of dissemination frameworks
Implementation Science volume 17, Article number: 53 (2022)
The field of dissemination and implementation (D&I) research has grown immensely in recent years. However, the field of dissemination research has not coalesced to the same degree as the field of implementation research. To advance the field of dissemination research, this review aimed to (1) identify the extent to which dissemination frameworks are used in dissemination empirical studies, (2) examine how scholars define dissemination, and (3) identify key constructs from dissemination frameworks.
To achieve aims 1 and 2, we conducted a scoping review of dissemination studies published in D&I science journals. The search strategy included manuscripts published from 1985 to 2020. Articles were included if they were empirical quantitative or mixed methods studies about the dissemination of information to a professional audience. Studies were excluded if they were systematic reviews, commentaries or conceptual papers, scale-up or scale-out studies, qualitative or case studies, or descriptions of programs. To achieve aim 1, we compiled the frameworks identified in the empirical studies. To achieve aim 2, we compiled the definitions from dissemination from frameworks identified in aim 1 and from dissemination frameworks identified in a 2021 review (Tabak RG, Am J Prev Med 43:337-350, 2012). To achieve aim 3, we compile the constructs and their definitions from the frameworks.
Out of 6017 studies, 89 studies were included for full-text extraction. Of these, 45 (51%) used a framework to guide the study. Across the 45 studies, 34 distinct frameworks were identified, out of which 13 (38%) defined dissemination. There is a lack of consensus on the definition of dissemination. Altogether, we identified 48 constructs, divided into 4 categories: process, determinants, strategies, and outcomes. Constructs in the frameworks are not well defined.
Implication for D&I research
This study provides a critical step in the dissemination research literature by offering suggestions on how to define dissemination research and by cataloging and defining dissemination constructs. Strengthening these definitions and distinctions between D&I research could enhance scientific reproducibility and advance the field of dissemination research.
The field of dissemination and implementation (D&I) research has grown extensively in the past years. While scholars from the field of implementation research have made substantial advances, the field of dissemination research has not coalesced to the same degree, limiting the ability to conduct rigorous, reproducible dissemination research. Dissemination research has broadly focused on examining how evidence-based information gets packaged into practices, policies, and programs. This information delivery is often targeted at providers in public health and clinical settings and policymakers to improve public health decision-making. Here, we use provider to refer to a person or group that provides something—in this case, information. The chasm between how evidence-based information is disseminated and how this information is used by providers and policymakers is well-documented  and further evidenced by the ongoing COVID-19 pandemic [2, 3].
The definition of dissemination research has been modified over the years and is not consistent across various sources. Dissemination research could be advanced by further development of existing conceptual and theoretical work. In a previous review , nine D&I science frameworks were categorized as “dissemination only” frameworks (i.e., the explicit focus of the framework was on the spread of information about evidence-based interventions to a target audience) . Frameworks are important because they provide a systematic way to develop, plan, manage and evaluate a study [5, 6]. The extent to which dissemination scholars are using frameworks to inform their studies, and which frameworks are used, is unclear.
Building on previous compilations of dissemination frameworks , this paper intends to advance the knowledge of dissemination research by examining dissemination frameworks reported in the empirical literature, cataloging the constructs across different frameworks, and providing definitions for these constructs. A scoping review is ideal at this stage of the dissemination research literature because it helps map the existing frameworks from a body of emerging literature and identifies gaps in the field .
Specifically, this study has three aims: (1) to conduct a scoping review of the empirical dissemination literature and identify the dissemination frameworks informing those studies, (2) to examine how scholars define dissemination, and (3) to catalog and define the constructs from the dissemination frameworks identified in aim 1 and the frameworks categorized as dissemination only by Tabak et al. 
The methods section is divided into the three aims of this study. First, we report the methods for our scoping review to identify the frameworks used in empirical dissemination studies. Second, we report on how we identified the definitions of dissemination. Third, we report the methods for abstracting the dissemination constructs from the frameworks identified in the empirical literature (aim 1) and from the frameworks categorized as “dissemination only” by Tabak et al.  Tabak et al.  categorized models “on a continuum from dissemination to implementation” and acknowledge that “these divisions are intended to assist the reader in model selection, rather than to provide actual classifications for models.” For the current review, we selected only those categorized as dissemination-only because we aimed to examine whether there were any distinct components between the dissemination and implementation frameworks by coding the dissemination-only frameworks.
Scoping review of the literature
We conducted a scoping review to identify dissemination frameworks used in the empirical dissemination literature. A scoping review is appropriate as the goal of this work is to map the current state of the literature, not to evaluate evidence or provide specific recommendations as is the case with a systematic review . We followed the method developed by Arksey and O’Malley  and later modified by Levac and colleagues . In doing so, we first identified the research questions (i.e., “Which dissemination frameworks are used in the literature?” and “How are the dissemination constructs defined?”), identified relevant studies (see below), and charted the data to present a summary of our results.
We iteratively created a search strategy in Scopus with terms relevant to dissemination. We ran the search in 2017 and again in December 2020, using the following terms: TITLE-ABS-KEY (dissem* OR (knowledge AND trans*) OR diffuse* OR spread*) in the 20 most relevant journals for the D&I science field, identified by Norton et al.  We ran an identical search at a second time point due to several logistical reasons. This review was an unfunded project conducted by faculty and students who experienced numerous significant life transitions during the project period. We anticipated the original search would be out of date by the time of submission for publication, thus wanted to provide the most up-to-date literature feasible given the time needed to complete the review steps. This approach is appropriate for systematic and scoping reviews 
We included studies if they were (a) quantitative or mixed methods empirical studies, (b) if they were about the dissemination of information (e.g., guidelines) to targeted professional audiences, and (c) published since 1985. Articles were excluded if they were (a) systematic reviews, commentaries, or other non-empirical articles; (b) qualitative studies; (c) scale-up studies (i.e., expanding a program into additional delivery settings); (d) case studies or description of programs; and/or (e) dissemination of information to lay consumer audiences or the general public. Some of the exclusion criteria, specifically around distinguishing studies that were dissemination studies from scale-up or health communication studies, were refined as we reviewed the paper abstracts. In the “Definition of dissemination section, we explain our rationale and process to distinguish these types of studies.
The screening procedures were piloted among all coders with a random sample of articles. AB, SaM, CH, CG, EK, and CWB screened titles for inclusion/exclusion independently, then met to ensure a shared understanding of the criteria and to generate consensus. The same coders then reviewed titles based on the above inclusion/exclusion criteria. Any unclear records were retained for abstract review. Consistent with the previously utilized methodology, the abstract review was conducted sequentially to the title review [13, 14]. This approach can improve efficiency while maintaining accuracy . In this round of review, abstracts were single-screened for inclusion/exclusion. Then, 26% of the articles were independently co-screened by pairs of coders; coding pairs met to generate consensus on disagreements.
Articles that passed to full-text review were independently screened by two coders (AB, CH, EK, and CWB). Coders met to reach a consensus and a third reviewer was consulted if the pair could not reach an agreement. From included records, coders extracted bibliometric information about the article (authors, journal, and year of publication) and the name of the framework used in the study (if a framework was used). Coders met regularly to discuss any discrepancies in coding and to generate consensus; final decisions were made by a third reviewer if necessary.
Review of definitions of dissemination
First, we compiled the list of frameworks identified in the empirical studies. Because some frameworks categorized as dissemination-only by the review of frameworks in Tabak et al.  were not present in our sample, we added those to our list of frameworks to review. From the articles describing these frameworks, we extracted dissemination definitions, constructs, and construct definitions. AB, SM, AM, and MP independently abstracted and compared the constructs’ definitions.
Review of dissemination constructs
Once constructs were identified, the frequency of the constructs was counted, and definitions were abstracted. We then organized the constructs into four categories: dissemination processes, determinants, strategies, and outcomes. These categories were organized based on themes by AB and reviewed by all authors. We presented different versions of these categories to groups of stakeholders along our process, including posters at the 2019 and 2021 Conferences on the Science of Dissemination and Implementation in Health, the Washington University Network for Dissemination and Implementation Researchers (WUNDIR), and our network of D&I research peers. During these presentations and among our internal authorship group, we received feedback that the categorization of the constructs was helpful.
We defined the constructs in the dissemination process as constructs that relate to processes, stages, or events by which the dissemination process happens. The dissemination determinants construct encompasses constructs that may facilitate or obstruct the dissemination process (i.e., barriers or facilitators). The dissemination strategies constructs are those that describe the approaches or actions of a dissemination process. Finally, dissemination outcomes are the identified dissemination outcomes in the frameworks (distinct from health service, clinical, or population health outcomes). These categories are subjective and defined by the study team. The tables in Additional file 1 include our suggested labels and definitions for the constructs within these four categories, the definitions as provided by the articles describing the frameworks, and the total frequency of each construct from the frameworks reviewed.
Scoping review of the literature
The PRISMA Extension for Scoping Reviews (PRISMA-ScR) flowchart is shown in Fig. 1. The combined searches yielded 6017 unique articles. Of those, 5622 were excluded during the title and abstract screening. Of the 395 full-text articles, we retained 89 in our final sample.
Papers were excluded during the full-text review for several reasons. Many papers (n = 101, 33%) were excluded because they did not meet the coding definitions for dissemination studies. For example, some studies were focused on larger quality improvement initiatives without a clear dissemination component while other studies reported disseminating findings tangentially. Many (n = 61; 20%) were excluded because they reported a study testing approaches to spread information to the general public or lay audiences instead of to a group of professionals (e.g., disseminating information about HIV perinatal transmission to mothers, not healthcare providers.) Several articles (n = 55, 18%) were related to the scale up of interventions and not the dissemination of information.
Table 1 shows the frameworks used in the included studies. We identified a total of 27 unique frameworks in the empirical studies. Out of the 27 frameworks identified, only three overlapped with the 11 frameworks cataloged as “dissemination only” in Tabak et al.  review. Two frameworks identified in the empirical studies were cataloged by Tabak et al  as “D = I,” one was cataloged as “D > I,” and one as “I only.” Additional file 1: Table S1 shows all the frameworks, with frameworks 1–11 being “D only” from Tabak et al. , and frameworks 12–34 are the ones identified in our empirical sample. Rogers’ diffusion of innovation  was used most frequently (in 10 studies), followed by the Knowledge to Action Framework (in 4 studies)  and RE-AIM (in 3 studies) . Dobbins’ Framework for the Dissemination and Utilization of Research for Health-Care Policy and Practice , the Interactive Systems Framework and Network Theory , and Kingdon’s Multiple Streams Framework  were each used by two studies. Thirty studies (33%) did not explicitly describe a dissemination framework that informed their work.
Definition of dissemination
Table 2 shows the definition of dissemination from the frameworks. Out of the 38 frameworks, only 12 (32%) defined dissemination. There is wide variability in the depth of the definitions, with some authors defining dissemination as a process “transferring research to the users,”  and others defining it as both a process and an outcome [19, 23]. The definitions of dissemination varied among the 13 frameworks that defined dissemination; however, some shared characteristics were identified. In nine of the 13 frameworks, the definition of dissemination included language about the movement or spread of something, whether an idea, innovation, program, or research finding [16, 23,24,25,26,27,28, 31, 32]. Seven of the frameworks described dissemination as active, intentional, or planned by those leading a dissemination effort [7, 16, 23, 25,26,27, 32]. Five frameworks specified some type of outcome as a result of dissemination (e.g., the adoption of an innovation or awareness of research results) [7, 19, 23, 27, 29, 30]. Three of the frameworks’ definitions included the role of influential determinants of dissemination [19, 27, 29, 30]. Only two frameworks highlighted dissemination as a process [23, 25].
Definition of dissemination constructs
Below, we describe the results presented in Tables 3, 4, 5, and 6 with constructs grouped by dissemination process, determinants, strategies, and outcomes. The definitions proposed for the constructs were based on a thematic review of the definitions provided in the articles, which can be found in the Additional file 1: Tables S2-S5.
Table 3 shows the constructs that relate to the dissemination processes, i.e., the steps or processes through which dissemination happens. Seven constructs were categorized as processes: knowledge inquiry, knowledge synthesis, communication, interaction, persuasion, activation, and research transfer. That is, six frameworks suggest that the dissemination process starts with an inquiry of what type of information is needed to close the knowledge gap. Next, there is a process of gathering and synthesizing the information, including examining the context in which the information will be shared. After the information is identified and gathered, there is a process of communication, interaction with the information, and persuasion where the information is shared with the target users, where the users then engage with the information and activate towards action based on the information received. Finally, there is a process of research transfer, where the information sharing “becomes essentially independent of explicit intentional change activity.” 
Table 4 shows the 17 constructs categorized as dissemination determinants, which are constructs that reflect aspects that may facilitate or hinder the dissemination process. Determinants identified included content of the information, context, interpersonal networks, source of knowledge and audience, the medium of dissemination, opinion leaders, compatibility of the information with the setting, type of information, and capacity of the audience to adopt the innovation. Communication, the salience of communication, and users’ perceived attitudes towards the information were the most frequent constructs (n = 14 each), followed by context (n = 13), interpersonal networks (n = 12), sources of knowledge, and audience (n = 10 each).
Table 5 shows the nine constructs related to dissemination strategies, which are constructs that describe the approaches or actions to promote or support dissemination. Leeman and colleagues  conceptualize dissemination strategies as strategies that provide synthesis, translation, and support of information. The authors refer to dissemination as two broad strategies: developing materials and distributing materials. We identified several strategies related to the synthesis of information (e.g., identify the knowledge), translation of information (e.g., adapt information to context), and other constructs. Monitoring and evaluation were the most frequent constructs (n = 10), with identify the quality gap and increase audience’s skills next (n = 6).
Finally, Table 6 shows the dissemination outcomes, which are constructs related to the effects of the dissemination process. Fifteen constructs were categorized here, including awareness and changes in policy, decision and impact, adoption and cost, emotion reactions, knowledge gained, accountability, maintenance, persuasion, reception, confirmation, and fidelity. Knowledge utilization was the most cited construct across frameworks (n = 11), followed by awareness and change in policy (n = 8 each).
The goals of this study were threefold. First, we conducted a scoping review of the empirical literature to catalog the dissemination frameworks informing dissemination studies. Second, we compiled the definition of dissemination, and third, we cataloged and defined the constructs from the dissemination frameworks. During our review process, we found that clearly identifying dissemination studies was more complicated than anticipated. Defining the sample of articles to code for this study was a challenge because of the large variability of studies that use the word “dissemination” in the titles but that are actually scale-up or health communication studies.
The high variability in the definition of dissemination poses a challenge for the field because if we do not clearly define what we are doing, we are unable to set boundaries to distinguish dissemination research from other fields. Among the identified frameworks that defined dissemination, the definitions highlighted that dissemination involved the spread of something, whether knowledge, an innovation, or a program. Distinct from diffusion, several definitions described dissemination as an active process, using intentional strategies. Few definitions described the role of determinants, whether dissemination is a process or a discrete event, and what strategies and outcomes may be pertinent. Future work is needed to unify these distinct conceptualizations into a comprehensive definition that dissemination researchers can use.
While it is clear that dissemination differs from diffusion, as the latter has been considered the passive and “haphazard” spread of information , the distinction between dissemination and scale-up—as shown in the definitions identified in this study—is less clear. Some articles from our search not included in the review conceptualized dissemination as similar to scale-up. To clarify the distinction between dissemination and scale-up in our review, we used the WHO’s definition of scale-up  as “deliberate efforts to increase the impact of successfully tested health innovations to benefit more people and to foster policy and program development on a lasting basis.” In other words, based on these definitions, our team considered scale-up as referencing active efforts to spread evidence-based interventions, whereas diffusion is the passive spread of information. Dissemination, therefore, can be conceptualized as the active and planned spread of information.
Another helpful component in distinguishing dissemination science from other sciences is related to the target audience. Brownson et al.  define dissemination as an “active approach of spreading evidence-based information to the target audience via determined channels using planned strategies” (p. 9). Defining the target audience in the context of dissemination is important because it may help distinguish the field from social marketing. Indeed, several studies we excluded involved sharing information with the public (e.g., increasing the awareness of the importance of sunscreen in public swimming pools). Grier and Bryant define social marketing as a “program-planning process that applies commercial marketing concepts and techniques to promote voluntary behavior change ( … ) by groups of individuals, often referred to as the target audience.”  The target audience in the context of social marketing, the authors explain, is usually considered consumers but can also be policymakers . To attempt to delineate a distinction between these two fields, dissemination work has traditionally identified professionals (e.g., clinicians, public health practitioners, policymakers) as the target audience of dissemination efforts, whereas the target audience in social marketing is conceptualized as a broader audience. Figure 2 shows how we conceptualize the distinct components of dissemination research from other fields. Based on these distinctions, we propose the following coalesced definition for dissemination research to guide this review: the scientific study of the targeted distribution of information to a specific professional person or group of professionals. Clearly distinguishing dissemination from scale-up as well as health communication will help further advance the dissemination research field.
Our results show that of the empirical papers identified in this review, 51% used a framework to guide their study. This finding mirrors the suboptimal use of frameworks in the field of implementation research [38, 39], with scholars recently putting forth guidance on how to select and use frameworks to enhance their use in implementation research studies . Similarly, we provide a catalog of dissemination frameworks and their constructs identified in dissemination studies. It is necessary to move the dissemination research field forward by embedding frameworks in dissemination-focused studies.
Some empirical papers included in our review used frameworks based on the knowledge translation literature. Knowledge translation, a field most prominent outside the USA, has been defined as “a dynamic and iterative process that includes the synthesis, dissemination, exchange and ethically sound application of knowledge to improve health, provide more effective health services and products, and strengthen the health care system” . As such, it conceptualizes an interactive relationship between the creation and the application of knowledge. In the USA, however, researchers tend to conceptualize dissemination as a concept discrete from implementation and use the acronym “D&I” to identify these two fields.
While one could state that there is a distinct set of outcomes, methods, and frameworks between dissemination and implementation fields, previous scholars have cataloged  a continuum, from dissemination only” to “implementation only” frameworks. Consistent with this, our findings show that scholars have adapted implementation frameworks to fit dissemination outcomes (e.g., Klesges’ adaptation of RE-AIM ), while other frameworks have both dissemination and implementation components (e.g., integrated Promoting Action on Research Implementation in Health Services [i-PARIHS] ). Additionally, behavioral change frameworks (e.g., theory of planned behavior) were cataloged in our study as they were used in included articles. The use of implementation frameworks in studies identified here as dissemination studies highlights at least three potential hypotheses. One possibility is the use of implementation frameworks in dissemination studies is due to the underdevelopment of the field of dissemination, as shown in the challenges that we found in the conceptual definition of dissemination. We hope that, by clearly outlining a definition of dissemination, scholars can start to empirically examine whether there are distinct components between implementation and dissemination outcomes and processes.
The second hypothesis is that we still do not have enough evidence in the dissemination or implementation fields to be dogmatic about the categorization of frameworks as either “dissemination” or “implementation.” Until we have more robust evidence about what is and what is not dissemination (or other continua along which frameworks may be categorized), we caution against holding too firm to characterizations of frameworks [38, 43,44,45] Frameworks evolve as more empirical evidence is gathered [43, 45,46,47,48,49], and they are applied in different settings and contexts. We could hypothesize that it is less important, as of now, to categorize a framework as an implementation or dissemination framework and instead clearly explain why a specific framework was selected and how it is applied in the study.
Selection and application of frameworks in dissemination and implementation research is still a challenge, especially considering scholars may often select frameworks in a haphazard way [6, 50, 51]. While scholars have put forward some guidance to select implementation frameworks [6, 52], the challenge in the dissemination and implementation research fields is likely not only in the selection of the frameworks but perhaps more so in the misuse or misapplication of frameworks, theories, or models. A survey indicated that there is little consensus on the process that scholars use to select frameworks and that scholars select frameworks based on several criteria, including familiarity with the framework . As such, Birken et al.  offer other criteria for the selection of frameworks, such as (a) usability (i.e., whether the framework includes relevant constructs and whether the framework provides an explanation of how constructs influence each other), (b) applicability (i.e., how a method, such as an interview, can be used with the framework; whether the framework is generalizable to different contexts), and (c) testability (i.e., whether the framework proposed a testable hypothesis and whether it contributes to an evidence-based or theory development). Moullin et al.  suggest that implementation frameworks should be selected based on their (a) purpose, (b), levels of analysis (e.g., provider, organizational, system), (c) degree of inclusion and depth of analysis or operationalization of implementation concepts, and (d) the framework’s orientation (e.g., setting and type of intervention).
More than one framework can be selected in one study, depending on the research question(s). The application of a framework can support a project in the planning stages (e.g., examining the determinants of a context, engaging with stakeholders), during the project (e.g., making explicit the mechanisms of action, tracking and exploring the process of change), and after the project is completed (e.g., use of the framework to report outcomes, to understand what happened and why) [6, 51, 53]. We believe that similar guidance can and should be applied to dissemination frameworks; further empirical work may be needed to help identify how to select and apply dissemination and/or implementation frameworks in dissemination research. The goal of this review is to support the advancement of the dissemination and implementation sciences by identifying constructs and frameworks that scholars can apply in their dissemination studies. Additional file 1: Tables S6-S9 show the frequency of constructs per framework, and readers can see the variability in the frequency of constructs per framework to help in their selection of frameworks.
A third hypothesis is that the processes of dissemination and implementation are interrelated, may occur simultaneously, and perhaps support each other in the uptake of evidence-based interventions. For example, Leppin et al.  use the definition of implementation based on the National Institutes of Health: “the adoption and integration of evidence-based health interventions into clinical and community settings for the purposes of improving care delivery and efficiency, patient outcomes, and individual and population health” , and implementation research as the study of this process to develop a knowledge base about how interventions can be embedded in practices. In this sense, implementation aims to examine the “how” to normalize interventions in practices, to enhance uptake of these interventions, guidelines, or policies, whereas dissemination examines how to spread the information about these interventions, policies, and practices, intending to support their adoption (see Fig. 1). In other words, using Curran’s  simple terms, implementation is about adopting and maintaining “the thing” whereas dissemination is about intentionally spreading information to enable learning about “the thing.” As Leppin et al. argue, these two sciences [54, 57, 58], while separate, could co-occur in the process of supporting the uptake of evidence-based interventions. Future work may entail empirically understanding the role of these frameworks in dissemination research.
This review aimed to advance a critical step in the dissemination literature by defining and categorizing dissemination constructs. Constructs are subjective, socially constructed concepts , and therefore their definitions may be bounded by factors including, but not limited to, the researchers’ discipline and background, the research context, and time . This is evident in the constructs’ lack of consistent, clear definitions (see Additional file 1). The inconsistency in the definitions of the constructs is problematic because it impairs measurement development and consequently validity and comparability across studies. The lack of clear definitions of the dissemination constructs may be due to the multidisciplinary nature of the D&I research field in general [61, 62], which is a value of the field. However, not having consistency in terms and definitions makes it difficult to develop generalizable conclusions and synthesize scientific findings regarding dissemination research.
We identified a total of 48 constructs, which we separated into four categories: dissemination processes, determinants, strategies, and outcomes. By providing these categories, we can hope to help advance the field of dissemination research to ensure rigor and consistency. Process constructs are important to guide the critical steps and structure that scholars may need to take when doing dissemination research. Of note is that the processes identified in this study may not be unique to dissemination research but rather to the research process in general. As the field of dissemination research advances, it will be interesting to examine whether there are unique components in these process stages that are unique to the dissemination field. In addition to the process, an examination of dissemination determinants (i.e., barriers and facilitators) is essential in understanding how contextual factors occurring at different levels (e.g., information recipient, organizational setting, policy environment) influence dissemination efforts and impede or improve dissemination success . Understanding the essential determinants will help to guide the selection and design of strategies that can support dissemination efforts. Finally, the constructs in the dissemination outcomes will help examine levels and processes to assess.
The categorization of the constructs was not without challenges. For example, persuasion was coded as a strategy (persuading) and as an outcome (persuasion). Likewise, the construct confirmation could be conceptualized as a stage  or as an outcome . The constructs identified in this review provide an initial taxonomy for understanding and assessing dissemination outcomes, but more research and conceptualization are needed to fully describe dissemination processes, determinants, strategies, and outcomes. Given the recent interest in the dissemination literature [22, 63], a future step for the field is examining the precise and coherent definition and operationalization of dissemination constructs, along with the identification or development of measures to assess them.
A few limitations to this study should be noted. First, the search was limited to one bibliometric database and from journals publishing D&I in health studies. We limited our search to one database because we aimed to capture articles from Norton et al. , and therefore, our search methodology was focused on journals instead of on databases. Future work learning from other fields, and doing a broader search on other databases could provide different perspectives. Second, we did not include terms such as research utilization, research translation, knowledge exchange, knowledge mobilization, or translation science in our search, limiting the scope and potential generalizability of our search. Translation science has been defined as being a different science than dissemination, however. Leppin et al. , for example, offer the definition of translation science as the science that aims to identify and advance generalizable principles to expedite research translation, or the “process of turning observations into interventions that improve health” (see Fig. 1). Translation research, therefore, focuses on the determinants to achieve this end. Accordingly, Wilson et al.  used other terms in their search, including translation, diffusion of innovation, and knowledge mobilization and found different frameworks in their review. In their paper, Wilson and colleagues  provided a different analysis than ours in that they aimed to examine the theoretical underpinning of the frameworks identified by them. Our study is different from theirs in that we offer the definition of disseminating and a compilation of constructs and their definitions. A future study could combine the frameworks identified by our study with the ones identified by Wilson and colleagues and detail the theoretical origins of the frameworks, and the definitions of the constructs to support in the selection of frameworks for dissemination studies. Third, by being stringent in our inclusion criteria, we may have missed important work. Several articles were excluded from our scoping review because they were examining the spread of an evidence-based intervention (scale up) or of the spread of dissemination for the public (health communication). As noted above, however, clearly distinguishing dissemination from scale-up and from health communication will help further advance the dissemination research field and identify its mechanisms of action. Fourth, given the broad literatures in diffusion, dissemination, and social marketing, researchers may disagree with our definitions and how we conceptualized the constructs. Fifth, we did not code qualitative studies because we wanted to have boundaries in this study as it is a scoping study. Future studies could examine the application of frameworks in qualitative work. It is our hope that future research can build from this work to continue to define and test the dissemination constructs.
Based on the review of frameworks and the empirical literature, we defined dissemination research and outlined key constructs in the categories of dissemination process, strategies, determinants, strategies, and outcomes. Our data indicate that the field of dissemination research could be advanced with a more explicit focus on methods and a common understanding of constructs. We hope that our review will help guide the field in providing a narrative taxonomy of dissemination constructs that promote clarity and advance the dissemination research field. We hope that future stages of the dissemination research field can examine specific measures and empirically test the mechanisms of action of the dissemination process.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Dissemination and implementation
Integrated Promoting Action on Research Implementation in Health Services
Reach, Effectiveness, Adoption, Implementation, Maintenance
Consolidated Framework for Implementation Research
Brownson RC, Eyler AA, Harris JK, Moore JB, Tabak RG. Getting the Word Out: New Approaches for Disseminating Public Health Science. J Public Health Manag Pract. 2018;24(2):102-11. https://doi.org/10.1097/PHH.0000000000000673.
Naeem S, bin, Bhatti R. The COVID-19 ‘infodemic’: a new front for information professionals. Health Inf Libr J. 2020;37(3):233–9. https://doi.org/10.1111/hir.12311.
Narayan KMV, Curran JW, Foege WH. The COVID-19 pandemic as an opportunity to ensure a more successful future for science and public health. JAMA. 2021;325(6):525–6. https://doi.org/10.1001/jama.2020.23479.
Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50. https://doi.org/10.1016/j.amepre.2012.05.024.
Green L, Kreuter M. Health program planning: an educational and ecological approach: McGraw-Hill Education; 2005.
Moullin JC, Dickson KS, Stadnick NA, et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun. 2020;1(1):42. https://doi.org/10.1186/s43058-020-00023-7.
Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010;5(1):1–16.
Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143. https://doi.org/10.1186/s12874-018-0611-x.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. https://doi.org/10.1080/1364557032000119616.
Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1):69. https://doi.org/10.1186/1748-5908-5-69.
Norton WE, Lungeanu A, Chambers DA, Contractor N. Mapping the growing discipline of dissemination and implementation science in health. Scientometrics. 2017;112(3):1367–90. https://doi.org/10.1007/s11192-017-2455-2.
Bramer W, Bain P. Updating search strategies for systematic reviews using EndNote. J Med Libr Assoc. 2017;105(3):285–9. https://doi.org/10.5195/jmla.2017.183.
Hickey MD, Odeny TA, Petersen M, et al. Specification of implementation interventions to address the cascade of HIV care and treatment in resource-limited settings: a systematic review. Implement Sci. 2017;12(1):102. https://doi.org/10.1186/s13012-017-0630-8.
Hooley C, Amano T, Markovitz L, Yaeger L, Proctor E. Assessing implementation strategy reporting in the mental health literature: a narrative review. Adm Policy Ment Health Ment Health Serv Res. 2020;47(1):19–35. https://doi.org/10.1007/s10488-019-00965-8.
Mateen FJ, Oh J, Tergas AI, Bhayani NH, Kamdar BB. Titles versus titles and abstracts for initial screening of articles for systematic reviews. Clin Epidemiol. 2013;5(1):89–95. https://doi.org/10.2147/CLEP.S43118.
Rogers EM, Singhal A, Quinlan MM. Diffusion of innovations: Routledge; 2014.
Graham ID, Tetroe JM. The Knowledge to Action Framework. Models Frameworks Implement Evid Based Pract. 2010;207:222.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.
Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A. A framework for the dissemination and utilization of research for health-care policy and practice. Worldviews Evid Based Nurs Presents Arch Online J Knowl Synth Nurs. 2002;9(1):149–60.
Wandersman A, Duffy J, Flaspohler P, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3):171–81.
Kingdon JW, Stano E. Agendas, alternatives, and public policies, vol. 45: Little, Brown Boston; 1984.
Winkler JD, Lohr KN, Brook RH. Persuasive communication and medical technology assessment. Arch Intern Med. 1985;145(2):314–7.
Scullion PA. Effective dissemination strategies. Nurse Res (through 2013). 2002;10(1):65–77.
Anderson M, Cosby J, Swan B, Moore H, Broekhoven M. The use of research in local health service agencies. Soc Sci Med. 1999;49(8):1007–19.
Elliott SJ, O’Loughlin J, Robinson K, et al. Conceptualizing dissemination research and activity: the case of the Canadian Heart Health Initiative. Health Educ Behav. 2003;30(3):267–82.
Owen N, Glanz K, Sallis JF, Kelder SH. Evidence-based approaches to dissemination and diffusion of physical activity interventions. Am J Prev Med. 2006;31(4):35–44.
Yuan CT, Nembhard IM, Stern AF, Brush JE Jr, Krumholz HM, Bradley EH. Blueprint for the dissemination of evidence-based practices in health care. Issue Brief (Commonw Fund). 2010;86:1–16.
Graham ID, Logan J, Harrison MB, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.
Oh CH, Rich RF. Explaining use of information in public policymaking. Knowledge Policy. 1996;9(1):3–35.
Landry R, Amara N, Lamari M. Utilization of social science research knowledge in Canada. Res Policy. 2001;30(2):333–49.
Birken SA, Lee SYD, Weiner BJ. Uncovering middle managers’ role in healthcare innovation implementation. Implement Sci. 2012;7(1):1–12.
Fairweather GW. Methods for experimental social innovation. 1967. Published online
Fairweather GWTLG. Experimental methods for social policy research. Pergamon Press; 1977.
Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. Implement Sci. 2017;12(1):125. https://doi.org/10.1186/s13012-017-0657-x.
Lomas J. Diffusion, dissemination, and implementation: who should do what? Ann N Y Acad Sci. 1993;703:226–35. https://doi.org/10.1111/j.1749-6632.1993.tb26351.x discussion 235-7.
World Health Organization, EXPAND NET. Nine steps for developing a scaling-up strategy.; 2010.
Grier S, Bryant CA. Social marketing in public health. Annu Rev Public Health. 2005;26(1):319–39. https://doi.org/10.1146/annurev.publhealth.26.021304.144610.
Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1. https://doi.org/10.1186/s13012-018-0842-6.
Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci. 2016;11(1):72. https://doi.org/10.1186/s13012-016-0437-z.
Straus SE, Tetroe J, Graham I. Defining knowledge translation. Can Med Assoc J. 2009;181(3-4):165–8. https://doi.org/10.1503/cmaj.081229.
Dzewaltowski DA, Glasgow RE, Klesges LM, Estabrooks PA, Brock E. RE-AIM: evidence-based standards and a web resource to improve translation of research into practice. Ann Behav Med. 2004;28(2):75–80.
Rycroft-Malone J, Kitson A, Harvey G, et al. Ingredients for change: revisiting a conceptual framework. BMJ Qual Saf. 2002;11(2):174–80.
Glasgow RE, Estabrooks PA, Ory MG. Characterizing evolving frameworks: issues from Esmail et al. (2020) review. Implement Sci. 2020;15(1):53. https://doi.org/10.1186/s13012-020-01009-8.
Esmail R, Hanson HM, Holroyd-Leduc J, et al. A scoping review of full-spectrum knowledge translation theories, models, and frameworks. Implement Sci. 2020;15(1):11. https://doi.org/10.1186/s13012-020-0964-5.
Holtrop JS, Estabrooks PA, Gaglio B, et al. Understanding and applying the RE-AIM framework: clarifications and resources. J Clin Transl Sci. 2021;5(1):e126. https://doi.org/10.1017/cts.2021.789.
Damschroder LJ, Reardon CM, Opra Widerquist MA, Lowery J. Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum. Implement Sci. 2022;17(1):7. https://doi.org/10.1186/s13012-021-01181-5.
Means AR, Kemp CG, Gwayi-Chore MC, et al. Evaluating and optimizing the Consolidated Framework for Implementation Research (CFIR) for use in low- and middle-income countries: a systematic review. Implement Sci. 2020;15(1):17. https://doi.org/10.1186/s13012-020-0977-0.
Baumann AA. Commentary: Adapting and operationalizing the RE-AIM Framework for implementation science in environmental health: clean fuel cooking programs in low resource countries. Front Public Health. 2020;8. https://doi.org/10.3389/fpubh.2020.00218.
Harvey G, Kitson A. Introducing the i-PARIHS framework. In: Implementing evidence-based practice in healthcare. 1st ed: Routledge; 2015. p. 25–46.
Birken SA, Powell BJ, Shea CM, et al. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implement Sci. 2017;12(1):124. https://doi.org/10.1186/s13012-017-0656-y.
Lynch EA, Mudge A, Knowles S, Kitson AL, Hunter SC, Harvey G. “There is nothing so practical as a good theory”: a pragmatic guide for selecting theoretical approaches for implementation projects. BMC Health Serv Res. 2018;18(1):857. https://doi.org/10.1186/s12913-018-3671-z.
Birken SA, Rohweder CL, Powell BJ, et al. T-CaST: an implementation theory comparison and selection tool. Implement Sci. 2018;13(1):143. https://doi.org/10.1186/s13012-018-0836-4.
Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ. A guide for applying a revised version of the PARIHS framework for implementation. Implement Sci. 2011;6(1):99. https://doi.org/10.1186/1748-5908-6-99.
Leppin AL, Mahoney JE, Stevens KR, et al. Situating dissemination and implementation sciences within and across the translational research spectrum. J Clin Transl Sci. 2020;4(3):152–8. https://doi.org/10.1017/cts.2019.392.
National Institutes of Health. PAR 18-007 Dissemination and Implementation Research in Health FOA. 2017; October 12, 2017
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. https://doi.org/10.1097/MLR.0b013e3182408812.
Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci. 2006;1(1):1. https://doi.org/10.1186/1748-5908-1-1.
Dearing JW. Evolution of diffusion and dissemination theory. J Public Health Manag Pract. 2008;14(2):99–108. https://doi.org/10.1097/01.PHH.0000311886.98627.b7.
Nunnally Bernstein Ira H. JC. Psychometric theory. McGraw-Hill; 1994.
Bergkvist L, Eisend M. The dynamic nature of marketing constructs. J Acad Mark Sci. 2021;49(3):521–41. https://doi.org/10.1007/s11747-020-00756-w.
Kislov R, Pope C, Martin GP, Wilson PM. Harnessing the power of theorising in implementation science. Implement Sci. 2019;14(1):103. https://doi.org/10.1186/s13012-019-0957-4 s13012-019-0957-4.
Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–34.
Purtle J, Marzalik JS, Halfond RW, Bufka LF, Teachman BA, Aarons GA. Toward the data-driven dissemination of findings from psychological science. Am Psychol. 2020;75(8):1052–66. https://doi.org/10.1037/amp0000721.
Baker EA, Brewer SK, Owens JS, Cook CR, Lyon AR. Dissemination science in school mental health: a framework for future research. Sch Ment Heal. 2021;13(4):791–807. https://doi.org/10.1007/s12310-021-09446-6.
Lester JP. The utilization of policy analysis by state agency officials. Knowledge. 1993;14(3):267–90.
Kramer DM, Cole DC. Sustained, intensive engagement to promote health and safety knowledge transfer to and utilization by workplaces. Sci Commun. 2003;25(1):56–82.
Jacobson N, Butterill D, Goering P. Development of a framework for knowledge translation: understanding user context. J Health Serv Res Policy. 2003;8(2):94–9.
Zeldin S, Petrokubi J, MacNeil C. Youth-adult partnerships in decision making: disseminating and implementing an innovative idea into established organizations and communities. Am J Community Psychol. 2008;41(3):262–77.
Lipowski EE, Becker M. Presentation of drug prescribing guidelines and physician response. QRB Q Rev Bull. 1992;18(12):461–70.
Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):1–12.
Edquist C, Hommen L, McKelvey MD. Innovation and employment: process versus product innovation: Edward Elgar Publishing; 2001.
Fairweather GW, Davidson WS. An introduction to community experimentation: McGraw-Hill; 1986.
Hovland CI, Janis IL, Kelley HH. Communication and persuasion. 1953. Published online.
Kumagai AK. A conceptual framework for the use of illness narratives in medical education. Acad Med. 2008;83(7):653–8.
de Silva MJ, Breuer E, Lee L, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15(1):1–13.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9):S63–7.
Schmid TL, Pratt M, Witmer L. A framework for physical activity policy research. J Phys Act Health. 2006;3(s1):S20–9.
Redman S, Turner T, Davies H, et al. The SPIRIT Action Framework: a structured approach to selecting and testing strategies to increase the use of research in policy. Soc Sci Med. 2015;136:147–55.
Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manag Sci. 1989;35(8):982–1003.
Thacker SB, Stroup DF, Parrish RG, Anderson HA. Surveillance in environmental public health: issues, systems, and sources. Am J Public Health. 1996;86(5):633–8.
Ajzen I. From intentions to actions: a theory of planned behavior. In: Action control Springer; 1985. p. 11–39.
Kaegi L. From paper to practice to point of care: reports from a Zitter Group Conference on Implementing Practice Guidelines. Jt Comm J Qual Improv. 1996;22(8):551–83.
The authors would like to thank the WUNDIR community for their invaluable feedback.
AB is supported by the National Heart, Lung and Blook Institute U24HL154426 and 5U01HL133994, the National Institute of Child Health and Human Development R01HD091218, and the National Institute of Mental Health P50MH122351. CWB is funded by NIMHD T37 MD014218. MP is supported by the National Institute of Allergy and Infectious Diseases (K24AI134413). ABM is supported by the National Heart, Lung, and Blood Institute (1T32HL130357). RGT and SM were supported by the National Institute of Diabetes and Digestive and Kidney Diseases P30DK092950 and by the Nutrition Obesity Research Center, P30 DK056341, and Cooperative Agreement number U48DP006395 from the Centers for Disease Control and Prevention. AB, SM, and TB were supported by the National Cancer Institute P50CA244431. AAB, ABM, MP, RGT, and SM were also supported by the National Center for Advancing Translational Sciences UL1TR002345. The findings and conclusions in this paper are those of the authors and do not necessarily represent the official positions of the National Institutes of Health or the Centers for Disease Control and Prevention.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Definition of disseminations from frameworks. Table S2. Dissemination Process constructs, their definition, and frequency across frameworks. Table S3. Dissemination determinants constructs, their definition, and frequency across frameworks. Table S4. Dissemination strategy constructs, their definition, and frequency across frameworks. Table S5. Dissemination outcome constructs, their definitions, and frequency across frameworks. Table S6. Frequency of Process Constructs Across Frameworks. Table S7. Frequency of Determinant Constructs Across Frameworks. Table S8. Frequency of Strategy Constructs Across Frameworks. Table S9. Frequency of Determinant Constructs Across Frameworks. Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist [64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82].
About this article
Cite this article
Baumann, A.A., Hooley, C., Kryzer, E. et al. A scoping review of frameworks in empirical studies and a review of dissemination frameworks. Implementation Sci 17, 53 (2022). https://doi.org/10.1186/s13012-022-01225-4