Skip to main content
Download PDF
Download ePub
  • Systematic review
  • Open access
  • Published:

A citation analysis and scoping systematic review of the operationalization of the Practical, Robust Implementation and Sustainability Model (PRISM)

Implementation Science volume 17, Article number: 62 (2022) Cite this article

Abstract

Background

The Practical, Robust Implementation and Sustainability Model (PRISM) was developed in 2008 as a contextually expanded version of the broadly used Reach, Adoption, Effectiveness, Implementation, and Maintenance (RE-AIM) framework. PRISM provides researchers a pragmatic and intuitive model to improve translation of research interventions into clinical and community practice. Since 2008, the use of PRISM increased across diverse topics, populations, and settings. This citation analysis and scoping systematic review aimed to assess the use of the PRISM framework and to make recommendations for future research.

Methods

A literature search was conducted using three databases (PubMed, Web of Science, Scopus) for the period of 2008 and September 2020. After exclusion, reverse citation searches and invitations to experts in the field were used to identify and obtain recommendations for additional articles not identified in the original search. Studies that integrated PRISM into their study design were selected for full abstraction. Unique research studies were abstracted for information on study characteristics (e.g., setting/population, design), PRISM contextual domains, and RE-AIM outcomes.

Results

A total of 180 articles were identified to include PRISM to some degree. Thirty-two articles representing 23 unique studies integrated PRISM within their study design. Study characteristics varied widely and included studies conducted in diverse contexts, but predominately in high-income countries and in clinical out-patient settings. With regards to use, 19 used PRISM for evaluation, 10 for planning/development, 10 for implementation, four for sustainment, and one for dissemination. There was substantial variation across studies in how and to what degree PRISM contextual domains and RE-AIM outcomes were operationalized and connected. Only two studies directly connected individual PRISM context domains with RE-AIM outcomes, and another four included RE-AIM outcomes without direct connection to PRISM domains.

Conclusions

This is the first systematic review of the use of PRISM in various contexts. While there were low levels of ‘integrated’ use of PRISM and few reports on linkage to RE-AIM outcomes, most studies included important context domains of implementation and sustainability infrastructure and external environment. Recommendations are provided for more consistent and comprehensive use of and reporting on PRISM to inform both research and practice on contextual factors in implementation.

Peer Review reports

Introduction

The field of implementation science has made significant advancements towards understanding how evidence-based practices, programs, and policies are adopted and implemented in different clinical and community settings [1, 2]. While there is a wide range of evidence-based interventions, it is still the case that less is known about successfully implementing and sustaining these programs in a range of settings [3, 4]. Implementation science has emphasized the development and use of theories, models, and frameworks (TMF) to guide and understand translation of research into practice [5, 6] and has prioritized understanding how health care and public health programs interact with context and both implementers and beneficiaries to influence adoption, engagement, equity [7], implementation, reach, effectiveness, and sustainment [8,9,10,11].

There is increasing interest [12, 13] but still limited understanding of which contextual factors [3, 14,15,16,17] have an impact on the initial uptake; equitable implementation, reach, effectiveness; and sustained use of complex health interventions [18] in a variety of clinical and community settings, which inhibits the translation of research into practice [10]. More specifically, there is a need to document and understand the impact of the dynamic context in which interventions are integrated [19,20,21,22,23]. The Practical, Robust Implementation and Sustainability Model (PRISM) was developed to fill this need using key concepts from research on and models of chronic care, the diffusion of innovations, quality improvement, and measures of population-based effectiveness for translating research into practice [3, 4].

PRISM was developed as a contextually expanded version of the broadly used Reach, Adoption, Effectiveness, Implementation, and Maintenance (RE-AIM) framework, and as a pragmatic and intuitive model to improve translation of research-tested interventions into clinical and community practice and ultimately population health impact [24]. PRISM can be considered a determinant and evaluation framework in the classification suggested by Nilsen [25] and, as illustrated in Fig. 1, considers how perspectives of the program, policy, or intervention design; the external environment; the implementation and sustainability infrastructure; and the characteristics of multiple levels of “recipients” (e.g., implementers, beneficiaries) influence program adoption, implementation, and maintenance. Within the program or intervention design domain and the recipient domain, PRISM incorporates the perspectives of both the patients (recipients or participants) and the organizational members at different levels of influence (e.g., top leadership, mid-level managers, and frontline staff) to help understand what factors within and external to the organization need to be considered and addressed for successful implementation and sustainability of complex interventions [26]. A relatively unique aspect of PRISM, compared to most other models addressing context, is explicit inclusion of the domain of the “implementation and sustainability infrastructure” (e.g., clear roles and responsibilities related to this program; timely data reporting capabilities, strong communication channels). Inclusion of this domain was based on experience in healthcare settings in which those settings that were able to implement and sustain programs most consistently had the type of infrastructure and support resources noted in this domain. The outcome measures hypothesized to be influenced by PRISM contextual factors include RE-AIM outcomes of reach, effectiveness, adoption, implementation, and individual- and organizational-level maintenance (www.re-aim.org) [4, 27].

Fig. 1
figure 1

The Practical, Robust Implementation and Sustainability Model

Full size image

Since 2008, PRISM has been used across diverse topics, populations, and settings. The purpose of this citation analysis and scoping systematic review was to explore and describe how PRISM has been used, how it has been operationalized, for what populations and settings, and with what outcomes. Specifically, the review aimed to (1) summarize use of PRISM to date; (2) identify and address conceptual and methodological issues to potentially improve research in this area; and (3) provide recommendations for research teams and practitioners about using PRISM to improve translation of evidence-based interventions in a variety of clinical and community settings.

Methods

We conducted a systematic scoping literature review to determine how PRISM has been used. A literature search was conducted using three databases PubMed, Web of Science, and Scopus. The search algorithm included ((“Practical” AND “Robust” AND “Implementation” AND “Sustainability” AND “Model”) OR (“Practical, Robust Implementation and Sustainability Model”)) OR (“Practical Robust Implementation and Sustainability Model”).

The date range was from 2008 (publication date of the original PRISM manuscript) through September 2020. Further, following the approach described by Bergstörm et al. [28], we conducted a reverse citation search of the original PRISM article (i.e., index article) in PubMed reviewing all papers that cited this index paper to identify studies that used PRISM [4]. Only peer-reviewed articles were included in this review. First, duplicates were removed from the results. Full-text articles were obtained for all articles identified in the searches and were independently reviewed by two researchers (BR, JC) to determine eligibility. Articles were excluded if they did not cite or specify PRISM or were not yet published in a peer-reviewed journal. We adapted and refined categories previously developed by Field et al. [29] to classify the extent PRISM was used in the articles (i.e., referenced the model, framing a field or in a review, informed by the model, directed by the model, or integrated the model into the study design) (Table 1). Classification of articles per the Field et al categories [29] was done by two members of the team (BR, JC). Discrepancies in classification were resolved through consensus discussion and the involvement of the other members of the abstraction team (CG, BG). Because one purpose of this review was to explore the degree to which PRISM propositions were supported (i.e., relationships between PRISM contextual factors and RE-AIM outcomes), only studies that met the criteria for ‘integrated use,’ which required explicit linking of study activities to PRISM domains and/or subdomains, of the PRISM framework were included [29]. Following the database searches and initial eligibility screening, the list of included articles was circulated to an expert panel of implementation science researchers via a national listserv to obtain recommendations for additional articles that described an integrated use of PRISM not identified in the original search.

Table 1 Categories and definitions for the use of the Practical, Robust Implementation and Sustainability Model (PRISM) in published peer-reviewed literature, adapted from Field et al. (2014) [29]
Full size table

All articles that were categorized as integrating PRISM into their study design (i.e., integrated use [29]) were selected for full abstraction. Articles that described the same study were bundled as primary and companion papers and were abstracted together. Data abstraction was conducted by four researchers (BR, BG, CG, and JC). Data abstraction forms were developed based on prior work of the co-authors in reviewing the use of the RE-AIM framework [30, 31]. We expanded these abstractions forms to include PRISM contextual domains of characteristics of the intervention, characteristics of the recipients (including the multi-level organizational setting), implementation and sustainability infrastructure, and external environment. The abstraction form was then iteratively refined as the team tested it on the abstraction of four studies and then programmed into a REDCap database [32, 33]. The rest of the eligible articles were assigned to pairs of researchers to independently abstract. The pairs of coders met to review their abstractions, resolve discrepancies, and reach consensus. Consensus, rotation of abstraction teams, and iterative group discussions were used to ensure the accuracy and consistency of data abstraction.

The database was used to capture information from three key domains: study characteristics (setting, design, population, etc.), PRISM contextual domains, and RE-AIM outcomes [32, 33]. Articles were categorized as addressing planning/development, dissemination, implementation, evaluation, and/or sustainment. To describe the degree (i.e., quality and extent) of operationalization of PRISM domains, we used a scale of 0-5 in which 0 indicated poor operationalization and 5 indicated excellent operationalization. Ratings were separately made for each type of use of PRISM (i.e., planning/development, dissemination, implementation, evaluation, and/or sustainment). Two abstractors per article/study rated the degree of operationalization and used a consensus approach to decide on the final rating. They also documented the rational for their rating in a qualitative manner. If articles included lessons learned about operationalizing PRISM, this information was also systematically abstracted (see Additional file 1). Key themes from lessons learned were synthesized based on the review of this data by the lead author.

Results

Included studies

Of the 237 unique articles identified, 57 were excluded for not meeting the initial inclusion criteria (Fig. 2 and Table 1). A total of 180 articles were identified as using PRISM to some degree (i.e., referenced the model, framing a field or in a review, informed by the model, directed by the model, or integrated the model into the study design). As shown in Fig. 3, the number of publications increased over time as we moved from 2008 (n=3) to 2019 (n=31). Overall increases in the proportion of directed and integrated articles were also observed (see Table 1 for definitions).

Fig. 2
figure 2

Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagram of systematic review of articles using Practical, Robust Implementation and Sustainability Model (PRISM)

Full size image
Fig. 3
figure 3

Number of articles using the Practical, Robust Implementation and Sustainability Model (PRISM) across years (2008 through September 2020*)

Full size image

Of the 180 initially identified articles, 29 (16.1%) included PRISM as a potential means for understanding the current state of research or advancing research in a specific field (i.e., framing), and 14 articles (7.8%) included PRISM in a review of frameworks (i.e., reviews). Eleven articles (6.1%) mentioned that PRISM informed their study without specifying how the model was used (i.e., informed), and another 23 articles (12.8%) provided more details as to how PRISM was used in developing their study but lacked specific details about how the domains were operationalized (i.e., directed). Seventy-two articles (40.0%) referenced PRISM in either the introduction or discussion as an alternative model that was not used in their study methods (i.e., referenced). Finally, 31 articles (17.2%), representing 23 unique studies, were determined to integrate PRISM into their study design and were abstracted (Fig. 2) [29]. One additional article was added to the final abstraction as it was identified as a later published result for an initially included protocol article (the total number of publications in the integrated category was n=32). For the full list of included papers, their categorization by use, and search source, see Additional file 2.

Study characteristics

Of the 23 abstracted studies, 17 were conducted in the USA, and only three were conducted in low-middle income countries. Thirteen studies addressed primary or secondary prevention as the main topic area followed by seven studies related to mental health, four on veterans’ health, three on cancer, two on infectious disease, two on reproductive health (including OBGYN), one on clinical guidelines, and eight were coded as other topics. Eighteen of the studies addressed health equity, as defined as “reducing and ultimately eliminating disparities in health and its determinants that adversely affect excluded or marginalized groups” [34] (Table 2). Most frequent operationalization of addressing health equity was through the focus of the study on underserved populations.

Table 2 Summary of original studies included in a systematic review of the use of the Practical, Robust Implementation and Sustainability Model (PRISM)
Full size table

The target populations for the studies were mainly focused on the providers or delivery agents (n= 20), but most also included the setting level (n=16) and patient or community (n=15 for both groups). One study targeted payors and another targeted policy makers (Table 3). Most studies that integrated PRISM were conducted in the clinical out-patient setting (n=13) with a minority of studies being conducted in community settings (n=4). Additional settings identified were clinical in-patient (n=3), schools (n=2), or as part of a national health initiative (n=2). Two studies were conducted in other settings (i.e., a care transition context and a regional evaluation). The study design varied greatly across studies with seven being stand-alone protocol papers, five being randomized controlled trials, four quasi-experimental pre/post designs, three case studies, one cohort study, and one narrative piece (Table 3). Of note, nine were classified as having a design different from above such as qualitative implementation study, cross-sectional study, and adaptation study. The type of study varied from nine that were specifically implementation focused; six that were type 2 hybrid effectiveness-implementation; three efficacy studies; and two were effectiveness studies. Five studies were classified as pilot studies and five did not fit into any of the study type categories. The most frequently used methods used were qualitative (n=8), mixed methods (n=7) and multi-method (n=6). Only two studies reported strictly quantitative methods. In terms of socioecologic level, 14 studies used setting, four individual, three delivery agent, and two had multiple levels at which randomization and/or data collection happened.

Table 3 Summary of domain use of Practical, Robust Implementation and Sustainability Model (PRISM) and Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) frameworks (N=23)
Full size table

PRISM use

PRISM was used primarily for study evaluation (n=19), but also for planning and development (n=10), and implementation (n=10). Obviously, many addressed multiple implementation stages. Four studies addressed sustainment, and only one study addressed dissemination (Additional file 3). The research team identified two studies, Ayele, R. A., et al. [36] and Leonard et al. [48], that used PRISM for planning and development, implementation, and evaluation. Woodbridge, M. W., et al. [61] was found to be an exemplar in evaluation and sustainment. There were no exemplar studies identified for dissemination.

Table 3 provides further details on the extent to which studies included the various context domains of PRISM and Table 4 shows what sub-domains were addressed. Twenty-two studies included perspectives on the Program/Intervention from the organizational lens, with nearly three-quarters addressing barriers for frontline staff. There were 15 studies including Program/Intervention from the patient perspective focusing on patient barriers, being patient-centered, and addressing service and access. Recipient characteristics at the organizational level (n=18) focused on management support and communication as well as shared goals and cooperation. Recipient patient characteristics reported (n=16) were primarily related to demographics. Most studies (n=21) included Implementation and Sustainability Infrastructure and performance data was the most frequent sub-domain reported within this factor. Studies addressing the external environment domain (n=19) were primarily focused on community resources.

Table 4 Inclusion and operationalization of Practical, Robust Implementation and Sustainability Model (PRISM) elements across all articles included in review by dimension and evaluation criteria: 2008–2020
Full size table

In terms of the operationalization of the PRISM context domains, most domains were operationalized using qualitative methods followed by quantitative, mixed methods, and muti-methods approaches and only one study used a narrative approach. The specific distribution of the methods for each domain is provided in Table 4. Specific techniques used for data collection about each domain were not as consistently reported but a general review of themes identified interviews, focus groups, and surveys as the most common approaches of data collection with a few studies reporting the use of more innovative approaches such as brainwriting or process mapping) (data not shown). When rating the degree of operationalization of the PRISM domains across the various stages of use of PRISM (i.e., planning/development, dissemination, implementation, evaluation, and sustainment) we found that average ratings were similar across the stages and ranged from 2.3 to 3.1 on the scale of 0 to 5 where 0 was poor and 5 excellent. Operationalization of the PRISM domains for supporting sustainment was rated on average the lowest and implementation the highest. Lower ratings were due to a lack of specificity on how the PRISM domains were operationalized for the given stage.

Only eight included studies provided specific lessons learned about the contribution of PRISM to planning, implementation, and/or evaluation (Table 2). The following key themes were identified when reviewing the lessons learned: (1) PRISM was useful in supporting pre-implementation planning and adaptation of interventions to multilevel contexts [42, 45, 48]; (2) PRISM was feasible and useful in supporting the implementation of interventions in multilevel contexts [26, 46]; and (3) PRISM with its multilevel consideration of determinants was helpful in organizing multilevel influencers of implementation [59, 60].

There were six studies that included all six contextual domains. Despite the RE-AIM outcomes being an explicit part of the original PRISM model (Fig. 1 and Table 3), only two studies directly connected individual PRISM domains with RE-AIM outcomes, and another four studies included RE-AIM outcomes without directly connecting them to the PRISM context domains. Even the two papers in which a connection between the context domain and RE-AIM was made, the studies did not attempt to explicitly test relationships between the contextual factors and RE-AIM outcomes. Of the six studies that included RE-AIM, all but one addressed implementation, three addressed reach, three adoption at the staff and/or setting level, one included effectiveness, and one maintenance at the individual and setting level. One included all RE-AIM dimensions except effectiveness and no studies included all five RE-AIM outcomes.

Few studies combined PRISM with another TMF (n=7) and even fewer described the adaptation of PRISM for the study context (n=2). TMFs that were used in combination with PRISM included the expanded framework for reporting adaptations and modifications to evidence-based interventions (FRAME) [65], the learning evaluation [66], the Social Ecological Model [67], and Lean Six Sigma [68]. Adaptations to PRISM focused on the modifications of domains to align with the context of the study. Goplan et al. adapted and tailored PRISM to reflect the context of their 4Rs and 2Ss for strengthening families intervention [45] and Knudsen et al. modified how the implementation and sustainability infrastructure and external environment are structured based on their community and collation partners [47].

Discussion

PRISM was developed to specify multi-level contextual factors related to implementation research outcomes included in the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework [4, 27, 69]. Our review summarized published reports of use of PRISM from 2002 to 2020 and attempted to report on findings related to relationships between PRISM contextual factors and RE-AIM outcomes. Nearly 200 articles referenced PRISM, used it to inform or direct their research, or integrated it within the research design—with the numbers growing over the past decade. The studies reflected a diverse body of literature that applied PRISM across the stages of intervention planning, implementation, and evaluation. While 23 studies (represented by 32 articles) integrated PRISM within their research methodology, very few included PRISM contextual factors and RE-AIM outcomes together. None made an explicit attempt to test the connection between contextual domains and RE-AIM outcomes, making it difficult to determine the relationships between specific contextual constructs and unique implementation outcomes.

We noted that the purpose and use of PRISM varied across included studies and the level of specificity on how PRISM was integrated and measured was often lacking, making it difficult to compare findings across studies. Similarly, it was challenging to rate the degree and quality of use of PRISM as there were few studies using or reporting on the PRISM sub-domains comprehensively. More guidance on how to use PRISM especially as it relates to its sub-domains should be provided for future studies. Furthermore, measures should be linked to specific PRISM domains and sub-domains to support a more comprehensive use of the model.

Studies that have integrated PRISM in their research methodology reflect a body of literature that is relatively early in its development. As a result, few studies reported using PRISM as a framework to describe potential relationships between context and outcomes. Indeed, many of the studies have used PRISM in planning and characterizing dissemination and implementation settings and “recipients” (participants, implementers, and organizations). A large proportion of these studies examined implementation and sustainability infrastructure issues when planning for intervention implementation. Explicitly reporting on this dimension is seen as one of the strengths of PRISM (explicit focus on this construct is relatively unique among context-oriented implementation science frameworks) and conceptually is likely to be strongly related to sustainment, although this remains to be tested. We were surprised to find that 78% of the studies addressed health equity in some way. This focus was primarily operationalized by the primary focus of the studies on underserved populations. We believe that the main reason for this high percentage of health equity focus is due to the focus of the RE-AIM outcomes on representativeness which lends itself to health equity applications [20]. This trend should be further broadened to include the standard use of equity-related factors in each of the PRISM domains.

The application, operationalization, and assessment of every construct within PRISM including the implementation outcomes reflected in RE-AIM within a single study can be challenging [70]. Only a small percentage of originally identified articles met the criteria for the “integrated” use of PRISM. Given several new developments related to implications and use of RE-AIM to address equity issues, which is a key part of the PRISM framework, there is likely to be a lot more in the near future [27, 71,72,73]. Thus, it is timely to review what has been learned and to make recommendations for future applications of PRISM.

Key findings from our review are that (1) PRISM has been primarily used in outpatient clinical settings and in the US; (2) it has been used to study a variety of issues and conditions using a wide range of experimental designs and often using mixed methods; (3) most studies have reported on half or more of the PRISM domains and over half of the studies reported on at least 5 of the 6 domains; (4) PRISM contextual components most frequently assessed were the Program/Intervention characteristics from the organizational perspective, the Implementation and Sustainability Infrastructure, and the Organizational and Individual Recipient characteristics; (5) PRISM contextual components were most frequently operationalized using qualitative methods followed by quantitative, mixed-, and multi-method approaches; and (6) for the RE-AIM aspects of PRISM, the outcomes most often reported were Implementation and Maintenance.

Compared to the widespread use of RE-AIM, there has been a modest uptake of PRISM, especially until the last few years. There are multiple potential reasons for this finding including that the original article was not in a high-impact journal and was published before Open Access and citation services dramatically increased article accessibility. Other reasons likely include that the National RE-AIM Working Group until very recently has not promoted PRISM and that it has not been taught as part of the major training programs in D&I science. Finally, to date, most studies have treated PRISM and RE-AIM as separate frameworks rather than reporting them as directly related, and PRISM as being an expansion of RE-AIM [27, 71, 74]. These findings present both a need and an opportunity for future researchers to better incorporate the full PRISM framework into their studies. In this review, only six of the 23 studies included any RE-AIM outcomes, despite these outcomes being an explicit part of the original model (Table 3). More consistent inclusion of RE-AIM outcomes would also allow for more robust assessments of how PRISM domains impact implementation outcomes, including formal mediation or moderation analysis.

We found that due to the lack of consistency and specificity in the use of PRISM and reporting on the operationalization of the PRISM domains, it was challenging to synthesize information across studies on the contributions of PRISM to support planning, implementation, and evaluation. When reviewing the eight studies that identified specific lessons learned about the use of PRISM, we noted that these studies found PRISM useful in supporting planning, implementation, and evaluation efforts especially due its multilevel, contextual orientation. More comprehensive and proactive use of PRISM in future studies will allow the broader analysis and synthesis of conclusions and lessons learned.

Strengths and limitations

This review has both strengths and limitations. Limitations include that the review was limited to English language reports and to published research. It is possible that creative work and important examples of cultural adaptations using PRISM may have been missed with these decisions. The resulting 23 studies, while a large enough sample to draw conclusions and suggest directions for future application, is too small to conduct meta-analyses or draw definitive conclusions. Furthermore, our review relied on the initial classification of papers regarding the use of PRISM based on the information provided in the published papers that were identified through our multi-step search and validation process. It is possible that contacting the corresponding authors of these papers could have yielded more information about the use and resulted in different classification of these papers (e.g., ‘integrated’ instead of ‘directed’ use). This paper was also solely focused on describing pattern of use for studies that were classified as integrated use. Future papers could explore how PRISM and other TMFs have been used I n Framing and Directed studies. Finally, studies provided less consistent information on the operationalization of each PRISM domain which limited our ability to systematically report and synthesize information about this aspect. In this paper, we were able to include information about the methods used to operationalize domains and the most frequent techniques used for data collection.

Strengths of this review include following PRISMA recommendations and reporting standards; the use of multiple reviewers and coders at all review stages; and the use of the application categories previously developed by Field et al. [29] to justify and explain exclusions. We also used multiple search strategies, including reverse citation approaches and recommendations from prominent investigators- these proved effective in increasing the number of relevant articles.

Next steps and recommendations

We summarize key recommendations for research and practice directions:

For research, we recommend:

  1. 1.

    The development and validation of more quantitative measures of PRISM, especially those that meet pragmatic [75] and the PAPERS [76] criteria. This will allow greater mixed-methods research on PRISM and understanding of various linkages.

  2. 2.

    The use of common and where applicable, standardized PRISM definitions, assessments, and criteria. We note examples of mixed methods research with PRISM, including survey and qualitative interview guides as well as a new interactive PRSIM assessment and feedback tool that will soon be available on the re-aim.org website.

  3. 3.

    While preferred to advance implementation science, for pragmatic use it is not necessary to use all PRISM components or to use PRISM at all program time points (i.e., pre-implementation, implementation, sustainment [70]). When not feasible, authors should briefly and transparently state why certain components were not used or why PRISM was only used at one time point.

  4. 4.

    More investigations and transparent reporting are needed that (a) compare PRISM with other TMFs and create clear cross-walks between PRISM and other TMFs; (b) combine PRSIM with other models; and (c) adapt PRISM to diverse contexts and content areas.

  5. 5.

    Patient and community member issues involving (a) characteristics components of PRISM can be highlighted more; including especially social determinants of health and other equity-related issues; and (b) perceptions of the beneficiary of the intervention (e.g., patient-centeredness, trialability, relative advantage/etc.)

  6. 6.

    Consider using PRISM in more diverse settings including community, school, worksite, and other non-clinical contexts, especially including low resource settings and low- and middle-income countries.

For implementation practice, we recommend:

  1. 1.

    Reports on how PRISM is used with different types of implementation partners, in multi-sector research, and for team science, including the time involved and lessons learned.

  2. 2.

    Use of PRISM in logic models and to develop participatory implementation strategies that can help to address priority outcomes.

  3. 3.

    As discussed in the section on clarification, reviewing PRISM terminology to make it more user-friendly and relevant to the context of the implementation practice—for example changing some terms such as “patients” or “recipients.”

  4. 4.

    Development and usability evaluations of interactive tools and resources including videos that illustrate and guide PRISM use.

Conclusions

Although initial uptake of PRISM was slow after its initial publication in 2008, usage has increased and over 50 studies were published in 2019 and the most of 2020. While there are opportunities to further expand integrated use of PRISM and more explicit reports on linkage to RE-AIM outcomes, this review has produced learnings and recommendations for future directions. It is hoped this publication will encourage more sophisticated use and reporting on PRISM to inform both research and practice on contextual factors in implementation.

Availability of data and materials

The datasets analyzed during the current study available from the corresponding author on reasonable request. A separate protocol was to prepared for this study.

References

  1. Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin Transl Sci. 2012;5(1):48–55.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. 2nd ed. New York: Oxford University Press; 2018.

    Google Scholar 

  3. May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016;11(1):141.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43.

    PubMed  Google Scholar 

  5. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Birken SA, Rohweder CL, Powell BJ, Shea CM, Scott J, Leeman J, et al. T-CaST: an implementation theory comparison and selection tool. Implement Sci. 2018;13(1):143.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Brownson RC, Kumanyika SK, Kreuter MW, Haire-Joshu D. Implementation science should give higher priority to health equity. Implement Sci. 2021;16(1):28.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Kislov R, Pope C, Martin GP, Wilson PM. Harnessing the power of theorising in implementation science. Implement Sci. 2019;14(1):103.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Wensing M, Sales A, Wilson P, Armstrong R, Kislov R, Rankin NM, et al. Implementation Science and Implementation Science Communications: a refreshed description of the journals’ scope and expectations. Implement Sci. 2021;16(1):103.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Serv Res. 2019;19(1):189.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Movsisyan A, Arnold L, Evans R, Hallingberg B, Moore G, O’Cathain A, et al. Adapting evidence-informed complex population health interventions for new contexts: a systematic review of guidance. Implement Sci. 2019;14(1):105.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework. Implement Sci. 2017;12(1):21.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Damschroder LJ. Clarity out of chaos: use of theory in implementation research. Psychiatry Res. 2020;283:112461.

    Article  PubMed  Google Scholar 

  14. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Squires JE, Graham ID, Hutchinson AM, Michie S, Francis JJ, Sales A, et al. Identifying the domains of context important to implementation science: a study protocol. Implement Sci. 2015;10(1):135.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Schroeder D, Luig T, Finch TL, Beesoon S, Campbell-Scherer DL. Understanding implementation context and social processes through integrating Normalization Process Theory (NPT) and the Consolidated Framework for Implementation Research (CFIR). Implement Sci Commun. 2022;3(1):13.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Watson DP, Adams EL, Shue S, Coates H, McGuire A, Chesher J, et al. Defining the external implementation context: an integrative systematic literature review. BMC Health Serv Res. 2018;18(1):209.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Moore GF, Evans RE, Hawkins J, Littlecott H, Melendez-Torres GJ, Bonell C, et al. From complex social interventions to interventions in complex social systems: future directions and unresolved questions for intervention development and evaluation. Evaluation (Lond). 2019;25(1):23–45.

    Article  Google Scholar 

  19. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Shelton RC, Chambers DA, Glasgow RE. An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time. Front Public Health. 2020;8:134.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, et al. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci. 2012;7(1):32.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38(2):65–76.

    Article  Google Scholar 

  23. Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14(2):117–23.

    Article  PubMed  Google Scholar 

  24. Beck A, Bergman DA, Rahm AK, Dearing JW, Glasgow RE. Using implementation and dissemination concepts to spread 21st-century well-child care at a health maintenance organization. Perm J. 2009;13(3):10–8.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Liles EG, Schneider JL, Feldstein AC, Mosen DM, Perrin N, Rosales AG, et al. Implementation challenges and successes of a population-based colorectal cancer screening program: a qualitative study of stakeholder perspectives. Implement Sci. 2015;10:41.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health. 2019;7:64.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Bergström A, Ehrenberg A, Eldh AC, Graham ID, Gustafsson K, Harvey G, et al. The use of the PARIHS framework in implementation research and practice-a citation analysis of the literature. Implement Sci. 2020;15(1):68.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Field B, Booth A, Ilott I, Gerrish K. Using the Knowledge to Action Framework in practice: a citation analysis and systematic review. Implement Sci. 2014;9(1):172.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Harden SM, Gaglio B, Shoup JA, Kinney KA, Johnson SB, Brito F, et al. Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review. Syst Rev. 2015;4:155.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013;103(6):e38–46.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde J. A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:337–81.

    Article  Google Scholar 

  33. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Braveman PAE, Orleans T, Proctor D, Plough A. What is health equity? Robert Wood Johnson Foundation; 2017. [updated 5/1/2017]. Available from: https://www.rwjf.org/en/library/research/2017/05/what-is-health-equity-.html.

    Google Scholar 

  35. Ameling JM, Ephraim PL, Bone LR, Levine DM, Roter DL, Wolff JL, et al. Adapting hypertension selfmanagement interventions to enhance their sustained effectiveness among urban African Americans. Fam Commun Health. 2014;37(2):119–33.

    Article  Google Scholar 

  36. Ayele RA, Lawrence E, McCreight M, Fehling K, Peterson J, Glasgow RE, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient’s medical home. BMC Health Serv Res. 2017;17(1):123.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Ayele RA, Lawrence E, McCreight M, Fehling K, Glasgow RE, Rabin BA, et al. Perspectives of Clinicians, Staff, and Veterans in Transitioning Veterans from non-VA Hospitals to Primary Care in a Single VA Healthcare System. J Hosp Med. 2019;14(3):E1–e7.

  38. McCreight MS, Rabin BA, Glasgow RE, Ayele RA, Leonard CA, Gilmartin HM, et al. Using the Practical, Robust Implementation and Sustainability Model (PRISM) to qualitatively assess multilevel contextual factors to help plan, implement, evaluate, and disseminate health services programs. Transl Behav Med. 2019;9(6):1002–11.

    Article  PubMed  Google Scholar 

  39. Ekawati FM, Licqurish S, Emilia O, Gunn J, Brennecke S, Lau P. Developing management pathways for hypertensive disorders of pregnancy (HDP) in Indonesian primary care: a study protocol. Reprod Health. 2019;16(1):12.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Ekawati FM, Emilia O, Gunn J, Licqurish S, Lau P. The elephant in the room: an exploratory study of hypertensive disorders of pregnancy (HDP) management in Indonesian primary care settings. BMC Fam Pract. 2020;21(1):242.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Esses SA, Small S, Rodemann A, Hartman ME. Post-Intensive Care Syndrome: Educational Interventions for Parents of Hospitalized Children. Am J Crit Care. 2019;28(1):19–27.

    Article  PubMed  Google Scholar 

  42. Gopalan G. Feasibility of improving child behavioral health using task-shifting to implement the 4Rs and 2Ss program for strengthening families in child welfare. Pilot Feasibility Stud. 2016;2(1):1–3.

    Article  Google Scholar 

  43. Gopalan G, Hooley C, Winters A, Stephens T. Perceptions Among Child Welfare Staff when Modifying A Child Mental Health Intervention to be Implemented in Child Welfare Services. Am J Community Psychol. 2019;63(3–4):366–77.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Hooley C, Winters AM, Pisciotta C, Gopalan G. Caregiver-relevant perspectives from a multi-stakeholder collaborative advisory board on adapting a child mental health intervention to be delivered in child-welfare settings. J Public Child Welf. 2020:1–23.

  45. Gopalan G, Franco LM, Dean-Assael K, McGuire-Schwartz M, Chacko A, McKay M. Statewide implementation of the 4 Rs and 2 Ss for strengthening families. J Evid Based Soc Work. 2014;11(1-2):84–96.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Henderson V, Tossas-Milligan K, Martinez E, Williams B, Torres P, Mannan N, et al. Implementation of an integrated framework for a breast cancer screening and navigation program for women from underresourced communities. Cancer. 2020;126(Suppl 10):2481–93.

    Article  PubMed  Google Scholar 

  47. Knudsen HK, Drainoni M-L, Gilbert L, Huerta TR, Oser CB, Aldrich AM, et al. Model and approach for assessing implementation context and fidelity in the HEALing Communities Study. Drug Alcohol Depend. 2020;217:108330.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Leonard C, Gilmartin H, McCreight M, Kelley L, Lippmann B, Mayberry A, et al. Operationalizing an implementation framework to disseminate a care coordination program for rural veterans. J Gen Intern Med. 2019;34(Suppl 1):58–66.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Leonard C, Lawrence E, McCreight M, Lippmann B, Kelley L, Mayberry A, et al. Implementation and dissemination of a transition of care program for rural veterans: a controlled before and after study. Implement Sci. 2017;12(1):123.

  50. Linke SE, Kallenberg GR, Kronick R, Tai-Seale M, De-Guzman K, Rabin B. Integrating “Exercise Is Medicine” into primary care workflow: a study protocol. Transl Behav Med. 2020.

  51. Paniagua-Avila A, Fort MP, Glasgow RE, Gulayin P, Hernández-Galdamez D, Mansilla K, et al. Evaluating a multicomponent program to improve hypertension control in Guatemala: study protocol for an effectiveness-implementation cluster randomized trial. Trials. 2020;21(1):509.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Pittman JOE, Davidson EJ, Dozier ME, Blanco BH, Baer KA, Twamley EW, et al. Implementation and evaluation of a community-based treatment for late-life hoarding. Int Psychogeriatr. 2020:1–10.

  53. Satre DD, Anderson AN, Leibowitz AS, Levine-Hall T, Slome S, Flamm J, et al. Implementing electronic substance use disorder and depression and anxiety screening and behavioral interventions in primary care clinics serving people with HIV: Protocol for the Promoting Access to Care Engagement (PACE) trial. Contemp Clin Trials. 2019;84.

  54. Schneider JL, Davis J, Kauffman TL, Reiss JA, McGinley C, Arnold K, et al. Stakeholder perspectives on implementing a universal Lynch syndrome screening program: a qualitative study of early barriers and facilitators. Genet Med. 2016;18(2):152–61.

    Article  PubMed  Google Scholar 

  55. Schölin L, Fitzgerald N. The conversation matters: a qualitative study exploring the implementation of alcohol screening and brief interventions in antenatal care in Scotland. BMC Pregnancy Childbirth. 2019;19(1):316.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Shields N, Willis C, Imms C, Prendergast LA, Watts JJ, van Dorsselaer B, et al. FitSkills: protocol for a stepped wedge cluster randomised trial of a community-based exercise programme to increase participation among young people with disability. BMJ Open. 2020;10(7):e037153.

  57. Ssewamala FM, Sensoy Bahar O, McKay MM, Hoagwood K, Huang KY, Pringle B. Strengthening mental health and research training in Sub-Saharan Africa (SMART Africa): Uganda study protocol. Trials. 2018;19(1):423.

    Article  PubMed  PubMed Central  Google Scholar 

  58. McKay MM, Sensoy Bahar O, Ssewamala FM. Implementation science in global health settings: Collaborating with governmental & community partners in Uganda. Psychiatry Res. 2020;283.

  59. Stephens TN, McGuire-Schwartz M, Rotko L, Fuss A, McKay MM. A learning collaborative supporting the implementation of an evidence-informed program, the “4Rs and 2Ss for children with conduct difficulties and their families”. J Evid Based Soc Work. 2014;11(5):511–23.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Sullivan JL, Shin MH, Engle RL, Yaksic E, Lukas CV, Paasche-Orlow MK, et al. Evaluating the implementation of project Re-Engineered Discharge (RED) in five Veterans Health Administration (VHA) hospitals. Jt Comm J Qual Patient Saf. 2018;44(11):663–73.

    PubMed  Google Scholar 

  61. Woodbridge MW, Sumi WC, Yu J, Rouspil K, Javitz HS, Seeley JR, et al. Implementation and Sustainability of an Evidence-Based Program Lessons Learned From the PRISM Applied to First Step to Success. J Emot Behav Disord. 2014;22(2):95–106.

    Article  Google Scholar 

  62. Yakovchenko V, Hogan TP, Houston TK, Richardson L, Lipschitz J, Petrakis BA, et al. Automated text messaging with patients in Department of Veterans Affairs specialty clinics: Cluster randomized trial. J Med Internet Res. 2019;21(8).

  63. Zhang R, Chen Y, Liu S, Liang S, Wang G, Li L, et al. Progress of equalizing basic public health services in Southwest China--- health education delivery in primary healthcare sectors. BMC Health Serv Res. 2020;20(1):247.

  64. Li L, Zhang R, Chen Y, Deng H, Liu S, Wang G, et al. Achievements and challenges in health management for aged individuals in primary health care sectors: a survey in Southwest China. BMC Public Health. 2020;20(1):338.

  65. Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Balasubramanian BA, Cohen DJ, Davis MM, Gunn R, Dickinson LM, Miller WL, et al. Learning evaluation: blending quality improvement and implementation research methods to study healthcare innovations. Implement Sci. 2015;10:31.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Sallis JF, Owen N, Fisher EB. Ecological models of health behavior. In: Health behavior and health education: theory, research, and practice. 4th ed. San Francisco: Jossey-Bass; 2008. p. 465–85.

    Google Scholar 

  68. Raval SJ, Kant R. Study on Lean Six Sigma frameworks: a critical literature review. Int J Lean Six Sigma. 2017;8(3):275–334.

    Article  Google Scholar 

  69. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  70. Glasgow RE, Estabrooks PE. Pragmatic applications of RE-AIM for health care initiatives in community and clinical settings. Prev Chronic Dis. 2018;15:E02.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Holtrop JS, Estabrooks PA, Gaglio B, Harden SM, Kessler RS, King DK, et al. Understanding and applying the RE-AIM framework: Clarifications and resources. J Clin Transl Sci. 2021;5(1):e126.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Matlock DD, Fukunaga MI, Tan A, Knoepke C, McNeal DM, Mazor KM, et al. Enhancing success of medicare’s shared decision making mandates using implementation science: examples applying the Pragmatic Robust Implementation and Sustainability Model (PRISM). MDM Policy Pract. 2020;5(2):2381468320963070.

    PubMed  PubMed Central  Google Scholar 

  73. Glasgow RE, Studts T, Ford B. RE-AIM online: FameThemes; 2022. Available from: https://re-aim.org/. Cited 2022 4/11/22

    Google Scholar 

  74. Glasgow RE, Estabrooks PA, Ory MG. Characterizing evolving frameworks: issues from Esmail et al. (2020) review. Implement Sci. 2020;15(1):53.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Glasgow RE, Riley WT. Pragmatic measures: what they are and why we need them. Am J Prev Med. 2013;45(2):237–43.

    Article  PubMed  Google Scholar 

  76. Lewis CC, Mettert KD, Stanick CF, Halko HM, Nolen EA, Powell BJ, et al. The psychometric and pragmatic evidence rating scale (PAPERS) for measure development and evaluation. Implement Res Pract. 2021;2:26334895211037391.

    Google Scholar 

Download references

Acknowledgements

We appreciate the guidance from the National RE-AIM Workgroup for their feedback on the original concept of this manuscript.

Funding

Dr. Rabin’s time was partially funded through the National Institutes of Health UL1TR001442, UC San Diego ACTRI Dissemination and Implementation Science Center (UC San Diego Health Sciences). Dr. Glasgow’s time was partially funded through the National Cancer Institute Implementation Science Center P50CA244688.

Author information

Authors and Affiliations

  1. Herbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, 9500 Gillman Drive, La Jolla, CA, 92037, USA

    Borsika A. Rabin & Julie Cakici

  2. UC San Diego Altman Clinical and Translational Research Center Dissemination and Implementation Science Center, UC San Diego, 9500 Gillman Drive, La Jolla, CA, 92037, USA

    Borsika A. Rabin & Julie Cakici

  3. Dissemination and Implementation Science Program, Adult & Child Center for Health Outcomes Research & Delivery Science; and Department of Family Medicine, University of Colorado, 1635 Aurora Ct, Aurora, CO, 80045, USA

    Borsika A. Rabin & Russell E. Glasgow

  4. School of Public Health, San Diego State University, 5500 Campanile Drive, San Diego, CA, 92182, USA

    Julie Cakici

  5. University of Nebraska Medical Center, 42nd and Emile St, Omaha, NE, 68198, USA

    Caitlin A. Golden

  6. Health & Kinesiology, College of Health, University of Utah, 248 HPER North, 260 South 1850 East, Salt Lake City, UT, 84112, USA

    Paul A. Estabrooks

  7. Patient-Centered Research, Evidera, 7101 Wisconsin Ave, Suite 1400, Bethesda, MD, 20814, USA

    Bridget Gaglio

Authors
  1. Borsika A. Rabin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julie Cakici
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Caitlin A. Golden
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paul A. Estabrooks
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Russell E. Glasgow
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Bridget Gaglio
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

BR, JC, CG, BG, RG, and PE conceptualized the manuscript; BR, JC, CG, and BG formalized the methods, led the review of the papers, abstracted the papers, and drafted tables for the manuscript. All authors drafted different sections of the manuscript. All authors read and approved the final manuscript.

Authors’ information

Dr. Rabin, Dr. Estabrooks, Dr. Glasgow, and Dr. Gaglio are members of the National RE-AIM Workgroup.

Corresponding author

Correspondence to Borsika A. Rabin.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no financial or non-financial competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Abstraction form.

Additional file 2.

All papers included in the Practical, Robust Implementation and Sustainability Model review with level of use and search source.

Additional file 3.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rabin, B.A., Cakici, J., Golden, C.A. et al. A citation analysis and scoping systematic review of the operationalization of the Practical, Robust Implementation and Sustainability Model (PRISM). Implementation Sci 17, 62 (2022). https://doi.org/10.1186/s13012-022-01234-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-022-01234-3

Keywords

Implementation Science

ISSN: 1748-5908