- Systematic review
- Open Access
- Open Peer Review
Effective strategies for scaling up evidence-based practices in primary care: a systematic review
Implementation Sciencevolume 12, Article number: 139 (2017)
While an extensive array of existing evidence-based practices (EBPs) have the potential to improve patient outcomes, little is known about how to implement EBPs on a larger scale. Therefore, we sought to identify effective strategies for scaling up EBPs in primary care.
We conducted a systematic review with the following inclusion criteria: (i) study design: randomized and non-randomized controlled trials, before-and-after (with/without control), and interrupted time series; (ii) participants: primary care-related units (e.g., clinical sites, patients); (iii) intervention: any strategy used to scale up an EBP; (iv) comparator: no restrictions; and (v) outcomes: no restrictions. We searched MEDLINE, Embase, PsycINFO, Web of Science, CINAHL, and the Cochrane Library from database inception to August 2016 and consulted clinical trial registries and gray literature. Two reviewers independently selected eligible studies, then extracted and analyzed data following the Cochrane methodology. We extracted components of scaling-up strategies and classified them into five categories: infrastructure, policy/regulation, financial, human resources-related, and patient involvement. We extracted scaling-up process outcomes, such as coverage, and provider/patient outcomes. We validated data extraction with study authors.
We included 14 studies. They were published since 2003 and primarily conducted in low-/middle-income countries (n = 11). Most were funded by governmental organizations (n = 8). The clinical area most represented was infectious diseases (HIV, tuberculosis, and malaria, n = 8), followed by newborn/child care (n = 4), depression (n = 1), and preventing seniors’ falls (n = 1). Study designs were mostly before-and-after (without control, n = 8). The most frequently targeted unit of scaling up was the clinical site (n = 11). The component of a scaling-up strategy most frequently mentioned was human resource-related (n = 12). All studies reported patient/provider outcomes. Three studies reported scaling-up coverage, but no study quantitatively reported achieving a coverage of 80% in combination with a favorable impact.
We found few studies assessing strategies for scaling up EBPs in primary care settings. It is uncertain whether any strategies were effective as most studies focused more on patient/provider outcomes and less on scaling-up process outcomes. Minimal consensus on the metrics of scaling up are needed for assessing the scaling up of EBPs in primary care.
This review is registered as PROSPERO CRD42016041461.
Primary care is a critical component of the health system and is at the heart of important reforms [1,2,3]. Evidence shows that countries with a strong primary care component in their health system have better health outcomes and are better at keeping costs under control [4, 5]. Primary care delivery is also associated with lower mortality rates and a more equitable distribution of health in populations than is specialty care . In addition, primary care reaches more people. In Canada, for example, more than three times as many people with chronic diseases contact a primary care physician than contact a specialist . Unfortunately, despite its importance, the provision of primary care consistent with the exponentially increasing evidence is variable. Evidence-practice gaps are a concern and reduce the potential benefit of primary care health services to the community [7, 8].
The development of evidence-based practices (EBPs) generally follows several steps including the testing of the practice under optimal conditions (efficacy trials), followed by testing in real-world conditions (effectiveness trials) . There have been many efforts to generate evidence and determine the degree of rigor required to qualify practices and programs as evidence-based . This has resulted in an extensive array of new ideas, products, services, care, tools, programs, and policies whose evidence base has been rigorously established. However, there is a widespread failure to extend these practices to larger populations. Scaling up EBPs to primary care contexts specifically could benefit the quality of care for a larger number of individuals. In order for EBPs to realize their full benefits in primary care, there is a need to understand how they can move from single trials of local innovative projects to broad-scale use.
Although scaling up is an acknowledged concept in the field of knowledge translation and implementation science, most publications focus on methods or strategies to enhance the uptake, implementation, or sustainability of EBPs, while leaving out the step of scaling up the implementation to enable the EBPs to benefit whole populations [11,12,13]. A clear definition of scaling up has not emerged in the literature, nor have many theories, frameworks, or strategies been proposed to support its implementation . The term “spread” is commonly used interchangeably with “scale up” [14,15,16]. However, while “spread” suggests the organic process of the diffusion of a local improvement within a health system , “scale up” implies a systematic approach often used in the context of rolling out a successful local program to regional, national, or international levels .
As we were not aware of any systematic reviews (completed or in progress), we sought to identify effective strategies for scaling up EBPs in primary care.
We conducted a systematic review, following the methodology suggested by the Cochrane Effective Practice and Organisation of Care (EPOC) Review Group . We reported our findings according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement [19, 20]. The review is registered in the International Prospective Register of Systematic Reviews (PROSPERO, CRD42016041461) .
Criteria for considering studies for this review
Our specific research question was: “What are effective strategies for the scaling up of EBPs in primary care?” Following the PICO approach (participants, intervention, comparator, outcome), we used the following criteria: participants (P)—any individual, organization, or system involved in the delivery or receipt of primary health services that was the target of the scale-up of an EBP; intervention (I)—any component of a strategy used to scale up an EBP; comparator (C)—no restrictions; and outcomes (O)—any outcomes (i.e., no restriction), including measures associated with the scaling-up process (e.g., number of targeted units that benefited from the use of an EBP out of all of those targeted) and provider- or patient-reported outcomes regarding the effect of the EBP (Additional file 1).
Types of participants
We included any individual, organization, or system involved in the delivery or receipt of primary health services (e.g., geographical regions, clinical sites, policymakers/managers, health care providers, patients) that were the target of the scale-up of an EBP. We refer to these targeted participants as the “units” that the EBP was intended to reach (i.e., intended recipients). For example, an EBP could be implemented in several clinical sites to cover a certain number of patients; we identified both as units. Furthermore, we defined primary care, in the context of this review, as the level of the health system that provides individuals with (1) the first point of access to the system for all their health needs and problems; (2) care for all but very uncommon or unusual conditions; (3) continuity of care; and (4) the coordination or integration of the care provided by other levels of the system or by other professionals [22, 23]. Primary and secondary care each have their own cultures, policies, and traditions, and a clear difference between implementation and impact issues in these two settings has been identified . As we were not aware of strategies to scale EBPs in any medical setting , we chose to identify scaling-up strategies potentially useful and transferable to primary care settings. Scaling-up efforts in this setting are likely to impact larger populations, are more likely to increase equity, and have more important health outcomes [3,4,5,6].
Types of interventions and comparators
We included any component of a strategy used to scale up an EBP. In the context of this review, a scaling-up strategy refers to any process that aims to expand the coverage of an EBP (i.e., a practice that has been reported successful by the authors) to multiple settings (or targeted primary care units). We drew a distinction between the components of strategies used to expand an EBP (i.e., scaling-up strategies, our main focus as the intervention of interest) and the components of the EBP itself [9, 26].
Combining Cochrane’s EPOC guidelines with various published scaling-up guides [16, 27,28,29], we identified the five following components of scaling-up strategies: (C1) healthcare infrastructure-related (e.g., providing medical equipment or changing linkages within a health system), (C2) policy and regulation-related (e.g., revising policy to allow widespread community-based case management of a disease), (C3) financing-related (e.g., changing payment mechanisms), (C4) human resource-related (e.g., training and deployment of health care providers, changing roles of administrators), and (C5) patient-related (e.g., involving patients/public in recruitment or promotion). We defined a vertical scaling-up strategy as the expansion of an EBP simultaneously to a whole system (as a result of a change of national policy, for example), while a horizontal scaling-up strategy referred to the expansion of an EBP across different settings in a phased manner [16, 27].
Finally, the comparator consisted of one or more alternative scaling-up strategies or usual practice (i.e., no restrictions).
We considered a wide range of outcomes (i.e., no restrictions). First, we considered measures associated with the scaling-up process, such as the coverage of the targeted units and cost of scaling up the EBP. Within the concept of coverage, some distinguish between “reach” (individuals targeted who were reached by the intervention) and “adoption” (institutions targeted that adopted the intervention) [27, 30,31,32]. In keeping with a recent study by Fixsen et al., we defined coverage as the number of the targeted units (individuals, organizations, or systems) that were benefiting from the use of the EBP (i.e., the numerator for the scaling up) divided by the total number of targeted units (i.e., the denominator for the scaling up) . Second, we also considered any reported outcomes at the level of the health system (e.g., clinical site performance) as well as provider- and patient-reported outcomes regarding the effect of the EBPs.
Types of studies
We considered randomized and non-randomized controlled trials, controlled before-and-after, before-and-after (i.e., pre-post with no control group), and interrupted time series (with at least three data points before and after the scaling up). We excluded literature reviews and meta-analyses. Finally, there were no restrictions on length of study follow-up, language of publication, or country of origin.
Our information specialist (RL) performed the search strategy to identify published studies in the following electronic bibliographic databases (from inception to 30th August 2016): MEDLINE (Ovid and PubMed), Embase, PsycINFO, Web of Science, CINAHL, and the Cochrane Library. The search terms were developed in consultation with the other authors using a combination of keywords and Medical Subject Headings (MeSH). We also followed some recommendations of a previous review about terms to use for scaling up . The search strategy was first developed in MEDLINE (Ovid) (Additional file 2) and was adapted to the other databases. We used keywords such as “scaling up,” “scalability,” or “spread.” We used an adapted filter for limiting the search to studies conducted in primary care settings  and a study design filter. All search results were imported into EndNote X7. Duplicate search results were identified by the software and were eliminated using a method that enables retaining unique citations without accidentally excluding false duplicates .
We also conducted searches in clinical trial registries and identified gray literature using the search engines and websites of relevant organizations (Additional file 3). We searched published bibliographies of related topics and citations in included articles, and contacted experts in the field and relevant organizations in Canada (e.g., Canadian Institutes of Health Research, Primary Health Care Innovation Teams ).
We developed a study selection form based on our eligibility criteria. After removal of duplicates, two review authors (ABC, LL) independently piloted the study selection form with a small random sample of studies to assess understanding of eligibility criteria and ease of use of the form. Two review authors independently screened all titles/abstracts and full text to identify the relevant studies. For all ineligible studies, we documented the main reason for exclusion. Discrepancies between review authors regarding study eligibility were resolved by consensus or, when required, with a third party (FL, HTVZ).
We developed a data extraction form using a guide for scaling up [27, 37] and the Cochrane EPOC resources . Two review authors (ABC, LL) independently extracted characteristics from the included studies: year of publication, the country’s economic status (low-, middle-, or high-income), funding source, clinical area, study design, setting, name of EBP, and PICO elements. We also extracted the number of components of (multifaceted) scaling-up strategies mentioned in each study, the number of units targeted, the number of units covered, the timeframe of the scaling-up process and the frameworks/theories used. We validated data extraction of eligible studies with their authors by email with a reminder through ResearchGate (Additional file 4). We resolved any disagreement in the data collection process through discussion and consensus between the two reviewers and, if needed, with a third party (FL, HTVZ).
Two independent reviewers completed the quality assessment of each included study using the Quality Assessment Tool for Quantitative Studies developed by the Effective Public Health Practice Project . This generic tool is used to evaluate a variety of intervention study designs such as randomized and non-randomized controlled studies, controlled before-and-after studies, and uncontrolled studies. The tool has been assessed for content and construct validity and meets accepted standards . In addition, unlike the Cochrane Collaboration Risk of Bias Tool, the tool performs with high interrater reliability . It assesses six domains: selection bias, study design, confounders, blinding, data collection method, and withdrawals/dropouts. Each domain was rated “strong,” “moderate,” or “weak.” Studies were assigned a quality rating of strong (if no domain was rated weak), moderate (if one domain was rated weak), or weak (if at least two domains were rated weak). All disagreements were resolved through discussion between the two reviewers and a third party.
We used the PRISMA flowchart to describe the process of study selection . The nature of our question, along with the lack of a standard methodological approach for evaluating scaling-up strategies, meant that it was not feasible to perform a meta-analysis . Thus, data extracted from the included studies were analyzed using simple frequency counts and a narrative approach . We described general characteristics of included studies, participants, components of scaling-up strategies, successful coverage of the targeted units, and impact of the strategies. We defined a successful scaling-up strategy as one which achieved 80% of the intended coverage of targeted units with a favorable impact on the main outcomes of the study. This coverage threshold is defined in several international scaling-up initiatives, including Avahan (India) [43,44,45], Reaching Every District (World Health Organization) [46,47,48], and the US President’s Emergency Plan for AIDS Relief . In addition, the 80% threshold was the saturation level used in a synthesis of over 500 studies on the impact of implementation processes . Finally, we also described the quality assessment of all included studies.
Our electronic search identified 2997 potentially relevant studies. Of these, 1510 were duplicates, leaving 1487 studies. Of these, 1215 did not meet the review criteria. Thus, we reviewed a total of 272 full-text papers and retained 12. A second search (author contacts and gray literature) led to the inclusion of two additional studies. Overall, a total of 14 unique studies were included in this review [51,52,53,54,55,56,57,58,59,60,61,62,63,64] (Fig. 1).
Characteristics of included studies
Characteristics of included studies are outlined in Table 1. All included studies were published since 2003. The majority were conducted in middle-income countries (n = 6) [51, 53, 58, 59, 61, 64], followed by low-income countries (n = 5) [52, 54, 55, 60, 63] and high-income countries (n = 3) [56, 57, 62]. They were mostly funded by international (e.g., United Nations) and/or national governmental organizations (n = 8) [51,52,53,54, 57, 59, 60, 63], followed by voluntary or charitable bodies (n = 3) [55, 61, 64] and research bodies (n = 1) . For two studies [58, 62], this information was not found. Most EBPs concerned preventing or treating infectious diseases: HIV, tuberculosis, and malaria (n = 8) [51,52,53,54, 56, 58, 59, 61]. Others concerned newborn/child care (n = 4) [55, 60, 63, 64], depression (n = 1) , and preventing seniors’ falls (n = 1) .
The majority of study designs were before-and-after (no control) (n = 8) [52,53,54,55, 57, 59, 61, 64], followed by six studies with control groups: non-randomized controlled trials (n = 4) [51, 56, 60, 63], randomized controlled trials (n = 1) , and controlled before-and-after (n = 1) .
Targeted units (i.e., intended recipients) were mostly clinical sites (n = 11) [52,53,54,55,56, 58,59,60,61,62, 64], followed by patients (n = 5) [51, 53, 59, 60, 62], geographical regions (n = 4) [51, 60, 61, 63], and health care providers (n = 2) [54, 57] (Table 1).
Components of scaling-up strategies mentioned in the studies were, in order of frequency, those relating to human resources (C4) (e.g., policymakers/managers, providers, external medical consultants and community healthcare workers) (n = 12) [51, 53,54,55,56,57,58,59,60, 62,63,64], components relating to healthcare infrastructure (C1) (e.g., new buildings, linkages between different clinical sites) (n = 6) [55, 58, 60, 62,63,64], components related to changes in policy/regulation (C2) (n = 5) [52, 56, 59, 60, 63], and components related to financing (C3) (e.g., paying bonuses to healthcare workers) (n = 2) [62, 63]. As reported in Table 1, eight studies mentioned several components of a multifaceted scaling-up strategy [55, 56, 58,59,60, 62,63,64] (ranging from two to four components), while five studies [51,52,53,54, 57] only mentioned one component. Six studies [55, 58, 60,61,62, 64] reported on scaling up an EBP across different settings in a phased manner (i.e., horizontal scaling-up strategy). Eight studies did not mention whether the scaling up was horizontal (phased) or vertical (simultaneously to a whole system).
Only five studies [51, 55, 57, 60, 61] reported scaling-up process outcomes: three studies [51, 57, 61] reported coverage of the targeted units, one study  reported on costs, and two studies [57, 60] reported on other process measures (Table 1).
Three studies [51, 57, 61] reported coverage comprehensively, i.e., number of targeted units that received the EBP over all those targeted. Respectively, these scaling-up coverages were achieved after 30, 22, and 57 months of the scaling-up process (Table 2). As detailed in Table 2, information on coverage was unavailable or incomplete in 11 studies. Seven studies reported only the number of units targeted (denominator) but not the number covered (numerator) [52, 55, 56, 58, 59, 63, 64]; three reported the number of patients/providers covered and the number of sites targeted [53, 54, 62]; one reported the number of sites covered but the number of patients targeted .
Beyond scaling-up process measures, patient outcomes were the most reported outcomes (n = 13) [51,52,53, 55,56,57,58,59,60,61,62,63,64], followed by health system outcomes (n = 3) [55, 56, 60] and provider outcomes (n = 2) [54, 56] (Table 1).
Only one included study  used a model to assess the impact of the scaling-up strategy, namely the “Reach, Effectiveness, Adoption, Implementation and Maintenance” (RE-AIM) model.
Success of the scaling-up strategies
One study  quantitatively reported successful coverage, i.e., coverage of 80% was achieved (Table 2). Of the 13 remaining studies, nine qualitatively reported successful coverage [51, 53,54,55,56,57,58,59,60] (e.g., “Ethiopia’s iCCM strategy has accomplished much and contributed to national and global learning” ), while two reported that scaling up did not succeed [62, 63] (e.g., “The ‘Rapid Scale-Up’ did not result in coverage increases (of intervention) or mortality reductions in Burkina Faso” ) and two were unclear [52, 64].
In terms of the main outcomes of studies (provider/patient outcomes), six [51, 52, 54, 56, 58, 64] quantitatively reported a favorable impact (i.e., using statistical methods), while three studies [53, 62, 63] quantitatively reported no impact. Of the five remaining studies, four [55, 57, 59, 61] qualitatively reported a favorable impact (e.g., “The number of pregnant women tested for HIV increased from 41,800 of 67,924 (61.5%) in 2009 to 269,935 of 361,655 (70.7%) in 2012” ). In one study , information about impact was unclear.
No study quantitatively reported achieving coverage of 80% in combination with a favorable impact on its main outcomes.
Quality assessment of studies
Our assessment of the 14 included studies using the Quality Assessment Tool for Quantitative Studies resulted in a strong rating for six studies [52, 53, 58, 59, 61, 63], a moderate rating for two studies [56, 62], and a weak rating for six studies [51, 54, 55, 57, 60, 64] (Additional file 5).
Data validation with authors of studies
We contacted authors of included studies to validate our data extraction. Overall, we received eight responses (57.1%) from corresponding authors.
To the best of our knowledge, our review is the first to explore elements of strategies for scaling up EBPs in primary care settings. We found few studies assessing the impact of scaling-up strategies of EBPs in primary care. Most were conducted in low- and middle-income countries. Most were funded by international and national governmental organizations. The most represented clinical area was infectious diseases followed by newborn/child care, depression, and preventing seniors’ falls. Study designs were mostly before-and-after studies, without control. Clinical sites (e.g., hospitals, health posts, community health centers) were the most frequently targeted units. The component of the scaling-up strategy most mentioned was human resource-related. Very few studies provided information on the scaling-up metrics, i.e., coverage of the units they targeted. While several studies reported on the success of the scaled-up EBP in terms of patient/provider outcomes, no studies quantitatively reported on the success of the scaling-up strategy itself. These results lead us to make the following observations.
First, only a small number of studies were identified. Although this may not be surprising giving the emerging nature of the field and its dispersal across many disciplines, it is possible that the search strategy did not identify all relevant studies. Despite the inclusion of a broad range of databases, scale up and spread are ill-defined and under-theorized concepts , and there is a lack of consensus within the field regarding terminology. The development of a validated search filter for “scale up” of EBPs would be of particular value for future reviews in the field to balance the sensitivity and specificity of search strategies and reduce the likelihood of omitting pertinent research.
Second, the majority of studies were undertaken in low- and middle-income countries and focused on EBPs tackling infectious diseases. The overrepresentation of low- and middle-income countries in our review is consistent with previous work . This could be explained by the burden of care that these countries were facing at the time which, due to rapid spread of infectious diseases, was quickly increasing and urgently required the scaling up of specific EBPs to address these threats to their population [65,66,67,68]. In addition, given the financial constraints faced by low- and middle-income countries, it would appear reasonable to scale up existing EBPs rather than spend more resources in developing new EBPs. In addition, low- and middle-income countries often incentivise health systems research that promotes global health equity . Moreover, many primary care EBPs in low- and middle-income countries originate at very local levels, often supported by non-governmental organizations and external funding. Many countries attempt to eliminate their infectious disease burden by scaling up these small-scale EBPs to achieve broad impact at the national level . The scaling up, too, therefore often involves foreign nationals and world leaders. For example, through the Millennium Development Goals , the World Health Organization is working with world leaders on scaling up initiatives to reduce child mortality, improve maternal health, and combat HIV/AIDS, malaria, and tuberculosis, clinical areas identified in almost all our included studies.
Third, we found poor representation of high-income countries in studies assessing the impact of strategies to scale up EBPs in primary care settings. In high-income economies, much funding of health research has focused on development and testing of original and innovative interventions, and less on the scaling up of these interventions [66, 71]. High-income countries also face a very different burden of care, mostly non-communicable chronic diseases. These diseases and a growing proportion of elderly citizens increasingly drive the demand for healthcare, and there is a new urgency to scale up effective EBPs that address these concerns in the hope of saving costs [65, 68, 72,73,74]. High-income countries are therefore taking a new interest in scaling-up research [37, 71, 74,75,76]. Based on the results of this review, scaling-up strategies developed in low- and middle-income countries may now be in a position to inform the scaling up of EBPs in high-income countries [66, 77]. This is a reversal long needed to increase the capacity of low- and middle-income countries to play a major role in the field of implementation science , although transferability of strategies to different settings will continue to be a challenge [25, 79]. This is an area that needs further investigation .
Fourth, we noted vast inconsistencies in the reporting of scaling up and its critical components. Although some studies were rated high quality (regarding what was done in terms of selection, design, and data collection, for example), relevant information on the scaling-up process they used was unavailable. For example, scaling-up strategies were poorly defined, and most studies focused more on the EBP itself. As the science of scaling up is a relatively new field, there is little guidance on how to assess or report on scaling-up strategies. Overall, studies did not attempt to provide the information needed to foster the use or replication of their scaling-up strategies . It has been found that overall, more than half of clinical treatments are not beneficial , and so there is clearly no point scaling up the majority of clinical practices. If few clinical practices have beneficial effects under controlled delivery conditions, even fewer are effective under real-world conditions [9, 27, 81]. Problems and difficulties with scaling up even proven clinical practices suggest that it might be beneficial to identify phases as well as components of scaling up. The current literature [16, 27] highlights four phases that could be documented on a more systematic basis: (1) assessment of scalability; (2) development of the scaling plan; (3) preparation of material, financial, and human resources; and (4) scaling up of the EBP. While the “Standards for Reporting Implementation Studies” (StaRI) could be a starting point, they do not cover core components of scaling-up strategies .
Fifth, we found very little measurable evidence regarding the success of the scaling-up strategies in the studies we reviewed. This could be explained by the lack of consensus on scaling-up outcomes. It could also be because of the heterogeneity of EBPs, leading to an assumption among researchers that each EBP must be scaled up in a different way, and there can be no single set of procedures or measures. We suggest that proper reporting on scaling up would require both a denominator (number of targeted units) and a numerator (number of units covered by the EBP) , in combination with impact measurements. Central to evaluation of the success of scale-up initiatives is the extent to which an EBP achieved its intended benefit on the targeted populations [31, 43, 82, 83]. Coverage of the targeted population is therefore a key indicator for measuring this success [33, 43, 83]. For EBPs to have a substantial impact, it is also necessary to have a large enough population coverage over a sustained period . While there is no consensus yet on a threshold of coverage that would indicate success, several international scaling-up initiatives and a large implementation review have identified 80% as a reasonable target coverage [43,44,45,46,47,48,49,50]. The power of scaling up is in its ability to maximize the benefits of EBPs, i.e., produce a numerator substantial enough [33, 83].
Our study has limitations. First, we cannot assume that we found all potentially eligible studies. However, we consulted many literature sources and implementation experts in order to substantially reduce this limitation. Second, little clear information on the scaling-up process itself was reported in the published materials, and it was difficult to clearly draw a distinction between the components of the EBP and the components of the scaling-up strategy. However, we invited all corresponding authors of the included studies to validate the extracted data and provide any missing information. Although we did not receive a perfect response rate, more than half of them responded. Finally, considering the low number of studies included, this review is limited in its capacity to provide clear guidance on scaling-up strategies. The review was triggered by the needs of Canadian policymakers who are proceeding with scaling up effective healthcare practices, but find there is little guidance on strategy, methods, and evaluation measures. In spite of the few studies in our review, we believe it was urgent to “get the ball rolling” by bringing together scaling-up studies in primary care from among the many disciplines in which they can be found; show their vast inconsistency in reporting on scaling-up strategies, methods, and measures; and lay the groundwork for future studies.
We found few studies assessing the impact of scaling-up strategies of EBPs in primary care in terms of coverage of the targeted units. Most were conducted in low- and middle-income countries. The most represented clinical area was infectious diseases followed by newborn/child care, depression, and prevention of seniors’ falls. The component of a scaling up strategy most frequently reported was related to human resources. As very few studies provided a measure of the coverage of the scaled-up intervention, it is uncertain whether their scaling up strategies were effective. The science of scaling up EBPs in primary care is young and future initiatives should include the development of specific reporting guidelines and minimal consensus on the metrics of scaling-up studies.
Effective Practice and Organisation of Care
Integrated community case management
Participant, intervention, comparator, outcome
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Reach, Effectiveness, Adoption, Implementation and Maintenance
Standards for Reporting Implementation Studies.
Fooks C. Implementing primary care reform in Canada: barriers and facilitators [Internet]. School of Policy Studies Queen’s University Kingston. Ontario: McGill-Queen’s University Press; 2003. Available from: http://rcrpp.org/documents/30882_en.pdf
Peckham S, Exworthy M. Primary care in the UK: policy, organisation and management. Basingstoke: Palgrave Macmillan; 2003.
Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83:457–502.
Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy. 2002;60:201–18.
Macinko J, Starfield B, Shi L. The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970-1998. Health Serv Res. 2003;38:831–65.
Stewart M, Ryan B. Ecology of health care in Canada. Can Fam Physician. 2015;61:449–53.
Andrews G, Williams AD. Up-scaling clinician assisted internet cognitive behavioural therapy (iCBT) for depression: a model for dissemination into primary care. Clin Psychol Rev. 2015;41:40–8.
O’Connor EA, Whitlock EP, Gaynes B, Beil TL. Screening for depression in adults and older adults in primary care: an updated systematic review [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2009. Available from: http://www.ncbi.nlm.nih.gov/books/NBK36403/
Flay BR, Biglan A, Boruch RF, Castro FG, Gottfredson D, Kellam S, et al. Standards of evidence: criteria for efficacy, effectiveness and dissemination. Prev Sci. 2005;6:151–75.
Fixsen D, Blase K, Metz A, Van Dyke M. Statewide implementation of evidence-based programs. Except Child. 2013;79:213–30.
Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, et al. Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews. BMJ Open. 2015;5:e009993.
Wilson PM, Sales A, Wensing M, Aarons GA, Flottorp S, Glidewell L, et al. Enhancing the reporting of implementation research. Implement Sci. 2017;12:13.
Moore JE, Mascarenhas A, Bain J, Straus SE. Developing a comprehensive definition of sustainability. Implement Sci. 2017;12(1):110. doi:10.1186/s13012-017-0637-1.
Ilott I, Gerrish K, Pownall S, Eltringham S, Booth A. Exploring scale-up, spread, and sustainability: an instrumental case study tracing an innovation to enhance dysphagia care. Implement Sci. 2013;8:128.
Milat AJ, Bauman A, Redman S. Narrative review of models and success factors for scaling up public health interventions. Implement Sci. 2015;10:113.
Barker PM, Reid A, Schall MW. A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa. Implement Sci. 2016;11:12.
Massoud MR, Donohue KL, McCannon CJ. Options for large-scale spread of simple high-impact interventions. Technical report. 2010; Available from: https://isqua.org/docs/future-conferences/m-rashad-massoud_-notes.pdf?sfvrsn=0. Accessed 6 Sept 2017.
Effective Practice and Organisation of Care (EPOC). EPOC resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services [Internet]. 2015 [cited 2016 Nov 23]. Available from: http://epoc.cochrane.org/epoc-specific-resources-review-authors
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.
Ben Charif A, Zomahoun HTV, Lépine R, Croteau J, Langlois L, Elidor H, et al. Effective interventions for scaling up evidence-based practices in primary care: a systematic review. PROSPERO [Internet]. 2016 [cited 2016 Nov 25];CRD42016041461. Available from: http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42016041461. Accessed 6 Sept 2017.
Kruk ME, Porignon D, Rockers PC, Van Lerberghe W. The contribution of primary care to health and health systems in low- and middle-income countries: a critical review of major primary care initiatives. Soc Sci Med. 2010;70:904–11.
Institute of Medicine (IOM). Primary care and public health: exploring integration to improve population health [Internet]. National Academies Press; 2012. Available from: https://www.nap.edu/read/13381/chapter/1#ii
Davies H, Tavakoli M. Health care policy, performance and finance: strategic issues in health care management [Internet]. Ashgate Publishing, Ltd.; 2004 [cited 2017 Sep 5]. Available from: https://books.google.fr/books?hl=fr&lr=&id=rhPe6_9NDlUC&oi=fnd&pg=PR8&dq=Health+Care+Policy,+Performance+and+Finance:+Strategic+Issues+in+Health+Care+&ots=KCRfvH7hXn&sig=SRyMjGJ3UdOVgkz7O3XUooGsK6Y. Accessed 5 Sept 2017.
Mangham LJ, Hanson K. Scaling up in international health: what are the key issues? Health Policy Plan. 2010;25:85–96.
Gottfredson DC, Cook TD, Gardner FEM, Gorman-Smith D, Howe GW, Sandler IN, et al. Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: next generation. Prev Sci. 2015;16:893.
Milat AJ, Newson R, King L, Rissel C, Wolfenden L, Bauman A, et al. A guide to scaling up population health interventions. Public Health Res Pract. 2016;26:e2611604.
Effective Practice and Organisation of Care (EPOC). EPOC taxonomy [Internet]. 2015. Available from: https://epoc.cochrane.org/epoc-taxonomy. Accessed 14 Mar 2017.
World Health Organization (WHO). Practical guidance for scaling up health service innovations [Internet]. 2009 p. 62. Available from: http://www.who.int/reproductivehealth/publications/strategic_approach/9789241598521/en/. Accessed 12 Apr 2017.
Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM). Frequently asked questions [Internet]. Available from: http://re-aim.org/about/frequently-asked-questions/. Accessed 23 May 2017.
Arrossi S, Paolino M, Thouyaret L, Laudi R, Campanera A. Evaluation of scaling-up of HPV self-collection offered by community health workers at home visits to increase screening among socially vulnerable under-screened women in Jujuy Province. Argentina Implement Sci. 2017;12:17.
Milat AJ, Li B. Narrative review of frameworks for translating research evidence into policy and practice. Public Health Res Pract. 2017;27
Fixsen DL, Blase KA, Fixsen AA. Scaling effective innovations. Criminol Public Policy. 2017;16:487–99.
Gill PJ, Roberts NW, Wang KY, Heneghan C. Development of a search filter for identifying studies completed in primary care. Fam Pract. 2014;31:739–45.
Bramer WM, Giustini D, de Jonge GB, Holland L, Bekhuis T. De-duplication of database search results for systematic reviews in EndNote. J Med Libr Assoc. 2016;104:240–3.
Canadian Institutes of Health Research (CIHR). CBPHC featured research [Internet]. 2012 [cited 2017 Apr 17]. Available from: http://www.cihr-irsc.gc.ca/e/45817.html. Accessed 17 Apr 2017.
Milat AJ, Newson R, King L. Increasing the scale of population health interventions: a guide. North Sydney: NSW Ministry of Health; 2014.
Thomas BH, Ciliska D, Dobbins M, Micucci S. A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. Worldviews Evid-Based Nurs. 2004;1:176–84.
Armijo-Olivo S, Stiles CR, Hagen NA, Biondo PD, Cummings GG. Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research. J Eval Clin Pract 2012;18:12–8.
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.
Willis CD, Riley BL, Stockton L, Abramowicz A, Zummach D, Wong G, et al. Scaling up complex interventions: insights from a realist synthesis. Health Res Policy Syst. 2016;14:88.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R. Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005;61:417–30.
Chandrasekaran P, Dallabetta G, Loo V, Mills S, Saidel T, Adhikary R, et al. Evaluation design for large-scale HIV prevention programmes: the case of Avahan, the India AIDS initiative. AIDS. 2008;22(Suppl 5):S1–15.
Thilakavathi S, Boopathi K, Girish Kumar CP, Santhakumar A, Senthilkumar R, Eswaramurthy C, et al. Assessment of the scale, coverage and outcomes of the Avahan HIV prevention program for female sex workers in Tamil Nadu, India: is there evidence of an effect? BMC Public Health. 2011;11 Suppl 6:S3.
Ramanathan S, Deshpande S, Gautam A, Pardeshi DB, Ramakrishnan L, Goswami P, et al. Increase in condom use and decline in prevalence of sexually transmitted infections among high-risk men who have sex with men and transgender persons in Maharashtra, India: Avahan, the India AIDS Initiative. BMC Public Health. 2014;14:784.
Ryman TK, Elsayed EA, Mustafa AA, Widoa NM, Omer A, Kamadjeu R. Implementation of the reaching every district (RED) approach: experience from North Sudan. East Mediterr Health J. 2011;17:804–12.
Ryman T, Macauley R, Nshimirimana D, Taylor P, Shimp L, Wilkins K. Reaching every district (RED) approach to strengthen routine immunization services: evaluation in the African region, 2005. J Public Health (Oxf). 2010;32:18–25.
United Nations Children’s Fund (UNICEF). Consultancy—support implementation and scale up of Reaching Every District/Reaching Every Child/Community strategy in 40 poor performing districts (Ugandan nationals only—8 months) [Internet]. [cited 2017 Jul 19]. Available from: http://www.impactpool.org/jobs/295172. Accessed 19 July 2017.
United States President’s Emergency Plan for AIDS Relief (PEPFAR). PEPFAR Country/Regional Operational Plan (COP/ROP) Guidance 2017 [Internet]. 2017. Available from: https://www.pepfar.gov/documents/organization/267162.pdf. Accessed 23 Aug 2017.
Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.
Frieden TR, Khatri GR. Impact of national consultants on successful expansion of effective tuberculosis control in India. Int. J. Tuberc. Lung Dis. 2003;7:837–41.
Price JE, Leslie JA, Welsh M, Binagwaho A. Integrating HIV clinical services into primary health care in Rwanda: a measure of quantitative effects. AIDS Care. 2009;21:608–14.
Mutevedzi PC, Lessells RJ, Heller T, Bärnighausen T, Cooke GS, Newell M-L. Scale-up of a decentralized HIV treatment programme in rural KwaZulu-Natal, South Africa: does rapid expansion affect patient outcomes? Bull World Health Organ. 2010;88:593–600.
Renju J, Andrew B, Nyalali K, Kishamawe C, Kato C, Changalucha J, et al. A process evaluation of the scale up of a youth-friendly health services initiative in northern Tanzania. J Int AIDS Soc. 2010;13:32.
Curry LA, Byam P, Linnander E, Andersson KM, Abebe Y, Zerihun A, et al. Evaluation of the Ethiopian Millennium Rural Initiative: impact on mortality and cost-effectiveness. PLoS One. 2013;8:e79847.
Goetz MB, Hoang T, Knapp H, Burgess J, Fletcher MD, Gifford AL, et al. Central implementation strategies outperform local ones in improving HIV testing in Veterans Healthcare Administration facilities. J Gen Intern Med. 2013;28:1311–7.
Li F, Harmer P, Stock R, Fitzgerald K, Stevens J, Gladieux M, et al. Implementing an evidence-based fall prevention program in an outpatient clinical setting. J Am Geriatr Soc. 2013;61:2142–9.
Miyano S, Dube C, Kayama N, Ishikawa N, Nozaki I, Syakantu G. Association between tuberculosis treatment outcomes and the mobile antiretroviral therapy programme in Zambia. Int J Tuberc Lung Dis. 2013;17:540–5.
Comfort AB, van Dijk JH, Mharakurwa S, Stillman K, Gabert R, Korde S, et al. Hospitalizations and costs incurred at the facility level after scale-up of malaria control: pre-post comparisons from two hospitals in Zambia. Am J Trop Med Hyg. 2014;90:20–32.
Legesse H, Degefie T, Hiluf M, Sime K, Tesfaye C, Abebe H, et al. National scale-up of integrated community case management in rural Ethiopia: implementation and early lessons learned. Ethiop Med J. 2014;52 Suppl 3:15–26.
Sim S, Tuon S, Welle E, Samreth S, Sun S, Ngauv B, et al. Implementation and operational research: scaling up the provision of the PMTCT services, using the linked response approach in Cambodia from 2008 to 2012. J Acquir Immune Defic Syndr. 2015;69:e66–73.
Solberg LI, Crain AL, Maciosek MV, Unützer J, Ohnsorg KA, Beck A, et al. A stepped-wedge evaluation of an initiative to spread the collaborative care model for depression in primary care. Ann Fam Med. 2015;13:412–20.
Munos M, Guiella G, Roberton T, Maïga A, Tiendrebeogo A, Tam Y, et al. Independent evaluation of the rapid scale-up program to reduce under-five mortality in Burkina Faso. Am J Trop Med Hyg. 2016;94:584–95.
Singh K, Brodish P, Speizer I, Barker P, Amenga-Etego I, Dasoberi I, et al. Can a quality improvement project impact maternal and child health outcomes at scale in northern Ghana? Health Res Policy Syst. 2016;14:45.
Jarnheimer A, Kantor G, Bickler S, Farmer P, Hagander L. Frequency of surgery and hospital admissions for communicable diseases in a high- and middle-income setting. Br J Surg. 2015;102:1142–9.
Bitanihirwe BK. Scaling-up innovation as a means of tackling health inequalities. Commentary Ann Ist Super Sanita. 2016;52:143–5.
Nayagam S, Thursz M, Sicuri E, Conteh L, Wiktor S, Low-Beer D, et al. Requirements for global elimination of hepatitis B: a modelling study. Lancet Infect Dis. 2016;16:1399–408.
Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2197–223.
Pratt B, Hyder AA. Designing research funding schemes to promote global health equity: an exploration of current practice in health systems research. Dev World Bioeth. 2016;
World Health Organization (WHO). Millennium Development Goals (MDGs) [Internet]. WHO. [cited 2017 Apr 19]. Available from: http://www.who.int/topics/millennium_development_goals/en/. Accessed 19 Apr 2017.
Bégin M, Eggertson L, Macdonald N. A country of perpetual pilot projects. CMAJ. 2009;180(1185):E88–9.
World Health Organization (WHO). Ageing and health [Internet]. WHO. CMAJ. 2009;180(12). doi.10.1503/cmaj.090808.
Ploeg J, Markle-Reid M, Davies B, Higuchi K, Gifford W, Bajnok I, et al. Spreading and sustaining best practices for home care of older adults: a grounded theory study. Implement Sci. 2014;9:162.
Ovretveit J. Widespread focused improvement: lessons from international health for spreading specific improvements to health services in high-income countries. Int J Qual Health Care. 2011;23:239–46.
Norton WE, McCannon CJ, Schall MW, Mittman BS. A stakeholder-driven agenda for advancing the science and practice of scale-up and spread in health. Implement Sci. 2012;7:118.
Chambers D, Simpson L, Neta G, von Thiele Schwarz U, Percy-Laurry A, Aarons GA, et al. Proceedings from the 9th Annual Conference on the Science of Dissemination and Implementation. Implement Sci. 2017;12(Suppl 1):48. doi:10.1186/s13012-017-0575-y.
World Health Organization (WHO). Scaling up projects and initiatives for better health: from concepts to practice [Internet]. 2016 [cited 2016 Nov 23]. Available from: http://www.euro.who.int/en/publications/abstracts/scaling-up-projects-and-initiatives-for-better-health-from-concepts-to-practice-2016. Accessed 23 Nov 2016.
Simmons R, Fajans P, Ghiron L. Scaling up health service delivery: from pilot innovations to policies and programmes [Internet]. World Health Organization; 2007 [cited 2017 Sep 22]. Available from: http://www.who.int/reproductivehealth/publications/strategic_approach/9789241563512/en/. Accessed 15 Nov 2017.
Vis C, Kleiboer A, Prior R, Bønes E, Cavallo M, Clark SA, et al. Implementing and up-scaling evidence-based eMental health in Europe: the study protocol for the MasterMind project. Internet Interventions. 2015;2:399–409.
Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017;356:i6795.
BMJ Clinical Evidence. What conclusions has Clinical Evidence drawn about what works, what doesn’t based on randomised controlled trial evidence? [Internet]. [cited 2017 May 23]. Available from: http://clinicalevidence.bmj.com/x/set/static/cms/efficacy-categorisations.html. Accessed 23 May 2017.
Bryce J, Victora CG, Boerma T, Peters DH, Black RE. Evaluating the scale-up for maternal and child survival: a common framework. Int Health. 2011;3:139–46.
Kohl R. An analytical framework for scaling up pilots in public health. From one to many: scaling up health programs in low income countries. University Press Ltd ,Bangladesh: Cash RA, Chowdhury AMR, Smith GB, Ahmed F; 2011. p. 276.
The authors wish to acknowledge the following persons for their dedicated assistance with various aspects of this systematic review: Titilayo Tatiana Agbadje, Michèle Schemilt, Susie Gagnon, José Massougbodji, and Marie-Joëlle Cossi. Also, we thank Louisa Blair, English-language editor, for her kind help with the manuscript.
This study was funded by the “Health and Social Services Systems, Knowledge Translation and Implementation” component of the Quebec SPOR-SUPPORT Unit (#SU1-139759), one of the Canadian Institutes of Health Research (CIHR) Strategy for Patient-Oriented Research (SPOR) Support for People and Patient-Oriented Research and Trials (SUPPORT) unit. However, only the authors are responsible for the information provided and the views expressed in this article. FL holds a Tier 1 Canada Research Chair in Shared Decision Making and Knowledge Translation. AL holds a Fonds de recherche en santé du Québec - Santé (FRQ-S) Junior 2 Scientist Award.
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Review inclusion and exclusion criteria. (DOCX 44 kb)
Search strategy in MEDLINE (Ovid), August 30, 2016. (DOCX 44 kb)
Gray literature search. (DOCX 47 kb)
Email sent regarding validation of data extraction. (DOCX 43 kb)
Quality assessment of 14 included studies using the Effective Public Health Practice Project tool. (DOCX 14 kb)