Skip to main content
Download PDF
Download ePub

Implementation of peer specialist services in VA primary care: a cluster randomized trial on the impact of external facilitation

Implementation Science volume 16, Article number: 60 (2021) Cite this article

Abstract

Background

Over 1100 veterans work in the Veterans Health Administration (VHA) as peer specialists (PSs)—those with formal training who support other veterans with similar diagnoses. A White House Executive Action mandated the pilot reassignment of VHA PSs from their usual placement in mental health to 25 primary care Patient Aligned Care Teams (PACTs) in order to broaden the provision of wellness services that can address many chronic illnesses. An evaluation of this initiative was undertaken to assess the impact of outside assistance on the deployment of PSs in PACTs, as implementation support is often needed to prevent challenges commonly experienced when first deploying PSs in new settings.

Methods

This study was a cluster-randomized hybrid II effectiveness-implementation trial to test the impact of minimal implementation support vs. facilitated implementation on the deployment of VHA PSs in PACT over 2 years. Twenty-five Veterans Affairs Medical Centers (VAMCs) were recruited to reassign mental health PSs to provide wellness-oriented care in PACT. Sites in three successive cohorts (n = 7, 10, 8) over 6-month blocks were matched and randomized to each study condition. In facilitated implementation, an outside expert worked with site stakeholders through a site visit and regular calls, and provided performance data to guide the planning and address challenges. Minimal implementation sites received a webinar and access to the VHA Office of Mental Health Services work group. The two conditions were compared on PS workload data and veteran measures of activation, satisfaction, and functioning. Qualitative interviews collected information on perceived usefulness of the PS services.

Results

In the first year, sites that received facilitation had higher numbers of unique veterans served and a higher number of PS visits, although the groups did not differ after the second year. Also, sites receiving external facilitation started delivering PS services more quickly than minimal support sites. All sites in the external facilitation condition continued in the pilot into the second year, whereas two of the sites in the minimal assistance condition dropped out after the first year. There were no differences between groups on veterans’ outcomes—activation, satisfaction, and functioning. Most veterans were very positive about the help they received as evidenced in the qualitative interviews.

Discussion

These findings demonstrate that external facilitation can be effective in supporting the implementation of PSs in primary care settings. The lack of significant differences across conditions after the second year highlights the positive outcomes associated with active facilitation, while also raising the important question of whether longer-term success may require some level of ongoing facilitation and implementation support.

Trial registration

This project is registered at ClinicalTrials.gov with number NCT02732600 (URL: https://clinicaltrials.gov/ct2/show/NCT02732600).

Peer Review reports

Background

Over 1100 veterans work in the Veterans Health Administration (VHA) as peer specialists (PSs). PSs are veterans with lived mental health experience and formal training who provide support to other veterans with similar diagnoses. Drawing on their own recovery experience, PSs provide a range of services including facilitating groups, role modeling, providing outreach and support, teaching coping skills, and helping veterans navigate and coordinate care. PSs have traditionally supported recovery from mental illness and substance use disorders in mental health settings. While not conclusive, randomized and quasi-experimental trials have shown that individuals with mental illnesses who receive PS services benefit across a range of outcomes, such as improved functioning and patient activation [1].

PSs are increasingly being deployed beyond mental health treatment settings to support holistic physical health and wellness in other medical settings such as primary care. In 2014, the White House issued an Executive Action mandating the pilot reassignment of VHA PSs from mental health to 25 primary care Patient Aligned Care Teams (PACTs) in order to extend delivery of peer support to veterans in primary care settings. VHA PACTs, first established in 2010, are medical homes that provide coordinated, comprehensive patient-centered outpatient primary care using a multidisciplinary team-based approach [2]. Models like VHA PACT, especially those that use quality improvement methods, have been shown to be effective in managing chronic conditions [3,4,5]. Importantly, to maximize the effectiveness of this type of coordinated, team-based, complementary support, “patient activation” is often needed [6,7,8], which is the knowledge, skills, and motivation to be involved in one’s own care [9, 10]. One such intervention which can increase patient activation is health coaching, a patient-centered approach that includes assessing needs, developing concrete goals, and skill building [6, 11,12,13,14,15]. Research also indicates that such supportive, complementary coaching interventions delivered by peers, or individuals who share a common characteristic with a target population, can make primary care services more effective by activating patients to engage in more health behaviors such as illness self-management, disease prevention, and health information seeking [16, 17].

Although PS services are expanding from mental health to other medical settings, there has been no research to examine how best to implement PS services in primary care settings. However, within mental health settings, there have been many documented challenges to the implementation of PS services, especially when these services were just starting. For example, lack of understanding regarding the PS role, inadequate supervision, lack of training opportunities, stigma, and discrimination against PSs have been common implementation challenges [18,19,20,21,22,23,24,25,26,27], all of which can lead to poor uptake of PS services. One strategy that has been examined to implement PS services in mental health settings is external facilitation [19]. External facilitation is an evidence-based implementation strategy specified within the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework [28,29,30,31,32], in which outside individuals activate and support implementation by assessing and responding to characteristics of recipients of the innovation, taking into consideration additional factors within their inner organizational and outer contextual settings [28]. It is a multifaceted strategy involving interactive problem-solving and support that occurs in a context of a recognized need for improvement and supportive interpersonal relationships [33]. Several studies have shown external facilitation to be an effective strategy for improving implementation of complex evidence-based practices and other clinical innovations [30, 34,35,36,37], as well as improving patient-level outcomes [38,39,40,41]. Thus, we hypothesized that facilitation would help sites and their PSs overcome multiple challenges and have better implementation, which would then lead to better outcomes of patient activation, satisfaction with overall care, and self-rated health. As detailed below, the purpose of this study is to evaluate the impact of external facilitation on implementing PS services and veteran outcomes in VA primary care settings.

Methods

The present study evaluates a pilot project to deploy PSs in 25 VA primary care settings. It is a hybrid II, cluster randomized trial comparing 12 VA medical centers (VAMCs) receiving external facilitation to 13 VAMCs receiving minimal assistance. Including PSs in PACT teams were intended to extend the provision of VA PS services beyond mental health settings and could include some form of brief health coaching. Sites agreed to participate in the pilot for 2 years. To facilitate health coaching, VA Central Office (VACO) made whole health coach training available for most PSs engaged in this pilot. As is common in hybrid type II designs [42], the project has a dual emphasis on the assessment of both uptake of PS services and veteran-level outcomes. Key outcomes for this evaluation were specified according to the RE-AIM model [43], an evaluation model that specifies five domains needed for successful impact of a new intervention (i.e., Reach, Effectiveness, Adoption, Implementation, and Maintenance). The present manuscript presents findings relating to Reach and Adoption as measured using administrative services data. We also report on the Effectiveness of PS-delivered services on veteran satisfaction, activation, and functioning. Qualitative interviews with 10 veterans in receipt of PS services (6 in the external facilitation sites and 4 in sites receiving minimal implementation assistance) were also conducted to characterize and describe participant experiences regarding the PSs’ Effectiveness. Finally, we also report on the maintenance (sustainment) of PS-delivered services beyond the first and second years specified in the pilot.

In collaboration with our VA national operational partners, the project was determined to be quality improvement by the VA, thus individual informed consent for the peer specialists, non-peer providers and supervisors, and Veterans was not required or sought. However, veterans are always free to decline PS and participation in the evaluation. Full details of this process are available elsewhere [44]. Facilitators and research staff watched for harms of PSs while they were active. None were reported.

Site recruitment and randomization

A convenience sample of 25 PACT sites were recruited by a workgroup of national VA leaders led by the VA’s National Director of Peer Support and National Director of Integrated Services and the project team. To participate, sites demonstrated endorsement from facility leadership and had to agree to dedicate one or more already-hired PSs to PACT for a total of 10 or more hours per week, for 1 year. No additional funds were made available, thus sites had to reassign their current PSs deployed in mental health settings, in part or in full, to work in PACT. The actual amount of PS time dedicated to PACT across sites ranged from 4 h per week (in one site) up to 80 h per week covered by two or more PSs (in 3 sites). Most PSs worked 10 h a week (in 8 sites) or 20-50 h a week (in 13 sites).

From January 2016 to March 2019, 25 recruited sites were divided into three cohorts. A new cohort was introduced over three successive 6-month blocks. Our original plan was to establish three successive cohorts of n = 8, n = 8, and n = 9 sites. In cohort 1, 8 sites were pair-matched based on the number of PSs deployed at the site, number of hours each PS would provide in PACT, and the status of PS assignment to PACT (currently deployed, n = 2, or anticipating deployment to PACT as part of the pilot, n = 23). A statistician with no other direct involvement in the project used a computerized random number generator to assign sites within each pair to 1 year of either minimal implementation support (n = 4) or external facilitation (n = 4). A control site in cohort 1 left the study early on, prior to when any data collection or any study procedures were implemented. Because of the uneven number of sites, randomization in cohort 2 pair-matched 10 sites, randomly assigned an entire pair to the minimal implementation support condition, and then proceeded to assign the remaining sites, within each pair, to either facilitation (n = 4) or minimal implementation support (n = 6). Finally, sites in cohort 3 were pair-matched and within each pair, randomly assigned to either facilitation (n = 4) or minimal implementation support (n = 4). Across all cohorts, the total number of sites receiving facilitation was 12, and the total number of sites receiving only minimal implementation support was 13. Blinding to condition assignment was not possible because it was well known who received the external facilitation. Across sites, there was a total of 43 PSs and 44 supervisors. The average age of the PSs was 52, 81% were male, 52% Caucasian, and 48% African-American or other race, and the mean number of years spent working in the VA was 3.9 (s.d. = 2.3). There were no differences among PSs in age, gender, and race across conditions. There was, however, a significant difference on the mean number of years PSs had spent working in the VA between external facilitation (3.0 ± 1.5) and minimal implementation support sites (5.1 ± 2.7), p = 0.007.

External facilitation versus minimal implementation support

External facilitation, provided for 1 year at each site by one of three doctorate level psychologists, was tailored to site needs and adapted to incorporate lessons learned about the implementation challenges experienced when first deploying peer specialists [45]. Facilitation was organized across two phases: pre-implementation (i.e., preparatory tasks) and implementation (i.e., monitoring and troubleshooting). As is typical for external facilitation, facilitators engaged in multiple proactive strategies, tailored to each location [46]. These activities are summarized in Table 1 [29, 42, 46,47,48].

Table 1 Facilitation activities compared to activities in the minimal assistance condition [44]
Full size table

Facilitators began this process by conducting telephone conference calls with local site team members to assess a range of domains related to the local context—e.g., available resources for PS implementation—using a standardized semi-structured interview guide. These site assessment calls were followed by an in-person, two-day site visit to connect with key staff, and complete a PS implementation checklist to develop a specific implementation plan tailored to each site. These site visits also provided opportunities for the external facilitators to further develop relationships with site stakeholders, provide staff and leadership with an overview of the project and the PS role, and build consensus. Once the local implementation plan had been finalized, the facilitators then engaged the local implementation team, including PSs and supervisors, in bi-weekly phone or Skype meetings to monitor and support implementation of the plan and encourage accountability. These meetings frequently involved feedback of PS administrative services data extracted from the VA electronic medical record.

While the overall structure of the facilitation did not change from cohort to cohort, we did refine our methods over time. For example, over time, we were better able to pull PS service delivery data and feed it back to sites for use in quality improvement purposes. As we learned more about the specific challenges facing sites, we were able to develop new educational materials (e.g., a document entitled, “What can Peers do?”). Also, we refined the implementation checklist and we referred PSs and supervisors to consult with sites from earlier cohorts.

The role of the facilitators should be contrasted with the PS supervisors. Each site decided who each PS’s supervisor was going to be. Supervisors met with PSs to discuss individual veterans and their care; the external facilitators met with the supervisors, PSs, and other primary care stakeholders about incorporating PSs into the primary care work flow. External facilitators did strongly recommend to each site that PSs receive regular supervision, and inquired about whether it was happening in the regular facilitation meetings.

The average number of hours of external facilitation (operationalized as direct contact between facilitator and sites) ranged from 5.98 to 37.25 h with an average of 23.26 (sd = 9.77) hours across the 12 sites receiving this implementation support. Each site received about 1 h per month of faciliation, although the external facilitators also spent time helping sites outside of site meetings (e.g., reviewing data, preparing documents, etc.). More details about the external facilitation strategy applied in this project are available elsewhere [44].

The assistance offered to the minimal implementation support sites included written guidance (a toolkit on how to hire and integrate PSs into a clinical setting), a 1-h webinar on integrating mental health and primary care, and the option to call VHA Central Office staff overseeing the pilot for ad hoc consultation. Further, two separate monthly learning collaborative calls were held for sites within each of the two study conditions; one for PSs and one for PSs’ supervisors. Facilitated by a consultant expert in PS services, these calls afforded staff from all sites the opportunity to meet together to review implementation progress, share ideas and lessons learned, and provide support.

Peer specialist services delivered

PSs provided a variety of services across the sites, through a mix of phone and in-person visits. Approximately 30 of the 43 PSs across sites received training in Whole Health Coaching (WHC) from the VA Office of Patient-Centered Care and Cultural Transformation, and incorporated aspects of the training into their activities with veterans, including the completion of personalized health plans and individual or group-based WHC. An overarching goal for PSs utilizing WHC was to help veterans identify realistic goals, and then provide or connect veterans with the support needed to achieve those goals. Identifying and connecting veterans with VA and community resources was another important service provided. PSs also facilitated groups, independently or with another co-leader from PACT, on topics ranging from dental education and smoking cessation to PTSD support and chronic disease self-management.

Measures and analytic methods

In addition to the measures below, the study initially had planned to collect data on the organizational readiness and level of team cohesion of the groups the PSs had joined in primary care (both designated as secondary outcomes in the Clinical Trials record for this study). This plan assumed that each site would have a cohesive team and that information about the team would be useful in interpreting other study data. However, the teams the PSs joined were loose affiliations and thus the data from those assessments were not useful. Results from this trial are available at https://clinicaltrials.gov/ct2/show/record/NCT02732600. In that study record, outcomes that addressed provider behavior or patient outcomes were designated as primary or secondary. Information about how to obtain each measure is available from the first author.

Reach and adoption

Two years of biweekly administrative data pulls from the VA Corporate Data Warehouse were used to assess measures of Reach and Adoption of PS services from the RE-AIM framework. Reach was operationalized as: (1) the number of unique Veterans who received services from PSs, and (2) the average number of visits per Veteran. Adoption was operationalized as: (1) the total number of services provided by each PS; and (2) each site’s time to first PS service delivered from the start of the cohort, as an indirect measure of the site’s ability to get their program operational.

These variables were calculated as both “raw” scores—the total number of unique veterans and services in the 2-year period for each PS regardless of the PS employment period and hours worked and as “adjusted” scores. The adjusted workload variables took into consideration both the employment period (many PSs did not start immediately or may have left prior to the end of the 2 years) and weekly hours worked (varying from 1 h to 40 h per week). Visits during each PS’s employment period were divided by the total number of hours worked, then multiplied by 40 to calculate adjusted values for both operationalizations of Reach (as defined above) and total number of services (Adoption) provided per a 40-h work week. Because these variables were significantly skewed, we used a log transformation to improve their distributional properties. Differences between intervention conditions were then compared with a series of analyses of covariance models with age, gender, and race as covariates. Since these variables are measured at the PS level, the covariates were the average across the veterans seen by each PS (mean age, percent White, and percent male). The average number of visits per veteran was also compared across conditions. This is a veteran-level variable, thus a General Linear Mixed Model (GLMM) was used with PS specified as a random effect and veteran age, race, and gender included as covariates.

Before comparing conditions, we removed two sites from the first cohort that were matched with each other, both of which already had PSs working in PACT (one in each condition) at the time of joining the pilot. These sites had substantially more PS services provided than all other sites and their inclusion initially obscured the results for the rest of the sites. Thus, we present raw totals from the 25 sites, but focused on the remaining 23 sites in this pilot that were newly implementing PS services in primary care in the adjusted comparisons (as defined above).

Effectiveness

PSs asked veterans to complete a brief survey during one of their first interactions with the veteran. Project evaluation staff collected follow-up assessments at 6-months (timepoint 2, TP2) and 1-year (timepoint 3, TP3) by phone or mail. A total of 415 baselines were completed across the 25 participating sites. For the 23 sites used for all between condition comparisons, a total of 263 baseline surveys were completed; a greater proportion of veterans from the facilitation sites completed baseline surveys than did veterans from minimal implementation support sites (Chi-square 6.42; p = 0.011). Of these 263 baselines, 154 (59%) completed TP2 assessments and 125 (48%) completed TP3 assessments (see Fig. 1). There were no differences in response rates across study conditions (p = 0.820 at TP2, p = 0.605 at TP3).

Fig. 1
figure 1

Study flow diagram

Full size image

Three measures were included in the veteran level assessment completed at each timepoint: (1) a single item regarding general health functioning taken from the VR-12, a veteran version of the SF-36 Health Inventory [49,50,51]; (2) the Patient Activation Measure (PAM—the primary outcome listed in the clinical trials record for this study), a 13-item survey that measures an individual’s perceived ability to manage his or her illness and health behaviors and act as an effective patient [10]; and, (3) a modified version of the 12-item Satisfaction Index-Mental Health Survey (designated as a secondary outcome in the clinical trials record for this study) [52]. A General Linear Mixed Model (SAS v 9.4 Proc MIXED) was used to compare conditions over time (baseline, 6 months, 12 months) with veteran age, race, and gender as covariates and site as a random effect. ICCs ranged from .001 to .07. All available data were used at each timepoint.

As a measure of Effectiveness, semi-structured, qualitative interviews were also completed via telephone with a total of 10 veterans (3 female and 7 male) across the three cohorts to characterize and describe participant experiences working with PSs in PACT settings. These veterans were identified as having had a high number of documented contacts with the PS (range = 8-34). Interviews were professionally transcribed. A senior member of the evaluation team read the interview transcripts and summarized veterans’ experiences with and reactions to working with PSs. A second member of the team who had also read the transcripts then reviewed the summary for accuracy.

Results

Sample demographics

Across all 25 participating sites, the demographics of the full sample are presented in rows one through three in Table 2; for the 23 sites that newly implemented PSs in PACT (used in the adjusted Reach and Adoption analyses), demographics are presented in rows four through six. Finally, demographics across all 23 sites for participants who completed surveys for our Effectiveness measures are presented in rows seven through nine.

Table 2 Demographics
Full size table

Reach

Using raw numbers, 3841 unique veterans were reached across all 25 sites during the first year (during which external facilitation was provided to the experimental condition sites) and 5616 unique veterans were reached across both years. The average number of visits per veteran across all 25 sites was 1.9 during the first year and 2.3 across both years.

As noted above, before looking at comparisons across conditions, we removed two matched sites who already had PSs working in PACT (one in each condition) and used adjusted comparisons (as defined above) to focus more specifically on sites that were newly implementing PSs in primary care. Compared to minimal assistance sites, sites receiving external facilitation saw a significantly larger average number of unique veterans (p = 0.046) at the end of the first year; though across both years there was no significant difference between conditions (p = 0.428). Though the average number of PS visits per veteran trended higher for sites receiving external facilitation, these differences were not significant for the first year (p = 0.419) nor across both years (p = 0.266). Reach data are presented in Table 3.

Table 3 Adjusted measures of Reach and Adoption among 23 sites newly implementing peer support in primary care
Full size table

Adoption

Using raw unadjusted numbers, a total of 7153 visits were held across all 25 sites during the first year, and 12,771 were held across both years. Within the 23 sites where PSs were newly added to PACT and using adjusted data (as defined above), external facilitation sites had a significantly greater average number of total visits in the first year than did minimal support sites (p = 0.014); though across both years there was no significant difference between conditions (p = 0.336) (see Table 3). Also, within the 23 sites, newly implementing PSs, time to first service was significantly shorter in sites receiving external facilitation (89 days) than in sites receiving minimal implementation support (188 days), p = 0.027.

Effectiveness

Quantitative measures

As shown in Table 4, there were no significant group by time effects at between baseline and 6 months or baseline and 1 year on any of the veteran outcome measures across the 23 sites (results were the same when analyzing data from the 25 sites).

Table 4 Effectiveness outcomes for veterans served by peer specialists
Full size table

Qualitative findings

Most veterans who were interviewed (n = 10) were very positive about their experiences working with a PS. They described PSs as being “terrific,” “professional,” “easy to talk to,” and “knowledgeable.” Veterans noted that the PS helped them in meeting their personal goals (e.g., diabetes management and weight loss) with a positive attitude and nonjudgmental accountability. Some veterans said that the PS also helped them get connected with other services and programs, both within the VA and in the community. PSs functioned not only as a sounding board (“he’s the only one that listens to me”) but also as a liaison between Veterans and their PACT teams and other providers (“he knew how to get things done”). PSs’ veteran status was “the key thing” for many veterans because it helped establish an immediate comradery: “it’s different if you’ve been there and done that or if you just learned it off a book.” Notably, several veterans said that working with a PS gave them a better view of the VA overall, with one veteran saying that the experience “restored my faith and relationship with the VA.” A few of the veterans also expressed negative sentiments about working with a PS; these complaints centered on aspects of program delivery (e.g., the focus on a particular model of Whole Health coaching rather than open-ended peer support, difficulty getting appointments with the PS). Still, even the least-satisfied veteran said that the program was “better than nothing” and that he found it helpful “knowing somebody out there was interested in helping you get better.”

Maintenance

We also tracked the number of sites across study conditions that continued using PSs in PACT after the first and second years. After the first year, all external facilitation sites (12 out of 12) continued into the second year; two of the minimal support sites discontinued (11 out of 13 continued). Regarding continuation beyond 2 years, there was not a difference in rates of continuation by condition; fourteen (56%) of the twenty-five sites were able to sustain the PS’ presence (6 external facilitation, 8 minimal support) and 11 discontinued (6 external facilitation, 5 minimal support) after the project period (Chi-square = 0.561, p = 0.34).

Discussion

In the first year, sites that received external facilitation had higher numbers of unique veterans served (operationalized as Reach according to the RE-AIM framework) and a higher number of visits (operationalized as Adoption). Also, sites receiving external facilitation were able to start delivering PS services more quickly than comparison sites receiving minimal implementation support. Finally, all sites in the external facilitation condition continued in the pilot into the second year, whereas two of the sites in the minimal assistance condition dropped out after the first year. These findings demonstrate that external facilitation can be effective in supporting the implementation of PSs in primary care settings, as it has been in mental health settings [19].

The lack of significant differences across conditions after the second year—in terms of service delivery and sustainability (maintenance in RE-AIM)—highlights the positive outcomes associated with active facilitation, while also raising the important question of whether longer-term success may require some level of ongoing facilitation and implementation support. Implementation research in other fields has documented a drop off in implementation after active implementation support ended [53]. In another study focused on integrating new mental health providers into primary care settings, a facilitation was applied for up to 28 months at participating sites to produce and sustain significant improvements in RE-AIM measures of Reach and Adoption [30, 54]. Thus, a combination of data from this and other implementation studies suggest incorporating new types of providers into primary care involving significant provider engagement and education, new roles for clinical staff, and new clinical processes and referral patterns may require the use of more enduring facilitation strategies to produce sustained improvements in service delivery.

Regarding Effectiveness, the qualitative interviews did show that veterans generally reported positive experiences and outcomes in working with PSs. However, there were no group differences in veteran-level outcomes of satisfaction, activation, or functioning. Our hypothesis that facilitation could improve services, which could then lead to better outcomes, was not supported. Research on other PS initiatives has involved much more intensive interventions than what was delivered here (average of 2.3 services to each veteran). It is likely, for example, that a total of two or three visits—which is not atypical for health coaching in primary care—may be inadequate to meaningfully impact these particular outcomes. Additionally, the lack of significant effects may also be due to timing of assessments which may have been months after the Veteran had contact with PSs. There was also great variability in the PS services delivered and the target of those services, and the limited outcome measures that were collected may not have been sensitive enough to detect that wide variety of outcomes. Other unmeasured outcomes such as recovery, hope, and resiliency—measures that have shown improvement in other PS studies (e.g., [55, 56])—may have been more impacted by working with a PS. As such, future studies that more narrowly specify the content of the PS intervention and conduct appropriately timed and more targeted assessments are needed to better understand the impact of PS services in this setting.

Given the recent passage of the Mission Act [57], which in part mandates the hiring and integration of PSs in 30 primary care settings across the VHA, the results of this study have several implications for how to improve the effectiveness of external facilitation designed to support PSs in primary care. First, the number and types of people charged to work with external facilitators should be considered; e.g., perhaps an internal facilitator might be added at the local level to supplement and extend the external facilitator’s efforts, and the duration of active facilitation may need to be extended. Second, perceived need for assistance, or other site-level idiosyncrasies (including available money and resources to invest) may also impact which types of implementation support are required (or feasible) to help sites adopt and sustain new models of care delivery. Future studies might consider adding assessments to characterize these elements including measures that look at the extent to which program goals and objectives have been written into policies and standard operating procedures (SOPs, including job descriptions), the allocation/assignment of permanent staff positions and protected space as additional metrics of adoption and institutionalization of care delivery models [58]. Third, the external facilitators in the present study are individuals who are very familiar with PSs’ training and role, which may be an important requirement for facilitators in future PS implementation efforts. Fourth, our study only used one specific type of implementation support (i.e., external facilitation). It may be that impacts on service delivery and patient outcomes may be enhanced by using alternative or multiple types of implementation support. For example, as noted above, external facilitation could be used to train internal facilitators and site champions to take a longer-term lead in integrating new providers into the primary care setting and institutionalizing the programmatic change [30]. Finally, PSs are increasingly being used not only in mental health settings but also to help address a range of health behaviors such as weight management, management of chronic health conditions [59], and addictions [60]. Given the challenges faced by sites when PSs are first introduced, including lack of role clarity and inadequate supervision, it would be advantageous to adopt a similar set of implementation strategies that were used in this effort in future PS deployment efforts.

Limitations

The present study had some limitations that should be noted. PSs typically had limited time in primary care, some as few as 4 h a week. Further, the PSs were “on loan” from each site’s mental health service, which likely impacted their ability to deliver services during the pilot, and perhaps influenced their sustainability. In addition, there was a lack of standardization of what interventions PSs provided (PSs tailored their services to their individual settings); more information is needed on what PS interventions are effective in primary care and in what dose. In addition, the target veteran group differed by site, and sites also differed in terms of how and where they received referrals. Baseline veteran-level data was collected by the peer specialists themselves, which may have biased responses. Some peer specialists were reluctant or uncomfortable asking veterans to complete the survey, and this reduced the available veteran data. The present study also did not examine the impact of PS services on service use outcomes outside of primary care; future studies could examine whether PS support helps to improve use of health care services (as has been done in other studies, (e.g., [61,62,63]) and reduce use of high-cost services. Also, the study relied on self-reported measures of effectiveness. Lastly, the extraction and analysis of administrative data may not have accurately captured all the services delivered by PSs. Utilizing the reporting structure within each local sites’ electronic health record was challenging because PSs occasionally did not record their visits and coding of the visits would change without our knowledge.

Conclusions

It is notable that external facilitation had success given that implementing PS services in a new setting like primary care requires in-depth education of providers and leadership regarding an entirely new discipline. With only a modest investment of external facilitation resources, sites that received implementation support were able to deploy PSs more quickly and deliver more services than sites without such support. This approach could be a model to other PS initiatives such as the MISSION Act.

Availability of data and materials

Readers can request data and materials from the lead author.

Abbreviations

i-PARIHS:

Integrated Promoting Action on Research Implementation in Health Services

PACT:

Patient Aligned Care Teams

PSs:

Peer specialists

VAMC:

Veterans Affairs Medical Centers

VHA:

Veterans Health Administration

References

  1. Chinman M, George P, Dougherty RH, Daniels AS, Ghose SS, Swift A, et al. Peer support services for individuals with serious mental illnesses: assessing the evidence. Psychiatr Serv. 2014;65(4):429–41. https://doi.org/10.1176/appi.ps.201300244.

    Article  PubMed  Google Scholar 

  2. Rosland AM, Nelson K, Sun H, Dolan ED, Maynard C, Bryson C, et al. The patient-centered medical home in the Veterans Health Administration. Am J ManagCare. 2013;19(7):e263–e72.

    Google Scholar 

  3. Chan JCN, Lim LL, Luk AOY, Ozaki R, Kong APS, Ma RCW, et al. From Hong Kong diabetes register to JADE program to RAMP-DM for data-driven actions. Diabetes Care. 2019;42(11):2022–31. https://doi.org/10.2337/dci19-0003.

    Article  PubMed  Google Scholar 

  4. Lim LL, Lau ESH, Kong APS, Davies MJ, Levitt NS, Eliasson B, et al. Aspects of multicomponent integrated care promote sustained improvement in surrogate clinical outcomes: a systematic review and meta-analysis. Diabetes Care. 2018;41(6):1312–20. https://doi.org/10.2337/dc17-2010.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Loewenson R, Simpson S. Strengthening integrated care through population-focused primary care services: international experiences outside the United States. Annu Rev Public Health. 2017;38(1):413–29. https://doi.org/10.1146/annurev-publhealth-031816-044518.

    Article  PubMed  Google Scholar 

  6. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, part 2. JAMA: The Journal of the American Medical Association. 2002;288(15):1909–14. https://doi.org/10.1001/jama.288.15.1909.

    Article  PubMed  Google Scholar 

  7. Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the chronic care model in the new millennium. Health Aff(Millwood). 2009;28(1):75–85.

    Google Scholar 

  8. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20(6):64–78. https://doi.org/10.1377/hlthaff.20.6.64.

    Article  CAS  PubMed  Google Scholar 

  9. Hibbard JH, Mahoney ER, Stock R, Tusler M. Do increases in patient activation result in improved self-management behaviors? Health ServRes. 2007;42(4):1443–63.

    Google Scholar 

  10. Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the patient activation measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004;39(4 Pt 1):1005–26. https://doi.org/10.1111/j.1475-6773.2004.00269.x.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Jonk Y, Lawson K, O’Connor H, Riise KS, Eisenberg D, Dowd B, et al. How effective is health coaching in reducing health services expenditures? Med Care. 2015;53(2):133–40. https://doi.org/10.1097/MLR.0000000000000287.

    Article  PubMed  Google Scholar 

  12. Kivela K, Elo S, Kyngas H, Kaariainen M. The effects of health coaching on adult patients with chronic diseases: a systematic review. Patient Educ Couns. 2014;97(2):147–57. https://doi.org/10.1016/j.pec.2014.07.026.

    Article  PubMed  Google Scholar 

  13. Linden A, Butterworth SW, Prochaska JO. Motivational interviewing-based health coaching as a chronic care intervention. J Eval Clin Pract. 2010;16(1):166–74. https://doi.org/10.1111/j.1365-2753.2009.01300.x.

    Article  PubMed  Google Scholar 

  14. Lorig KR, Holman H. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med. 2003;26(1):1–7. https://doi.org/10.1207/S15324796ABM2601_01.

    Article  PubMed  Google Scholar 

  15. Olsen JM, Nesbitt BJ. Health coaching to improve healthy lifestyle behaviors: an integrative review. Am J Health Promot. 2010;25(1):e1–e12. https://doi.org/10.4278/ajhp.090313-LIT-101.

    Article  PubMed  Google Scholar 

  16. Brady TJ, Murphy L, O’Colmain BJ, Beauchesne D, Daniels B, Greenberg M, et al. A meta-analysis of health status, health behaviors, and health care utilization outcomes of the chronic disease self-management program. Prev Chronic Dis. 2013;10:120112. https://doi.org/10.5888/pcd10.120112.

    Article  PubMed  Google Scholar 

  17. Webel AR, Okonsky J, Trompeta J, Holzemer WL. A systematic review of the effectiveness of peer-based interventions on health-related behaviors in adults. Am J Public Health. 2010;100(2):247–53. https://doi.org/10.2105/AJPH.2008.149419.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Carlson LS, Rapp CA, McDiarmid D. Hiring consumer-providers: barriers and alternative solutions. Community Ment Health J. 2001;37(3):199–213. https://doi.org/10.1023/A:1017569913118.

    Article  CAS  PubMed  Google Scholar 

  19. Chinman M, Shoai R, Cohen A. Using organizational change strategies to guide peer support technician implementation in the Veterans Administration. Psychiatr Rehabil J. 2010;33(4):269–77. https://doi.org/10.2975/33.4.2010.269.277.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Dixon L, Krauss N, Lehman A. Consumers as service providers: the promise and challenge. Community Ment Health J. 1994;30(6):615–25. https://doi.org/10.1007/BF02188599.

    Article  CAS  PubMed  Google Scholar 

  21. Fisk D, Rowe M, Brooks R, Gildersleeve D. Integrating consumer staff members into a homeless outreach project: critical issues and strategies. Psychiatric Rehab J. 2000;23(3):244–52. https://doi.org/10.1037/h0095161.

    Article  Google Scholar 

  22. Gates LB, Akabas SH. Developing strategies to integrate peer providers into the staff of mental health agencies. Adm Policy MentHealth. 2007;34(3):293–306. https://doi.org/10.1007/s10488-006-0109-4.

    Article  Google Scholar 

  23. Hamilton AB, Chinman M, Cohen AN, Oberman RS, Young AS. Implementation of consumer providers into mental health intensive case management teams. J Behav Health Serv Res. 2015;42(1):100–8. https://doi.org/10.1007/s11414-013-9365-8.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Manning SS, Suire B. Consumers as employees in mental health: bridges and roadblocks. PsychiatrServ. 1996;47(9):939–40 43.

    CAS  Google Scholar 

  25. Miya K, Wilbur S, Corcker B, Compton F. Addressing and resolving role issues between professionals and consumer employees. In: Mowbray CT, Moxley DP, Jasper CA, Howell J, editors. Consumers as providers in psychiatric rehabilitation. Columbia: International Association of Psychosocial Rehabilitation Services; 1997. p. 334–6.

    Google Scholar 

  26. Mowbray CT, Moxley DP, Thrasher S, Bybee D, McCrohan N, Harris S, et al. Consumers as community support providers: issues created by role innovation. Community Ment Health J. 1996;32(1):47–67.

    Article  CAS  Google Scholar 

  27. Solomon P, Draine J. Perspectives concerning consumers as case managers. Community Ment Health J. 1996;32(1):41–6. https://doi.org/10.1007/BF02249366.

    Article  CAS  PubMed  Google Scholar 

  28. Harvey G, Kitson A. Implementing evidence-based practice in healthcare: a facilitation guide. London: Routledge; 2015.

    Book  Google Scholar 

  29. Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37(6):577–88. https://doi.org/10.1046/j.1365-2648.2002.02126.x.

    Article  PubMed  Google Scholar 

  30. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care-mental health. J Gen Intern Med. 2014;29(Suppl 4):904–12. https://doi.org/10.1007/s11606-014-3027-2.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7(3):149–58. https://doi.org/10.1136/qshc.7.3.149.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3(1):1–12. https://doi.org/10.1186/1748-5908-3-1.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21. https://doi.org/10.1186/s13012-015-0209-1.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Heidenreich PA, Sahay A, Mittman BS, Oliva N, Gholami P, Rumsfeld JS, et al. Facilitation of a multihospital community of practice to increase enrollment in the hospital to home national quality improvement initiative. Jt Comm J Qual Patient Saf. 2015;41(8):361–9. https://doi.org/10.1016/S1553-7250(15)41047-5.

    Article  PubMed  Google Scholar 

  35. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, et al. Protocol: adaptive implementation of effective programs trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9(1):132. https://doi.org/10.1186/s13012-014-0132-x.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Kirchner JE, Woodward EN, Smith JL, Curran GM, Kilbourne AM, Owen RR, et al. Implementation science supports core clinical competencies: an overview and clinical example. Prim Care Companion CNS Disord. 2016;18(6). https://doi.org/10.4088/PCC.16m02004.

  37. Mignogna J, Hundt NE, Kauth MR, Kunik ME, Sorocco KH, Naik AD, et al. Implementing brief cognitive behavioral therapy in primary care: a pilot study. Transl Behav Med. 2014;4(2):175–83. https://doi.org/10.1007/s13142-013-0248-6.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Fortney J, Enderle M, McDougall S, Clothier J, Otero J, Altman L, et al. Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics. Implementation science : IS. 2012;7(1):30. https://doi.org/10.1186/1748-5908-7-30.

    Article  Google Scholar 

  39. Harvey G, Oliver K, Humphreys J, Rothwell K, Hegarty J. Improving the identification and management of chronic kidney disease in primary care: lessons from a staged improvement collaborative. Int J Qual Health Care. 2015;27(1):10–6. https://doi.org/10.1093/intqhc/mzu097.

    Article  PubMed  Google Scholar 

  40. Jacavone JB, Daniels RD, Tyner I. CNS facilitation of a cardiac surgery clinical pathway program. Clin Nurse Spec. 1999;13(3):126–32. https://doi.org/10.1097/00002800-199905000-00009.

    Article  CAS  PubMed  Google Scholar 

  41. Wang A, Pollack T, Kadziel LA, Ross SM, McHugh M, Jordan N, et al. Impact of practice facilitation in primary care on chronic disease care processes and outcomes: a systematic review. J Gen Intern Med. 2018;33(11):1968–77. https://doi.org/10.1007/s11606-018-4581-9.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.

    Article  Google Scholar 

  43. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. https://doi.org/10.2105/AJPH.89.9.1322.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Chinman M, Daniels K, Smith J, McCarthy S, Medoff D, Peeples A, et al. Provision of peer specialist services in VA patient aligned care teams: protocol for testing a cluster randomized implementation trial. IS. 2017;12(1):57. https://doi.org/10.1186/s13012-017-0587-7.

    Article  PubMed  Google Scholar 

  45. Chinman M, Oberman RS, Hanusa BH, Cohen AN, Salyers MP, Twamley EW, et al. A cluster randomized trial of adding peer specialists to intensive case management teams in the Veterans Health Administration. J Behav Health Serv Res. 2015;42(1):109–21. https://doi.org/10.1007/s11414-013-9343-1.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science : IS. 2006;1(1):23. https://doi.org/10.1186/1748-5908-1-23.

    Article  Google Scholar 

  47. Hayden P, Frederick L, Smith BJ, Broudy A. Developmental facilitation: helping teams promote systems change. Collaborative Planning Project for Planning Comprehensive Early Childhood Systems. 2001 4/2001.

  48. Nagykaldi Z, Mold JW, Aspy CB. Practice facilitators: a review of the literature. Fam Med. 2005;37(8):581–8.

    PubMed  Google Scholar 

  49. Kazis LE, Skinner K, Rogers W. Health status of veterans: physical and mental component summary scores (SF-12V). Washington D.C., Bedford and West Roxbury: Department of Veterans Affairs; 1998.

    Google Scholar 

  50. Kazis LE, Skinner KM, Ren XS. Health status and outcomes of veterans: physical and mental component summary scores (SF-36). Washington D.C.: Department of Veterans Affairs; 2000.

    Google Scholar 

  51. Tunis SL, Croghan TW, Heilman DK, Johnstone BM, Obenchain RL. Reliability, validity, and application of the medical outcomes study 36-item short-form health survey (SF-36) in schizophrenic patients treated with olanzapine versus haloperidol. Med Care. 1999;37(7):678–91. https://doi.org/10.1097/00005650-199907000-00008.

    Article  CAS  PubMed  Google Scholar 

  52. Nabati L, Shea N, McBride L, Gavin C, Bauer MS. Adaptation of a simple patient satisfaction instrument to mental health: psychometric properties. Psychiatry Res. 1998;77(1):51–6. https://doi.org/10.1016/S0165-1781(97)00122-4.

    Article  CAS  PubMed  Google Scholar 

  53. Chinman M, Ebener P, Malone PS, Cannon J, D’Amico EJ, Acosta J. Testing implementation support for evidence-based programs in community settings: a replication cluster-randomized trial of Getting To Outcomes®. Implementation science : IS. 2018;13(1):131. https://doi.org/10.1186/s13012-018-0825-7.

    Article  PubMed  Google Scholar 

  54. Ritchie MJ, Kirchner JE, Townsend JC, Pitcock JA, Dollar KM, Liu CF. Time and organizational cost for facilitating implementation of primary care mental health integration. J Gen Intern Med. 2020;35(4):1001–10. https://doi.org/10.1007/s11606-019-05537-y.

    Article  PubMed  Google Scholar 

  55. Barbic S, Krupa T, Armstrong I. A randomized controlled trial of the effectiveness of a modified recovery workbook program: preliminary findings. Psychiatr Serv. 2009;60(4):491–7. https://doi.org/10.1176/ps.2009.60.4.491.

    Article  PubMed  Google Scholar 

  56. Cook JA, Jonikas JA, Hamilton MM, Goldrick V, Steigman PJ, Grey DD, et al. Impact of Wellness Recovery Action Planning on service utilization and need in a randomized controlled trial. Psychiatr Rehabil J. 2013;36(4):250–7. https://doi.org/10.1037/prj0000028.

    Article  PubMed  Google Scholar 

  57. Aggarwal NK. Ramifications of the VA MISSION Act of 2018 on Mental Health: Potential Implementation Challenges and Solutions. JAMA Psychiatry. 2020;77(4):337-8. https://doi.org/10.1001/jamapsychiatry.2019.3883.

  58. Goodman RM, McLeroy KR, Steckler AB, Hoyle RH. Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993;20(2):161–78. https://doi.org/10.1177/109019819302000208.

    Article  CAS  PubMed  Google Scholar 

  59. Young AS, Cohen AN, Goldberg R, Hellemann G, Kreyenbuhl J, Niv N, et al. Improving weight in people with serious mental illness: the effectiveness of computerized services with peer coaches. J Gen Intern Med. 2017;32(Suppl 1):48–55. https://doi.org/10.1007/s11606-016-3963-0.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Bassuk EL, Hanson J, Greene RN, Richard M, Laudet A. Peer-delivered recovery support services for addictions in the United States: a systematic review. J Subst Abuse Treat. 2016;63:1–9. https://doi.org/10.1016/j.jsat.2016.01.003.

    Article  PubMed  Google Scholar 

  61. Boevink W, Kroon H, van Vugt M, Delespaul P, van Os J. A user-developed, user run recovery programme for people with severe mental illness: a randomised control trial. Psychosis. 2016;8(4):287–300. https://doi.org/10.1080/17522439.2016.1172335.

    Article  Google Scholar 

  62. Cook JA, Copeland ME, Jonikas JA, Hamilton MM, Razzano LA, Grey DD, et al. Results of a randomized controlled trial of mental illness self-management using Wellness Recovery Action Planning. Schizophrenia Bull. 2012;38(4):881–91. https://doi.org/10.1093/schbul/sbr012.

    Article  Google Scholar 

  63. Craig T, Doherty I, Jamieson-Craig R, Boocock A, Attafua G. The consumer-employee as a member of a Mental Health Assertive Outreach Team. I. Clinical and social outcomes. J Mental Health. 2004;13(1):59–69. https://doi.org/10.1080/09638230410001654567.

    Article  Google Scholar 

Download references

Acknowledgements

The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs or other affiliated institutions. We would like to acknowledge the contributions of Daniel O’Brian-Mazza and Andrew Pomerantz for their assistance with this project.

Funding

All the authors are funded by a grant from the Department of Veterans Affairs (QUERI): QUERI for Team-Based Behavioral Health (1IP1HX001979-01): Evaluation of Peer Specialists on VA PACTs.

Author information

Authors and Affiliations

  1. VISN 4 Mental Illness Research, Education and Clinical Center, VA Pittsburgh, Pittsburgh, PA, USA

    Matthew Chinman & Sharon McCarthy

  2. Center for Health Equity Research and Promotion, VA Pittsburgh, Pittsburgh, PA, USA

    Matthew Chinman, Karin Daniels & Sharon McCarthy

  3. RAND Corporation, Pittsburgh, PA, USA

    Matthew Chinman

  4. VISN 5 Mental Illness Research, Education and Clinical Center (MIRECC), Baltimore, MD, USA

    Richard Goldberg, Anjana Muralidharan, Deborah Medoff, Amanda Peeples, Lorrianne Kuykendall, Natalie Vineyard & Lan Li

  5. Division of Psychiatric Services Research-Department of Psychiatry, School of Medicine, University of Maryland, Baltimore, MD, USA

    Richard Goldberg, Deborah Medoff & Lan Li

  6. VA Behavioral Health Quality Enhancement Research Initiative (QUERI), Central Arkansas Veterans Healthcare System, North Little Rock, AR, USA

    Jeffrey Smith

Authors
  1. Matthew Chinman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Richard Goldberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Karin Daniels
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anjana Muralidharan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jeffrey Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sharon McCarthy
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Deborah Medoff
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Amanda Peeples
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Lorrianne Kuykendall
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Natalie Vineyard
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Lan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RG helped conceptualized the study and developed the evaluation plan and edited the manuscript. MC conceptualized the study, developed the facilitation plan, and wrote significant portions of the manuscript. KD helped to develop the facilitation plan and wrote and edited significant portions of the text. AM helped with the literature for the introduction. JS contributed to both the evaluation and facilitation plans and edited the manuscript. SM edited the manuscript and developed significant portions of the facilitation plan. DM developed the statistical analyses for the evaluation plan and wrote that portion of the manuscript. AP developed the qualitative analyses for the evaluation plan and wrote that portion of the manuscript. LK and NV collected and managed the survey data. LL conducted all the statistical analyses. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Matthew Chinman.

Ethics declarations

Ethics approval and consent to participate

The project was deemed a Quality Improvement project on February 24, 2016. Because of this determination, individual consent will not be sought from individual staff or veterans. However, all staff and veterans will have the opportunity to decline participation without penalty after reviewing information provided to them about the study. This determination was made after two actions. First, on December 3, 2015, the PIs (MC, RG) completed a non-research determination checklist that asked several questions about the nature of the project (e.g., yield generalizable knowledge, expanding knowledge base, double-blind or placebo design). All answers indicated the project was not a research study. We sent the completed checklist to the VA’s Chief Consultant of Mental Health Services to obtain final approval. In addition, we obtained approval on March 10, 2016, from Organizational Assessment Sub-Committee (OASC) of the Office of Research Development, which governs the surveying of VA staff (Peer Specialists are VA staff).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chinman, M., Goldberg, R., Daniels, K. et al. Implementation of peer specialist services in VA primary care: a cluster randomized trial on the impact of external facilitation. Implementation Sci 16, 60 (2021). https://doi.org/10.1186/s13012-021-01130-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-021-01130-2

Keywords

Implementation Science

ISSN: 1748-5908