Skip to main content
  • Study protocol
  • Open access
  • Published:

Implementation and dissemination of a transition of care program for rural veterans: a controlled before and after study



Adapting promising health care interventions to local settings is a critical component in the dissemination and implementation process. The Veterans Health Administration (VHA) rural transitions nurse program (TNP) is a nurse-led, Veteran-centered intervention designed to improve transitional care for rural Veterans funded by VA national offices for dissemination to other VA sites serving a predominantly rural Veteran population. Here, we describe our novel approach to the implementation and evaluation = the TNP.


This is a controlled before and after study that assesses both implementation and intervention outcomes. During pre-implementation, we assessed site context using a mixed method approach with data from diverse sources including facility-level quantitative data, key informant and Veteran interviews, observations of the discharge process, and a group brainstorming activity. We used the Practical Robust Implementation and Sustainability Model (PRISM) to inform our inquiries, to integrate data from all sources, and to identify factors that may affect implementation. In the implementation phase, we will use internal and external facilitation, paired with audit and feedback, to encourage appropriate contextual adaptations. We will use a modified Stirman framework to document adaptations. During the evaluation phase, we will measure intervention and implementation outcomes at each site using the RE-AIM framework (Reach, Effectiveness, Adoption, Implementation, and Maintenance). We will conduct a difference-in-differences analysis with propensity-matched Veterans and VA facilities as a control. Our primary intervention outcome is 30-day readmission and Emergency Department visit rates. We will use our findings to develop an implementation toolkit that will inform the larger scale-up of the TNP across the VA.


The use of PRISM to inform pre-implementation evaluation and synthesize data from multiple sources, coupled with internal and external facilitation, is a novel approach to engaging sites in adapting interventions while promoting fidelity to the intervention. Our application of PRISM to pre-implementation and midline evaluation, as well as documentation of adaptations, provides an opportunity to identify and address contextual factors that may impede or enhance implementation and sustainability of health interventions and inform dissemination.

Peer Review reports


Patients are at high risk for adverse events during the transition period from hospital to home [1, 2]. The transition home presents challenges such as adjusting to new or changed medications, understanding disease management strategies, and learning home care routines. “Bridging” (i.e., pre- and post-discharge) interventions to improve transitional care practices reduce hospital readmissions [3]. These interventions focus on creating an “ideal” transition of care, which includes preparing patients for discharge with thorough education about self-care, ensuring the completion of medication reconciliation, arranging for any home care needs, and organizing appropriate follow-up [3,4,5,6,7,8,9]. Improving the transition from hospital to home is especially important in high-risk cohorts [3, 10], such as the elderly or those who live in a rural setting.

Rural Veterans are a high-risk cohort as they face barriers in nearly all aspects of an ideal transition in care. One such barrier relates to the structure of the Veterans Health Administration (VA) healthcare system. The VA is organized in a hub and spoke system, with large hospitals in urban areas and affiliated smaller clinics in rural areas. This structure leads to unique challenges for rural Veterans transitioning back to their primary care provider, such as difficulties with medication reconciliation between VA facilities, medication gaps due to limited availability of specialized medications in rural areas, inadequate discharge plans, lack of communication between tertiary hospitals and rural Patient Aligned Care Team (PACT) sites, and missed follow-up appointments with primary care providers (PCPs) [11]. In this paper, we describe the dissemination and implementation plan for the rural Transitions Nurse Program (TNP), a nurse-led and Veteran-centered intervention designed to address these transitional care gaps and improve post-discharge outcomes for rural Veterans hospitalized at tertiary VA sites.

The dual goals of this project are to (1) improve transitions and reduce hospital readmissions for rural Veterans hospitalized at tertiary VA facilities, and (2) contribute to the field of implementation science through a robust application of the PRISM framework at every stage from pre-implementation contextual assessment, to implementation and adaptation, to evaluation. The PRISM framework has been used to assess site context in a number of studies [12, 13], but to our knowledge, it has not been used to organize and integrate data from multiple sources or in an iterative manner to guide implementation and evaluation in successive waves. This work will address a gap in the literature on the use of PRISM to guide implementation. It will test the utility of PRISM to guide scale-up efforts of an intervention to diverse settings and provide an example of an innovative diffusion process in the VA.


Description of intervention

The TNP is an intervention carried out with a Transition Nurse (TN) in collaboration with a hospitalist site champion at each intervention site. The intervention is based on the Ideal Transitions of Care (ITC) framework [3] and consists of four core components. These are (1) pre-discharge assessment of patient understanding of self-care, medications, supports for post-discharge care, and obtaining a follow-up appointment; (2) structured post-discharge interactive communication between the hospital and primary care team alerting the primary care team of discharge; (3) a follow-up call to the patient within 48 to 72 h of discharge to confirm attendance to the follow-up appointment with the PCP, reinforce medication and self-care education provided at discharge, and assess symptoms and concerns; and (4) build knowledge and capacity at both the tertiary and primary care site to deliver improved care to future rural Veterans. The TNP was piloted in Denver between 2014 and 2016 with encouraging results such as reduced hospital readmissions and reduced costs relative to a control population [11]. Based on the success of the pilot, the TNP was funded by the VA Office of Rural Health with the support of the Veterans Health Administration (VHA) Office of Nursing Services for expansion to additional tertiary VA sites over the next 5 years.

Intervention and study design

We will use the Practical, Robust, Implementation, and Sustainability (PRISM) model [14] to inform the both implementation and evaluation of TNP. PRISM is ideal for guiding our multi-site implementation effort because it accounts for multi-level effects; it builds on several Implementation Science frameworks and can guide pre-implementation, implementation, and evaluation. Several studies show that the adoption, implementation, and sustainment of interventions are related to how well the intervention is integrated into the local context [12,13,14,15,16]. We will assess PRISM domains using convergent mixed methods, collecting both quantitative facility-level data, and qualitative data. We will use PRISM in each phase of our intervention: pre-implementation, implementation, and evaluation. Figure 1 shows the flow of project phases.

Fig. 1
figure 1

TNP flow chart. This figure illustrates how each stage of the TNP intervention informs subsequent stages. Our pre-implementation evaluation of intervention recipients informs adaptations to the intervention. Evaluation of adaptations and intervention outcomes inform preparation for the next cycle of implementation

This is a type II hybrid study, which tests both intervention outcomes and the implementation strategy [17]. TNP implementation will occur in waves, enrolling additional sites every 12 months. Each wave of implementation will follow three stages: pre-implementation training and evaluation, implementation, and outcome evaluation. It is important to distinguish the evaluation components of pre-implementation and implementation from the final outcome evaluation. Pre-implementation evaluation will be used to evaluate the implementation strategy and tailor the intervention to each site, formative midline evaluation 6 months after implementation will measure the initial intervention outcomes and provide performance feedback to each site, whereas summative outcome evaluation will measure the overall success of the program outcomes and implementation strategy at each site, and will be used to adapt future waves of implementation.


In the first wave of implementation, the program will be implemented at five sites (2017), one site from each of five geographic VA “regions,” the North Atlantic Region, the Southeast Region, the Midwest Region, the Continental Region, and the Pacific Region. These are tertiary hospital sites that treat more than 1000 rural Veterans annually, had leadership willing to sign a letter of support, and an active hospitalist program that cares for the majority of medical inpatients at the tertiary site. Prior to the second wave of implementation, we will evaluate implementation at the first five sites to test the utility of our implementation strategy. In subsequent waves, the Office of Rural Health will use a national solicitation of applicants for participation in the TNP through a formal application process. Sites that serve large rural populations will be encouraged to apply through targeted promotional materials to hospital leadership.

Description of implementation strategy

We will conduct pre-implementation site assessments before rolling out the program at each expansion site. Our implementation strategy combines robust pre-implementation work with internal and external facilitation, and audit and feedback.


During the pre-implementation phase, we will collect qualitative contextual data to (1) understand the current process for transitioning rural Veterans back to their PCP after an inpatient hospitalization at a VHA tertiary medical center, (2) identify and highlight the impact of factors encapsulated in the PRISM framework that may enhance or discourage the implementation of TNP at participating sites, and (3) use these data to facilitate implementation, document adaptations to the program, and enhance sustainability of the intervention and its implementation. In addition, we will meet with site leadership and identify a hospitalist champion as an internal facilitator. A hospitalist was chosen for this role to provide a link between inpatient and outpatient settings and to help troubleshoot clinical problems with enrolled patients. Each site will identify a cohort of rural patients to enroll in the program and modulate the TN workflow to avoid overlap with other transition of care practices.

Qualitative methods include key informant interviews, process mapping, as well as site visits with adapted ethnographic observation and a written group brainstorming activity (brainwriting). Key informant interviews and process mapping interviews with providers and administrators will begin prior to pre-implementation site visits. Table 1 summarizes how we use these methods to measure PRISM domains in our pre-implementation evaluation.

Table 1 Assessing PRISM domains to understand context for implementation

We will employ process mapping to understand the current discharge process for rural Veterans and inform the implementation process [18]. We will validate process maps using adapted ethnographic observations on-site visits [19]. During adapted ethnographic observation, qualitative analysts will join medical teams on rounds and observe the patient discharge process. Team members will collect information on the process, interactions among providers and between providers and patients, and contextual information on the atmosphere. Process maps will also aid in return on the investment (ROI) analyses by identifying each role involved in the discharge process, the steps in the process, and time and resources required to complete each step in the discharge process.

Key informant interviews with providers at VA tertiary hospitals and rural PACT clinics will identify attitudes and beliefs, initial reactions to the TNP, barriers and facilitators to implementation of the TNP, and participant perspectives on the potential value of the program. Interviews will be summarized for each site and used to inform site visit data collection. In particular, interviews will determine which areas of the discharge process need clarification or confirmation and identify remaining questions.

Finally, during pre-implementation site visits, we will conduct a brainwriting activity [20, 21]. The brainwriting activity will be used to clarify the rural patient discharge process at each site, to identify perceived failure points in the implementation of TNP and to consider strategies to overcome these barriers. Site visits provide the opportunity to verify what we learn in key informant and process map interviews.

Pre-implementation data will inform adaptations to the intervention. We will provide sites with initial feedback from our interviews and observations within 1 week of the site visit using rapid qualitative analysis techniques [22, 23]. This will allow sites to begin planning for implementation. Additionally, cross-site barriers and facilitators will be identified and discussed with site transition nurses and hospital champions during pre-implementation training.

Transition nurse training

Transition nurses from each site will be trained in their role prior to implementation. Transition nurses will complete care coordination and transitions management (CCTM) online training and a 2-day in-person training session in Denver. CCTM is conducted through a course offered by the American Academy of Ambulatory Care Nursing (AAACN) and was created from a consensus statement of the AAACN about the core competencies for care coordination [24]. The in-person training will take place at the Center for Advancing Professional Excellence (CAPE) at the University Of Colorado School Of Medicine in Denver, CO. This 2-day training will focus on learning and practicing relationship-centered communication skills and goal-based effective feedback techniques, through utilization of standardized patients. The skills-based training is interactive, experiential, and grounded in feedback. Training will discuss skills for initiating and maintaining relationships, as well as sharing information and negotiating a mutual plan of action. Pre- and post-training surveys will assess nurse satisfaction and perceived change in confidence and knowledge after training.


Our implementation strategy uses internal and external facilitation [25] and audit and feedback [25, 26] to encourage real-time adaptation of the intervention to each site. In our intervention, external facilitation will be conducted by a team in Denver. The primary investigator in Denver (RB) will meet with individual site leadership and leverage relationships with the Office of Rural Health and the Office of Nursing Services. Internal facilitation is conducted by the hospitalist champion, who will receive data from the team in Denver and have an on-the-ground role in establishing successful implementation of the program. Each site must complete the four core components of the intervention but will individualize the intervention by determining how the intervention best fits their needs and local context. For instance, each site will be responsible for identifying the high-risk rural patient population they will enroll, as each site has more rural Veteran hospitalizations (more than 1000 annually at each site) than the transition nurse can likely enroll (pilot data suggests enrollment of 250–350 rural Veterans annually).

In the first month of implementation, the TN at each site will participate in a regular teleconference with facilitators in Denver to identify barriers to intervention uptake and formulate solutions. The teleconference will serve to support the TNs as they begin enrolling patients in the program, to continually identify barriers to the program and to promote a community of practice. The Denver team will conduct a site visit 6 months after the initial implementation on TNP. The purpose of this site visit is to understand local context in order to better assist with remaining implementation barriers and to evaluate implementation fidelity. This is part of our audit and feedback strategy. By monitoring implementation at each site and assessing barriers as they arise, we will collect actionable data to share with the hospitalist champions that can be used to customize the TNP to each site. For example, we will share with each site the number of Veterans admitted, the number of Veterans who receive all components of the intervention, the time required to enroll Veterans in the program, and hospital readmission rates on a monthly to quarterly basis.

In addition, the facilitators in Denver will also provide contextual interventions to address problems that may arise during implementation (e.g., problems identified in teleconferences and site visits). Possible interventions for barriers include targeted capacity building, team building, encouraging and facilitating communication, reaching out to leadership to enlist support for the intervention, and providing knowledge sharing opportunities (e.g., best practices).

We will ask the first five sites to facilitate implementation at the second wave of sites using a “train the trainer” approach. We will create a manual that encapsulates lessons learned, common barriers to implementation, and solutions to these barriers and ask the first five sites to consider using this manual to “train” the new sites in their region.

Implementation outcomes

We will assess both intervention outcomes and implementation outcomes [27, 28]. We will use the RE-AIM framework [29] to measure implementation outcomes (see Table 2).

Table 2 RE-AIM measures in the rural transition nurse program

We will complement RE-AIM with the use of an adapted version of the Stirman adaptation and modification framework [30] to systematically document program modifications during implementation. Our pragmatic approach emphasizes the need for careful balance between fidelity to core program elements and modifications of peripheral program components (i.e., those components that are not essential to achieving consistent program outcomes) to local circumstances and preferences. The adapted Stirman framework includes tracking who makes modifications, what is modified, at what level of delivery, context modifications, and the nature of context modifications. Using this information in combination with intervention outcome measures, we will determine which parts of the intervention are necessary for success, in order to inform subsequent waves of implementation and to ensure sustainability in present and future contexts.

All qualitative data will be managed and coded using Atlas.ti [31] according to PRISM domains. A priori codes were developed through group discussion; additional codes that emerge will be applied to all previously coded manuscripts until saturation is reached [32,33,34]. Intercoder reliability will be conducted through team-based consensus building; qualitative analysts will independently code the same three transcripts and then discuss points of divergence and convergence. These discussions and coding of additional transcripts will continue until the group reaches consensus on the code meaning and application. Investigators with expertise in qualitative methods and implementation science (JJ, BR) will moderate these discussions.

Intervention outcomes

Intervention outcomes will gauge the effects of the intervention Veteran health outcomes (e.g., reduction in 30-day readmissions and Emergency Department visits). Due to restrictions of the funding agency, we cannot use a randomized design. Therefore, we are using a rigorous non-randomized design. We will conduct a difference-in-differences analysis using similar VA facilities as a control. Facilities will be matched based on their propensity for intervention assignment. Propensity scores will take into account potential confounders including both summarized patient and facility-level factors such as percent rurality, size, readmission rates, and patient risk factors. Our primary outcome will be 30-day readmission and Emergency Department visit rate. We will compare 30-day readmission and Emergency Department visit rates during a defined pre-intervention period at both intervention and control sites, and again beginning 6 months after implementation. We will also conduct an ROI analysis of the TNP, comparing the costs of implementing the program and the costs of the TN with reductions in post-discharge utilization costs. Finally, we will measure client outcomes like Veteran satisfaction.


The TNP is an innovative intervention with the dual goals of (1) improving the transition of care for rural Veterans hospitalized at tertiary VA hospitals and (2) testing a novel application of PRISM to assess contextual elements and tailor the intervention to individual sites. This study represents a robust application of the PRISM framework to a novel intervention. As a type II hybrid intervention-implementation study, we are also assessing novel implementation strategies combining internal and external facilitation and audit and feedback. Our implementation strategy is unique in its use of PRISM to integrate data from a variety of sources in a pre-implementation evaluation with the goal of providing real-time feedback to sites to enhance the impact adoption, implementation, and impact of the TNP.

The TNP builds on components of existing successful Transition Nurse Programs, such as the Department of Veterans Affairs Coordinated Transitional Care (C-Trac) program [35, 36]. C-Trac utilizes nurse case managers to work with patients on care coordination after discharge to community settings from a VA hospital. Like the TNP, C-Trac involves direct communication between the nurse case manager and patients via a post-discharge follow-up call. TNP builds on this program by promoting relationship building between the TN at VA tertiary hospitals and nursing staff at rural PACT sites. The creators of C-Trac used a modified version of the Replicating Effective Programs (REP) implementation theory model to adapt C-Trac to different contexts. REP is most commonly used at the population level rather than the hospital level and begins with the identification of a local site champion and documentation of existing process, followed by a pre-implementation phase that focuses on stakeholder engagement and coaching, identification of barriers, staff training, and also guiding stakeholders in formally adapting programs and documenting modifications [37]. We feel that PRISM is more appropriate for our intervention because it has a greater focus on understanding local contextual factors and organization, allowing for adaptations to diverse and unique environments. PRISM also includes the RE-AIM framework for evaluation. In our approach, external facilitators monitor the intervention using RE-AIM measures and feed the data to internal facilitators, allowing them to make targeted modifications to the intervention when necessary.

PRISM has proven a useful framework for several interventions. Liles et al. [13] used PRISM to explore internal and external barriers to colorectal cancer screening. They were able to identify barriers to colorectal screening at the staff, provider, and patient levels through stakeholder interviews, and were able to implement a program that addressed these specific barriers. Similarly, Beck et al. [12] used PRISM to assess barriers and facilitators in focus groups. As far as we know, our study is the first application of PRISM to assess context, barriers, and facilitators using data from such a wide variety of sources. Our use of PRISM to integrate data from multiple sources is also unique. We are unaware of another intervention using PRISM as a data reduction tool.

This study represents a robust application of the PRISM framework to a novel intervention. Results of our analysis will inform the utility of the PRISM framework for developing better implementation and evaluation strategies. Our multi-source data will allow us to assess the utility of our pre-implementation strategies and determine which are most successful, and to assess the utility of our intervention training and implementation strategies. Our use of the Stirman framework [34] for tracking modifications to the intervention as well as RE-AIM [33] for measuring program outcomes will allow us to assess the reach, effectiveness, adoption, implementation, and maintenance of the program in real time. In each subsequent wave of implementation, we will be able to use this information to enhance external facilitation and may be able to utilize novel study designs or new strategies when appropriate. Our use of standardized frameworks will make our findings applicable to the development, adaptation, and dissemination of new health interventions.

The primary focus of the TNP is to improve the transition of care for rural Veterans. Successful implementation will lead to reduced hospital readmissions through improved follow-up care and communication between hospitals and rural PACT sites. Our findings will have implications for the development of programs addressing transitions of care for vulnerable patient populations.



American Academy of Ambulatory Care Nursing


Center for Advancing Professional Excellence


Care coordination and transitions management


Department of Veterans Affairs Coordinated Transitional Care Program


Ideal Transitions of Care


Patient Aligned Care Team


Primary care provider


Practical Robust Implementation and Sustainability Model


Reach, Effectiveness, Adoption, Implementation, and Maintenance Framework


Replicating Effective Programs


Transitions nurse


Transitions nurse program


Veterans Health Administration


Veterans Health Administration


  1. Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161.

    Article  PubMed  Google Scholar 

  2. Auerbach AD, Kripalani S, Vasilevskis EE, Sehgal N, Lindenauer PK, Metlay JP, Fletcher G, et al. Preventability and causes of readmissions in a national cohort of general medicine patients. JAMA Intern Med. 2016;176(4):484. doi:10.1001/jamainternmed.2015.7863.

    Article  PubMed  Google Scholar 

  3. Burke RE, Kripalani S, Vasilevskis E, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8:102–9. doi:10.1002/jhm.1990.

    Article  PubMed  Google Scholar 

  4. Burke RE, Guo R, Prochazka AV, Misky GJ. Identifying keys to success in reducing readmissions using the ideal transitions in care framework. BMC Health Serv Res. 2014;14(1) doi:10.1186/1472-6963-14-423.

  5. Coleman EA, Parry C, Chalmers S, Min S-J. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006, 1822;166(17) doi:10.1001/archinte.166.17.1822.

  6. Hernandez AF. Relationship between early physician follow-up and 30-day readmission among Medicare beneficiaries hospitalized for heart failure. JAMA. 2010;303(17):1716. doi:10.1001/jama.2010.533.

    Article  CAS  PubMed  Google Scholar 

  7. Misky GJ, Wald HL, Coleman EA. Post-hospitalization transitions: examining the effects of timing of primary care provider follow-up. J Hosp Med. 2010;5(7):392–7. doi:10.1002/jhm.666.

    Article  PubMed  Google Scholar 

  8. Leppin AL, Gionfriddo MR, Kessler M, Brito JP, Mair FS, Gallacher K, Wang Z, et al. Preventing 30-day hospital readmissions: a systematic review and meta-analysis of randomized trials. JAMA Intern Med. 2014;174(7):1095–107. doi:10.1001/jamainternmed.2014.1608.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Naylor MD, Brooten D, Campbell R, Jacobsen BS, Mezey MD, Pauly MV, Sanford Schwartz J. Comprehensive discharge planning and home follow-up of hospitalized elders: a randomized clinical trial. JAMA. 1999;281(7):613. doi:10.1001/jama.281.7.613.

    Article  CAS  PubMed  Google Scholar 

  10. Burke RE, Coleman EA. Interventions to decrease hospital readmissions: keys for cost-effectiveness. JAMA Intern Med. 2013;173(8):695. doi:10.1001/jamainternmed.2013.171.

    Article  PubMed  Google Scholar 

  11. Burke RE, Kelley L, Gunzburger E, Grunwald G, Gokhale M, Plomondon ME. Improving transitions of care for rural Veterans transferred to tertiary VA medical centers. Am J Med Qual. 2017. in press. doi:10.1177/2F1062860617715508l.

  12. Beck A, Bergman DA, Rahm AK, Dearing JW, Glasglow RE. Using implementation and dissemination concepts to spread 21st-century well-child Care at a Health Maintenance Organization. Perm J. 2009;13(3):10–8.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Liles EG, Schneider JL, Feldstein AC, Mosen DM, Perrin N, Rosales AG, Smith DH. Implementation challenges and successes of a population-based colorectal cancer screening program: a qualitative study of stakeholder perspectives. Implement Sci. 2015;10:1. doi:10.1186/s13012-015-0227-z.

    Article  Google Scholar 

  14. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43. doi:10.1016/S1553-7250(08)34030-6.

    Article  PubMed  Google Scholar 

  15. Chor KHB, Wisdom JP, Olin S-CS, Hoagwood KE, Horwitz SM. Measures for predictors of innovation adoption. Adm Policy Ment Health Ment Health Serv Res. 2015;42(5):545–73. doi:10.1007/s10488-014-0551-7.

    Article  Google Scholar 

  16. Gagnon M-P, Nsangou É-R, Payne-Gagnon J, Grenier S, Sicotte C. Barriers and facilitators to implementing electronic prescription: a systematic review of user groups’ perceptions. J Am Med Inform Assoc. 2014;21(3):535–41. doi:10.1136/amiajnl-2013-002203.

    Article  PubMed  Google Scholar 

  17. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. doi:10.1097/MLR.0b013e3182408812.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Pojesak RB. Lean, six sigma, and the systems approach: management initiatives for process improvement. Environ Qual Manag. 2003;13:2.

    Google Scholar 

  19. Walby KT. Institutional ethnography and surveillance studies: an outline for inquiry. Surveill Soc. 2005;3(2/3):158–72.

    Google Scholar 

  20. Heslin PA. Better than brainstorming? Potential contextual boundary conditions to Brainwriting for idea generation in organizations. J Occup Organ Psychol. 2009;82(1):129–45. doi:10.1348/096317908X285642.

    Article  Google Scholar 

  21. Michinov N. Is electronic brainstorming or brainwriting the best way to improve creative performance in groups? An overlooked comparison of two idea-generation techniques: electronic brainstorming and Brainwriting. J Appl Soc Psychol. 2012;42:E222–43. doi:10.1111/j.1559-1816.2012.01024.x.

    Article  Google Scholar 

  22. Beebe J. Rapid assessment process. Encyclopedia Soc Measurement. 2004;0:1–7.

    Google Scholar 

  23. Hargreaves MB. Rapid evaluation approaches for complex initiatives. Mathematica Policy Res. 2014;

  24. Haas S, Swan BA, Haynes T. Developing ambulatory care registered nurse competencies for care coordination and transition management: College of Nursing Faculty Papers & Presentations; 2013.

  25. Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care–mental health. J Gen Intern Med. 2014;29(S4):904–12. doi:10.1007/s11606-014-3027-2.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, Grimshaw JM. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9(1) doi:10.1186/1748-5908-9-14.

  27. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–34. doi:10.1007/s10488-008-0197-4.

    Article  Google Scholar 

  28. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38(2):65–76. doi:10.1007/s10488-010-0319-7.

    Article  Google Scholar 

  29. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. doi:10.2105/AJPH.89.9.1322.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8(1) doi:10.1186/1748-5908-8-65.

  31. AtlasTi V. 7.5 Manual. 7.5 ed. Berlin: Scientific Software Development GmbH.

  32. Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2006;27(2):237–46. doi:10.1177/1098214005283748.

    Article  Google Scholar 

  33. Jones J, Nowels CT, Sudore R, Ahluwalia S, Bekelman DB. The future as a series of transitions: qualitative study of heart failure patients and their informal caregivers. J Gen Intern Med. 2015;30(2):176–82. doi:10.1007/s11606-014-3085-5.

    Article  PubMed  Google Scholar 

  34. Morse JM. Critical analysis of strategies for determining rigor in qualitative inquiry. Qual Health Res. 2015;25(9):1212–22. doi:10.1177/1049732315588501.

    Article  PubMed  Google Scholar 

  35. Kind AJ, Jensen L, Barczi S, Bridges A, Kordahl R, Smith MA, Asthana S. Low-cost transitional care with nurse managers making mostly phone contact with patients cut rehospitalization at a VA Hospital. Health Aff. 2012;31:12. doi:10.1377/hlthaff.2012.0366.

    Article  Google Scholar 

  36. Kind AJ, Brenny-Fitzpatrick M, Leahy-Gross K, Mirr J, Chapman E, Frey B, Houlahan B. Harnessing protocolized adaptation in dissemination: successful implementation and sustainment of the veterans affairs coordinated-transitional care program in a non-veterans affairs hospital. J Am Geriatr Soc. 2016;64(2):409–16.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Kilbourne AM, Neuman MS, Pincus HA, Bauer Mark S, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implementation science. Implement Sci. 2007;2:42. doi:10.1186/1748–5908–2-42.

    Article  PubMed  PubMed Central  Google Scholar 

Download references


We would like to thank our operational partners Thomas Klobucar, PhD, from the Office of Rural Health and Christine Engstrom, PhD, CRNP, AOCN, from the Office of Nursing Services for their support of the TNP.


We are grateful for the operational support from the VA Office of Rural Health, which funded the Transitions Nurse Program [N19-FY14Q3-S0-P01240]. The sponsor had no role in the design, conduct, analysis, interpretation, or presentation of the study. Dr. Burke was supported by a VA Career Development Award.

Availability of data and materials

Not applicable.


The contents of this manuscript do not represent the views of the Department of Veterans Affairs or the United States Government.

Author information

Authors and Affiliations



CL wrote the collated program information and prepared the manuscript. EL developed the qualitative analysis plan and commented on the manuscript. MM developed the process mapping plan with assistance from MJC and commented on the manuscript. BL was involved in program development and planning for dissemination, and commented on the manuscript. LK and AM developed transition nurse training and commented on the manuscript. AL assisted with the planning of qualitative analysis and commented on the manuscript. HG developed the brainwriting activity and commented on the manuscript. JJ guided the development of qualitative analysis plan. BR provided guidance on the planning for dissemination and adaptations. MH provided guidance for the program development. RB created the TNP program and commented on the manuscript. All authors have approved the final version of the manuscript.

Corresponding author

Correspondence to Chelsea Leonard.

Ethics declarations

Ethics approval and consent to participate

This study is a designated program evaluation by the VA Office of Rural Health. This project is not a human subject research.

Consent for publication

Not applicable.

Competing interests

All authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leonard, C., Lawrence, E., McCreight, M. et al. Implementation and dissemination of a transition of care program for rural veterans: a controlled before and after study. Implementation Sci 12, 123 (2017).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: