Skip to main content

Advertisement

Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes

Article metrics

Abstract

Background

Incorporating shared medical appointments (SMAs) or group visits into clinical practice to improve care and increase efficiency has become a popular intervention, but the processes to implement and sustain them have not been well described. The purpose of this study was to describe the process of implementation of SMAs in the local context of a primary care clinic over time.

Methods

The setting was a primary care clinic of an urban academic medical center of the Veterans Health Administration. We performed an in-depth case analysis utilizing both an innovations framework and a nested systems framework approach. This analysis helped organize and summarize implementation and sustainability issues, specifically: the pre-SMA local context; the processes of tailoring and implementation of the intervention; and the evolution and sustainability of the intervention and its context.

Results

Both the improvement intervention and the local context co-adapted and evolved during implementation, ensuring sustainability. The most important promoting factors were the formation of a core team committed to quality and improvement, and the clinic leadership that was supported strongly by the team members. Tailoring had to also take into account key innovation-hindering factors, including limited resources (such as space), potential to alter longstanding patient-provider relationships, and organizational silos (disconnected groups) with core team members reporting to different supervisors.

Conclusion

Although interventions must be designed to meet the needs of the sites in which they are implemented, specific guidance tailored to the practice environment was lacking. SMAs require complex changes that impact on care routines, collaborations, and various organizational levels. Although the SMA was not envisioned originally as a form of system redesign that would alter the context in which it was implemented, it became clear that tailoring the intervention alone would not ensure sustainability, and therefore adjustments to the system were required. The innovation necessitated reconfiguring some aspects of the primary care clinic itself and other services from which the patients and the team were derived. In addition, the relationships among different parts of the system were altered.

Background

Successful implementation is a function of the relationship between the nature of the evidence, the context in which the proposed change is to be implemented, and the methods by which the change is facilitated [1, 2]. However, operationalizing improvement within a specific context based on the literature is challenging, due in part to the limitations of the literature describing improvement efforts [3]. For example, often the rationale for the choice of an improvement intervention is not given except in the most general terms. Similarly, specific barriers, especially factors other than those related to the individual professional (e.g., factors related to the patient, the healthcare team, the healthcare organization and the healthcare system when addressed) also tend to be presented in general terms [414]. This lack of specificity inherently recognizes the need for decisions to tailor the general concept to the specific location, but at the same time there is rarely guidance provided for thinking about local challenges and opportunities. Nor is there guidance for making those types of decisions. This phenomenon of context-dependence has led to calls for tailoring interventions [6, 1520].

Local and global problems

Although the concept of tailoring interventions is generally accepted, a systematic review of tailored strategies for behavior change in healthcare professionals revealed mixed results [20]. Moreover, much of the work describing tailored interventions has focused on individuals (end users), such as adaptation to patients' cultural background or adaptation of practice guidelines for healthcare professionals [2124]. Thus, the process by which an organization-level practice change intervention can be individualized and implemented has not been well described. We suggest that part of the problem is conceptualizing the process as simply that of tailoring interventions to the context, and not recognizing or adjusting the unique local context to optimize success of that intervention. In fact, there have been relatively few studies of adaptation at multiple organizational levels, from the individual level (both patient and healthcare professional) to clinical microsystem, mesosystem, macrosystem, and even supramacrosystem. Even fewer describe the adaptation process itself, i.e., the basis for the choices made in determining the makeup of the intervention, and the evolution of the intervention over time. We will describe in detail the implementation of a specific intervention – shared medical appointments/group visits – in a specific context in order to elucidate these many issues.

Intended Improvement

Shared medical appointments (SMAs) constitute a promising improvement strategy to help address the complexities and demands of managing chronic health conditions. There is evidence in support of this approach, including our own experience [25]. Shared medical appointments may also be called group visits, cluster visits, or chronic healthcare clinics. They have been described as a form of medical appointment with varying medical staff and patient populations and have been utilized for patients with chronic illnesses for whom education, self-management, and problem-solving skills are essential. The SMA is a patient medical appointment in which a multi-disciplinary team of providers (ranging from two to six) see a group of patients (eight to twenty) in a one and one-half to two hour visit. The implementation of SMAs was designed as a quality improvement project to improve intermediate outcome measures for diabetes – A1c, systolic blood pressure, low density lipoprotein cholesterol (LDL-cholesterol) – focusing on those patients at highest cardiovascular risk. We have previously reported the initial results in 44 patients who participated in these group visits: Levels of A1c, fell significantly post-intervention, with a mean (95% CI) decrease of A1c of 1.4% (0.8, 2.1) (p <0.001). The reduction in A1c was significantly greater in the intervention group relative to concurrent but non-randomized controls: 1.44 versus -0.30 (p = 0.002) [25].

While not all evaluations of outcomes associated with SMAs are as encouraging, the format remains appealing in an environment of growing demands and limited resources. In fact, the lack of success may be attributed to implementation challenges and issues that have not been adequately examined [26, 27]. The general structure and processes for conducting SMAs have been established, but there is a lack of specific guidance to ensure success. As with other complex interventions, SMAs necessitate a systemic redesign that intersects a wide range of levels of a system (micro- to supramacro) for successful implementation and sustainability: SMAs require reconfiguring various levels of an organization's model of primary care.

Study purpose

Our goal in this case study was to provide an in-depth analysis with the potential to identify themes and issues that will inform others interested in conducting or refining SMAs, or other organizational change. We describe the implementation and evolution of SMAs within a particular local context, a process that involved more than tailoring the intervention to the context; surprisingly, it also involved altering the context for intervention success. After initially considering the SMA as an addition to, or an enhancement of, the microsystem, we recognized over time that successful implementation required expansion of the clinical microsystem by creating an intra-meso structure within the constraints of the existing microsystem (one-on-one doctor-patient relationship) and mesosystem (primary care clinic) that is nested within a macrosystem (medical center) which in turn is nested within a supra-macrosystem, the Veterans Healthcare Administration (VHA) healthcare system.

Methods

Setting

This intervention was initiated within the primary care clinic of an urban academic medical center of the Veterans Health Administration. This clinic's primary care providers – five nurse practitioners (NPs), one physician assistant, eight part-time attending physicians, and 60 resident physicians – provide care for 11,000 patients, of whom 25% have diabetes. In addition to having a sophisticated electronic medical record, aspects of the Chronic Care Model routinely integrated into this clinic included nurse case management, and a clinical reminder system with feedback on performance [25]. The local context prior to initiating SMAs for patients with diabetes is outlined in Table 1, and follows a scheme adapted from Batalden et al [28]. The clinical microsystem is the small, frontline unit that is the primary clinical care unit (primary care provider and patient), which is nested within a mesosystem, and further nested within a macrosystem. Specifically, Table 1 defines the local context in January 2005 related to care for patients with diabetes and lists key elements related to diabetes care-based practices before introducing SMAs.

Table 1 Defining the local context prior to introducing shared medical appointments (SMAs)

Planning the intervention

The microsystem prior to SMAs consisted of the patient care visit (primary care providers and patients). The visits consisted solely of one-on-one encounters with patients and differing providers (primary care provider, nurse, clinical pharmacist, and psychologist). The mesosystem was the whole primary care clinic where patients were seen. The clinic culture was characterized by a focus on individual responsibility of primary care providers rather than systems-based practice and there was relatively little interdisciplinary care. However, usual care also included referral to a dietician, certified diabetes educator, clinical pharmacist, or endocrine/diabetes specialty clinic at the discretion of the primary care provider. Thus, high-risk patients (part of the clinical microsystem) not meeting physiologic or process measure goals for diabetes were referred to any number of support staff for further education and treatment (mesosystem). A link back to the primary care provider existed via the electronic medical record. Additionally, different disciplines were not supervised by one director, but by leaders in their own discipline who did not work within the mesosystem. Changes in processes of care were difficult to achieve without many discussions with multiple discipline-specific supervisors. Improvement efforts previously were primarily top-down, based on mandates from the top management at the facility. At the macro-system level, the Cleveland VAMC was engaged in demonstrating quality measures for diabetes determined by the supramacro-system level of the VHA Central Office. At both supra and macro levels, there was increasing awareness of SMAs as a means to improve waiting times while meeting quality imperatives in an efficient manner. Organizational direction at the level of the macro- and supramacro-systems had a greater influence; there were mandates to conduct SMAs issued by the VHA, primarily to address issues related to waiting times and clinic access. Mandates from outside the local medical center aside, local leadership in general and in the primary care clinic in particular were strongly supportive of improvement efforts and open to the use of novel methods of care delivery. Moreover, the local facility has had a long history of support for and success in the implementation of clinical improvement allowing reliance on internal rather than external facilitation [29]. A committee formed to address the quality of diabetes care was an outgrowth of a day-long clinic retreat conducted off-site by two of the authors (SRK and DCA), among others. Clinic staff who previously had little involvement in system redesign began to take part.

Planning the study

We used a nested systems framework to help organize and summarize implementation and sustainability issues [28]. Figure 1 provides a visual representation and framework for understanding the system redesign associated with successfully tailoring the intervention and the local context. Specifically, the left side of Figure 1 depicts the initial conceptual model of our healthcare system. The microsystem links to the mesosystem in that patients are referred, as needed, to nursing and other services. The macrosystem level refers to the local organization. The local organization is also linked to the national organization (supramacro level). We represented the supramacro-system as a perpendicular layer to emphasize the role as a foundation and the distant though defining influence of the supramacrosystem on the local context. Figure 1 also depicts the conceptual model that evolved to describe the successful implementation of SMAs for patients with diabetes (right side of the figure; see below for discussion).

Figure 1
figure1

Visual representation and framework for understanding the transformation (system redesign) associated with successful SMA implementation as intra-meso component. The figure on the left side is the initial model and the right side includes the system redesign.

Methods of evaluation and analysis

We used an in-depth case analysis approach focusing on the context and methods of implementation. This allowed us to describe the conceptual issues related to system redesign to implement an SMA for patients with diabetes [1, 2, 3035]. In particular, we used the characteristics of innovations framework of Grol et al. to characterize SMAs as an innovation in terms of the factors that might promote or hinder implementation processes [32]. We have used a participatory/action research approach where relevant parties of the process actively examine, plan, evaluate, and reflect throughout the cycles. [36] Such an approach best achieved our goals related to capturing the processes and key elements impacting on those processes. [3740]. Notes from meetings and debriefings, including feedback from primary care providers, patient surveys, e-mails, and meeting summaries (e.g., meetings of the team developing the related research grant application and the practice manual), were reviewed, cataloged, and coded for relevance to the implementation process. In addition, this quality improvement project took place in concert with the Academic Chronic Care Collaborative sponsored by the Association of American Medical Colleges and the Institute for Healthcare Improvement. Monthly reports submitted to this Collaborative were reviewed. This was done in an iterative process combined with interviews with key participants and observations. Seven local individuals familiar with the implementation processes of this project or SMAs were asked to independently review the summaries and findings. Six provided written feedback and were interviewed in a semi-structured format for validation purposes. The model presented here and the formats for structuring the presentation emerged from this participatory/action based and grounded-theory approaches [36, 41].

Results

Accommodating the innovation into the local context: initial decisions

Once the decision was made to begin SMAs, it was necessary to create general guidelines about SMAs and translate those into the local context, with its resources and needs. Implementation fidelity is often presented as critical to achieving the levels of efficacy demonstrated in clinical trials. However, it became apparent that descriptions of SMA interventions provided insufficient detail to guide implementation into differing clinical settings. While decisions and potential options were sometimes discussed, guidance on translating and mapping out to the local context was not provided. Table 2 outlines the initial dimensions of the SMA innovation we identified (first column). The second column delineates our initial decisions or translation of the intervention to the needs of the local context. In order to maximize success and meet demanding clinical care needs, we began with diabetes as a focus because of the existing core team and its openness to change, some collaboration between key disciplines was loosely in place, the volume of patients with diabetes, the cost to the organization, and the high demand of resources required to manage patients with diabetes. However, as is true with most decisions, there were aspects of many decisions that included promoting factors but also came with hindering factors. Therefore, Table 2 also outlines the promoting and hindering factors associated with each of the initial decisions.

Table 2 Analysis of SMAs Innovation: Translating SMA into Local Context (February 2005)

It is worth highlighting key promoting factors for the innovation that relate to the system levels because ultimate system redesign requires successful alignment and interplay between all levels. While the organizational structure is very hierarchical (Figure 1), there was openness to novelty. In fact, there was the supramacrosystem level mandate to begin SMAs, with considerable latitude given to how those mandates were achieved. Descriptions of the transformation of the VHA describe these seemingly contradictory strains [42]. Thus, at the supramacrosystem level, promoting factors included the mandate for action to address performance deficiencies, the so-called 'burning platform' and the simultaneous freedom and flexibility to pilot test to secure buy-in [43]. At the macrosystem level, there was similar support for innovation. At the mesosystem level, a strong core care team was essential that reflected multi-disciplinary members from the various services that would be linked. This team was open to new care models and expanding roles with a leader who had the ability to make changes at the microsystem level. Although Table 2 identifies a number of promoting factors, we believe that the most essential factors were the formation of a core team committed to quality and improvement, and the leadership provided by the clinic director that was supported strongly by the team members.

At the same time, there were several key innovation-hindering factors associated with the general mandate to conduct SMAs and the specific decision to translate the mandated innovation into the local context: limited resources (such as space); potential to alter longstanding patient-provider relationships; organizational silos (disconnected groups) with core team members reporting to different supervisors; difficulties in documenting workload for credit; and finally, the flexibility itself and absence of specific guidelines for meeting the mandates, resulting in a certain inefficiency and delay in the process. Implementation in a space-constrained facility that was in the midst of major construction and renovation meant that the choice of a location resulted in displaced providers who used the space, and limited access to computers available in the conference room. There was concern that group visits with different providers would disrupt established provider-patient relationships and inhibit those providers from referring patients. The different lines of authority for each of the core team members necessitated negotiations with four different supervisors, some of whom were more open to SMAs than others. In this organization, there is a strongly perceived need (varying among different clinical and administrative departments) for meticulous accounting of one's workload. It was not intuitively obvious how to account for SMA work within current accounting systems.

Implementation and evolution

SMAs require complex changes that impact on care routines, collaborations, and various levels of the organization. As such, implementing the initial decisions involved more than putting decisions into place. As noted by others, implementers and champions of innovation are critical. This is particularly true the more complex the change and the need for system redesign. Those who conduct and carry out the implementation obviously play a key role in helping to initiate and sustain the intervention. Implementers for our SMA intervention included a physician who was the Medical Director of the clinic and an Endocrine Nurse Practitioner. The physician was an established leader of the Primary Care Clinic for two years prior to initiating the intervention and had some training in Quality Improvement. The physician felt ownership of the improvement processes overall and had the authority to solicit and get approval for staff in other disciplines to participate in the SMA. The Endocrine Nurse Practitioner was not a member of the Primary Care Clinic but was considered to be a content expert and opinion leader at our institution. She had worked with high-risk patients with diabetes for 20 years prior to the intervention and was willing to share her expertise with patients as well as other less knowledgeable team members. All members of the core team were strongly committed to working together and were key stakeholders at the mesosystem level.

Although the initial analysis and translation of the innovation (Table 2) provided a starting point and the implementers provided additional local motivation, further analysis of the SMA beyond the promoting and hindering factors associated with the decision to implement was necessary for guidance to tailor and adjust the innovation to the local context. Grol et al. identified a series of characteristics of innovations that might promote or hinder implementation processes [32]. The relationship between these factors and the local context is outlined in Table 3. While the relative advantage/utility was appreciated by the initiators early on, three other innovation characteristics also appeared to be critical to successful implementation: compatibility, involvement, and collective action. This innovation was very compatible with the norms and values of the institution in promoting improvement in chronic disease quality measures. The involvement of the core team who would be implementing the SMA was very high. Individuals met to collectively decide the specific details of the clinical experience for patients and providers. However, hindering factors included: low compatibility with the traditional one-on-one visit with a primary care provider, high complexity in that the innovation was difficult to explain, and low collective action from the primary care providers who did not have input into the SMAs into which their patients would be recruited.

Table 3 Key implementation and evolution factors using Grol and Wensing's Characteristics of Innovations Framework [32].

The initial decisions and implementation endeavors began the process of practice change, but iterations of tailoring the intervention and negotiating system redesign were necessary. While not surprising that there would be issues on the path from start-up to sustainability, little attention has been given to identifying and categorizing them. Within our local context, the SMA process for patients with diabetes has changed over the last two years. These changes have occurred at the level of the clinical microsystem, mesosystem, and macrosystem. Within the microsystem, many changes have involved team structure, the patient population, and clinic flow. In Table 3, we have used the Grol et al. framework to list the key changes over time and strategies for promoting implementation and sustainability [32]. This framework identifies the flexibility and adaptability during implementation as a dimension which can either promote or hinder the process. We found that because our SMA had a strong core team, this was an important aspect to identify and maximize throughout implementation. Once identified, we could use this promoting factor to offset challenges encountered during implementation. The lack of clear designation of what the innovation and team members needed permitted the team to adapt the innovation to the local context and needs throughout the implementation process. As an example, we recognized after initiation of the SMA process that patients wanted to discuss dietary issues in detail, and we subsequently added a nutritionist. Another example is the response to the challenges of documenting the patient visit. We initially used the group note function in our electronic medical record. The group note field allows text to be entered that will appear in the note of every patient in the group. However, it was recognized early on that such a note did not allow for customization. Therefore, we initiated the development of a template note with embedded guidelines that was user-friendly and facilitated the efficiency of documentation and standardization and completeness of individual treatment plans. This development took place over a period of several months. Another characteristic is that of complexity of both the innovation (SMA) and its implementation. The SMA was something that was identified initially as a vague unknown type of clinical care which was not easy to explain to the primary care staff. This constituted a barrier to successful implementation. We decided to take advantage of a trial period with small numbers of patients to highlight success as well as allow clinic practitioners to sit in on one to three SMAs. Through identification of this barrier we were able to develop a strategy to overcome it.

Results: Evolution of the conceptual model

The right side of Figure 1 depicts the conceptual model that evolved with the successful implementation of SMAs for patients with diabetes. The system redesign that resulted from implementing SMAs included continuous tailoring of the intervention to and continuous adjustment of the local context. This interplay of co-evolving components added a new clinical venue to which referral of patients was possible. SMAs were designed with the idea that they would exhibit the characteristics of a high-performing clinical microsystem; e.g., alignment of roles and training for efficiency and staff satisfaction; interdependence of the care team to meet patient needs; integration of information and technology into work flows; and supportiveness of the larger organization [36, 44]. However, we felt that to conceptualize SMAs as another clinical microsystem was confusing, given the co-presence of the more traditional microsystem and the unique way SMAs expanded and integrated other services and resources of the primary care clinics that was contrary to traditional thinking about care. Moreover, the primary responsibility for the patients seen in the SMAs was and would remain in the hands of the primary care provider in his or her microsystem. Accordingly, SMAs are identified as an intra-mesosystem component to recognize the linkages among and between other meso components (intra-meso) beyond the microsystem, and to emphasize the system redesign. Additionally, the SMA with its own iterative improvements and evolution seemed a separate system as opposed to a higher functioning system that already existed. This is in contrast to the initial system design where there was only the closed microsystem with the components within (intra-micro) the inner clinical microsystem.

System redesign is also reflected in the arrangement of the SMAs: the squares in Figure 1 represent participants on equal footing by recognizing the role of each discipline's expertise, including the patients who also bring expertise to the exchange. In addition, the graphic representation of the flow of communication underscores the mutual contributions and simultaneous, non-sequential nature of the interactions for patients and providers. Finally, the clinical microsystem and the intra-mesosystem (SMAs) are overlapping to reflect that SMAs do not eliminate the traditional clinical microsystem but rather offer another opportunity for care, with both approaches co-evolving. This point is particularly important to recognize, as one concern providers often expressed was the potential undermining impact SMAs might have on the individual provider-patient relationship.

Local context and sustainability of SMAs two years later

The current local context and care-based practices related to diabetes are summarized in Figure 2. Changes or differences are denoted in italics, with items directly impacting on diabetes care aligned on the right side of the last column. The current state of the SMAs for patients with diabetes is summarized in the pull-out box that reflects the intra-mesosystem redesign level. Figures 1 and 2 help to identify the major changes and shifts in local context as well as the issues related to tailoring the intervention and adjusting the context.

Figure 2
figure2

Current (post-transformation) local context and care-based practices related to diabetes management.

It is worth highlighting some issues at each level of the care system. At the supramacro level, while continued improvement in information technology helps further support the SMA as configured at the local level, the mandates and priorities have changed. While this is to be expected, it does alert innovators and implementers to appreciating windows of opportunity. If the innovation has not taken off and achieved a force of its own (including demonstrating some levels or areas of success consistent with the organizational goals), changing priorities (new mandates), and the lack of success will create increasingly difficult challenges.

Given the demonstrated successes, leaders at the macrosystem system want the SMAs to be expanded to other conditions and possibly other care sites, e.g., the community-based outpatient clinics linked to the main facility. Some new or adjusted practices beyond the actual SMA venue at the mesosystem level have also come about because of SMAs (e.g., monthly clinic meetings to discuss resource allocation and group meetings among discipline representatives) and some will help to further propel SMAs forward (e.g., registry and protocol development to identify high-risk patients).

At the microsystem level, primary care providers are experiencing more pressure to meet performance measures of quality and productivity (and at the supramacrosystem level, the current context is also for more prescriptive approaches about how to achieve goals). The objectives of the diabetes SMA map out to the increased pressures experienced by providers. Seeing the successes of the SMA, providers began to send patients with A1c levels very close to goal. This was not necessarily all positive, as we were unable to accommodate those identified in the registry with an A1c of greater than 9%. While the magnitude of the increase in referrals to SMAs created some unanticipated adjustments, we have worked and continue to work and negotiate with providers to prioritize resources. Their clear desire to refer more patients to SMAs underscores the growing foundation for sustainability.

Many factors contribute to implementation and sustainability of the SMA within the mesosystem (intra-mesosystem component) and with regard to its relationship to the clinical microsystems. Most importantly is how the SMA is valued. The increased number of referrals is evidence of the value placed on SMAs by the mesosytem providers. SMAs are valued by the professionals on the team based on their experiences with patients and on their feelings of a high degree of 'teamness', or esprit de corps [45]. Team members meet after each SMA where various members take turns working a little extra to support the SMA during non-clinical time with activities like making extra phone calls, generating letters to new patients, tracking patient satisfaction data, and meeting to change flow, if needed. In addition, the flexibility of the individual team members is manifest during the SMA sessions; all staff members pitch in with clerical duties as needed, re-check blood pressures, and download glucometers. A weekly meeting after each SMA continues to occur to discuss patients and processes to assure that all team members have an open forum to voice concerns and make group changes, thus maintaining the high degree of shared governance. In addition, beyond improved clinical outcomes, patient satisfaction has helped confirm the added value to providers and to administration (macro- and supramacrosystems). Patient satisfaction surveys routinely are administered following the SMA. Typical comments from patients have included: 'I learned a lot', 'this clinic really takes such good care of patients' and 'I wish this kind of clinic existed 20 years ago.'

Discussion

Although the SMA originally was not envisioned as a form of system redesign that would alter the context in which it was implemented, it became clear that tailoring the intervention alone would not ensure sustainability without adjustments to the system. The innovation necessitated reconfiguring some aspects of the mesosytem (the primary care clinic and other services from which the patients and the team were derived) and relationships with the microsystems. Though not specifically anticipated, evolution of the former was associated with evolution of the latter: As the patients from the primary care providers were seen in the SMA and then transitioned back to them there was transfer (spread) of management knowledge in patients with diabetes, particularly among the nurse practitioner providers. We have gained the impression that many more primary care providers initiate insulin appropriately at a lower threshold. Additionally, the use of patient check-out sheets that had been modified for the SMA to include lab results, targets, and self-management goals have been adopted by primary care providers. When they reviewed the SMA sheets, they wanted the additional information on the check-out sheets for all clinic patients, not just patients seen in the groups.

Other sustainability ingredients observed at the mesosystem level include a high level of interest and volunteers to help staff additional SMAs for hypertension and hyperlipidemia. This will provide the cadre of individuals necessary for sustainability. At the macrosystem level, the implementation of a SMA for diabetes and its success has come to the attention of the Chief of Staff and Medical Center Director. They have committed resources (i.e., financial resources) to maintain our clinical registry which serves as part of the critical infrastructure supporting SMAs. There has also been some redesign of clinic space to better accommodate the needs of SMAs. A construction project is planned to create a new room within the clinic designed specifically for group visits.

The fact that implementation could be accomplished without requiring the hiring of additional personnel facilitated gaining administrative support (macrosystem), but this required a compromise – using a less cost-effective approach to visit documentation. The organizational mandate and sponsorship of the clinic leader allowed time to be freed up for the staff. Different policies had to be developed for scheduling for the new clinic. Over time, this innovation became 'accepted practice' and SMAs for other conditions have been established; the mesosystem redesign factors and processes directly and indirectly related to SMAs for patients with diabetes is ongoing. Recent analyses of routine clinical quality assurance data have suggested the continued beneficial patient impact of SMAs.

Limitations

Our study has a number of limitations. First, this was a retrospective study of a quality improvement project. Standardized written materials pertaining to the implementation were limited. Consequently, recall of information with its attendant shortcomings was an important source of the data. However, all available material was evaluated systematically and triangulated with other individuals. Second, the study is limited to one local context and one intervention. At the same time, the issues faced – both the challenges and opportunities – are not unique. While predicting change and its course are challenging, understanding case studies of the process of individualizing or tailoring interventions to the existing and evolving environment provides important lessons, as others have noted [46]. Our adaptations did not sacrifice the improved clinical outcomes, and in fact may have enhanced clinical outcomes. Thus, our study provides insights into a successful implementation process for SMAs by describing how we addressed initial contextual decisions, and why those decisions were made, by identifying factors and considerations that necessitated adjusting initial decisions. Actions regarding issues ranged from clinic set-up to provider roles and tasks, sharing strategies to sustain this clinic as an adjunct to the primary care clinic, and providing information on how and what we chose to evaluate.

Conclusion

Our study describes in detail the processes by which an improvement intervention and the local context co-adapted and evolved during implementation, and continue to evolve to ensure sustainability. In theory, high implementation fidelity is necessary to achieve the levels of efficacy demonstrated in clinical trials. However, it is also clear that interventions must be tailored to meet the needs of the sites in which they are implemented [19, 20, 23, 47]. Unfortunately, guidance on specifics of that tailoring to the practice environment is lacking. We have described initial key characteristics of the intervention (SMA) that required adaptation and those perceived important to maintain without change if successful implementation was to occur. By identifying innovation characteristics as they pertain to our innovation (SMA), we illustrate the iterative processes involved in implementation [32]. Although specific factors of the intervention and the context appeared to be critical in this particular circumstance, it is most noteworthy that both the intervention and the context (at multiple levels) had to change. By illustrating key portions, we found that the more the intervention necessitated organizational and structural changes the more difficult it was to translate successfully. A strong core team, clinical improvements and an organization that supports innovation were paramount in overcoming the inertia inherent in clinic structure redesign, a necessary step to sustain the innovation. This system redesign needed to happen and could not have occurred devoid of appreciating and co-adapting the context and the intervention. It is also imperative to recognize the iterative nature of successful implementation that occurred as a part of our evolution. This iterative practice re-evaluation has now become manifest in other SMAs implemented (heart failure and hypertension), thus continuous quality improvement has become ingrained into routine operation in SMAs. This differs from many of the other clinics. Although clinical improvements have been sustained for two years, it is also important to recognize that outcomes need to be assessed at multiple levels – patients, staff and organization. For staff, this could include satisfaction as well as knowledge and skills. For the organization, it could include cost and efficiency as well as organizational climate and culture. A comprehensive set of measures would constitute the balanced scorecard necessary for overall system optimization.

References

  1. 1.

    Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C: Ingredients for change: revisiting a conceptual framework. Qual Saf Health Care. 2002, 11: 147-180. 10.1136/qhc.11.2.174.

  2. 2.

    Rycroft-Malone J: The PARIHS framework-a framework for guiding the implemention of evidence-based practice. J Nurs Care Qual. 2004, 19: 297-304.

  3. 3.

    Davidoff F, Batalden P: Toward stronger evidence on quality improvement. Qual Saf Health Care. 2005, 14: 319-325. 10.1136/qshc.2005.014787.

  4. 4.

    Brown J, Harris S, Webster-Bogaert S, Wetmore S, Faulds C, Stewart M: The role of patient, physician and systemic factors in the management of type 2 diabetes mellitus. Family Practice. 2002, 19: 344-349. 10.1093/fampra/19.4.344.

  5. 5.

    Fixson D, Naoom S, Blase K, Friedman R, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, Tampa: National Implementation Research Network

  6. 6.

    Grimshaw J, Thomas R, MacLennan G, Fraser C, Ramsay C, Vale L, Whitty P, Eccles M, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implmentation strategies. Health Technology Assessment. 2004, 8: iii-72.

  7. 7.

    Helfrich C, Savitz L, Swiger K, Weiner B: Adoption and implementation of mandated diabetes registries by community health centers. Am J Prev Med. 2007, 33: S50-S65. 10.1016/j.amepre.2007.04.002.

  8. 8.

    Hulscher M, Wensing M, Grol R, Weijden van der T, van Weel C: Interventions to Improve the Delivery of Preventive Services in Primary Care. American Journal of Public Health. 1999, 89: 737-746.

  9. 9.

    Hysong S, Best R, Pugh J: Guideline Implementation Strategy Patterns in Veterans Affairs Primary Care Clinics. HSR: Health Services Research. 2007, 42: 84-103. 10.1111/j.1475-6773.2006.00610.x.

  10. 10.

    Li R, Siomn J, Bodenheimer T, Gillie R, Casalino L, Schmittdiel J, Shortell S: Organizational factors affecting the adoption of diabetes care management processes in physican organizations. Diabetes Care. 2004, 27: 2312-2316. 10.2337/diacare.27.10.2312.

  11. 11.

    Macfarlane R, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.

  12. 12.

    Renders C, Valk G, Griffin S, Wagner A, Eljk Van J, Assendelft J: Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 2001, 24: 1821-1833. 10.2337/diacare.24.10.1821.

  13. 13.

    Savitz L, Kaluzny A: Assessing the implementation of clinical process innovations: a cross-case comparison. J Healthc Manag. 2000, 45: 379-

  14. 14.

    Weiner B, Helfrich C, Savitz L, Swiger K: Adoption and Implementation of Strategies for Diabetes Management in Primary Care Practices. American Journal of Preventive Medicine. 2007, 33: S35-S49. 10.1016/j.amepre.2007.04.001.

  15. 15.

    Bosch M, Weijden van der T, Wensing M, Grol R: Tailoring quality improvement interventions to identified barriers: a mulitple case analysis. Journal of Evaluation in Clinical Practice. 2007, 13: 161-168. 10.1111/j.1365-2753.2006.00660.x.

  16. 16.

    Davies B, Hodett E, Hannah M, O'Brien-Pallas L, Pringle D, Wells G: Fetal health surveillance: a community-wide approach versus a tailored intervention for the implementation of clinical practice guidelines. Canadian Medical Association Journal. 2002, 167: 469-474.

  17. 17.

    Flottorp Signe, Oxman Andrew: Identifying barriers and tailoring interventions to improve the management of urinary tract infections and sore thoart: a pragmatic study using qualitative methods. BMC Health Services Research. 2003, 3: 3-10.1186/1472-6963-3-3.

  18. 18.

    Goodwin M, Zyzanski S, Zronek S, Ruhe M, Weyer S, Konrad N, Esola D, Stange K: A clinical trial of tailored office systems for preventive service delivery: The study enhanced prevention by understanding practice (STEP-UP). American Journal of Preventive Medicine. 2001, 21: 20-28. 10.1016/S0749-3797(01)00310-5.

  19. 19.

    Jansen Y, deBont A, Foets M, Bruijnzeels M, Bal R: Tailoring intervention procedures to routine primary health care practice: an ethnographic process evaluation. BMC Health Services Research. 2007, 7: 125-10.1186/1472-6963-7-125.

  20. 20.

    Shaw B, Shaw B, Cheater F, Baker R, Gillies C, Hearnshaw H, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: effects on professional practice and health outcomes. The Cochrane Database of Systematic Reviews. 2005, 3

  21. 21.

    Castro F, Barrera M, Martinez C: The Cultural Adaptation of Prevention Interventions: Resolving Tensions Between Fidelity and Fit. Prevention Science. 2004, 5: 41-45. 10.1023/B:PREV.0000013980.12412.cd.

  22. 22.

    Gonzales J, Ringeisen H, Chambers D: The Tangled and Thorny Path of Science to Practice: Tensions in Interpreting and Applying 'Evidence'. Clinical Psychology: Science and Practice. 2002, 9: 204-209. 10.1093/clipsy/9.2.204.

  23. 23.

    Hill L, Maucione K: A Focused Approach to Assessing Program Fidelity. Preventive Science. 2007, 8: 25-34. 10.1007/s11121-006-0051-4.

  24. 24.

    Rohrbach L, Grana R, Sussman S, Valente T: Type Translation Transporting Prevention Interventions From Research to Real-World Settings. Evaluation & the Health Professions. 2006, 29: 302-333. 10.1177/0163278706290408.

  25. 25.

    Kirsh SR, Watts S, Pascuzzi K, O'Day M, Davidson D, Strauss G, Kern E, Aron D: Shared medical appointments based on the chronic care model: a quality improvement project to address the challenges of patients with diabetes with high cardiovascular risk. Quality Safety in Health Care. 2007, 16: 349-353. 10.1136/qshc.2006.019158.

  26. 26.

    Jaber R, Braksmajer A, Trilling J: Group Visits: A Qualitative Review of Current Research. Journal of American Board of Family Medicine. 2006, 19: 276-290.

  27. 27.

    Wagner E, Grothaus L, Sandhu N, Galvin M, McGgregor M, Artz K, Coleman E: Chronic Care Clinics for Diabetes in Primary Care. Diabetes Care. 2001, 24: 695-700. 10.2337/diacare.24.4.695.

  28. 28.

    Batalden P, Nelson E, Edwards W, Godfrey M, Mohr J: Microsystems in Health Care: Part 9. Developing Small Clinical Units to Attain Peak Performance. Joint Commission Journal on Quality and Patient Safety. 2003, 29: M575-585.

  29. 29.

    Stetler C, Legro M, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S, Wallace C: The importance of 'facilitation' to the implementation of research findings: reflective expereinces from the field. Implementation Science. 2006, 1: 23-10.1186/1748-5908-1-23.

  30. 30.

    Abelson J, Forest P, Eyles J, Casebeer A, Martin E, Mackean G: Examining the role of context in the implementation of a deliberative public participation experiment: Results from a Canadian comparative study. Social Science & Medicine. 2007, 64: 2115-2128. 10.1016/j.socscimed.2007.01.013.

  31. 31.

    Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.

  32. 32.

    Grol R, Bosch M, Hulscher M, Eccles M, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.

  33. 33.

    Kochevar L, Yano E: Understanding Health Care Orgnization Needs and Context: Beyond Performance Gaps. J Gen Intern Med. 2006, 21: S25-S29.

  34. 34.

    May C, Mair F, Dowrick C, Finch T: Process evaluation for complex interventions in primary care: understanding trials using the normalization process model. BMC Family Practice. 2007, 8: 42-10.1186/1471-2296-8-42.

  35. 35.

    May C: A rational model for assessing and evaluating complex interventions in health care. BMC Health Services Research. 2006, 6: 86-10.1186/1472-6963-6-86.

  36. 36.

    Meyer J: Using qualitative methods in health related action research. BMJ. 2000, 320: 178-181. 10.1136/bmj.320.7228.178.

  37. 37.

    Anderson R, Crabtree B, Steele D, McDaniel R: Case Study Research: The View From Complexity Science. Qualitative Health Research. 2005, 15: 669-685. 10.1177/1049732305275208.

  38. 38.

    Flyvbjerg B: Five Misunderstandings About Case-Study Research. Qualitative Inquiry. 2006, 12: 219-245. 10.1177/1077800405284363.

  39. 39.

    Lenz M, Stecklberg A, Richter B, Mûhlhauser I: Meta-analysis does not allow appraisal of complex interventions in diabetes and hypertension self-management: a methodological review. Diabetologia. 2007, 50: 1375-1383. 10.1007/s00125-007-0679-z.

  40. 40.

    Yin R: Case Study Reseach. 2003, Thousand Oaks: Sage Publications, 3

  41. 41.

    Crabtree B, Miller W: Doing Qualitative Research. 1999, Thousand Oaks, CA: Sage Publications, 2

  42. 42.

    Oliver A: The Veterans Health Administration: An American Success Story?. Milbank Q. 2007, 85: 5-35. 10.1111/j.1468-0009.2007.00475.x.

  43. 43.

    Kizer KW, Demakis JG, Feussner JR: Reinventing VA health care: systematizing quality improvement and quality innovation. Med Care. 2000, 386: I7-I16.

  44. 44.

    Nelson E, Batalden P, Huber T, Mohr J, Godfrey M, Headrick L, Wasson J: Microsystems in Health Care: Part 1. Learning from High-Performing Front-Line Clinical Units. Journal of Quality Improvement The Joint Commission. 2002, 28: 472-493.

  45. 45.

    Lencioni P: The Five Dysfunctions of a TEAM: A Leadership Fable. 2002, San Francisco: Jossey-Bass

  46. 46.

    Ruhe M, Weyer S, Zronck S, Wilkinson A, Wilkinson PS, Stange K: Facilitating practice change: lessons from the STEP-UP clinical trial. Preventive Medicine. 2005, 40: 729-734. 10.1016/j.ypmed.2004.09.015.

  47. 47.

    Flottorp S, Havelsrud K, Oxman A: Process evaluation of a cluster randomized trail of tailored interventions to implement guidelines in primary care-why is it so hard to change practice?. Fam Pract. 2003, 20: 333-339. 10.1093/fampra/cmg316.

Download references

Acknowledgements

The authors wish to thank the SMA Team including Gerald Strauss, Ph.D., Mary Ellen O'Day, Pharm D, CDE, Sharon Watts, ND, RN-C, CDE, NP, Julie Gee, RN, MSN, CNP, Kimberley Schaub, Ph.D., Gloria Taylor, RN, CDE, and Elizabeth Kern, MD, MS, for offering insights and clarifications to the implementation processes.

Contributions were supported by awards to Dr. Susan Kirsh and Dr. David Aron from the Quality Enhancement Research Initiative (Diabetes) of the Health Services Research & Development Service, Department of Veterans Affairs, USA.

Author information

Correspondence to Susan R Kirsh.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

The authors shared equally in the conception of the study, design, coordination and drafting the manuscript. All authors work in the medical center with two working in the clinic (SRK and DCA). Specifically, two of the authors (SRK and DCA) participated in the initiation and development of the SMA, with SRK being a regular team member and DCA being a back-up team member. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Keywords

  • Primary Care Provider
  • Local Context
  • Primary Care Clinic
  • Quality Improvement Project
  • Group Visit