- Research article
- Open Access
- Open Peer Review
Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes
Implementation Sciencevolume 2, Article number: 28 (2007)
Despite the development of several models of care delivery for patients with chronic illness, consistent improvements in outcomes have not been achieved. These inconsistent results may be less related to the content of the models themselves, but to their underlying conceptualization of clinical settings as linear, predictable systems. The science of complex adaptive systems (CAS), suggests that clinical settings are non-linear, and increasingly has been used as a framework for describing and understanding clinical systems. The purpose of this study is to broaden the conceptualization by examining the relationship between interventions that leverage CAS characteristics in intervention design and implementation, and effectiveness of reported outcomes for patients with Type II diabetes.
We conducted a systematic review of the literature on organizational interventions to improve care of Type II diabetes. For each study we recorded measured process and clinical outcomes of diabetic patients. Two independent reviewers gave each study a score that reflected whether organizational interventions reflected one or more characteristics of a complex adaptive system. The effectiveness of the intervention was assessed by standardizing the scoring of the results of each study as 0 (no effect), 0.5 (mixed effect), or 1.0 (effective).
Out of 157 potentially eligible studies, 32 met our eligibility criteria. Most studies were felt to utilize at least one CAS characteristic in their intervention designs, and ninety-one percent were scored as either "mixed effect" or "effective." The number of CAS characteristics present in each intervention was associated with effectiveness (p = 0.002). Two individual CAS characteristics were associated with effectiveness: interconnections between participants and co-evolution.
The significant association between CAS characteristics and effectiveness of reported outcomes for patients with Type II diabetes suggests that complexity science may provide an effective framework for designing and implementing interventions that lead to improved patient outcomes.
Although the cost of managing patients with chronic disease is high, and is predicted to rise to 80% of US health care dollars by 2020 , identification of effective ways to improve care of patients with chronic disease has been difficult. While the evidence base regarding optimal medical management of these patients has grown, our ability to implement evidence into routine clinical practice across diverse clinical settings has been limited. A recent study of chronically ill patients revealed poor provider adherence to guideline recommendations . Attempts to improve outcomes through use of practice guidelines, quality improvement, or system improvement have not led to consistently positive effects on process of care measures or outcomes, and have been disappointing [3–5]. Organizational barriers, such as inadequate staff or support structure, are typically cited as a hindrance to guideline implementation .
To facilitate implementation, several models for delivery of care for patients with chronic disease have emerged. These include the "self-management" and "collaborative management" models, the "chronic care model," and the "disease management" approach [6–9]. Recent systematic reviews of organizational intervention studies based on the self-management, chronic care, and disease management models reveal small to moderate effects on process or outcome measures [6, 10–13]. These results suggest that it may not be the content of the models, but rather, it may be that the specific way in which they are applied in organizations is critical.
One possible reason for the modest effects of organizational intervention outcomes is suggested by the recent application of complex adaptive system (CAS) theory to the organization of health care delivery [14–17]. A CAS is characterized by individuals who can learn, interconnect, self-organize, and co-evolve with their environment in non-linear dynamic ways [18, 19]. These factors lead to patterns of relationships and interconnections in the system that influence performance of the system. Like musicians in an improvisational jazz band, individuals in a CAS learn from and react to each other and their environment, leading to constant shifts in the pattern of relationships or the interpretation of the music. The natural tendency of individuals to learn, form patterns of relationships, organize and evolve suggests that interventions that suppress these activities will lead to poorer outcomes than those that facilitate them.
CAS theory has been used to describe clinical settings, such as primary care clinics . However, it also has implications for how we approach changing clinical systems [16, 20], but the implementation literature is less developed than the descriptive literature. Using CAS theory as a framework to assist us in designing and implementing organizational interventions could potentially make these interventions more likely to achieve their aims.
Complexity science suggests that inconsistent outcomes may result from an implicit assumption of linear, mechanistic relationships between cause and effect in implementing organizational interventions. This linear viewpoint implies that a specific intervention should lead to consistent, reproducible results across clinical settings. In contrast, nonlinearity, self-organization, and co-evolution suggest that each clinical setting is unique, and that outcomes of interventions may be greatly affected by small situational differences. [18, 19]. For example, clinical reminders may be very effective in prompting providers in one setting to perform recommended care, but may not be as effective in another because of very small differences in the settings (i.e., differences in the workflow of test ordering, ease of access of recommended care, patient population served, or provider beliefs).
The goal of this study is to build on the current literature related to using CAS to observe and understand clinical settings, to begin to examine the extent to which CAS theory is useful as a tool for designing and/or implementing organizational interventions. We hypothesize that interventions that leverage the characteristics of complex adaptive systems, intentionally or not, and regardless of the particular model of chronic care delivery on which the intervention was based, will consistently lead to improved outcomes over those that do not. To test this hypothesis, we conducted a systematic review of organizational interventions for patients with Type II diabetes and examine these interventions through the lens of complexity science.
We defined organizational interventions as those that explicitly attempt to affect or change organizational structures or processes to implement evidence-based practice. We searched Medline from 1989 through 29 December 2005, after developing a search strategy based on four components: 1) the strategy developed by the Effective Practice and Organization of Care (EPOC) Group of the Cochrane Collaboration and updated for a recent systematic review of Medicare-funded preventive services [21, 22]; (2) additional search terms for types of organizational interventions not included in the EPOC search strategy, such as total quality improvement, PDSA (Plan-Do-Study-Act), and practice redesign; (3) additional search terms used by a recent systematic review of preventive and quality improvement strategies ; and (4) bibliographies and Medline indexing terms of relevant publications on organizational change and guideline implementation. To focus the search on diabetes, we added disease-specific MeSH and text word terms, ran a preliminary search, and reviewed 200 titles and abstracts (determined by saturation, until no further new terms were identified) for additional text word terms. The search terms are available in Additional File 1. We did not search the management literature, nor did we seek out unpublished data.
Inclusion and exclusion criteria
Inclusion criteria were randomized, quasi-randomized, or controlled clinical trials published in English and conducted in economically developed countries as identified by the International Monetary Fund or the Organization for Economic Cooperation and Development . We excluded non-English articles because non-English studies comprise only 1% of the EPOC registry. We excluded studies reporting only the following nonclinical outcomes: patient or provider knowledge; self-efficacy; satisfaction; or other attitudes and beliefs. We also excluded studies of: Type 1 or gestational diabetes; patients < 18 years old or patients younger and older than 18 but not reporting results separately for adults; work site health interventions; exercise rehabilitation or smoking cessation; and disease prevention or screening only.
Four investigators independently reviewed overlapping groups of differing halves of the citations' titles and abstracts generated by the full literature search to assess agreement regarding potentially eligible publications. Raw agreement was 94%. If eligibility was uncertain after review of the title and abstract, the full article was reviewed. Eligible studies were independently reviewed and jointly abstracted in detail by teams of two investigators. Disagreements were resolved by consensus of the group of investigators.
Assessment of leveraging of characteristics of CAS
Eligible publications were independently evaluated by two raters with content expertise in complexity science to assess the extent to which the intervention utilized any of the following characteristics of a CAS: individuals' capacity/ability to learn; the interconnections between individuals; the ability of participants to self-organize; and the tendency of participants to co-evolve. These are representative of critical elements of CAS [18, 19]. The definition of each characteristic used by reviewers is shown in Table 1. Each study was given a point for each of the characteristics present in the study design, for a possible lowest score of zero and highest score of four. Table 2 gives specific examples of interventions that met criteria for each score, with the characteristics they were felt to reflect. The raters were blinded to the outcomes of the studies. The kappa for these scores between reviewers was 0.78, with conflicts subsequently resolved by discussion.
Assessment of reported outcomes
Because of the heterogeneity across study outcomes, we did not use effect size as the outcome variable. The most commonly used outcome was change in hemoglobin A1c, but this was used in only 14 studies of variable duration, four of which contained unit of allocation error, or mismatch between the unit of randomization and unit of analysis. Additionally, some studies compared change in hemoglobin A1c with baseline values, rather than with controls. To overcome this, a rating scale was used to assess the efficacy of the intervention. The outcomes of each study were assessed by two independent raters on a scale of 0 (no effect), 0.5 (mixed results), and 1 (intervention effective) based on the type (process versus outcome), number, and statistical significance of outcomes reported. The specific criteria used for each rating, along with specific examples of the reported outcomes for each rating, are shown in Table 3. Raters were blinded to study interventions, and one was different from the intervention raters. The kappa for these scores was 0.79, with conflicts resolved by discussion.
Because of the small number of studies identified, we used Fisher's exact test to test the significance of the relationship between total number of characteristics of complex adaptive systems being leveraged by an organizational intervention and the strength of outcomes reported, as well as between each individual characteristic and the strength of outcomes. Because a mismatch between the unit of allocation and analysis may bias a study toward positive results, we divided studies into two groups based on whether a unit of analysis error was present. A second analysis using Fisher's exact test was performed including only those studies that did not contain a unit of analysis error. Finally, a third analysis using logistic regression was performed to weight studies based on both sample size and duration of intervention. All statistical analyses were performed using Stata 8.0 (College Station, Texas).
The search identified 5,590 publications; 157 were potentially eligible by review of title and abstract. After full review of these published studies, 32 met our eligibility criteria [25–56]. Figure 1 details the numbers of articles eligible and ineligible at each point. The interventions, outcomes, duration of intervention, presence of unit of allocation error, and extent to which interventions used characteristics of complex adaptive systems are summarized in Additional File 2. Half of studies reported significant improvement in most or all outcomes. Ten studies were felt to utilize self-organization; co-evolution was a component in twenty-four, learning in twenty-seven, and interconnections in thirty. Interventions that involved learning typically took the form of distribution of educational materials; interconnections were changed frequently through the addition of case managers or care coordinators. Relatively few (eight) allowed participants to self-organize.
The distribution of characteristics of complex adaptive systems utilized by a study intervention and the intervention efficacy for all studies is shown in Table 4. Only 50% of studies demonstrated effective results as reflected by a score of 1. All studies with an effectiveness score of 1 reported interventions whose CAS characteristic scores were at least 3, while the studies with lower effectiveness had lower CAS characteristic scores. The association between the number of CAS characteristics and effectiveness was statistically significant (p = 0.002). Analysis using logistic regression adjusting for sample size and duration of intervention remained significant. Nine studies had level of analysis error, most commonly because the unit of randomization was a clinic or physician, while the unit of analysis was the patient. The association between CAS characteristic scores and outcome effectiveness was also statistically significant when these nine studies were excluded (p = 0.004).
Of the four CAS characteristics assessed for each intervention, two were individually significantly associated with effectiveness. Interventions that affected interconnections in the organization or allowed participants to co-evolve were significantly associated with intervention effectiveness (p = 0.03 and 0.001, respectively). When studies with unit of analysis error were excluded, these associations remained significant (p = 0.05 and 0.003). The associations between interventions affecting participants' ability to learn or self-organize were not statistically significant (p = 0.06 and 0.58).
Consistent with prior literature, this systematic review found that many studies of organizational interventions do not improve process or outcome measures for patients with the chronic illness diabetes [3–5]. Only 50% of randomized or controlled clinical trials meeting criteria for this systematic review demonstrated significant improvement in most or all endpoints. In support of our hypothesis that implementation strategies consistent with CAS theory will be more likely to be effective, we found a significant relationship between the number of CAS characteristics utilized in an intervention and the intervention's effectiveness in improving process or outcome measures in patients with Type II diabetes. This was true in studies conducted across a diversity of clinical settings and reported outcomes. This finding potentially widens the scope of the application of CAS theory beyond the current literature that focuses on describing clinical settings as CAS [14, 15], to build upon the idea that we can use CAS to both design and implement interventions [16, 20] that are more likely to lead to improved performance.
Specifically, the finding that interventions incorporating features of CAS were more effective suggests that a dynamic approach to the design of organizational interventions to improve patient outcomes may be helpful. Rather than designing one-size-fits-all interventions that require adherence to a rigid, pre-set course of action, allowing participants to have input and control that reflect their local environment, as well as allowing them to adapt or deviate from a set plan as results evolve, may lead to more effective change. In short, we suggest that thinking about the intervention as a participatory, adaptive process rather than a set blueprint will lead to more effective interventions. These approaches currently exist; one example includes the Institute for Healthcare Improvement's Framework for Spread . However, our finding that less than one-third of studies identified in our search allowed for self-organization suggests that their use is far from universal.
Two individual characteristics, co-evolution (ability of participants to modify practices based on forces internal and external to the clinical setting) and interconnections (changing the pattern of communication between participants) had the strongest relationship with intervention effect. It is difficult to interpret the lack of a relationship between other individual characteristics and strength of outcomes, as the number of studies included in this analysis was small, particularly after those with level of analysis error were excluded. However, the significant association between the overall number of characteristics of CAS and the intervention effectiveness, in the absence of a clear association for all individual characteristics, could imply that combinations of characteristics are more effective,i.e., the interventions should consider the holistic nature of practices. The number of studies was too small to allow for this analysis.
The association between interventions that influenced the interconnections between participants and intervention effectiveness may suggest that interventions that focus on the quality and pattern of relationships between participants in a clinical setting may be superior to those that focus on trying to change the behavior of a single participant. What sets this apart from other theories of organizational change is the scope of this approach to allow consideration of multiple aspects of the clinical setting, and the nonlinearity of the relationships between them. This inherent nonlinearity implies that inputs and outputs are unlikely to be proportional, particularly across clinical settings and over time, and suggests the need for the following specific approaches: involvement of more than one type of participant in both intervention design and implementation, use of more than one method of connecting agents in an organization, and continual reassessment of the effect of an intervention coupled with a willingness to make changes based on this reassessment. In fact, this may explain why multi-faceted organizational interventions may be more effective than those with a focus on a single strategy .
Several other limitations besides the small sample size deserve mention. All of the studies included related only to the chronic care of diabetic patients. Confirmation of these findings for patients with other chronic diseases is necessary. In addition, while we were able to address the potential bias inherent in studies with unit of allocation error, publication bias (e.g., positive studies being more likely to be published), or the possibility that studies with negative outcomes did not provide sufficient detail regarding interventions, could potentially impact these results. However, regarding the latter potential bias, the inter-rater consistency on characteristic ratings indicates that reported methods were sufficient to reliably assess the interventions. We did not identify studies in the management literature or seek out unpublished information or "grey literature." Our intention was to focus on studies in the peer-reviewed medial literature as the most simple, direct, and universally accepted approach to studying whether an association between interventions with features that reflect CAS and outcome effectiveness exists. If this association had not been found, our next step might have been to identify these additional sources.
The methodology of assigning scores retrospectively to both characteristics and outcomes is also potentially a limitation. Categorization based on a relatively small amount of data can be difficult, but we believe that the methods sections of the included studies contained enough information to give the reader at least a basic overview of all intervention components and thus a reliable assessment of utilization of CAS characteristics. It may also seem counterintuitive to apply a lens of nonlinearity to interventions conducted in the context of traditional randomized, quasi-randomized, or controlled clinical trials, and in fact it is near impossible to assess nonlinearity itself in the context of the format of a published interventional study. However, we do believe that enough information was present to make a determination of whether key characteristics of CAS were present in the intervention, and our inter-rater reliability supports this. We also believe that the characteristics of learning, interconnections, self-organization and co-evolution are the key concepts that are representative of CAS and its implications [18, 19]; therefore, we do not believe it likely that other CAS experts would identify important elements whose basic meaning is not encompassed in these characteristics. It is possible that because all investigators come from a single institution or "school" of complexity, that the interpretation of a different group of investigators could be different, but we believe that because we focused on the key characteristics of CAS whose definitions are relatively well-established, this is less likely to have occurred. Finally, CAS characteristics may be inherent parts of several care delivery models; this is particularly true of learning and interconnections between individuals. However, the underlying CAS assumption of nonlinearity differentiates this perspective in a fundamental way.
While these results may be regarded as preliminary, they point to the use of complexity science as a framework for thinking about clinical settings that may allow us to better understand the inconsistencies in the health care organizational literature and to better design interventions that will lead to the greatest improvement in outcomes for our patients.
Improved outcomes in Type II diabetes were significantly associated with organizational interventions that had characteristics of complex adaptive systems in their design. Those interventions incorporating a greater number of characteristics demonstrated the greatest improvement in diabetes-related outcomes. We observed a greater effect for interventions that promoted interconnections between, and co-evolution of, individuals.
These data may allow us to expand the framework of CAS from conceptualizing and studying clinical systems to encompass designing and implementing interventions that lead to improved patient outcomes. Specifically, interventions and implementation strategies that target multiple CAS characteristics may be most effective in improving health outcomes. Further research should address how best to translate the theoretical constructs of complex adaptive systems into interventions that improve the outcomes of chronically ill patients.
Wu S, A G: Projection of Chronic Illness Prevalence and Cost Inflation. Santa Monica, CA: RAND Health. 2000
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-45. 10.1056/NEJMsa022615.
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): iii-iv. 1–72
Solberg LI, Kottke TE, Brekke ML, Magnan S, Davidson G, Calomeni CA, Conn SA: Failure of a continuous quality improvement intervention to increase the delivery of preventive services. A randomized trial. EffClin Pract. 2000, 3 (3): 105-15.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don't physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999, 282 (15): 1458-65. 10.1001/jama.282.15.1458.
Warsi A, Wang PS, LaValley MP, Avorn J, Solomon DH: Self-management education programs in chronic disease: a systematic review and methodological critique of the literature. Arch Intern Med. 2004, 164 (15): 1641-9. 10.1001/archinte.164.15.1641.
Von Korff M, Gruman J, Schaefer J, Curry SJ, Wagner EH: Collaborative Management of Chronic Illness. Ann Intern Med. 1997, 127 (12): 1097-1102.
Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness. Jama. 2002, 288 (14): 1775-9. 10.1001/jama.288.14.1775.
Hunter DJ, Fairfield G: Disease management. Bmj. 1997, 315 (7099): 50-3.
Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness: the chronic care model, Part 2. Jama. 2002, 288 (15): 1909-14. 10.1001/jama.288.15.1909.
Bodenheimer T: Disease management–promises and pitfalls. N Engl J Med. 1999, 340 (15): 1202-5. 10.1056/NEJM199904153401511.
Weingarten SR, Henning JM, Badamgarov E, Knight K, Hasselbad V, Gano A, Ofman JJ: Interventions used in disease management programmes for patients with chronic illness – which ones work? Meta-analysis of published reports. BMJ. 2002, 325 (7370): 925-10.1136/bmj.325.7370.925.
Katon W, Russo J, Von Korff M, Lin E, Simon G, Bush T, Ludman E, Walker E: Long-term effects of a collaborative care intervention in persistently depressed primary care patients. J Gen Intern Med. 2002, 17 (10): 741-8. 10.1046/j.1525-1497.2002.11051.x.
Plsek PE, Greenhalgh T: Complexity science: The challenge of complexity in health care. Bmj. 2001, 323 (7313): 625-8. 10.1136/bmj.323.7313.625.
Miller WL, McDaniel RR, Crabtree BF, Stange KC: Practice jazz: understanding variation in family practices using complexity science. J Fam Pract. 2001, 50 (10): 872-8.
Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC: How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005, 31 (8): 438-46.
Plsek P: Redesigning Health Care with Insights from the Science of Complex Adaptive Systems. Crossing the Quality Chasm: A New Heath System for the 21st Century. 2000, National Academy of Sciences, 309-322.
Cilliers P: Complexity and Postmodernism: Understanding Complex Systems. 1998, New York, NY: Routledge
Maguire S, McKelvey B, Mirabeau L, Oztas N: Complexity Science and Organization Studies. The SAGE Handbook of Organization Studies. 2006, SAGE Publications, 165-214.
Litaker D, Tomolo A, Liberatore V, Stange K, Aron D: Using Complexity Theory to Build Interventions that Improve Health Care Delivery in Primary Care. J Gen Intern Med. 2006, 21: S30-4.
Rubenstein L, Shekelle PG, Stone EG, Maglione MA, Hirt M, Mojica W, Srikanthan P, Tomizawa T, Morton SC, Chao B, Roth EA, Breuder T: Interventions that Increase the Utilization of Medicare-Funded Preventive Services for Persons Age 65 and Older. Evidence Report/Technology Assessment. Publication no HCFA-02151. 1999, Baltimore, MD: US Dept. of Health and Human Services. Health Care Financing Administration
Stone EG, Morton SC, Hulscher ME, Maglione MA, Roth EA, Grimshaw JM, Mittman BS, Rubenstein LV, Rubenstein LZ, Shekelle PG: Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med. 2002, 136: 641-51.
Shojania KG, Ranji SR, Shaw LK, Charo LN, Lai JC, Rushakoff RJ, McDonald KM, Owens DK: Diabetes Mellitus Care. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Technical Review 9 (Contract No. 290-02-0017 to the Stanford University-UCSF Evidence-based Practice Center). AHRQ Publication No. 04-0051-2. Edited by: Shojania KG, McDonald KM, Wachter RM, Owens DK. 2004, Rockville, MD: Agency for Healthcare Research and Quality, 2:
accessed on 11/20/2003, [http://www.nationmaster.com/encyclopedia/Developed-countries]
Denver EA, Barnard M, Woolfson RG, Earle KA: Management of uncontrolled hypertension in a nurse-led clinic compared with conventional care for patients with type 2 diabetes. Diabetes Care. 2003, 26 (8): 2256-60. 10.2337/diacare.26.8.2256.
Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, Braspenning JC, Prins A, van der Wouden JC, Grol RP: Multifaceted support to improve clinical decision making in diabetes care: a randomized controlled trial in general practice. Diabet Med. 2002, 19 (10): 836-42. 10.1046/j.1464-5491.2002.00810.x.
Gary TL, Bone LR, Hill MN, Levine DM, McGuire M, Saudek C, Brancati FL: Randomized controlled trial of the effects of nurse case manager and community health worker interventions on risk factors for diabetes-related complications in urban African Americans. Prev Med. 2003, 37 (1): 23-32. 10.1016/S0091-7435(03)00040-9.
Glasgow RE, Toobert DJ, Hampson SE, Strycker LA: Implementation, generalization and long-term results of the "choosing well" diabetes self-management intervention. Patient Educ Couns. 2002, 48 (2): 115-22. 10.1016/S0738-3991(02)00025-3.
Hirsch IB, Goldberg HI, Ellsworth A, Evans TC, Herter CD, Ramsey SD, Mullen M: A multifaceted intervention in support of diabetes treatment guidelines: a cont trial. Diabetes Res Clin Pract. 2002, 58 (1): 27-36. 10.1016/S0168-8227(02)00100-6.
Kim HS, Oh JA: Adherence to diabetes control recommendations: impact of nurse telephone calls. J Adv Nurs. 2003, 44 (3): 256-61. 10.1046/j.1365-2648.2003.02800.x.
Miller CD, Barnes CS, Phillips LS, Ziemer DC, Gallina DL, Cook CB, Maryam SD, El-Kebbi IM: Rapid A1c availability improves clinical decision-making in an urban primary care clinic. Diabetes Care. 2003, 26 (4): 1158-63. 10.2337/diacare.26.4.1158.
Oh JA, Kim HS, Yoon KH, Choi ES: A telephone-delivered intervention to improve glycemic control in type 2 diabetic patients. Yonsei Med J. 2003, 44 (1): 1-8.
Sanders KM, Satyvavolu A: Improving blood pressure control in diabetes: limitations of a clinical reminder in influencing physician behavior. J Contin Educ Health Prof. 2002, 22 (1): 23-32. 10.1002/chp.1340220104.
Stroebel RJ, Scheitel SM, Fitz JS, Herman RA, Naessens JM, Scott CG, Zill DA, Muller L: A randomized trial of three diabetes registry implementation strategies in a community internal medicine practice. Jt Comm J Qual Improv. 2002, 28 (8): 441-50.
Groeneveld Y, Petri H, Hermans J, Springer M: An assessment of structured care assistance in the management of patients with type 2 diabetes in general practice. Scand J Prim Health Care. 2001, 19 (1): 25-30.
McDermott RA, Schmidt BA, Sinha A, Mills P: Improving diabetes care in the primary healthcare setting: a randomised cluster trial in remote Indigenous communities. Med J Aust. 2001, 174 (10): 497-502.
Piette JD, Weinberger M, Kraemer FB, McPhee SJ: Impact of automated calls with nurse follow-up on diabetes treatment outcomes in a Department of Veterans Affairs Health Care System: a randomized controlled trial. Diabetes Care. 2001, 24 (2): 202-8. 10.2337/diacare.24.2.202.
Piette JD, Weinberger M, McPhee SJ, Mah CA, Kraemer FB, Crapo LM: Do automated calls with nurse follow-up improve self-care and glycemic control among vulnerable patients with diabetes?. Am J Med. 2000, 108 (1): 20-7. 10.1016/S0002-9343(99)00298-3.
Pritchard DA, Hyndman J, Taba F: Nutritional counselling in general practice: a cost effective analysis. J Epidemiol Community Health. 1999, 53 (5): 311-6.
Wagner EH, Grothaus LC, Sandhu N, Galvin MS, McGregor M, Artz K, Coleman EA: Chronic care clinics for diabetes in primary care: a system-wide randomized trial. Diabetes Care. 2001, 24 (4): 695-700. 10.2337/diacare.24.4.695.
Walker EA, Engel SS, Zybert PA: Dissemination of diabetes care guidelines: lessons learned from community health centers. Diabetes Educ. 2001, 27 (1): 101-10.
Cagliero E, Levina EV, Nathan DM: Immediate feedback of HbA1c levels improves glycemic control in type 1 and insulin-treated type 2 diabetic patients. Diabetes Care. 1999, 22 (11): 1785-9. 10.2337/diacare.22.11.1785.
Vaughan NJ, Potts A: Implementation and evaluation of a decision support system for type II diabetes. Comput Methods Programs Biomed. 1996, 50 (3): 247-51. 10.1016/0169-2607(96)01754-3.
Coffey E, Moscovice I, Finch M, Christianson JB, Lurie N: Capitated Medicaid and the process of care of elderly hypertensives and diabetics: results from a randomized trial. Am J Med. 1995, 98 (6): 531-6. 10.1016/S0002-9343(99)80011-4.
Litzelman DK, Slemenda CW, Langefeld CD, Hays LM, Welch MA, Bild DE, Ford ES: Reduction of lower extremity clinical abnormalities in patients with non-insulin-dependent diabetes mellitus. A randomized, controlled trial. Ann Intern Med. 1993, 119 (1): 36-41.
Newcomb PA, Klein R, Massoth KM: Education to increase ophthalmologic care in older onset diabetes patients: indications from the Wisconsin Epidemiologic Study of Diabetic Retinopathy. J Diabetes Complications. 1992, 6 (4): 211-7. 10.1016/1056-8727(92)90054-O.
Clancy DE, Cope DW, Magruder KM, Huang P, Wolfman TE: Evaluating concordance to American Diabetes Association standards of care for type 2 diabetes through group visits in an uninsured or inadequately insured patient population. Diabetes Care. 2003, 26 (7): 2032-6. 10.2337/diacare.26.7.2032.
McClellan WM, Millman L, Presley R, Couzins J, Flanders WD: Improved diabetes care by primary care physicians: results of a group-randomized evaluation of the Medicare Health Care Quality Improvement Program (HCQIP). J Clin Epidemiol. 2003, 56 (12): 1210-7. 10.1016/S0895-4356(03)00198-7.
Taylor CT, Byrd DC, Krueger K: Improving primary care in rural Alabama with a pharmacy initiative. Am J Health Syst Pharm. 2003, 60 (11): 1123-9.
Tsuyuki RT, Johnson JA, Teo KK, Simpson SH, Ackman ML, Biggs RS, Cave A, Chang WC, Dzavik V, Farris KB, Galvin D, Semchuk W, Taylor JG: A randomized trial of the effect of community pharmacist intervention on cholesterol risk management: the Study of Cardiovascular Risk Intervention by Pharmacists (SCRIP). Arch Intern Med. 2002, 162 (10): 1149-55. 10.1001/archinte.162.10.1149.
Basch CE, Walker EA, Howard CJ, Shamoon H, Zybert P: The effect of health education on the rate of ophthalmic examinations among African Americans with diabetes mellitus. Am J Public Health. 1999, 89 (12): 1878-82.
McCabe CJ, Stevenson RC, Dolan AM: Evaluation of a diabetic foot screening and protection programme. Diabet Med. 1998, 15 (1): 80-4. 10.1002/(SICI)1096-9136(199801)15:1<80::AID-DIA517>3.0.CO;2-K.
Lobach DF, Hammond WE: Computerized decision support based on a clinical practice guideline improves compliance with care standards. Am J Med. 1997, 102 (1): 89-98. 10.1016/S0002-9343(96)00382-8.
Shultz EK, Bauman A, Hayward M, Holzman R: Improved care of patients with diabetes through telecommunications. Ann N Y Acad Sci. 1992, 670: 141-10.1111/j.1749-6632.1992.tb26084.x.
Smith S, Bury G, O'Leary M, Shannon W, Tynan A, Staines A, Thompson C: The North Dublin randomized controlled trial of structured diabetes shared care. Fam Pract. 2004, 21 (1): 39-45. 10.1093/fampra/cmh109.
Rothman RL, Malone R, Bryant B, Shintani AK, Crigler B, Dewalt DA, Dittus RS, Weinberger M, Pignone MP: A randomized trial of a primary care-based disease management program to improve cardiovascular risk factors and glycated hemoglobin levels in patients with diabetes. Am J Med. 2005, 118 (3): 276-84. 10.1016/j.amjmed.2004.09.017.
Massoud MR, Nielsen GA, Nolan K, Schall MW, Sevin C: A Framework for Spread: From Local Improvements to System-Wide Change. IHI Innovation Series white paper. 2006, Cambridge, MA: Institute for Healthcare Improvement
Dijkstra R, Wensing M, Thomas R, Akkermans R, Braspenning J, Grimshaw J, Grol R: The relationship between organisational characteristics and the effects of clinical guidelines on medical performance in hospitals, a meta-analysis. BMC Health Services Research. 2006, 6 (53): 1-10.
The research reported here was supported by the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service (TRX # 01–091 & REA 05–129). Investigator salary support is provided through this funding, and through the South Texas Veterans Health Care System.
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs.
The author(s) declare that they have no competing interests.
LKL conceived this analysis using the database conceived by VL, PN, and JP, rated studies, performed preliminary statistical analysis, and drafted the manuscript. JP participated in the design of the study and helped to draft the manuscript. VL conceived the systematic review and database, rated studies, and helped to draft the manuscript. MP rated studies and helped to draft the manuscript. PN conceived the systematic review and database and helped to draft the manuscript. JC performed statistical analysis and helped to draft the manuscript. RMcD participated in the design of the study, provided theoretical expertise, and helped to draft the manuscript.
All authors have read and approved the final manuscript.
Electronic supplementary material
Additional file 1: Search strategy for organizational interventions to improve outcomes of patients with Type II diabetes. Medline search strategy to identify studies of organizational interventions to improve outcomes for patients with Type II diabetes, as described in Leykum, et al, Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes. Search completed December 2005. (DOC 317 KB)
Additional file 2: Summary of included studies. Summary of eligible studies of organizational interventions on outcomes of patients with type 2 diabetes, as described in Leykum, et al, Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes. (DOC 117 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.