Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes
© Leykum et al; licensee BioMed Central Ltd. 2007
Received: 08 February 2007
Accepted: 28 August 2007
Published: 28 August 2007
Despite the development of several models of care delivery for patients with chronic illness, consistent improvements in outcomes have not been achieved. These inconsistent results may be less related to the content of the models themselves, but to their underlying conceptualization of clinical settings as linear, predictable systems. The science of complex adaptive systems (CAS), suggests that clinical settings are non-linear, and increasingly has been used as a framework for describing and understanding clinical systems. The purpose of this study is to broaden the conceptualization by examining the relationship between interventions that leverage CAS characteristics in intervention design and implementation, and effectiveness of reported outcomes for patients with Type II diabetes.
We conducted a systematic review of the literature on organizational interventions to improve care of Type II diabetes. For each study we recorded measured process and clinical outcomes of diabetic patients. Two independent reviewers gave each study a score that reflected whether organizational interventions reflected one or more characteristics of a complex adaptive system. The effectiveness of the intervention was assessed by standardizing the scoring of the results of each study as 0 (no effect), 0.5 (mixed effect), or 1.0 (effective).
Out of 157 potentially eligible studies, 32 met our eligibility criteria. Most studies were felt to utilize at least one CAS characteristic in their intervention designs, and ninety-one percent were scored as either "mixed effect" or "effective." The number of CAS characteristics present in each intervention was associated with effectiveness (p = 0.002). Two individual CAS characteristics were associated with effectiveness: interconnections between participants and co-evolution.
The significant association between CAS characteristics and effectiveness of reported outcomes for patients with Type II diabetes suggests that complexity science may provide an effective framework for designing and implementing interventions that lead to improved patient outcomes.
Although the cost of managing patients with chronic disease is high, and is predicted to rise to 80% of US health care dollars by 2020 , identification of effective ways to improve care of patients with chronic disease has been difficult. While the evidence base regarding optimal medical management of these patients has grown, our ability to implement evidence into routine clinical practice across diverse clinical settings has been limited. A recent study of chronically ill patients revealed poor provider adherence to guideline recommendations . Attempts to improve outcomes through use of practice guidelines, quality improvement, or system improvement have not led to consistently positive effects on process of care measures or outcomes, and have been disappointing [3–5]. Organizational barriers, such as inadequate staff or support structure, are typically cited as a hindrance to guideline implementation .
To facilitate implementation, several models for delivery of care for patients with chronic disease have emerged. These include the "self-management" and "collaborative management" models, the "chronic care model," and the "disease management" approach [6–9]. Recent systematic reviews of organizational intervention studies based on the self-management, chronic care, and disease management models reveal small to moderate effects on process or outcome measures [6, 10–13]. These results suggest that it may not be the content of the models, but rather, it may be that the specific way in which they are applied in organizations is critical.
One possible reason for the modest effects of organizational intervention outcomes is suggested by the recent application of complex adaptive system (CAS) theory to the organization of health care delivery [14–17]. A CAS is characterized by individuals who can learn, interconnect, self-organize, and co-evolve with their environment in non-linear dynamic ways [18, 19]. These factors lead to patterns of relationships and interconnections in the system that influence performance of the system. Like musicians in an improvisational jazz band, individuals in a CAS learn from and react to each other and their environment, leading to constant shifts in the pattern of relationships or the interpretation of the music. The natural tendency of individuals to learn, form patterns of relationships, organize and evolve suggests that interventions that suppress these activities will lead to poorer outcomes than those that facilitate them.
CAS theory has been used to describe clinical settings, such as primary care clinics . However, it also has implications for how we approach changing clinical systems [16, 20], but the implementation literature is less developed than the descriptive literature. Using CAS theory as a framework to assist us in designing and implementing organizational interventions could potentially make these interventions more likely to achieve their aims.
Complexity science suggests that inconsistent outcomes may result from an implicit assumption of linear, mechanistic relationships between cause and effect in implementing organizational interventions. This linear viewpoint implies that a specific intervention should lead to consistent, reproducible results across clinical settings. In contrast, nonlinearity, self-organization, and co-evolution suggest that each clinical setting is unique, and that outcomes of interventions may be greatly affected by small situational differences. [18, 19]. For example, clinical reminders may be very effective in prompting providers in one setting to perform recommended care, but may not be as effective in another because of very small differences in the settings (i.e., differences in the workflow of test ordering, ease of access of recommended care, patient population served, or provider beliefs).
The goal of this study is to build on the current literature related to using CAS to observe and understand clinical settings, to begin to examine the extent to which CAS theory is useful as a tool for designing and/or implementing organizational interventions. We hypothesize that interventions that leverage the characteristics of complex adaptive systems, intentionally or not, and regardless of the particular model of chronic care delivery on which the intervention was based, will consistently lead to improved outcomes over those that do not. To test this hypothesis, we conducted a systematic review of organizational interventions for patients with Type II diabetes and examine these interventions through the lens of complexity science.
We defined organizational interventions as those that explicitly attempt to affect or change organizational structures or processes to implement evidence-based practice. We searched Medline from 1989 through 29 December 2005, after developing a search strategy based on four components: 1) the strategy developed by the Effective Practice and Organization of Care (EPOC) Group of the Cochrane Collaboration and updated for a recent systematic review of Medicare-funded preventive services [21, 22]; (2) additional search terms for types of organizational interventions not included in the EPOC search strategy, such as total quality improvement, PDSA (Plan-Do-Study-Act), and practice redesign; (3) additional search terms used by a recent systematic review of preventive and quality improvement strategies ; and (4) bibliographies and Medline indexing terms of relevant publications on organizational change and guideline implementation. To focus the search on diabetes, we added disease-specific MeSH and text word terms, ran a preliminary search, and reviewed 200 titles and abstracts (determined by saturation, until no further new terms were identified) for additional text word terms. The search terms are available in Additional File 1. We did not search the management literature, nor did we seek out unpublished data.
Inclusion and exclusion criteria
Inclusion criteria were randomized, quasi-randomized, or controlled clinical trials published in English and conducted in economically developed countries as identified by the International Monetary Fund or the Organization for Economic Cooperation and Development . We excluded non-English articles because non-English studies comprise only 1% of the EPOC registry. We excluded studies reporting only the following nonclinical outcomes: patient or provider knowledge; self-efficacy; satisfaction; or other attitudes and beliefs. We also excluded studies of: Type 1 or gestational diabetes; patients < 18 years old or patients younger and older than 18 but not reporting results separately for adults; work site health interventions; exercise rehabilitation or smoking cessation; and disease prevention or screening only.
Four investigators independently reviewed overlapping groups of differing halves of the citations' titles and abstracts generated by the full literature search to assess agreement regarding potentially eligible publications. Raw agreement was 94%. If eligibility was uncertain after review of the title and abstract, the full article was reviewed. Eligible studies were independently reviewed and jointly abstracted in detail by teams of two investigators. Disagreements were resolved by consensus of the group of investigators.
Assessment of leveraging of characteristics of CAS
Characteristics of complex adaptive systems abstracted
Agents who learn
People can and will process information, as well as react to changes in information
Change in pattern of interactions, including non-verbal communication, among agents Introducing new agents into the system.
Order is created in a system without explicit hierarchical direction
The system and the environment influence each other's development
Examples of interventions utilizing characteristics of complex adaptive systems
1-page reminder of BP goals put on the front of the charts of all diabetics
Educational materials (articles, videotapes) sent to physicians at defined intervals
Decision – support system generated treatment recommendations based on current treatment and level of control. Patients seen monthly until controlled.
Pharmaco-evaluation and med review conducted at set intervals over 1 year. Emphasis on education, but tailored to progress of individual patients
Learning Interconnections Co-evolution
Usual visits replaced with group visits led by a physician and diabetes nurse educator, who were allowed to tailor the meeting frequency and content to the needs of the group. The goal of these visits was to improve compliance through education.
Learning Interconnections Self-Organization Co-evolution
Assessment of reported outcomes
Criteria used to classify outcomes of studies with organizational interventions
No differences between control and intervention groups, or between intervention and baseline, on process or outcome measures
No difference in rate of medication changes between groups
Trends without significance Mixed outcomes (significant improvement in minority of measures) Significant improvement compared with baseline, but not with control
Significant improvement in hgb A1c at 6 and 12 months when compared with baseline, but not when compared with control group
- all outcomes if ≤ 3 endpoints
- majority of outcomes if > 3 endpoints
Significant improvement in number of patients at A1c goal, significant decrease in hospitalizations and emergency department visits
Because of the small number of studies identified, we used Fisher's exact test to test the significance of the relationship between total number of characteristics of complex adaptive systems being leveraged by an organizational intervention and the strength of outcomes reported, as well as between each individual characteristic and the strength of outcomes. Because a mismatch between the unit of allocation and analysis may bias a study toward positive results, we divided studies into two groups based on whether a unit of analysis error was present. A second analysis using Fisher's exact test was performed including only those studies that did not contain a unit of analysis error. Finally, a third analysis using logistic regression was performed to weight studies based on both sample size and duration of intervention. All statistical analyses were performed using Stata 8.0 (College Station, Texas).
Distribution of CAS and effectiveness of interventions
Total CAS Score
Rating of Intervention Effectiveness
Total No. Studies with each CAS Score
Total No. Studies at each Level of Effectiveness
Of the four CAS characteristics assessed for each intervention, two were individually significantly associated with effectiveness. Interventions that affected interconnections in the organization or allowed participants to co-evolve were significantly associated with intervention effectiveness (p = 0.03 and 0.001, respectively). When studies with unit of analysis error were excluded, these associations remained significant (p = 0.05 and 0.003). The associations between interventions affecting participants' ability to learn or self-organize were not statistically significant (p = 0.06 and 0.58).
Consistent with prior literature, this systematic review found that many studies of organizational interventions do not improve process or outcome measures for patients with the chronic illness diabetes [3–5]. Only 50% of randomized or controlled clinical trials meeting criteria for this systematic review demonstrated significant improvement in most or all endpoints. In support of our hypothesis that implementation strategies consistent with CAS theory will be more likely to be effective, we found a significant relationship between the number of CAS characteristics utilized in an intervention and the intervention's effectiveness in improving process or outcome measures in patients with Type II diabetes. This was true in studies conducted across a diversity of clinical settings and reported outcomes. This finding potentially widens the scope of the application of CAS theory beyond the current literature that focuses on describing clinical settings as CAS [14, 15], to build upon the idea that we can use CAS to both design and implement interventions [16, 20] that are more likely to lead to improved performance.
Specifically, the finding that interventions incorporating features of CAS were more effective suggests that a dynamic approach to the design of organizational interventions to improve patient outcomes may be helpful. Rather than designing one-size-fits-all interventions that require adherence to a rigid, pre-set course of action, allowing participants to have input and control that reflect their local environment, as well as allowing them to adapt or deviate from a set plan as results evolve, may lead to more effective change. In short, we suggest that thinking about the intervention as a participatory, adaptive process rather than a set blueprint will lead to more effective interventions. These approaches currently exist; one example includes the Institute for Healthcare Improvement's Framework for Spread . However, our finding that less than one-third of studies identified in our search allowed for self-organization suggests that their use is far from universal.
Two individual characteristics, co-evolution (ability of participants to modify practices based on forces internal and external to the clinical setting) and interconnections (changing the pattern of communication between participants) had the strongest relationship with intervention effect. It is difficult to interpret the lack of a relationship between other individual characteristics and strength of outcomes, as the number of studies included in this analysis was small, particularly after those with level of analysis error were excluded. However, the significant association between the overall number of characteristics of CAS and the intervention effectiveness, in the absence of a clear association for all individual characteristics, could imply that combinations of characteristics are more effective,i.e., the interventions should consider the holistic nature of practices. The number of studies was too small to allow for this analysis.
The association between interventions that influenced the interconnections between participants and intervention effectiveness may suggest that interventions that focus on the quality and pattern of relationships between participants in a clinical setting may be superior to those that focus on trying to change the behavior of a single participant. What sets this apart from other theories of organizational change is the scope of this approach to allow consideration of multiple aspects of the clinical setting, and the nonlinearity of the relationships between them. This inherent nonlinearity implies that inputs and outputs are unlikely to be proportional, particularly across clinical settings and over time, and suggests the need for the following specific approaches: involvement of more than one type of participant in both intervention design and implementation, use of more than one method of connecting agents in an organization, and continual reassessment of the effect of an intervention coupled with a willingness to make changes based on this reassessment. In fact, this may explain why multi-faceted organizational interventions may be more effective than those with a focus on a single strategy .
Several other limitations besides the small sample size deserve mention. All of the studies included related only to the chronic care of diabetic patients. Confirmation of these findings for patients with other chronic diseases is necessary. In addition, while we were able to address the potential bias inherent in studies with unit of allocation error, publication bias (e.g., positive studies being more likely to be published), or the possibility that studies with negative outcomes did not provide sufficient detail regarding interventions, could potentially impact these results. However, regarding the latter potential bias, the inter-rater consistency on characteristic ratings indicates that reported methods were sufficient to reliably assess the interventions. We did not identify studies in the management literature or seek out unpublished information or "grey literature." Our intention was to focus on studies in the peer-reviewed medial literature as the most simple, direct, and universally accepted approach to studying whether an association between interventions with features that reflect CAS and outcome effectiveness exists. If this association had not been found, our next step might have been to identify these additional sources.
The methodology of assigning scores retrospectively to both characteristics and outcomes is also potentially a limitation. Categorization based on a relatively small amount of data can be difficult, but we believe that the methods sections of the included studies contained enough information to give the reader at least a basic overview of all intervention components and thus a reliable assessment of utilization of CAS characteristics. It may also seem counterintuitive to apply a lens of nonlinearity to interventions conducted in the context of traditional randomized, quasi-randomized, or controlled clinical trials, and in fact it is near impossible to assess nonlinearity itself in the context of the format of a published interventional study. However, we do believe that enough information was present to make a determination of whether key characteristics of CAS were present in the intervention, and our inter-rater reliability supports this. We also believe that the characteristics of learning, interconnections, self-organization and co-evolution are the key concepts that are representative of CAS and its implications [18, 19]; therefore, we do not believe it likely that other CAS experts would identify important elements whose basic meaning is not encompassed in these characteristics. It is possible that because all investigators come from a single institution or "school" of complexity, that the interpretation of a different group of investigators could be different, but we believe that because we focused on the key characteristics of CAS whose definitions are relatively well-established, this is less likely to have occurred. Finally, CAS characteristics may be inherent parts of several care delivery models; this is particularly true of learning and interconnections between individuals. However, the underlying CAS assumption of nonlinearity differentiates this perspective in a fundamental way.
While these results may be regarded as preliminary, they point to the use of complexity science as a framework for thinking about clinical settings that may allow us to better understand the inconsistencies in the health care organizational literature and to better design interventions that will lead to the greatest improvement in outcomes for our patients.
Improved outcomes in Type II diabetes were significantly associated with organizational interventions that had characteristics of complex adaptive systems in their design. Those interventions incorporating a greater number of characteristics demonstrated the greatest improvement in diabetes-related outcomes. We observed a greater effect for interventions that promoted interconnections between, and co-evolution of, individuals.
These data may allow us to expand the framework of CAS from conceptualizing and studying clinical systems to encompass designing and implementing interventions that lead to improved patient outcomes. Specifically, interventions and implementation strategies that target multiple CAS characteristics may be most effective in improving health outcomes. Further research should address how best to translate the theoretical constructs of complex adaptive systems into interventions that improve the outcomes of chronically ill patients.
The research reported here was supported by the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service (TRX # 01–091 & REA 05–129). Investigator salary support is provided through this funding, and through the South Texas Veterans Health Care System.
The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs.
- Wu S, A G: Projection of Chronic Illness Prevalence and Cost Inflation. Santa Monica, CA: RAND Health. 2000Google Scholar
- McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-45. 10.1056/NEJMsa022615.View ArticlePubMedGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): iii-iv. 1–72View ArticlePubMedGoogle Scholar
- Solberg LI, Kottke TE, Brekke ML, Magnan S, Davidson G, Calomeni CA, Conn SA: Failure of a continuous quality improvement intervention to increase the delivery of preventive services. A randomized trial. EffClin Pract. 2000, 3 (3): 105-15.Google Scholar
- Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don't physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999, 282 (15): 1458-65. 10.1001/jama.282.15.1458.View ArticlePubMedGoogle Scholar
- Warsi A, Wang PS, LaValley MP, Avorn J, Solomon DH: Self-management education programs in chronic disease: a systematic review and methodological critique of the literature. Arch Intern Med. 2004, 164 (15): 1641-9. 10.1001/archinte.164.15.1641.View ArticlePubMedGoogle Scholar
- Von Korff M, Gruman J, Schaefer J, Curry SJ, Wagner EH: Collaborative Management of Chronic Illness. Ann Intern Med. 1997, 127 (12): 1097-1102.View ArticlePubMedGoogle Scholar
- Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness. Jama. 2002, 288 (14): 1775-9. 10.1001/jama.288.14.1775.View ArticlePubMedGoogle Scholar
- Hunter DJ, Fairfield G: Disease management. Bmj. 1997, 315 (7099): 50-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness: the chronic care model, Part 2. Jama. 2002, 288 (15): 1909-14. 10.1001/jama.288.15.1909.View ArticlePubMedGoogle Scholar
- Bodenheimer T: Disease management–promises and pitfalls. N Engl J Med. 1999, 340 (15): 1202-5. 10.1056/NEJM199904153401511.View ArticlePubMedGoogle Scholar
- Weingarten SR, Henning JM, Badamgarov E, Knight K, Hasselbad V, Gano A, Ofman JJ: Interventions used in disease management programmes for patients with chronic illness – which ones work? Meta-analysis of published reports. BMJ. 2002, 325 (7370): 925-10.1136/bmj.325.7370.925.View ArticlePubMedPubMed CentralGoogle Scholar
- Katon W, Russo J, Von Korff M, Lin E, Simon G, Bush T, Ludman E, Walker E: Long-term effects of a collaborative care intervention in persistently depressed primary care patients. J Gen Intern Med. 2002, 17 (10): 741-8. 10.1046/j.1525-1497.2002.11051.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Plsek PE, Greenhalgh T: Complexity science: The challenge of complexity in health care. Bmj. 2001, 323 (7313): 625-8. 10.1136/bmj.323.7313.625.View ArticlePubMedPubMed CentralGoogle Scholar
- Miller WL, McDaniel RR, Crabtree BF, Stange KC: Practice jazz: understanding variation in family practices using complexity science. J Fam Pract. 2001, 50 (10): 872-8.PubMedGoogle Scholar
- Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC: How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005, 31 (8): 438-46.PubMedGoogle Scholar
- Plsek P: Redesigning Health Care with Insights from the Science of Complex Adaptive Systems. Crossing the Quality Chasm: A New Heath System for the 21st Century. 2000, National Academy of Sciences, 309-322.Google Scholar
- Cilliers P: Complexity and Postmodernism: Understanding Complex Systems. 1998, New York, NY: RoutledgeGoogle Scholar
- Maguire S, McKelvey B, Mirabeau L, Oztas N: Complexity Science and Organization Studies. The SAGE Handbook of Organization Studies. 2006, SAGE Publications, 165-214.View ArticleGoogle Scholar
- Litaker D, Tomolo A, Liberatore V, Stange K, Aron D: Using Complexity Theory to Build Interventions that Improve Health Care Delivery in Primary Care. J Gen Intern Med. 2006, 21: S30-4.View ArticlePubMedPubMed CentralGoogle Scholar
- Rubenstein L, Shekelle PG, Stone EG, Maglione MA, Hirt M, Mojica W, Srikanthan P, Tomizawa T, Morton SC, Chao B, Roth EA, Breuder T: Interventions that Increase the Utilization of Medicare-Funded Preventive Services for Persons Age 65 and Older. Evidence Report/Technology Assessment. Publication no HCFA-02151. 1999, Baltimore, MD: US Dept. of Health and Human Services. Health Care Financing AdministrationGoogle Scholar
- Stone EG, Morton SC, Hulscher ME, Maglione MA, Roth EA, Grimshaw JM, Mittman BS, Rubenstein LV, Rubenstein LZ, Shekelle PG: Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med. 2002, 136: 641-51.View ArticlePubMedGoogle Scholar
- Shojania KG, Ranji SR, Shaw LK, Charo LN, Lai JC, Rushakoff RJ, McDonald KM, Owens DK: Diabetes Mellitus Care. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Technical Review 9 (Contract No. 290-02-0017 to the Stanford University-UCSF Evidence-based Practice Center). AHRQ Publication No. 04-0051-2. Edited by: Shojania KG, McDonald KM, Wachter RM, Owens DK. 2004, Rockville, MD: Agency for Healthcare Research and Quality, 2:Google Scholar
- accessed on 11/20/2003, [http://www.nationmaster.com/encyclopedia/Developed-countries]
- Denver EA, Barnard M, Woolfson RG, Earle KA: Management of uncontrolled hypertension in a nurse-led clinic compared with conventional care for patients with type 2 diabetes. Diabetes Care. 2003, 26 (8): 2256-60. 10.2337/diacare.26.8.2256.View ArticlePubMedGoogle Scholar
- Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, Braspenning JC, Prins A, van der Wouden JC, Grol RP: Multifaceted support to improve clinical decision making in diabetes care: a randomized controlled trial in general practice. Diabet Med. 2002, 19 (10): 836-42. 10.1046/j.1464-5491.2002.00810.x.View ArticlePubMedGoogle Scholar
- Gary TL, Bone LR, Hill MN, Levine DM, McGuire M, Saudek C, Brancati FL: Randomized controlled trial of the effects of nurse case manager and community health worker interventions on risk factors for diabetes-related complications in urban African Americans. Prev Med. 2003, 37 (1): 23-32. 10.1016/S0091-7435(03)00040-9.View ArticlePubMedGoogle Scholar
- Glasgow RE, Toobert DJ, Hampson SE, Strycker LA: Implementation, generalization and long-term results of the "choosing well" diabetes self-management intervention. Patient Educ Couns. 2002, 48 (2): 115-22. 10.1016/S0738-3991(02)00025-3.View ArticlePubMedGoogle Scholar
- Hirsch IB, Goldberg HI, Ellsworth A, Evans TC, Herter CD, Ramsey SD, Mullen M: A multifaceted intervention in support of diabetes treatment guidelines: a cont trial. Diabetes Res Clin Pract. 2002, 58 (1): 27-36. 10.1016/S0168-8227(02)00100-6.View ArticlePubMedGoogle Scholar
- Kim HS, Oh JA: Adherence to diabetes control recommendations: impact of nurse telephone calls. J Adv Nurs. 2003, 44 (3): 256-61. 10.1046/j.1365-2648.2003.02800.x.View ArticlePubMedGoogle Scholar
- Miller CD, Barnes CS, Phillips LS, Ziemer DC, Gallina DL, Cook CB, Maryam SD, El-Kebbi IM: Rapid A1c availability improves clinical decision-making in an urban primary care clinic. Diabetes Care. 2003, 26 (4): 1158-63. 10.2337/diacare.26.4.1158.View ArticlePubMedGoogle Scholar
- Oh JA, Kim HS, Yoon KH, Choi ES: A telephone-delivered intervention to improve glycemic control in type 2 diabetic patients. Yonsei Med J. 2003, 44 (1): 1-8.View ArticlePubMedGoogle Scholar
- Sanders KM, Satyvavolu A: Improving blood pressure control in diabetes: limitations of a clinical reminder in influencing physician behavior. J Contin Educ Health Prof. 2002, 22 (1): 23-32. 10.1002/chp.1340220104.View ArticlePubMedGoogle Scholar
- Stroebel RJ, Scheitel SM, Fitz JS, Herman RA, Naessens JM, Scott CG, Zill DA, Muller L: A randomized trial of three diabetes registry implementation strategies in a community internal medicine practice. Jt Comm J Qual Improv. 2002, 28 (8): 441-50.PubMedGoogle Scholar
- Groeneveld Y, Petri H, Hermans J, Springer M: An assessment of structured care assistance in the management of patients with type 2 diabetes in general practice. Scand J Prim Health Care. 2001, 19 (1): 25-30.View ArticlePubMedGoogle Scholar
- McDermott RA, Schmidt BA, Sinha A, Mills P: Improving diabetes care in the primary healthcare setting: a randomised cluster trial in remote Indigenous communities. Med J Aust. 2001, 174 (10): 497-502.PubMedGoogle Scholar
- Piette JD, Weinberger M, Kraemer FB, McPhee SJ: Impact of automated calls with nurse follow-up on diabetes treatment outcomes in a Department of Veterans Affairs Health Care System: a randomized controlled trial. Diabetes Care. 2001, 24 (2): 202-8. 10.2337/diacare.24.2.202.View ArticlePubMedGoogle Scholar
- Piette JD, Weinberger M, McPhee SJ, Mah CA, Kraemer FB, Crapo LM: Do automated calls with nurse follow-up improve self-care and glycemic control among vulnerable patients with diabetes?. Am J Med. 2000, 108 (1): 20-7. 10.1016/S0002-9343(99)00298-3.View ArticlePubMedGoogle Scholar
- Pritchard DA, Hyndman J, Taba F: Nutritional counselling in general practice: a cost effective analysis. J Epidemiol Community Health. 1999, 53 (5): 311-6.View ArticlePubMedPubMed CentralGoogle Scholar
- Wagner EH, Grothaus LC, Sandhu N, Galvin MS, McGregor M, Artz K, Coleman EA: Chronic care clinics for diabetes in primary care: a system-wide randomized trial. Diabetes Care. 2001, 24 (4): 695-700. 10.2337/diacare.24.4.695.View ArticlePubMedGoogle Scholar
- Walker EA, Engel SS, Zybert PA: Dissemination of diabetes care guidelines: lessons learned from community health centers. Diabetes Educ. 2001, 27 (1): 101-10.View ArticlePubMedGoogle Scholar
- Cagliero E, Levina EV, Nathan DM: Immediate feedback of HbA1c levels improves glycemic control in type 1 and insulin-treated type 2 diabetic patients. Diabetes Care. 1999, 22 (11): 1785-9. 10.2337/diacare.22.11.1785.View ArticlePubMedGoogle Scholar
- Vaughan NJ, Potts A: Implementation and evaluation of a decision support system for type II diabetes. Comput Methods Programs Biomed. 1996, 50 (3): 247-51. 10.1016/0169-2607(96)01754-3.View ArticlePubMedGoogle Scholar
- Coffey E, Moscovice I, Finch M, Christianson JB, Lurie N: Capitated Medicaid and the process of care of elderly hypertensives and diabetics: results from a randomized trial. Am J Med. 1995, 98 (6): 531-6. 10.1016/S0002-9343(99)80011-4.View ArticlePubMedGoogle Scholar
- Litzelman DK, Slemenda CW, Langefeld CD, Hays LM, Welch MA, Bild DE, Ford ES: Reduction of lower extremity clinical abnormalities in patients with non-insulin-dependent diabetes mellitus. A randomized, controlled trial. Ann Intern Med. 1993, 119 (1): 36-41.PubMedGoogle Scholar
- Newcomb PA, Klein R, Massoth KM: Education to increase ophthalmologic care in older onset diabetes patients: indications from the Wisconsin Epidemiologic Study of Diabetic Retinopathy. J Diabetes Complications. 1992, 6 (4): 211-7. 10.1016/1056-8727(92)90054-O.View ArticlePubMedGoogle Scholar
- Clancy DE, Cope DW, Magruder KM, Huang P, Wolfman TE: Evaluating concordance to American Diabetes Association standards of care for type 2 diabetes through group visits in an uninsured or inadequately insured patient population. Diabetes Care. 2003, 26 (7): 2032-6. 10.2337/diacare.26.7.2032.View ArticlePubMedGoogle Scholar
- McClellan WM, Millman L, Presley R, Couzins J, Flanders WD: Improved diabetes care by primary care physicians: results of a group-randomized evaluation of the Medicare Health Care Quality Improvement Program (HCQIP). J Clin Epidemiol. 2003, 56 (12): 1210-7. 10.1016/S0895-4356(03)00198-7.View ArticlePubMedGoogle Scholar
- Taylor CT, Byrd DC, Krueger K: Improving primary care in rural Alabama with a pharmacy initiative. Am J Health Syst Pharm. 2003, 60 (11): 1123-9.PubMedGoogle Scholar
- Tsuyuki RT, Johnson JA, Teo KK, Simpson SH, Ackman ML, Biggs RS, Cave A, Chang WC, Dzavik V, Farris KB, Galvin D, Semchuk W, Taylor JG: A randomized trial of the effect of community pharmacist intervention on cholesterol risk management: the Study of Cardiovascular Risk Intervention by Pharmacists (SCRIP). Arch Intern Med. 2002, 162 (10): 1149-55. 10.1001/archinte.162.10.1149.View ArticlePubMedGoogle Scholar
- Basch CE, Walker EA, Howard CJ, Shamoon H, Zybert P: The effect of health education on the rate of ophthalmic examinations among African Americans with diabetes mellitus. Am J Public Health. 1999, 89 (12): 1878-82.View ArticlePubMedPubMed CentralGoogle Scholar
- McCabe CJ, Stevenson RC, Dolan AM: Evaluation of a diabetic foot screening and protection programme. Diabet Med. 1998, 15 (1): 80-4. 10.1002/(SICI)1096-9136(199801)15:1<80::AID-DIA517>3.0.CO;2-K.View ArticlePubMedGoogle Scholar
- Lobach DF, Hammond WE: Computerized decision support based on a clinical practice guideline improves compliance with care standards. Am J Med. 1997, 102 (1): 89-98. 10.1016/S0002-9343(96)00382-8.View ArticlePubMedGoogle Scholar
- Shultz EK, Bauman A, Hayward M, Holzman R: Improved care of patients with diabetes through telecommunications. Ann N Y Acad Sci. 1992, 670: 141-10.1111/j.1749-6632.1992.tb26084.x.View ArticlePubMedGoogle Scholar
- Smith S, Bury G, O'Leary M, Shannon W, Tynan A, Staines A, Thompson C: The North Dublin randomized controlled trial of structured diabetes shared care. Fam Pract. 2004, 21 (1): 39-45. 10.1093/fampra/cmh109.View ArticlePubMedGoogle Scholar
- Rothman RL, Malone R, Bryant B, Shintani AK, Crigler B, Dewalt DA, Dittus RS, Weinberger M, Pignone MP: A randomized trial of a primary care-based disease management program to improve cardiovascular risk factors and glycated hemoglobin levels in patients with diabetes. Am J Med. 2005, 118 (3): 276-84. 10.1016/j.amjmed.2004.09.017.View ArticlePubMedGoogle Scholar
- Massoud MR, Nielsen GA, Nolan K, Schall MW, Sevin C: A Framework for Spread: From Local Improvements to System-Wide Change. IHI Innovation Series white paper. 2006, Cambridge, MA: Institute for Healthcare ImprovementGoogle Scholar
- Dijkstra R, Wensing M, Thomas R, Akkermans R, Braspenning J, Grimshaw J, Grol R: The relationship between organisational characteristics and the effects of clinical guidelines on medical performance in hospitals, a meta-analysis. BMC Health Services Research. 2006, 6 (53): 1-10.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.