- Study protocol
- Open Access
- Open Peer Review
A group randomized trial of a complexity-based organizational intervention to improve risk factors for diabetes complications in primary care settings: study protocol
© Parchman et al; licensee BioMed Central Ltd. 2008
- Received: 15 November 2007
- Accepted: 05 March 2008
- Published: 05 March 2008
Most patients with type 2 diabetes have suboptimal control of their glucose, blood pressure (BP), and lipids – three risk factors for diabetes complications. Although the chronic care model (CCM) provides a roadmap for improving these outcomes, developing theoretically sound implementation strategies that will work across diverse primary care settings has been challenging. One explanation for this difficulty may be that most strategies do not account for the complex adaptive system (CAS) characteristics of the primary care setting. A CAS is comprised of individuals who can learn, interconnect, self-organize, and interact with their environment in a way that demonstrates non-linear dynamic behavior. One implementation strategy that may be used to leverage these properties is practice facilitation (PF). PF creates time for learning and reflection by members of the team in each clinic, improves their communication, and promotes an individualized approach to implement a strategy to improve patient outcomes.
The specific objectives of this protocol are to: evaluate the effectiveness and sustainability of PF to improve risk factor control in patients with type 2 diabetes across a variety of primary care settings; assess the implementation of the CCM in response to the intervention; examine the relationship between communication within the practice team and the implementation of the CCM; and determine the cost of the intervention both from the perspective of the organization conducting the PF intervention and from the perspective of the primary care practice.
The study will be a group randomized trial conducted in 40 primary care clinics. Data will be collected on all clinics, with 60 patients in each clinic, using a multi-method assessment process at baseline, 12, and 24 months. The intervention, PF, will consist of a series of practice improvement team meetings led by trained facilitators over 12 months. Primary hypotheses will be tested with 12-month outcome data. Sustainability of the intervention will be tested using 24 month data. Insights gained will be included in a delayed intervention conducted in control practices and evaluated in a pre-post design.
Primary and secondary outcomes
To test hypotheses, the unit of randomization will be the clinic. The unit of analysis will be the repeated measure of each risk factor for each patient, nested within the clinic. The repeated measure of glycosylated hemoglobin A1c will be the primary outcome, with BP and Low Density Lipoprotein (LDL) cholesterol as secondary outcomes. To study change in risk factor level, a hierarchical or random effect model will be used to account for the nesting of repeated measurement of risk factor within patients and patients within clinics.
This protocol follows the CONSORT guidelines and is registered per ICMJE guidelines:
Clinical Trial Registration Number
- Primary Care Setting
- Primary Care Practice
- Complex Adaptive System
- Chronic Care Model
- Interclass Correlation Coefficient
Although tight control of glucose (A1c), blood pressure (BP), and lipids can prevent complications from type 2 diabetes [1–4], a substantial proportion of patients with type 2 diabetes seen in primary care settings have poor control of one or more of these risk factors [5–7]. According to the Chronic Care model (CCM), patient outcomes such as good control of these risk factors should be associated with the presence of one or more of the following elements within the health care organization: organizational leadership, self-management support, delivery system design, decision support, clinical information systems, and community linkages [8, 9]. Barriers to implementing the CCM elements in primary care include a lack of motivation of key stakeholders, no external motivators for change, a paucity of resources, and no perceived opportunities to implement change [10, 11].
Assumptions behind organizational interventions
When we design or use organizational interventions to improve patient outcomes, we make assumptions about the nature of the system we are targeting. Many prior attempts to design interventions for primary care settings were based on a mechanistic approach: each practice or clinic has a broken or sub-standard 'part' that needs to be isolated and 'fixed.' These approaches have consistently provided disappointing results . A recent review of such efforts revealed only a 9% improvement across all clinical practice guideline implementation studies . In a review of strategies to improve glycemic control, the Agency for Healthcare Research and Quality's funded Evidence Based Practice Center identified 27 studies that employed organizational interventions . They concluded: '...organizational change as a broad category had little impact on glycemic control....' What do we know about primary care teams that would inform the development of a more effective intervention to overcome these barriers in primary care settings?
Primary care clinics are complex adaptive systems
Recent conceptualizations of the health care system of the 21st century call for recognition of the complex, adaptive nature of primary care settings . Conceptualizing primary care practices as complex adaptive systems (CAS) facilitates understanding their current state, health systems context, and potential for change in response to interventions [10, 16]. A CAS is a collection of individuals (e.g., clinicians, staff, administrators, and patients) whose actions are interconnected such that one person's action changes the context for other individuals in the system . Although these individuals can behave in unpredictable ways, they usually act according to a set of stated and unstated simple rules [18, 19]. Agents in a CAS tend to repeat patterns of activities that serve their particular values and motivations, making transformation difficult because changes are met by pressures to maintain the status quo . CASs have multiple feedback loops by which agents organize and reorganize based upon nonlinear interactions .
The ability of a CAS to adapt in a manner that allows for change or improvement can be enhanced by improving the quality and quantity (bandwidth) of communication among agents [17–19]. In a study of organizational features that support innovation in primary care practices, a key feature was an increase or improvement in communication and participation among people at all levels of the practice . Another example of the importance of communication can be found in studies regarding implementation of Electronic Medical Records. (EMRs) Although EMRs are seen as potentially effective strategies to improve quality and outcome of care, a failure to resolve communication problems between agents in the system, rather than a failure to resolve information technology problems, is a major cause of failed implementation . The central question for any translational research effort in primary care settings is: how can we leverage the properties of a primary care CAS to develop sustainable interventions that will improve patient outcomes across a wide diversity of primary care settings? One such approach is practice facilitation.
CAS theory and practice facilitation
Practice Facilitation (PF) is an intervention that exploits these CAS properties and overcomes the aforementioned barriers [23, 24]. PF occurs when a trained facilitator meets with staff and clinicians in each practice over several months to assist the team in addressing an issue, such as improving risk factors for diabetes complications. The facilitation is guided by insights from an in-depth multi-method assessment process in each practice prior to the facilitation intervention. Facilitation meetings create time for learning and reflection by members of the team. This in turn helps the practice team improve their communication so that they can adopt and implement a strategy to improve patient care. It has proven effective in the primary care setting for improving quality of care processes for rates of colorectal cancer screening , health habit counseling , and the quality of asthma care for children . Although the effectiveness of in primary care settings has been demonstrated for process measures of quality, its effectiveness in improving clinical outcomes such as A1c, BP, or lipids for patients with type 2 diabetes has not been tested. In addition, little is known about the process through which PF might improve patient outcomes.
Evaluate the effectiveness and sustainability of PF to improve risk factors for type 2 diabetes complications across a variety of primary care settings.
Hypothesis 1a: Patients within intervention practices will have lower A1c, blood pressure and lipid levels than those in control practices.
Hypothesis 1b: This improvement will be sustained over the 12-month period after withdrawal of the PF intervention.
Assess the implementation of the CCM in response to the intervention.
Hypothesis 2a: Compared to control practices, practices in the intervention group will improve their delivery of CCM elements.
Hypothesis 2b: This change will be sustained 12 months after the intervention is withdrawn.
Hypothesis 2c: Implementation of the CCM elements will be associated with risk factor control, but this association will be stronger in the intervention clinics.
Examine the relationship between communication within the practice team and the presence of the CCM elements.
Hypothesis 3a: Communication among staff and clinicians within intervention clinics will improve compared to control clinics.
Hypothesis 3b: This improvement in communication will be sustained 12 months after the intervention is withdrawn.
Hypothesis 3c: Communication among staff and clinicians will be associated with a change in the presence of the CCM elements, but this association will be stronger in intervention clinics.
Determine: the cost of the intervention from the perspective of the organization providing the PF intervention activities; the net cost (revenue minus cost of services and intervention) from the perspective of a primary care practice; and the costs per change in risk factor from each perspective. (This objective is descriptive. No hypotheses are postulated.)
Study setting and subjects
The subjects of this study will be 40 primary care clinics known as 'practices' in a large practice-based research network, the South Texas Ambulatory Research Network. Inclusion criteria for the study are: 1) the practice must have seen at least 60 patients with type 2 diabetes in the past year (in order to insure our sample size of 60 patients per practice); 2) they must be willing and able to use their billing records to identify these patients; and 3) representative members, clinicians, and office staff in the practice must agree to meet with the practice facilitator on a regular basis for one-hour team meetings over 12 months. Exclusion criteria are: 1) multi-specialty practices; 2) practice owned by a large vertically integrated health care system; and 3) practices with five or more physicians.
This will be a cluster-randomized trial with 20 clinics in the intervention arm and 20 in the control arm. (see Additional File 1) Because the intervention will be implemented in groups of five clinics at three-month intervals, a block randomization to intervention or control groups will be done so that there are four blocks with ten clinics in each block. The randomization scheme will be computer-generated in SPSS 15.0 by the study statistician. Neither the investigators nor the subjects will be blinded. The final chart abstraction for primary and secondary outcomes will be done by a trained abstractor who is blinded to allocation.
To obtain the dependent and independent variable necessary to accomplish specific aims one through three, clinician and staff surveys will be administered and medical record abstracted in each clinic. Site visits will be conducted in all 40 clinics and will be conducted three times: at baseline after enrollment but prior to randomization, and 12 and 24 months after starting the initial facilitation intervention in each clinic. During each site visit, clinicians and staff will complete surveys to measure the presence of the elements of the CCM as well as communication among clinicians and staff (see description of outcomes below).
The second method of data collection is a blinded medical record abstraction for the primary outcomes: A1c, BP, and lipid levels. This will be accomplished by a trained chart auditor who is blinded to assignment of clinics to intervention or control groups. The abstraction will take place at baseline, after the conclusion of the delayed intervention in the control clinics and 12 months after the end of the intervention in the initial intervention clinics.
For the fourth specific aim, a project accounting system will be developed to allocate all project expenses to a set of cost categories (cost pools) to assess the cost from the perspective of the organization conducting the intervention. Definitions and rules for assigning expenses into cost pools will be developed by the PI and project director in the first three months of the project. The second goal of specific aim four is to estimate the direct variable cost of conducting PF in the typical primary care facility. Net cost to the practice of implementing the intervention is: Revenues – (service cost plus cost resulting from intervention). Revenue will be tracked from billing data downloaded from each practice during each of the three site visits to track utilization and charges for all patients with type 2 diabetes in each practice for the 12 months prior to intervention, and at the end of 12 month period following the first facilitation visit. The methods used to collect cost data include meeting with the office manager at each practice during each site visit, and the collection of detailed field notes by the facilitators during direct observation in each practice. These data will be used to estimate the fixed and incremental cost of all resources used by the practice to implement the new strategy. We anticipate that these new resources will vary from practice to practice depending on the number of strategies implemented by the practice as a result of the intervention.
Patient-level outcomes will be measured by collecting data on a random sample of medical records on 60 patients within each clinic at the conclusion of the delayed intervention. All dates and values of A1c, BP, and lipids for the prior 12 months will be collected at baseline and for the intervening time period during the final chart abstraction, for a total of 36 months of values. The random sample of medical records of patients with type 2 diabetes will be selected from a list of all patients with type 2 diabetes seen within each clinic over the prior 12 months generated from each practice's billing system.
Practice-level outcomes will be measured by physician and staff surveys administered three times: at baseline, at the conclusion of the 12-month intervention, and 12 months later. The extent to which the care delivered in each clinic is consistent with the elements of the CCM will be measured with the Assessment of Chronic Illness Care survey (ACIC) . The ACIC measures the presence of the six elements of the CCM. Each item is scored on a 0 to 11 scale and provides sub-scale scores for each of the six CCM components as well as a total score. The validity of the instrument is supported by the findings of a study of an intervention for diabetes and congestive heart failure: all six sub-scales were responsive to process of care improvement .
Communication among staff and clinicians will be measured with a survey developed by Shortell and colleagues that was previously validated in health care settings . This instrument captures three aspects of organizational communication: openness , timeliness  and accuracy . These aspects as measured by this specific instrument have been shown to influence the ability or willingness of health care workers to develop relationships that increase the number and quality of interconnections and information flow, contributing to better self-organization and outcomes .
Baseline practice assessment
Prior to the first practice team meeting, the facilitators will conduct a one-week detailed assessment in each of the 20 intervention practices [31–33]. This data will be used to prepare an initial practice report that will be used in the first step of the intervention. The data from the assessment will be used to locate potential change points for improving practice change capacity and diabetes service delivery.
The primary data of the assessment will be dictated field notes from observations of the practice environment and clinical encounters. A detailed template will be used as a reminder to the facilitator of topics to be included in the field notes. Observational field notes  will be supplemented with collection and review of existing practice documents, including medical charts, flow sheets, patient schedules, personnel lists, mission statements, office protocols, and annual reports. Key informant interviews will be conducted to develop a more detailed understanding of clinician, staff, and patient perception of their goals and performance . Separately, the facilitator will gather data using a standardized medical record review form to obtain performance data on risk factor control (A1c, BP and Lipids) for 60 patients with diabetes in each clinic (see outcomes below). Clinician and staff survey data collected during the initial site visit (see outcomes below), as well as practice characteristics will also be incorporated into the assessment. All qualitative data will be recorded, transcribed, and entered into a text management software program, and an in-depth analyses will be done to guide the subsequent facilitation intervention.
The intervention: PF and the facilitator's toolbox
Each practice facilitator will be assigned ten intervention practices, and will meet with team members in their assigned practices initially once every other week for three to six months, and then monthly over a period of 12 months. During each meeting the facilitator will assist the team in tailoring and implementing a strategy to improve risk factors that emerges out of the discussion of five strategies from the 'toolbox.' (see below) The practice facilitator will remain available to each practice for ad hoc consultation between team meetings during this 12-month period. Each meeting will last one hour.
The PF intervention will follow the principles described by Crabtree, Miller and Stange in their series of studies to improve health habit and cancer screening activities in primary care practice settings [23, 25]. One of the key attributes of PF is creating protected time and space for members of the practice to reflect on a given issue and tailor evidence-based strategies to improve diabetes care outcomes in a manner that is consistent with their resources, organizational culture and values, and history. The emphasis will be on a common goal: improving risk factors for diabetes complications.
Each facilitator will have resources and material on five strategies to improve diabetes outcomes in a 'toolbox' of ideas and will share these with the members of each practice during the first few sessions. Examination of the literature suggests that there is some evidence for potential effectiveness of five strategies: 1) implementation of a diabetes registry [36, 37]; 2) point-of-care testing for A1c and/or lipids [38, 39]; 3) group clinic visits [40, 41]; 4) clinical reminders and decisions support [42, 43]; and 5) patient activation ; . Practices will not be limited to these five strategies. A discussion of each of these tools in the 'toolbox' will occur as an initial step in the facilitation intervention. The purpose of this discussion is to stimulate the practice team to adapt and implement one or more of the five strategies or to develop their own innovative strategy to improve risk factors or both. This is consistent with current theory regarding primary care practices as complex adaptive systems [16, 17].
The delayed intervention
Insights gained during the initial 12-month intervention will be used to design a refined and enhanced delayed facilitation intervention in the practices initially randomized to the control group. This design allows initial learning about intervention techniques to be rapidly tested in the delayed intervention practices after they have served as controls. Importantly, the design also provides an incentive for the control practices to participate, because instead of just providing control data, they later receive a refined intervention. It is also important to note that institutional review boards are increasingly questioning the ethics of not offering control subjects and settings some benefit from participation in an RCT. This delayed intervention will help address those concerns. The delayed intervention will be similar process to the PF described above. However, the knowledge and skills acquired in the first 20 practices will be used to refine and enhance both the evidence-based strategies in the facilitator toolbox. This delayed intervention will be evaluated in a pre-post design.
Sample size and analysis
To test hypotheses for specific aim one, the unit of randomization will be the clinic and the unit of analysis will be the repeated measure of each risk factor for each patient, nested within the clinic. The outcome will be the level of control of each risk factor. We will examine A1c as our primary outcome, with BP and LDL-cholesterol as secondary outcomes. To study change in risk factor level, a hierarchical or random effect model will be used to account for the nesting of repeated measurement of risk factor within patients and patients within clinics [46, 47].
The power calculation is derived for the planned cluster randomized design with 20 clinic in each treatment arm and 40 patients each clinic under the hierarchical linear analysis plan (random effects models), and the significance level set at 0.05. For the first specific aim, our primary outcome is A1c and the power estimates are calculated based on the interclass correlation coefficient (ICC) for A1c obtained from a preliminary study of 20 practices . That value is 0.113. For the first specific aim, if the mean decrease in A1c due to intervention is 0.7 or greater, then the power for detecting the intervention effect on A1c is 0.80.
For specific aims two and three, the ACIC score (for specific aim two) and the communication score (for specific aim three) measured repeatedly at the staff and clinician level will be the outcome of primary interest, as it will reflect the presence of elements of the CCM. Due to a similar distributional nature of the ACIC or communication score and risk factors (ACIC and communication scores are measured repeatedly at three time points at the staff level nested within each clinic and are continuous), the three-level random effects model as proposed for specific aim one is appropriate. Sample size and power calculations for these aims are similar to those for the first aim. For the second aim, the ICC of the ACIC score is 0.12 with a standard error of 2.15, resulting in a power of 0.94 to detect a change in ACIC score of at least 1.5 in response to the intervention. For the third specific aim, the ICC for communication scores is 0.33 and the associated standard error is 9.46, thus the power for detecting the intervention effect on communication score is no less than 0.81 if the mean communication score in the intervention group is seven points or greater compared to that for the control group.
For specific aim four, the difference in revenues generated by the practice for all services provided to patients with diabetes for the 12 months prior to the intervention compared to the 12 months during the facilitation intervention will be determined. Second, the cost of providing services to each patient with diabetes in each practice will be estimated using CPT codes for services delivered at that CPT codes Relative Value Units from MedPar files . Finally, the incremental cost of implementing the strategy to improve risk factor control in each practice will be estimated.
This protocol received human subjects protection approval from the Institutional Review Board at the University of Texas Health Science Center at San Antonio on 19 March 2007. (IRB protocol HSC20070546H)
This study, is funded by a grant from the National Institute of Diabetes, Digestive and Kidney Disorders. (R18 DK 075692), follows the CONSORT guidelines, and is registered per ICMJE guidelines: Clinical Trial Registration Number: NCT00482768.
- Study UKPD: Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). UK Prospective Diabetes Study (UKPDS) Group. Lancet. 1998, 352 (9131): 837-853. 1998/09/22View ArticleGoogle Scholar
- Vijan S, Hayward RA: Treatment of hypertension in type 2 diabetes mellitus: blood pressure goals, choice of agents, and setting priorities in diabetes care. Ann Intern Med. 2003, 138 (7): 593-602. 2003/04/02View ArticlePubMedGoogle Scholar
- Anonymous: MRC/BHF Heart Protection Study of cholesterol lowering with simvastatin in 20,536 high-risk individuals: a randomised placebo-controlled trial. Lancet. 2002, 360 (9326): 7-22. 2002/07/13View ArticleGoogle Scholar
- Group UKPDS: Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38. UK Prospective Diabetes Study Group. BMJ. 1998, 317 (7160): 703-713. 1998/09/11View ArticleGoogle Scholar
- Beaton SJ, Nag SS, Gunter MJ, Gleeson JM, Sajjan SS, Alexander CM: Adequacy of glycemic, lipid, and blood pressure management for patients with diabetes in a managed care setting. Diabetes Care. 2004, 27 (3): 694-698. 2004/02/28View ArticlePubMedGoogle Scholar
- Grant RW, Buse JB, Meigs JB: Quality of diabetes care in U.S. academic medical centers: low rates of medical regimen change. Diabetes Care. 2005, 28 (2): 337-442. 2005/01/29View ArticlePubMedPubMed CentralGoogle Scholar
- Kerr EA, Gerzoff RB, Krein SL, Selby JV, Piette JD, Curb JD, Herman WH, Marrero DG, Narayan KM, Safford MM, Thompson T, Mangione CM: Diabetes care quality in the Veterans Affairs Health Care System and commercial managed care: the TRIAD study. Ann Intern Med. 2004, 141 (4): 272-281. 2004/08/18View ArticlePubMedGoogle Scholar
- Wagner EH, Austin BT, Von Korff M: Organizing care for patients with chronic illness. Milbank Q. 1996, 74 (4): 511-544. 1996/01/01View ArticlePubMedGoogle Scholar
- Wagner EH, Groves T: Care for chronic diseases. BMJ. 2002, 325 (7370): 913-914. 2002/10/26View ArticlePubMedPubMed CentralGoogle Scholar
- Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC: How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005, 31 (8): 438-446. 2005/09/15PubMedGoogle Scholar
- Thomas P, McDonnell J, McCulloch J, While A, Bosanquet N, Ferlie E: Increasing capacity for innovation in bureaucratic primary care organizations: a whole system participatory action research project. Ann Fam Med. 2005, 3 (4): 312-317. 2005/07/28View ArticlePubMedPubMed CentralGoogle Scholar
- Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998, 317 (7156): 465-468. 1998/08/14View ArticlePubMedPubMed CentralGoogle Scholar
- Grimshaw J, Eccles M, Tetroe J: Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof. 2004, 24 Suppl 1: S31-7. 2005/02/17View ArticlePubMedGoogle Scholar
- Shojania KG, Ranji SR, Shaw LK, Charo LN, Lai JC: Closing the quality gap: a critical analysis of quality improvement strategies. Technical review 9 (Contract No. 290-02-0017). Edited by: Center SUUCSFEP. 2004, Rockville , Agency for Healthcare Research and QualityGoogle Scholar
- IOM Committee on Quality of Health Care in America: Crossing the quality chasm: A new health system for the 21st century. 2001, Washington, DC , National Academy PressGoogle Scholar
- Miller WL, McDaniel RR, Crabtree BF, Stange KC: Practice jazz: understanding variation in family practices using complexity science. J Fam Pract. 2001, 50 (10): 872-878. 2001/10/25PubMedGoogle Scholar
- McDaniel RR, Driebe DJ: Complexity science and health care management . Advances in Health Care Management. 2001, 2: 11-36.View ArticleGoogle Scholar
- Zimmerman B, Lindberg C, Plsek P: Edgeware: Insights from complexity science for health care leaders . 1998, Irving , VHA, Inc.Google Scholar
- Stacey RD: Complexity and creativity in organizations. 1996, San Francisco , Berrett-Koehler Publishers, 1st ed.Google Scholar
- Anderson RA, Corazzini KN, McDaniel RR: Complexity science and the dynamics of climate and communication: reducing nursing home turnover. Gerontologist. 2004, 44 (3): 378-388. 2004/06/16View ArticlePubMedPubMed CentralGoogle Scholar
- Cilliers R: Complexity and postmodernism: Understanding coplex systems. 1998, New York , RoutledgeGoogle Scholar
- Paul DL, Pearlson KE, McDaniel RR: Assessing technological barriers to telemedicine: technology-management issues . IEEE Transactions in Engineering Management. 1999, 46: 279-288.View ArticleGoogle Scholar
- Ruhe MC, Weyer SM, Zronek S, Wilkinson A, Wilkinson PS, Stange KC: Facilitating practice change: lessons from the STEP-UP clinical trial. Preventive Medicine. 2004, 40 (6): 729-734.View ArticleGoogle Scholar
- Wei EK, Ryan CT, Dietrich AJ, Colditz GA: Improving colorectal cancer screening by targeting office systems in primary care practices: disseminating research results into clinical practice. Arch Intern Med. 2005, 165 (6): 661-666. 2005/03/30View ArticlePubMedGoogle Scholar
- Stange KC, Goodwin MA, Zyzanski SJ, Dietrich AJ: Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. 2003, 25 (4): 296-300. 2003/10/29View ArticlePubMedGoogle Scholar
- Lobo CM, Frijling BD, Hulscher ME, Bernsen RM, Braspenning JC, Grol RP, Prins A, van der Wouden JC: Improving quality of organizing cardiovascular preventive care in general practice by outreach visitors: a randomized controlled trial. Prev Med. 2002, 35 (5): 422-429. 2002/11/15View ArticlePubMedGoogle Scholar
- Bonomi AE, Wagner EH, Glasgow RE, VonKorff M: Assessment of chronic illness care (ACIC): a practical tool to measure quality improvement. Health Serv Res. 2002, 37 (3): 791-820. 2002/07/23View ArticlePubMedPubMed CentralGoogle Scholar
- Shortell SM, Rousseau DM, Gillies RR, Devers KJ, Simons TL: Organizational assessment in intensive care units (ICUs): construct development, reliability, and validity of the ICU nurse-physician questionnaire. Med Care. 1991, 29 (8): 709-726. 1991/08/01View ArticlePubMedGoogle Scholar
- Roberts K, O’Reilly C: Measuring organizational communication . Journal of Applied Psychology. 1974, 59: 321-326.View ArticleGoogle Scholar
- O’Reilly C, Roberts K: Task group structure, communication, and effectiveness in three organizations. Journal of Applied Psychology. 1977, 64: 674-681.View ArticleGoogle Scholar
- Stange KC, Crabtree BF, Miller WL: A multimethod assessment process (MAP) for understanding and individualizing practice change. 2005Google Scholar
- Crabtree BF, Miller W: Researching practice settings: A case study approach. In: Crabtree BF, Miller WL, eds. Doing qualitative research . 1999, Thousand Oaks , Sage Publications, 293-312. 2nd editionGoogle Scholar
- Kairys JA, Orzano J, Gregory P, Stroebel C, DiCicco-Bloom B, Roemheld-Hamm B, Kobylarz FA, Scott JG, Coppola L, Crabtree BF: Assessing diversity and quality in primary care through the multimethod assessment process (MAP). Qual Manag Health Care. 2002, 10 (4): 1-14. 2003/08/27View ArticlePubMedGoogle Scholar
- Bogdewic SP: Participant observation. In: Crabtree BF, Miller WL, eds. Doing qualitative research . 1999, Thousand Oaks , Sage Publications, 47-69. 2nd editionGoogle Scholar
- Gilchrist VJ, Williams RL: Key informant interviews. In: Crabtree BF, Miller WL, eds. Doing qualitative research. 1999, Thousand Oaks , Sage Publications , 71-88. 2nd editionGoogle Scholar
- Metzger J: Using computerized registries in chronic disease care. 2004Google Scholar
- Sperl-Hillen J, O'Connor PJ, Carlson RR, Lawson TB, Halstenson C, Crowson T, Wuorenma J: Improving diabetes care in a large health care system: an enhanced primary care approach. Jt Comm J Qual Improv. 2000, 26 (11): 615-622. 2000/12/01PubMedGoogle Scholar
- Cagliero E, Levina EV, Nathan DM: Immediate feedback of HbA1c levels improves glycemic control in type 1 and insulin-treated type 2 diabetic patients. Diabetes Care. 1999, 22 (11): 1785-1789. 1999/11/05View ArticlePubMedGoogle Scholar
- Miller CD, Barnes CS, Phillips LS, Ziemer DC, Gallina DL, Cook CB, Maryman SD, El-Kebbi IM: Rapid A1c availability improves clinical decision-making in an urban primary care clinic. Diabetes Care. 2003, 26 (4): 1158-1163. 2003/03/29View ArticlePubMedGoogle Scholar
- Wagner EH, Grothaus LC, Sandhu N, Galvin MS, McGregor M, Artz K, Coleman EA: Chronic care clinics for diabetes in primary care: a system-wide randomized trial. Diabetes Care. 2001, 24 (4): 695-700. 2001/04/24View ArticlePubMedGoogle Scholar
- Clancy DE, Cope DW, Magruder KM, Huang P, Wolfman TE: Evaluating concordance to American Diabetes Association standards of care for type 2 diabetes through group visits in an uninsured or inadequately insured patient population. Diabetes Care. 2003, 26 (7): 2032-2036. 2003/07/02View ArticlePubMedGoogle Scholar
- Goldberg HI, Neighbor WE, Hirsch IB, Cheadle AD, Ramsey SD, Gore E: Evidence-based management: using serial firm trials to improve diabetes care quality. Jt Comm J Qual Improv. 2002, 28 (4): 155-166. 2002/04/11PubMedGoogle Scholar
- Groeneveld Y, Petri H, Hermans J, Springer M: An assessment of structured care assistance in the management of patients with type 2 diabetes in general practice. Scand J Prim Health Care. 2001, 19 (1): 25-30. 2001/04/17View ArticlePubMedGoogle Scholar
- Greenfield S, Kaplan SH, Ware JE, Yano EM, Frank HJ: Patients' participation in medical care: effects on blood sugar control and quality of life in diabetes. J Gen Intern Med. 1988, 3 (5): 448-457. 1988/09/01View ArticlePubMedGoogle Scholar
- Greenfield S, Kaplan S, Ware JE: Expanding patient involvement in care. Effects on patient outcomes. Ann Intern Med. 1985, 102 (4): 520-528. 1985/04/01View ArticlePubMedGoogle Scholar
- Laird NM, Ware JH: Random-effects models for longitudinal data. Biometrics. 1982, 38 (4): 963-974. 1982/12/01View ArticlePubMedGoogle Scholar
- Raudenbush SW, Bryk AS: Hierarchical Linear Models. 2002, Thousand Oak , Sage, 2ndGoogle Scholar
- Parchman ML, Pugh JA, Wang CP, Romero RL: Glucose control, self-care behaviors, and the presence of the chronic care model in primary care clinics. Diabetes Care. 2007, 30 (11): 2849-2854. 2007/08/08View ArticlePubMedGoogle Scholar
- Hsiao WC, Braun P, Yntema D, Becker ER: Estimating physicians' work for a resource-based relative-value scale. N Engl J Med. 1988, 319 (13): 835-841. 1988/09/29View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.