- Study protocol
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Advancing heart health in North Carolina primary care: the Heart Health NOW study protocol
© Weiner et al. 2015
Received: 23 October 2015
Accepted: 9 November 2015
Published: 14 November 2015
The objective of Heart Health NOW (HHN) is to determine if primary care practice support—a comprehensive evidence-based quality improvement strategy involving practice facilitation, academic detailing, technology support, and regional learning collaboratives—accelerates widespread dissemination and implementation of evidence-based guidelines for cardiovascular disease (CVD) prevention in small- to medium-sized primary care practices and, additionally, increases practices’ capacity to incorporate other evidence-based clinical guidelines in the future.
HHN is a stepped wedge, stratified, cluster randomized trial to evaluate the effect of primary care practice support on evidence-based CVD prevention, organizational change process measures, and patient outcomes. Each practice will start the trial as a control, receive the intervention at a randomized time point, and then enter a maintenance period 12 months after the start of the intervention. The intervention will be randomized to practices in one of four strata defined by region of the state (east or west) and degree of practice readiness for change. Seventy-five practices in each region with a high degree of readiness will be randomized 1:1:1 in blocks of 3 sometime prior to month 8 to receive the intervention at month 9, 11, or 12. An additional 75 practices within each region that have a low degree of readiness or are recruited later will be randomized 1:1 in blocks of 2 prior to month 13 to receive the intervention at month 14 or 16. The sites will be ordered within each strata based on time of enrollment with the blocking based on this ordering. Evaluation will examine the effect of primary care practice support on (1) practice-level delivery of evidence-based CVD prevention, (2) patient-level health outcomes, (3) practice-level implementation of clinical and organizational changes that support delivery of evidence-based CVD prevention, and (4) practice-level capacity to implement future evidence-based clinical guidelines.
Results will indicate whether primary care practice support is an effective strategy for widespread dissemination and implementation of evidence-based clinical guidelines in primary care practices. Discernible reductions in cardiovascular risk in 300 practices covering over an estimated 900,000 adult patients would likely lead to prevention of thousands of cardiovascular events within 10 years.
Cardiovascular disease (CVD) is the leading cause of death in the USA . CVD imposes a staggering burden whether measured in life-years lost, diminished quality of life, racial and ethnic health disparities, or direct and indirect healthcare costs. Yet, the Centers for Disease Control and Prevention (CDC) estimates that more than 200,000 deaths from heart disease and stroke could be prevented each year through a concerted, national effort to control CVD risk factors such as blood pressure, cholesterol, and tobacco use.
In September 2011, the US Department of Health and Human Services launched the “Million Hearts” initiative to prevent 1 million heart attacks and strokes by 2017 . In the clinical realm, Million Hearts focuses on the management of the “ABCS”—aspirin use in high-risk individuals, blood pressure control, cholesterol management, and smoking cessation . To support Million Hearts, the US Agency for Healthcare Research and Quality (AHRQ) launched an initiative in 2015 to assist primary care practices in implementing clinical and organizational changes to improve the management of ABCS.
Objectives and aims
Heart Health NOW (HHN), an AHRQ-funded demonstration and evaluation, investigates whether a comprehensive evidence-based quality improvement strategy (which we call primary care practice support) accelerates the implementation of evidence-based guidelines for CVD prevention in primary care practices on a large scale. The specific aims are to evaluate the effect of primary care practice support in small- to medium-sized practices on (1) practice-level delivery of evidence-based CVD prevention, (2) patient-level health outcomes, (3) practice-level implementation of clinical and organizational changes that support delivery of evidence-based CVD prevention, and (4) practice-level capacity to implement future evidence-based clinical guidelines. HHN is a cooperative effort of the University of North Carolina at Chapel Hill (UNC-CH), the North Carolina Area Health Education Center (NC AHEC), and Community Care of North Carolina (CCNC), the primary care case management provider for NC Medicaid.
North Carolina is the tenth largest state in the USA with a population approaching 10 million and a racial and ethnic composition of 72 % white, 22 % black, and 9 % Hispanic . The burden of cardiovascular disease in North Carolina remains large. The cardiovascular death rate was 263 per 100,000 as measured in 2008–2010, accounting for almost one-third of deaths in the state. These data rank North Carolina 32nd among the 50 states for cardiovascular outcomes .
HHN is a stepped wedge, stratified, cluster randomized trial. Each practice will start the trial as a control, receive the primary care practice support intervention at a randomized time point, and then enter a maintenance period 12 months after the start of the intervention. The intervention will be randomized to practices in one of four strata defined by region of the state (east or west) and degree of practice readiness for change (described below). Specifically, 75 practices in each region with a high degree of readiness will be randomized 1:1:1 in blocks of 3 prior to month 8 to receive the intervention at month 9, 11, or 12. An additional 75 practices within each region that have a low degree of readiness or are recruited later will be randomized 1:1 in blocks of 2 prior to month 13 to receive the intervention at month 14 or 16. The sites will be ordered within each stratum based on time of enrollment with the blocking based on this ordering. The study’s statistician will generate the stratified permuted-block random allocation lists using a computer program. As practices are enrolled, the project management system will use the randomization schedule to randomize practices and assign their intervention start date. A practice is considered randomized once an intervention start date has been assigned. Neither study personnel nor participating practices will be blind to randomized start dates.
We will recruit 300 small- to medium-sized primary care practices. To be eligible, practices must have ten or fewer providers in a single location and have an electronic health record (EHR). Enrolling practices agree to the following: (1) form a quality improvement team; (2) meet with the practice facilitator up to 8 h a month; (3) send representatives to regional learning collaboratives three times yearly; (4) meet with experts to discuss CVD prevention, CVD risk assessment, and system change strategies; (5) permit the CCNC Informatics Center to process EHR data and provide the practice with cardiovascular care registries and dashboards for clinical decision support and population health management; (6) review data on ABCS measures at least monthly; and (7) use those data to plan, conduct, and assess improvement activities. Enrolling practices complete an information technology and quality improvement readiness assessment, which is used for earlier randomization of high-readiness practices and assignment of practices to more or less intensive practice facilitation.
Primary care practice support intervention
Practice facilitators will work for 12 months with practices’ quality improvement teams to implement four “key drivers” for supporting delivery of evidence-based CVD prevention: enhanced clinical information systems with dashboards on critical measures and drill downs to patient-level care; adoption and use of practice-wide evidence-based protocols; effective use, documentation, and tracking of patient self-management support goals; and optimization of the practice care team. Practices will receive up to 8 h a month of practice facilitation depending on their level of readiness at enrollment. In addition, physician faculty will engage in academic detailing through webinars and practice visits. Detailing will focus on CVD prevention and treatment, CVD risk assessment, and new recommendations for cholesterol and hypertension management. Finally, providers and staff will participate in regional learning collaborative meetings where they can share experiences implementing evidence into practice.
Theoretical constructs, measures, data sources, and data collection timing
Frequency, duration, and mode of PF contacts
PF contact logs
Frequency, duration, and mode of academic detailing contact
Contact, webinar logs
Attendance at regional collaborative meetings
Practice capacity for QI
Change Process Capacity Questionnaire
B, E, F
Adaptive Reserve Questionnaire
B, E, F
Organizational Readiness for Change Questionnaire (ORIC)
Implementation Policies and Practices (IPPs)
Key Driver Implementation Scales
Implementation barriers, facilitators, and IPPs
Implementation climate questionnaire
ABCS measures/clinical measures
B, I, E, F
Acceptability of implementation support
Patient outcomes (communication, shared decision-making)
Patient outcomes (healthcare utilization and mortality)
B, E, F
Practice outcomes (e.g., financial benefits)
Practice characteristics, patient population, EMR capabilities
KI survey, PF contact logs
External policies and incentives, market conditions
KI survey, KI interview, PF contact logs
B, E, F
Practice facilitator contact logs
Practice facilitators (PFs) will record monthly the frequency, duration, and mode of practice contact. We will use these data to measure the intensity of implementation support provided to practices.
Academic detailing logs
Physician faculty will record visits, calls, and other contacts with practices. Webinar software will track logins and pages viewed by practice staff.
Regional collaborative attendance records
Project staff will keep records of the number and types of staff from each practice that attend regional collaborative meetings.
Key informant surveys
We will survey key informants (KIs) to assess practice capacity for QI, inner context, and outer context. The surveys will be administered at baseline, end-of-intervention, 6 months post-intervention, and 12 months post-intervention for practices enrolled earlier in the study. The KI will be the practice’s provider champion (N = 300).
We will survey providers and staff to assess practice capacity for QI at baseline, end-of-intervention, 6 months post-intervention, and 12 months post-intervention for practices enrolled earlier; organizational readiness to implement change at baseline; and implementation climate at end-of-intervention and 6 months post-intervention. The sample will consist of 3–5 providers and staff members depending on practice size (N = 900–1500).
PFs will assess on a monthly basis practices’ progress in implementing clinical practice and organizational changes to support improvement in CVD prevention (implementation policies and practices). Ratings will focus on the extent to which practices have implemented four key drivers of improved CVD prevention and also level of leadership and team engagement.
We will conduct semi-structured KI interviews (N = 300) at end-of-intervention and 6 months post-intervention to obtain supplemental data about organizational changes for evidence-based CVD prevention (implementation policies and practices) and influential inner and outer context events. The KI interview at end-of-intervention will also ask about acceptability of the implementation support received (implementation effectiveness). The KI interview 6 months post-intervention will ask about practice-level outcomes (innovation effectiveness).
We will obtain performance data on the ABCS measures (implementation effectiveness) and patients’ intermediate clinical outcomes (innovation effectiveness) from the EHR. The ABCS measures and clinical outcomes will be collected at baseline, during the intervention (quarterly), at the end of the intervention, and post-intervention (6 and 12 months follow-up). The EHR will also supply race/demographic data. EHR data will be routed to the CCNC Informatics Center, where the data will be extracted, normalized, and placed in a standard report used for the evaluation and sent back to the practices.
We will survey 200 consecutive adult patients in each practice at baseline and at the end of the intervention to obtain patient experience data on communication and shared decision-making (innovation effectiveness). Data will be collected during an office visit using paper-based surveys. Eligible patients must have one or more of the following comorbidities: hypertension/high blood pressure, myocardial infarction/heart attack, angina/coronary heart disease, stroke, smoking, diabetes, and high cholesterol.
We will use claims data at baseline, end-of-intervention, and 6 months post-intervention to assess hospitalizations for cardiovascular-related conditions, in-hospital deaths, and mortality for patients seen at participating practices (innovation effectiveness). We will have access to claims data on 85 % of the insured population in NC, specifically those covered by Blue Cross Blue Shield of North Carolina, the State Employee Health Plan, Medicare, and Medicaid. Outcomes will be aggregated to the practice level. For the baseline period, we will examine claims data for the year prior to the intervention. Following the intervention, we will examine available claims during and after the intervention for each practice.
Implementation support. We will measure primary care practice support intensity as the percentage of contacts with a practice that are in-person. We will also report the actual number of in-person contacts and number of total contacts to account for variability in contacts across practices. We will also track frequency, mode, and duration of contact with academic detailers, as well as number and type of staff per practice attending collaborative meetings.
Practice capacity for QI encompasses two constructs. The first construct, change process capability, refers to a “state of preparedness for change that is influenced by the organization’s previous history of change, its plans for continuous organizational refinement, and its ability through its social and technical systems to initiate and sustain that change” (, p. 193). We will measure this construct using the Change Process Capacity Questionnaire (CPCQ) . The second construct, adaptive reserve, refers to “the practice relationship infrastructure; alignment of management functions in which clinical care, practice operations, and financial functions and reflect a consistent vision; facilitative leadership; teamwork; sense-making; a positive work environment; and a culture of learning”(, p. S37). We will measure this construct using the Practice Adaptive Reserve scale [11, 12].
Organizational readiness for change refers to the extent to which organizational members are psychologically and behaviorally prepared to implement change [6, 7, 13]. We will measure readiness using the Organizational Readiness for Implementing Change scale .
Key Drivers of Implementation Scale (KDIS) for standardized care processes
0 - No activity
No activity on standardization.
1 - Protocols identified
Practice identifies sample protocols and customizes them for their practice.
2 - Staff enabled
Practice enables staff to perform roles (via standing orders, etc.) needed to implement protocols.
3 - Testing workflow
Practice is develops/tests workflows to support protocols.
4 - Implementation
Practice implements and follows at least one protocol.
5 - Full implementation
Practice monitors the system to ensure that protocols are used consistently.
Implementation climate refers to organizational members’ “shared summary perception of the extent to which their use of a specific innovation is rewarded, supported, and expected within their organization” (, p. 1060). We will measure implementation climate using a 6-item scale .
Process of care measures for ABCS
Ischemic vascular disease (IVD): use of aspirin or another antithrombotic
Percentage of patients aged 18 years and older with ischemic vascular disease (IVD) with documented use of aspirin or other antithrombotic.
Aspirin for the primary prevention of cardiovascular disease
Percentage of patients between the ages of 50 and 75 with an ASCVD risk score of ≥10 % who do not currently have ischemic vascular disease with documented aspirin use.
Blood pressure management: controlling high blood pressure
Percentage of patients aged 18 through 85 years of age with a diagnosis of hypertension (HTN) whose blood pressure (BP) was adequately controlled (<140/90) during the measurement year.
Blood pressure management: controlling high blood pressure
Percentage of patients aged 18 through 85 years of age with a diagnosis of HTN whose blood pressure was adequately controlled ( age 18–59 and/or people with diabetes or chronic kidney disease <140/90; age 60–85 < 150/90 ) during measurement year.
Statin therapy for prevention and treatment of cardiovascular disease
Percentage of the following patients—all considered at high risk of cardiovascular events—who were prescribed or were on statin therapy: adults ages ≥21 years who were previously diagnosed with or currently have an active diagnosis of clinical atherosclerotic cardiovascular disease (ASCVD); or adults ages ≥21 years with a fasting or direct low-density lipoprotein cholesterol (LDL-C) level ≥190 mg/dL; or adults ages 40–75 years with a diagnosis of diabetes with a fasting or direct LDL-C level of 70–189 mg/dL.
Risk-based statin therapy
Percentage of patients aged 40 through 79 years of age whose Calculated Risk Score is 10 % or greater and are on a statin.
Assessment of cardiovascular risk
Percentage of patients ages 40–79, with no evidence of prior cardiovascular event, who have documentation of required elements for cardiovascular risk assessment.
Tobacco use screening
Percentage of patients aged 18 years or older who were seen for at least 2 office visits within 12 months and who were queried about tobacco use one or more times within 24 months PQRS 226 Part A (modified).
Smoking cessation support
Percentage of patients aged 18 years and older identified as tobacco users within the past 24 months and seen for at least 2 office visits within 12 months who received cessation intervention within 24 months PQRS 226 Part B (modified).
We will measure acceptability of primary care practice support qualitatively by asking about KIs’ satisfaction with the frequency, duration, and quality of implementation support.
In the last 12 months, how often did your provider
explain things in a way that was easy to understand?
listen carefully to you?
give you easy to understand information about any health questions or concerns?
seem to know about your medical history?
show respect for what you had to say?
spend enough time with you?
Shared decision-making questions
In the last 12 months, did you and your provider talk about starting or stopping a prescription medication? If yes, complete the rest of the questions.
When you talked about starting or stopping a prescription medicine, how much did your provider talk about the reasons you might want to take a medicine?
Not at all, a little, some, a lot
When you talked about starting or stopping a prescription medicine, how much did your provider talk about the reasons you might NOT want to take the medicine?
Not at all, a little, some, a lot
When you talked about starting or stopping a prescription medicine, did your provider ask you what you thought was best for you?
Practice-level patient outcomes
Percentage of patients who answered “always” to all 6 communication questions
Shared decision-making (SDM)
Percentage of patients who answered “a lot” and “yes” to all 3 SDM questions.
Percentage of patients hospitalized for stroke, MI, angina.
Percentage of patients hospitalized for stroke, MI, angina who died in the hospital.
Percentage of patients with BP <140/90, <140/90 if 18–59 years, <150/90 if 60–85 years.
Systolic blood pressure
Percentage of patients with a SBP <140; mean (SD), median (IQR) SBP
Diastolic blood Pressure
Percentage of patients with DBP < 90; mean (SD), median (IQR) DBP
Low-density lipoprotein (LDL) level
Percentage of patients with LDL levels in the following categories: <100 mg/dL; 100 to <160 mg/dL; 160 mg/dL or more
10-year CVD Riska
Mean (SD), median (IQR) of individuals who had CVD risk calculated
We will measure practice outcomes qualitatively by asking whether evidence-based CVD prevention improved the practice’s standing in a pay-for-performance program, provided them with maintenance of certification credits, improved their payments through the BCBS of NC sponsored Blue Quality Physicians Program, or made them more attractive for recruitment into ACOs/Shared Savings Programs and other global payment programs.
Inner context measures
Solo, single-specialty, multispecialty (NAMCS-EMR Q11-13)
Degree of integration
Practice owned by physician/group, HMO, CHC, AMC, other hospital, other corp. (NAMCS-EMR Q22)
Number of physicians (NAMCS-EMR Q12)
Number of mid-level providers (NAMCS-EMR Q14)
Number of office visits in a normal week (NAMCS-EMR Q10)/per provider full time equivalent (FTE)
Percent patient care revenue from Medicare, Medicaid, private insurance, other (NAMCS-EMR Q23)
Number and use of computerized capabilities (NAMCS-EMR Q18a-Q18j)
Outer context refers to features of the economic, political, and social context within which an organization resides . Through the KI survey, we will assess the perceived influence of external events using a 3-point Likert scale (no influence to significant influence). In KI interviews, we will explore qualitatively how events rated “2” (some influence) influenced the practice’s efforts to implement evidence-based CVD prevention processes of care.
Aim 1: Evaluate the effect of primary care practice support on delivery of evidence-based CVD prevention
Our primary hypotheses are that primary care practice support will improve the percentage of patients in a practice: (a) with ischemic vascular disease who use aspirin or other antithrombotics; (b) with hypertension who have adequate blood pressure control; (c) with an LDL test performed who are prescribed a recommended dose of statin based on risk status; (d) who were screened for tobacco use and, if identified as a tobacco user, received cessation counseling and/or pharmacological therapy; and (e) who receive aspirin for primary prevention based on a 10-year CVD risk status. Our secondary hypotheses are as follows: (a) practice capacity for QI, organizational readiness to implement change, implementation climate, and contextual factors (inner and outer) will moderate the effect of primary care practice support on evidence-based CVD prevention; and (b) primary care practice support will reduce race-based disparities in evidence-based CVD prevention.
The secondary hypotheses will (a) introduce practice capacity for QI, organizational readiness to change, implementation climate, and contextual factors as main effects and effect modifiers in model (1) and introduce race as a main effect and effect modifier to examine whether primary care practice support reduces race-based disparities in the use of evidence-based CVD prevention. Examination of race will require outcome data aggregated at the practice level to be broken out by race.
Aim 2: Evaluate the effect of primary care practice support on patient-level health outcomes
Our primary hypotheses are that primary care practice support will improve the percentage of patients in a practice who indicate that their provider (a) always communicated well with them during the visit, and (b) involved them a lot of the times in shared decision-making about their medications. Our secondary hypotheses are that primary care practice support will decrease (a) the percentage of patients within a practice who were hospitalized for a cardiovascular disease-related condition, (b) the percentage of patients within a practice who were hospitalized for a cardiovascular disease-related condition or died, and (c) race-based disparities in CVD-related hospitalizations and mortality. We will explore whether primary care practice support improves the percentage of patients in a practice whose tobacco use status and overall cardiovascular risk were assessed, whose blood pressure (BP) was adequately controlled, and who received appropriate management with regard to aspirin use, tobacco cessation support, and use of statin therapy.
For the secondary hypothesis, model (2) will apply to claims data for the percentage of patients (a) hospitalized for a cardiovascular disease-related condition and (b) hospitalized for a CVD-related condition or died. For these outcomes, X it3 = 1 if t = si + 18 (6 months post-intervention) and X it3 = 0 if t = si (baseline). To assess whether primary care practice support decreases race-based disparities in these outcomes, the binomial data will be obtained for each race and practice and time point. Other facility-level patient outcomes are given in Table 4. Model (3) will be fitted to all binomial outcomes (e. g., percentage of patients…) using SAS Proc GLIMMIX. For continuous outcomes (e.g., a 10-year CVD Risk), an identity link function leading to a linear model fitted with SAS PROC MIXED will be used with variance weight 1/N it where N it is the observed number of patients in the i-th practice at the t-th month.
Statistical power for the primary hypotheses is simulated using model (3) with β 1 = β 12 = 0 and dropping g 1(t;ψ) from the model. It is based on a planned constant sample size (denominator) of N = 200 patients/practice at each time point. For the communication outcome, we assumed β 0 = 1.4 corresponding to a baseline rate of 80 % for a low ready practice (X i2 = 0). For the shared decision-making outcome, we set β 0 = −0.8 giving 30 % baseline when X i2 = 0. Finally, we fixed β 2 = 0.05 and β 3 = 0.05, variances σ 0 2 = 0.42 and σ 1 2 = 0.32, and covariance σ 01 = −0.15. These values for variance components are adopted from Aim 1 for lack of preliminary data for Aim 2. They are considered reasonable estimates because the statistical analysis for Aim 2 involves a random effects logistic regression model for repeated binomial data. Power exceeds 98 % for detecting differences as small as 0.04 in proportions between intervention and control (see Additional file 2).
Aim 3: Examine the effect of primary care practice support on implementation of clinical practice and office system changes that support delivery evidence-based CVD prevention
Our primary hypothesis is that primary care practice support will increase implementation of clinical practice and office system changes to improve evidence-based CVD prevention. Our secondary hypotheses are that (a) primary care practice support intensity will increase implementation of clinical practice and office system changes, and (b) practice capacity for QI, organizational readiness to implement change, and contextual factors will moderate the effect of primary care practice support on the implementation of clinical practice and office system changes. We will explore the acceptability of primary care practice support from the perspective of the provider champion.
We will use simple statistics to describe the frequency and distribution of positively and negatively coded comments about the acceptability of primary care practice support. We will examine whether acceptability varied by primary care practice support intensity, baseline capacity for QI, and inner and outer contextual features. We will use the qualitative data to explore the reasons why KIs found primary care practice support acceptable (or not) and recommendations they have for future efforts.
Aim 4: Evaluate the effect of practice facilitation on practice capacity to implement future evidence-based clinical guidelines
Our primary hypothesis is that primary care practice support will improve capacity to implement other evidence-based clinical guidelines in the future. Our secondary hypotheses are that (a) contextual factors will moderate the effect of primary care practice support on practice capacity to implement additional evidence-based clinical guidelines, and (b) primary care practice support will generate additional positive practice outcomes.
In secondary analyses, contextual factors will be examined as additional main effects and as statistical interactions with X it3 in order to assess whether there are effect modifiers for the effect of primary care practice support on practice capacity to implement future evidence-based clinical guidelines. To test the hypothesis that primary care practice support generated additional positive practice outcomes, we will calculate 95 % confidence intervals for proportions of practices reporting positive outcomes, both overall and stratified by practice characteristics (inner context). We will also use logistic regression to ascertain whether additional positive outcomes varied as a function of primary care practice support intensity, KDIS scores, ABCS measures, and inner context variables.
For the primary hypotheses, we conservatively calculate power by ignoring any information from individuals 6 months post-intervention and allow a 15 % dropout (N = 255). Additional file 4 shows that our minimal detectable differences are similar to mean change reported by Nutting et al. and Solberg et al., respectively, for adaptive reserve and CPCQ [10, 11].
We will explore the reasons why some practices benefited more than others by identifying themes about actions taken, missed opportunities, influential inner and outer contextual factors, and other situational factors.
Practices are being recruited. The high-readiness practices randomized to start in month 9 will receive the intervention beginning January 2016.
Practice facilitation, when combined with other quality improvement interventions, is an effective strategy for supporting the implementation of evidence-based guidelines in primary care settings . However, no previous effort has conducted a controlled trial of practice facilitation at the scale or level of intensity that we propose. Results will have significant implications for healthcare payers, government agencies, and other stakeholders seeking to use practice facilitation, alone or combined with other quality improvement interventions, to support national initiatives to scale up and spread evidence-based clinical guidelines.
Recruiting and retaining a large number of practices to engage in a yearlong, comprehensive quality improvement effort poses significant challenges. Potential recruitment barriers include fear of financial risk, reluctance to share data, acquisition by larger health systems, and competing priorities. Potential retention barriers include loss of a key clinician, resignation of a practice manager, and financial difficulties. We will attempt to mitigate these barriers by using practice facilitation to help practice achieve other goals (e.g., PCMH recognition) or enhance billing for services. Also, CCNC and AHEC will leverage their strong relationships with hospitals and health systems to boost recruitment and prevent attrition.
Our stepped-wedge study design affords some control of the effects of secular trends and other factors unrelated to our comprehensive quality improvement strategy. We will supplement this by documenting and including in our statistical analysis temporal events that could affect the implementation and outcomes of the strategy. However, the effects of outer context factors can be challenging to measure and model.
If successful, our comprehensive quality improvement strategy will have a positive impact on both practices and patients. Hundreds of small- to medium-sized primary care practices, many located in rural and medically underserved areas, will be better prepared for the transition to value-based payment, wherein an increasing proportion of reimbursement is tied to performance on quality of care measures. Likewise, discernible reductions in cardiovascular risk among the estimated 900,000 adult patients served by participating practices would likely prevent thousands of cardiovascular events within 10 years.
This research is supported by the Agency for Healthcare Research & Quality (1R18HS023912).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Heidenreich PA, Trogdon JG, Khavjou OA, Butler J, Dracup K, Ezekowitz MD, et al. Forecasting the future of cardiovascular disease in the United States: a policy statement from the American Heart Association. Circulation. 2011;123(8):933–44. doi:10.1161/CIR.0b013e31820a55f5.View ArticlePubMedGoogle Scholar
- Million Hearts: the initiative. http://millionhearts.hhs.gov/aboutmh/overview.html. Accessed September 29 2015.
- North Carolina quick facts from the US Census Bureau. http://quickfacts.census.gov/qfd/states/37000.html. Accessed June 20 2014.
- America’s health rankings: North Carolina cardiovascular deaths. 2012. http://www.americashealthrankings.org/NC/CVDDeaths/2012. Accessed June 20 2014.
- Teal R, Bergmire DM, Johnston M, Weiner BJ. Implementing community-based provider participation in research: an empirical study. Implement Sci. 2012;7:41. doi:10.1186/1748-5908-7-41.PubMed CentralView ArticlePubMedGoogle Scholar
- Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4:67. doi:10.1186/1748-5908-4-67.PubMed CentralView ArticlePubMedGoogle Scholar
- Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436. doi:10.1177/1077558708317802.View ArticlePubMedGoogle Scholar
- Weiner BJ, Belden CM, Bergmire DM, Johnston M. The meaning and measurement of implementation climate. Implement Sci. 2011;6:78. doi:10.1186/1748-5908-6-78.PubMed CentralView ArticlePubMedGoogle Scholar
- Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009;24(2):292–305. doi:10.1093/her/cyn019.View ArticlePubMedGoogle Scholar
- Solberg LI, Asche SE, Margolis KL, Whitebird RR. Measuring an organization's ability to manage change: the change process capability questionnaire and its use for improving depression care. Am J Med Qual. 2008;23(3):193–200. doi:10.1177/1062860608314942.View ArticlePubMedGoogle Scholar
- Nutting PA, Crabtree BF, Stewart EE, Miller WL, Palmer RF, Stange KC, et al. Effect of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Ann Fam Med. 2010;8 Suppl 1:S33–44. doi:10.1370/afm.1119. S92.PubMed CentralView ArticlePubMedGoogle Scholar
- Jaen CR, Ferrer RL, Miller WL, Palmer RF, Wood R, Davila M, et al. Patient outcomes at 26 months in the patient-centered medical home National Demonstration Project. Ann Fam Med. 2010;8 Suppl 1:S57–67. doi:10.1370/afm.1121. S92.PubMed CentralView ArticlePubMedGoogle Scholar
- Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci. 2014;9:7. doi:10.1186/1748-5908-9-7.PubMed CentralView ArticlePubMedGoogle Scholar
- Klein KJ, Sorra JS. The challenge of innovation implementation. Acad Manage Rev. 1996;21(4):1055–80.Google Scholar
- Halladay JR, DeWalt DA, Wise A, Qaqish B, Reiter K, Lee SY, et al. More extensive implementation of the chronic care model is associated with better lipid control in diabetes. J Am Board Fam Med. 2014;27(1):34–41. doi:10.3122/jabfm.2014.01.130070.PubMed CentralView ArticlePubMedGoogle Scholar
- Klein KJ, Sorra JS. The challenge of implementation. Acad Manag Rev. 1996;21(4):1055–80.Google Scholar
- Jacobs SR, Weiner BJ, Bunger AC. Context matters: measuring implementation climate among individuals and groups. Implement Sci. 2014;9:46. doi:10.1186/1748-5908-9-46.PubMed CentralView ArticlePubMedGoogle Scholar
- Agency for Healthcare Research and Quality. Development of the Clinician & Group Surveys. https://cahps.ahrq.gov/surveys-guidance/cg/about/Develop-CG-Surveys.html. Accessed June 2 2014.
- Agency for Healthcare Research and Quality. Patient Experience Measures from the CAHPS® Clinician & Group Surveys. Document No. 1309. 2012. https://cahps.ahrq.gov/surveys-guidance/cg/cgkit/1309_CG_Measures.pdf. Accessed May 21 2014.
- Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11 Suppl 1:S115–23. doi:10.1370/afm.1549.PubMed CentralView ArticlePubMedGoogle Scholar
- Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74. doi:10.1370/afm.1312.PubMed CentralView ArticlePubMedGoogle Scholar
- Klein KJ, Dansereau F, Hall RJ. Levels issues in theory development, data collection, and analysis. Acad Manag Rev. 1994;19(2):195–229.Google Scholar
- Klein KJ, Kozlowski SWJ. From micro to meso: critical steps in conceptualizing and conducting multilevel research. Organ Res Methods. 2000;3(3):211–36.View ArticleGoogle Scholar
- Klein KJ, Kozlowski SWJ. From micro to meso: critical steps in conceptualizing and conducting multilevel research. 2000. p. 211–36.Google Scholar
- LeBreton JM, James LR, Lindell MK. Recent issues regarding r(WG), r*(WG), r(WG)(J), and r*(WG)(J). Organ Res Methods. 2005;8(1):128–38. doi:10.1177/1094428104272181.View ArticleGoogle Scholar
- LeBreton JM, Senter JL. Answers to 20 questions about interrater reliability and interrater agreement. Organ Res Methods. 2008;11(4):815–52. doi:10.1177/1094428106296642.View ArticleGoogle Scholar
- Centers for Medicare and Medicaid Services. Physician Quality Reporting System (PQRS) Measure Specifications Manual for Claims and Registry Reporting of Individual Measures. 2013. http://www.facs.org/ahp/pqrs/2014/registry-indiv-measure-spec.pdf. Accessed May 21 2014.