Skip to main content
  • Study protocol
  • Open access
  • Published:

Applying population health approaches to improve safe anticoagulant use in the outpatient setting: the DOAC Dashboard multi-cohort implementation evaluation study protocol



Use of direct oral anticoagulants (DOAC) is rapidly growing for treatment of atrial fibrillation and venous thromboembolism. However, incorrect dosing of these medications is common and puts patients at risk of adverse drug events. One way to improve safe prescribing is the use of population health tools, including interactive dashboards built into the electronic health record (EHR). As such tools become more common, exploring ways to understand which aspects are effective in specific settings and how to effectively adapt and implement in existing anticoagulation clinics across different health systems is vital.


This three-phase project will evaluate a current nation-wide implementation effort of the DOAC Dashboard in the Veterans Health Administration (VHA) using both quantitative and qualitative methods. Informed by this evaluation, the DOAC Dashboard will be implemented in four new health systems using an implementation strategy derived from the VHA experience and interviews with providers in those new health systems. Quantitative evaluation of the VHA and non-VHA implementation will follow the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. Qualitative interviews with stakeholders will be analyzed using the Consolidated Framework for Implementation Research and Technology Acceptance Models to identify key determinants of implementation success.


This study will (1) evaluate the implementation of an EHR-based population health tool for medication management within a large, nation-wide, highly integrated health system; (2) guide the adoption in a set of four different health systems; and (3) evaluation that multi-center implementation effort. These findings will help to inform future EHR-based implementation efforts in a wide variety of health care settings.


For more than five decades, warfarin was the only available oral anticoagulant in the USA and much of the world. Since 2010, four new direct oral anticoagulants (DOACs) have been introduced into the market. All are approved by the US Food and Drug Administration (FDA) for the prevention of stroke in non-valvular atrial fibrillation (AF) and to prevent or treat venous thromboembolism (VTE). The DOACs require a different management approach than warfarin [1]. Unlike warfarin, (1) no reliable and widely available laboratory tests exist to monitor drug levels, (2) each drug is excreted in part through the kidneys, (3) drug-drug interactions impact DOAC dosing and safe use differently when compared to warfarin, and (4) dosing of DOAC medications is unique for each indication (AF, VTE, and coronary/peripheral artery disease). In fact, multiple studies have identified that as many as 1 in 7 patients have inappropriate DOAC prescriptions [2,3,4,5]. When DOACs are used inappropriately (over-dosing, under-dosing, and dosing based on the wrong indication), patients are at markedly increased risk for costly and potentially deadly bleeding and thrombotic/stroke complications [3].

Many warfarin-treated patients are managed by anticoagulation clinics due to the drug’s complex pharmacokinetics and the need for frequent laboratory-guided dose adjustment [6]. These clinics are staffed by pharmacists and nurses with expertise in thrombotic disorders and anticoagulation, have shown to improve the quality of anticoagulation care, and are associated patient outcomes over standard of care [7, 8]. The US Veterans Health Administration (VHA) has been a national leader in the use of anticoagulation clinics. Anticoagulation clinics are also common outside the VHA and may improve the safe use of warfarin [8,9,10,11,12].

The VHA is the largest vertically and horizontally integrated health systems in the world [13]. Serving over 9 million veterans in the USA, it offers services through 170 medical centers throughout the 50 states, Puerto Rico, Guam, Philippines, American Samoa, and Virgin Islands. These medical centers have over 1000 affiliated outpatient clinics, over 100 nursing homes, and other health facilities focused on care for homeless veterans, behavioral health, and substance use disorders.

Given the robust VHA network of anticoagulation clinics managing warfarin-treated patients, we previously suggested that all DOAC-treated patients should be managed similarly [14]. However, without the burden of frequent laboratory tests or dose adjustment, most prescribers do not routinely refer DOAC-treated patients to anticoagulation clinics [6]. Doing so would likely require prohibitive resources at current staffing levels. Yet half of all anticoagulation clinics provide some DOAC support, and these clinics are looking for tools to broaden their reach and impact while improving efficiency [6, 15]. Expansion of anticoagulation clinics to identify and support the care of DOAC-treated patients requires a novel approach since they are not referred as commonly as warfarin-treated patients.

Provider education is unlikely to solve this significant quality gap because of the large number of uncommon but important risks. These include (1) a variety of drug-drug interactions to both common and rare drugs; (2) different adjustments for renal function for each different drug, all of which use the Cockcroft-Gault creatinine clearance [16] rather than the estimated glomerular filtration rate equation [17]; and (3) the nuanced differences in dosing for AF and VTE for each DOAC medication. While some patients are intentionally under-dosed due to high-risk for bleeding, these errors are often unintentional and can lead to both under- and over-dosing of DOAC medications. In addition, many providers see relatively few patients taking these medications, so that the medication risks and dosing nuances are not necessarily remembered easily and addressed.

EHR alerts and dosing guidance might encourage appropriate dosing. However, alert fatigue has led many health systems to either deactivate electronic health record (EHR) drug alerts or display only the highest-risk alerts [18, 19]. Additionally, many of the DOAC dosing issues may develop after the initial prescription (e.g., progressive renal function decline, failure to change VTE lead-in dosing for apixaban or rivaroxaban after 7 or 21 days, respectively) [20, 21]. Therefore, an EHR-based alert targeted at a prescribing provider is unlikely to be highly effective.

Population health tools, such as dashboards, leverage the power of the EHR to identify patients within a large population (e.g., an entire health system) who match certain criteria (e.g., being prescribed an oral anticoagulant) and then screen for any potential red flags (e.g., inappropriate dosing for a given renal function). While not able to address all components of high-quality medication use, these tools address one critical component (appropriate dosing) in an efficient manner [22]. Such tools are currently being used for population-based management of patients with diabetes [23]. However, integration into clinical work flow and responsiveness to user feedback remain major obstacles for implementation and broad dissemination. It is also unclear how implementation success will differ between fully integrated health systems, such as VHA which is publicly funded through a capitated system, and health systems with more insurance-based funding models that pay using fee-for-service models.

The DOAC Dashboard study will evaluate and compare the implementation of a DOAC population health tool within the nation-wide VHA health system as well as four diverse health systems participating in the Michigan Anticoagulation Quality Improvement Initiative (MAQI2). Quantitative implementation evaluation will use nation-wide data from VHA and federal resources, where the DOAC Dashboard was implemented beginning in 2016, as well as data from the MAQI2 collaborative, where the DOAC Dashboard was implemented starting in 2020. Qualitative evaluation will compare determinants of implementation success in fully integrated VHA facilities with less integrated health systems participating in the MAQI2 collaborative.


Specific aims

  1. 1)

    Evaluate the effectiveness, implementation successes, and limitations of the DOAC Dashboard for safe DOAC prescribing within the national VHA system. To do this, we will measure the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) of the VHA DOAC Dashboard using both patient-level and provider-/facility-level measures. By linking data from the VHA Clinical Data Warehouse with DOAC Dashboard utilization data from VA Pharmacy Benefits Management, we will identify high- and low-user centers, individual patient and prescriber characteristics, DOAC dosing errors, and DOAC adverse event rates (bleeding and thrombotic events).

  2. 2)

    Use a systematic approach to design an implementation plan for DOAC Dashboard use outside of VHA. Informed by stakeholder qualitative interviews at VHA and non-VHA sites, we will identify key determinants of implementation success. These determinants will be paired with targeted strategies for use during the MAQI2 implementation.

  3. 3)

    Evaluate the implementation of a DOAC Dashboard for safe DOAC management within four unique and diverse health systems. Informed by the design and implementation of the VHA DOAC Dashboard, we will adapt and implement a DOAC Dashboard at four health systems participating in MAQI2. Using the existing MAQI2 registry, we will evaluate this implementation using the RE-AIM framework. We will also perform qualitative interviews at each site to assess acceptability of this care model.


The DOAC Dashboard study was reviewed and approved or deemed “not regulated” by the University of Michigan (HUM00162234 and HUM0021922) and VA Ann Arbor Institutional Review Boards (IRB-2018-1101). The study is conducted in two settings. The MAQI2 collaborative of health systems in Michigan include non-governmental urban and suburban hospitals with and without academic affiliations. The MAQI2 collaborative is funded by Blue Cross Blue Shield of Michigan, a health insurance provider, to improve the quality of anticoagulation care in the state of Michigan. Participating hospitals enter data into a shared data registry and collaboratively work on quality improvement efforts. To date, data on more than 3800 patients taking DOACs with more than 8800 6-month follow-ups have been entered into the MAQI2 registry. The four participating sites in this project all enter patients taking DOAC medications into the MAQI2 registry and all use the same EHR vender (Epic®). Quantitative and qualitative evaluations will be performed in both settings, guided by the RE-AIM, CFIR, and TAM implementation models/frameworks. Any significant protocol modifications will be communicated in journal publications after review and approval by the study leadership team. Final quantitative datasets will remain under the supervision of the VHA and MAQI2 research teams.

Phase I—Evaluate the VHA DOAC Dashboard implementation

Evaluation of the current VHA DOAC Dashboard (sample screen shots in online appendix) will follow the RE-AIM framework (Table 1) [24].

Table 1 RE-AIM evaluation of DOAC Dashboard implementation

Reach will be calculated as the number (and percent) of patients taking DOAC medications who are managed at sites with regular (at least weekly) DOAC Dashboard use. This will be calculated month-by-month during the entire study period as well as during the 3 implementation phases (defined in Table 1). VHA sites with any tool use as well as number of sites based on level of DOAC Dashboard use. Use will be calculated as the number of days each month with one or more DOAC Dashboard log in. Characteristics of the DOAC prescribers and anticoagulation clinics will be assessed for DOAC Dashboard user and non-user sites in each of three implementation phases (defined in Table 1).

The primary outcome of our evaluation of the effectiveness of the DOAC Dashboard will be inappropriate DOAC prescribing. The core secondary outcomes will be DOAC-related adverse events. Our primary predictor will be the degree of DOAC Dashboard use (number of days with any DOAC Dashboard use in the month of DOAC prescription). All analyses will start in 2014 (2 years before the introduction of the DOAC Dashboard) and continue through at least the end of 2019.

We will use a logistic mixed effects regression model to examine whether there is a decline in the rate of inappropriate DOAC prescribing at sites with higher use of the dashboard. The primary outcome variable will be inappropriate DOAC use. The main predictor of interest will be the number of days with any DOAC Dashboard log in recordings in the month of each prescription normalized for the number of DOAC patients at that site. This provides a reasonable approximation of DOAC Dashboard use. We will explore non-linear relationships between DOAC Dashboard use and the inappropriate DOAC use. We will adjust for clinical and socioeconomic characteristics, including patient age, sex, race, indication for DOAC use, creatinine clearance, risk of strokes with the CHA2DS2-VASc score [25], risk of bleeding using the HAS-BLED score [26], and comorbidity using the Charlson score with Deyo modification [27], date, and site-level characteristics, including percent of patients who are rural and percent of patients who are Black. We will account for clustering using VHA facility as a random effect.

For the secondary outcome measures, we will individually measure bleeding, VTE, stroke events, and all-cause death using Poisson or negative binomial mixed effects regression models. We will also explore a composite endpoint of bleeding, VTE, stroke, and all-cause death in a similar model. In addition to the predictor variables listed above, we will also include a variable to account for length of DOAC treatment at the patient level, as this likely would influence a patient’s risk of adverse events. Details about adverse event ascertainment can be found in the online appendix.

In sensitivity analyses, we will conduct an interrupted time series analysis to explore how different levels of DOAC Dashboard use associate with appropriate DOAC prescribing. We will use three different time points in these sensitivity analysis: (1) date when each site first used the DOAC Dashboard, (2) date when each site first had at least weekly DOAC Dashboard use (averaged over a 4 week period), and (3) date when each site first had daily DOAC Dashboard use (averaged over a 5-consecutive-day period). In this approach, the number of sites achieving each of the time points may vary, as some sites may not achieve daily Dashboard use during the study period.

Phase II—Systematic approach to implementation planning

Determinants of implementation success will be evaluated in two different settings. First, we will assess realized determinants of implementation success in the national VHA health system. This will be done by conducting semi-structured interviews with key DOAC Dashboard stakeholders (primarily pharmacists, but also physicians, nurses, managers) at different VHA centers within each use category (low/no, moderate, high). We will also identify centers with notable changes in use (e.g., initially high but then low/no use) to explore what determinants of implementation success impacted change in DOAC Dashboard use. Draft interview guide is included in the online supplemental appendix.

Second, we will assess anticipated determinants of implementation success at four non-VHA health centers participating in the MAQI2 consortium. These semi-structured interviews will include the same stakeholders as in the VHA interviews. However, these will occur before any MAQI2 site has begun to implement the DOAC Dashboard. An orientation to the DOAC Dashboard using screen shots with blinded patient data will be shown to the interviewees.

Finally, after implementation of the DOAC Dashboard has been completed at the MAQI2 site, we will re-interview stakeholders to assess their experienced determinants of implementation success. The same stakeholders will be approached, when available. New stakeholders will also be approached as appropriate.

Potential interviewees will be identified both from institutional records of who manages anticoagulation at the relevant health systems as well as through recommendations from previously interviewed stakeholders. New semi-structured interviews will be conducted until either thematic saturation is reached or all potential stakeholders have been approached. The latter is more likely to occur within the MAQI2 sites given the smaller number of potential sites (4) and stakeholders than are present within the VHA system.

After transcribing and anonymizing each interview, we will undertake a template analysis, a form of thematic analysis which uses pre-determined codes from existing frameworks (e.g., CFIR, TAM) and then refines those codes as transcripts are coded and analyzed [28]. New themes that emerge from the transcripts will be included with the pre-existing themes included from CFIR and TAM. Emergent themes that do not fit well into either CFIR or TAM will be explored using other implementation determinants frameworks (e.g., Theoretical Domains Framework [29]), or potentially as new constructs.

Themes identified from both the VHA interviews as well as the MAQI2 initial interviews will be paired with relevant implementation strategies following a behavior change technique [30, 31]. We will leverage the existing quality collaborative infrastructure, including quarterly meetings, to share key implementation resources for the DOAC Dashboard.

Phase III—Implement and evaluate the DOAC Dashboard in MAQI2 health systems

An adaptation of the VHA DOAC Dashboard will be designed within the Epic EHR system. Working iteratively with anticoagulation clinic staff, the MAQI2 DOAC Dashboard will identify patients prescribed DOAC medications and who have a primary care provider, cardiologist, hematologist, or vascular surgeon that they follow with in the ambulatory setting. The dashboard will then identify potential medication or dosing errors based on indication, drug-drug interaction, or renal function. Implementation support, including EHR support specific to the DOAC Dashboard, will be provided by the research team. Each participating MAQI2 system will determine how best to operationalize dashboard implementation and utilization. The research team will interview anticoagulation clinic managers about specific implementation strategies employed and operational details about use of the Dashboard. Ongoing data collection through the MAQI2 consortium will be utilized to assess implementation success [32].

Similar to the phase I evaluation of the VHA DOAC Dashboard, evaluation of the MAQI2 DOAC Dashboard will also follow the RE-AIM framework (Table 2) [24].

Table 2 RE-AIM evaluation of MAQI2 DOAC Dashboard implementation

Unlike for phase I in which we have access to a national dataset of patients prescribed DOAC mediations, the MAQI2 will have fewer patients and therefore fewer DOAC-related complications (e.g., bleeding, thrombosis). Therefore, the effectiveness outcome will focus on appropriate prescribing rather than adverse event rates, which can be extrapolated from VHA data and other larger data sources. With alpha level of 0.05, we will have > 80% power to detect > 2.5% absolute reduction in the inappropriate DOAC use after the introduction of DOAC Dashboard from a MAQI2 baseline of 10% inappropriate use prior to DOAC Dashboard implementation.

Plans for dissemination

The study team anticipate disseminating findings through presentations at national and/or international scientific meetings and in peer reviewed manuscripts. Manuscripts will be authored by study team members without the use of professional writers. All authors will meet the appropriate requirements outlined by the Internal Committee of Medical Journal Editors. The study team anticipate preparing a “how to” guide for developing and implementing the DOAC Dashboard in health systems using the Epic® EHR. This guide will be made publicly available through appropriate requests to the MAQI2 organization.

Anticipated challenges

While unlikely, it is possible that the VHA stakeholders generally dislike using the DOAC Dashboard and recommend against implementation in the MAQI2 centers. However, initial feedback from multiple VHA providers demonstrated a very positive reception and continued, growing use of the tool. Also, initial quality improvement work within MAQI2 has demonstrated that 50% of contacted providers end up changing the drug or dose when alerted [33]. Single-center data from VHA sites suggest that the DOAC Dashboard’s use increases pharmacist efficiency and results in more dosing changes than usual care.

Additionally, the COVID-19 pandemic has changed the way clinical care and clinical research are conducted in the USA. While the VHA Dashboard evaluation will include data from the pre-COVID-19 era, implementation in the MAQI2 centers will have to adapt for COVID-19 changes. These could include restricted staff resource to dedicate to the DOAC Dashboard and the need to access the dashboard while working remotely. From a clinical research perspective, data analysis can be performed using remote and secure virtual private networks and interviews can be conducted using videoconferencing or teleconferencing systems.

Lastly, while it is possible that some MAQI2 sites may have difficulty implementing the tool, we already have a working prototype developed within the Epic EHR at one center (University of Michigan). This demonstrates our ability to develop and implement such a tool and will provide valuable experience when implementing at other centers. We also have enthusiastic support from each of the health systems’ anticoagulation clinic leadership and a commitment to providing staff resources to implement and use the DOAC Dashboard for all patients within their health system.


Use of DOAC medications is growing rapidly both within the USA and globally. Given the increasing number of indications for anticoagulation and complexities around treatment, implementation of tools and processes to ensure safe use of these medications is critical. This study will accomplish three main goals: (1) evaluate the effectiveness of an EHR-based population health tool for medication management, (2) compare key determinants of implementation success within and outside of highly integrated health systems (e.g., VHA) to select implementation strategies, and (3) compare anticipated and experienced determinants of implementation success. These findings will help to inform future EHR-based implementation efforts in a wide variety of health care settings.

Availability of data and materials




Atrial fibrillation


Corporate data warehouse


Consolidated Framework for Implementation Research


Direct oral anticoagulant


Electronic health record


Food and Drug Administration


Michigan Anticoagulation Quality Improvement Initiative


Pharmacy Benefits Management


Reach, Effectiveness, Adoption, Implementation, Maintenance


Technology Acceptance Model


Veterans Health Administration


Venous thromboembolism


  1. Levy JH, Spyropoulos AC, Samama CM, Douketis J. Direct oral anticoagulants: new drugs and new concepts. JACC Cardiovasc Interv [Internet]. 2014;7:1333–51. Available from:

  2. Barra ME, Fanikos J, Connors JM, Sylvester KW, Piazza G, Goldhaber SZ. Evaluation of dose-reduced direct oral anticoagulant therapy. Am J Med [Internet]. 2016;129:1198–204. Available from:

  3. Steinberg BA, Shrader P, Thomas L, Ansell J, Fonarow GC, Gersh BJ, et al. Off-label dosing of non-vitamin K antagonist oral anticoagulants and adverse outcomes: The ORBIT-AF II Registry. J Am Coll Cardiol [Internet]. 2016;68:2597–604. Available from:

  4. Trujillo-Santos J, Di Micco P, Dentali F, Douketis J, Diaz-Peromingo JA, Nunez MJ, et al. Real-life treatment of venous thromboembolism with direct oral anticoagulants: The influence of recommended dosing and regimens. Thromb Haemost [Internet]. 2016/10/28. 2017;117:382–9. Available from:

  5. Basaran O, Filiz Basaran N, Cekic EG, Altun I, Dogan V, Mert GO, et al. PRescriptiOn PattERns of oral anticoagulants in nonvalvular atrial fibrillation (PROPER study). Clin Appl Thromb Hemost [Internet]. 2015/11/01. 2017;23:384–91. Available from:

  6. Barnes GD, Kline-Rogers E, Graves C, Puroll E, Gu X, Townsend K, et al. Structure and function of anticoagulation clinics in the United States: an AC forum membership survey. J Thromb Thrombolysis. 2018.

  7. Phelps E, Delate T, Witt DM, Shaw PB, McCool KH, Clark NP. Effect of increased time in the therapeutic range on atrial fibrillation outcomes within a centralized anticoagulation service. Thromb Res [Internet]. 2018/02/07. 2018;163:54–9. Available from:

  8. Manzoor BS, Cheng WH, Lee JC, Uppuluri EM, Nutescu EA. Quality of pharmacist-managed anticoagulation therapy in long-term ambulatory settings: a systematic review. Ann Pharmacother [Internet]. 2017/07/25. 2017;51:1122–37. Available from:

  9. Garrison SR, Allan GM. Do specialty anticoagulation clinics really outperform primary care at INR management? J Thromb Thrombolysis [Internet]. 2014;38:420–1. Available from:

  10. McGuinn TL, Scherr S. Anticoagulation clinic versus a traditional warfarin management model. Nurse Pr [Internet]. 2014;39:40–6. Available from:

  11. Stoudenmire LG, DeRemer CE, Elewa H. Telephone versus office-based management of warfarin: impact on international normalized ratios and outcomes. Int J Hematol [Internet]. 2014;100:119–24. Available from:

  12. Entezari-Maleki T, Dousti S, Hamishehkar H, Gholami K. A systematic review on comparing 2 common models for management of warfarin therapy; pharmacist-led service versus usual medical care. J Clin Pharmacol [Internet]. 2016;56:24–38. Available from:

  13. About VHA - Veterans Health Administration [Internet]. [cited 2020 Jul 23]. Available from:

  14. Barnes GD, Nallamothu BK, Sales AE, Froehlich JB. Reimagining anticoagulation clinics in the era of direct oral anticoagulants. Circ Cardiovasc Qual Outcomes. 2016;9.

  15. Barnes GD, Acosta J, Graves C, Puroll E, Kline-Rogers E, Gu X, et al. Barriers to integrating direct oral anticoagulants into anticoagulation clinic care: a mixed-methods study. Res Pr Thromb Haemost [Internet]. 2019/01/19. 2019;3:79–84. Available from:

  16. Cockcroft DW, Gault MH. Prediction of creatinine clearance from serum creatinine. Nephron [Internet]. 1976;16:31–41. Available from:

  17. Stevens LA, Schmid CH, Greene T, Zhang YL, Beck GJ, Froissart M, et al. Comparative performance of the CKD Epidemiology Collaboration (CKD-EPI) and the Modification of Diet in Renal Disease (MDRD) Study equations for estimating GFR levels above 60 mL/min/1.73 m2. Am J Kidney Dis [Internet]. 2010;56:486–95. Available from:

  18. Carli D, Fahrni G, Bonnabry P, Lovis C. Quality of decision support in computerized provider order entry: systematic literature review. JMIR Med Inf [Internet]. 2018/01/26. 2018;6:e3. Available from:

  19. Backman R, Bayliss S, Moore D, Litchfield I. Clinical reminder alert fatigue in healthcare: a systematic literature review protocol using qualitative evidence. Syst Rev [Internet]. 2017/12/15. 2017;6:255. Available from:

  20. Minhas AS, Jiang Q, Gu X, Haymart B, Kline-Rogers E, Almany S, et al. Renal function in atrial fibrillation patients switched from warfarin to a direct oral anticoagulant. J Thromb Thrombolysis. 2016;42.

  21. Becattini C, Giustozzi M, Ranalli MG, Bogliari G, Cianella F, Verso M, et al. Variation of renal function over time is associated with major bleeding in patients treated with direct oral anticoagulants for atrial fibrillation. J Thromb Haemost [Internet]. 2018/02/21. 2018;16:833–41. Available from:

  22. Valencia D, Spoutz P, Stoppi J, Kibert JL II, Allen A, Parra D, et al. Impact of a direct oral anticoagulant population management tool on anticoagulation therapy monitoring in clinical practice. Ann Pharmacother [Internet]. 2019/03/12. 2019;1060028019835843. Available from:

  23. Eggleston EM, Klompas M. Rational use of electronic health records for diabetes population management. Curr Diab Rep [Internet]. 2014/03/13. 2014;14:479. Available from:

  24. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Heal [Internet]. 1999;89:1322–7. Available from:

  25. Lip GY, Nieuwlaat R, Pisters R, Lane DA, Crijns HJ. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation. Chest [Internet]. 2009/09/19. 2010;137:263–72. Available from:

  26. Pisters R, Lane DA, Nieuwlaat R, de Vos CB, Crijns HJ, Lip GY. A novel user-friendly score (HAS-BLED) to assess 1-year risk of major bleeding in patients with atrial fibrillation: the Euro Heart Survey. Chest [Internet]. 2010/03/20. 2010;138:1093–100. Available from:

  27. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol [Internet]. J Clin Epidemiol; 1992 [cited 2020 Jul 8];45:613–9. Available from:

  28. Brooks J, McCluskey S, Turley E, King N. The utility of template analysis in qualitative psychology research. Qual Res Psychol [Internet]. 2015/04/03. 2015;12:202–22. Available from:

  29. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci [Internet]. 2012;7:37. Available from:

  30. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From Theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol [Internet]. 2008;57:660–80. Available from:

  31. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci [Internet]. 2015/04/19. 2015;10:21. Available from:

  32. Barnes GD, Li Y, Gu X, Haymart B, Kline-Rogers E, Ali MA, et al. Periprocedural bridging anticoagulation in patients with venous thromboembolism: a registry-based cohort study. J Thromb Haemost [Internet]. Wiley; 2020 [cited 2020 Jun 25]; Available from:

  33. Dawson T, Decamillo D, Kline-Rogers E, Haymart B, Froehlich JB, Barnes GD. Correcting inappropriate prescribing of direct oral anticoagulants: a population health approach. Res Pr Thromb Haemost. 2018;2:229.

    Google Scholar 

Download references




This project is funded by the Agency for Healthcare Research and Quality (R18HS026874) and Blue Cross Blue Shield of Michigan/Blue Care Network. The funding organizations had no role in the development of this study protocol, preparation of the study protocol, or decision for manuscript publication.

Author information

Authors and Affiliations



GDB is the principal investigator and drafted the manuscript. All authors contributed to the conception and design of the study as well as provided critical revisions to the protocol manuscript. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Geoffrey D. Barnes.

Ethics declarations

Ethics approval and consent to participate

This research project has been approved by Institutional Review Boards at the Ann Arbor Veterans Health Administration and University of Michigan Medical School

Consent for publication


Competing interests

GB—consulting for Pfizer/Bristol-Myers Squibb, Janssen, Portola, and Acelis Connected Health; Grant funding from Pfizer/Bristol-Myers Squibb, Blue Cross-Blue Shield of Michigan

AA—consulting for Pfizer/Bristol-Myers Squibb and Roche Diagnostics; Speaking Bureaus for Janssen and Portola

All others—no disclosures

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

VHA DOAC Dashboard Screenshots. ICD Codes for Adverse Clinical Events. DOAC Dashboard Barriers and Facilitators Exploratory Research, Discussion Guide for Anticoagulation Clinic (PharmD, RN)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Barnes, G.D., Sippola, E., Dorsch, M. et al. Applying population health approaches to improve safe anticoagulant use in the outpatient setting: the DOAC Dashboard multi-cohort implementation evaluation study protocol. Implementation Sci 15, 83 (2020).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: