- Open Access
- Open Peer Review
The effect of a clinical decision support system on prompting an intervention for risky alcohol use in a primary care smoking cessation program: a cluster randomized trial
Implementation Sciencevolume 14, Article number: 85 (2019)
Clinical decision support systems (CDSSs) may promote practitioner adherence to evidence-based guidelines. This study examined if the addition of a CDSS influenced practitioner delivery of a brief intervention with treatment-seeking smokers who were drinking above recommended alcohol consumption guidelines, compared with practitioners who do not receive a CDSS prompt.
This was a cluster randomized controlled trial conducted in primary health care clinics across Ontario, Canada, implementing the Smoking Treatment for Ontario Patients (STOP) smoking cessation program. Clinics randomized to the intervention group received a prompt when a patient reported consuming alcohol above the Canadian Cancer Society (CCS) guidelines; the control group did not receive computer alerts. The primary outcome was an offer of an appropriate educational alcohol resource, an alcohol reduction workbook for patients drinking above the CCS guidelines, and an abstinence workbook to patients scoring above 20 points in the AUDIT screening tool; the secondary outcome was patient acceptance of the resource. The tertiary outcome was patient abstinence from smoking, and alcohol consumption within CCS guidelines, at 6-month follow-up. Results were analyzed using a generalized estimation approach for fitting logistic regression using a population-averaged method.
Two hundred and twenty-one clinics across Ontario were randomized for this study; 110 to the intervention arm and 111 to the control arm. From the 15,222 patients that enrolled in the smoking cessation program, 15,150 (99.6% of patients) were screened for alcohol use and 5715 patients were identified as drinking above the CCS guidelines. No statistically significant difference between groups was seen in practitioner offer of an educational alcohol resource to appropriate patients (OR = 1.19, 95% CI 0.88–1.64, p = 0.261) or in patient abstinence from smoking and drinking within the CCS guidelines at 6-month follow-up (OR = 0.93, 95% CI 0.71–1.22, p = 0.594). However, a significantly greater proportion of patients in the intervention group accepted the alcohol resource offered to them by their practitioner (OR = 1.48, 95% CI 1.01–2.16, p = 0.045).
A CDSS may not increase the likelihood of practitioners offering an educational alcohol resource, though it may have influenced patients’ acceptance of the resource.
This trial is registered with ClinicalTrials.gov, number NCT03108144, registered on April 11, 2017, “retrospectively registered”.
Implementation science is focused on understanding and accelerating the integration of research findings and research-based innovation into everyday practice settings to improve health. This is critical given the substantial barriers between evidence-based knowledge and practice across all health care disciplines . Health care practitioner decision-making is a highly complex and contextually dependent process. Non-adherence of practitioners to practice guidelines is common; there are intensive efforts by administrators and quality improvement specialists to promote evidence-based decision-making in a range of clinical settings . Practitioner non-adherence has been identified as one of the most critical gaps impeding improvements in the health of people across the cancer control continuum . For example, cancer risk due to dual tobacco and alcohol consumption can potentially be minimized by following recommended guidelines to provide screening, brief interventions, and referrals to treatment (SBIRT) to eligible patients in a primary care setting.
Although best-practice guidelines recommend treating tobacco and alcohol dependence concurrently to increase the chance of quit success for both substances [4, 5], treatment is often delivered separately [4,5,6,7,8,9,10], despite evidence of the multiplicative, positively associated risk for aero-digestive, and other related cancers resulting from the combined use of alcohol and tobacco [11,12,13,14,15,16,17,18,19,20,21].
Clinical decision support systems (CDSSs) have long been suggested as a way to promote practitioner adherence to evidence-based guidelines . Researchers have shown the effectiveness of CDSS in improving prescribing practices [23,24,25], reducing medication errors [25, 26], improving preventive care (such as vaccination, smoking cessation, breast cancer screening) , and in ordering and recommending patients to clinical studies .
CDSS supports practitioners by synthesizing and integrating patient-specific information, performing complex evaluations, and presenting results in a timely fashion . Given the increased use of electronic medical records in primary care offices, broader implementation of CDSS has become possible, offering an opportunity to improve evidence-based care.
While CDSS has been shown to be effective in improving health care processes across various clinical settings, it should be noted that over 30% of the studies assessed in a systematic review did not demonstrate improved clinical practice as a result of CDSS . In addition, achieving large-scale adoption of CDSS remains a challenge .
This cluster randomized controlled trial aimed to assess whether the addition of a web-based CDSS—designed to prompt practitioners in real time to conduct SBIRT with patients who are drinking above recommended alcohol consumption guidelines—influences the probability of practitioners delivering a brief intervention to their eligible patients attempting to quit smoking compared to those practitioners who did not receive a prompt during the clinical encounter. A cluster randomized trial, with clinics as the units of randomization and patients as the unit of analysis, was chosen to prevent contamination that would result if practitioners working within a clinic were exposed to both arms of the trial. This trial—addressing combined alcohol and tobacco use—will be referred to as COMBAT throughout this paper.
The Interactive Systems Framework (ISF) for Dissemination and Implementation  guided the implementation of this study. ISF includes three systems that need to interact with one another to implement scientific knowledge: the synthesis and translation system, the support system, and the delivery system. As applied to this study, the synthesis and translation system consisted of an infographic, newsletters, and a slide deck that translated the latest research findings on the risks of alcohol and tobacco use into friendly formats for practitioners. As part of the support system, two 60-min-long interactive web-based SBIRT trainings delivered by Dr. Selby, the Director of Medical Education and Clinician Scientist at CAMH, were offered before the launch of the COMBAT trial both aiming to build the capacity of practitioners to deliver an alcohol intervention to their smoking patients. The recordings of these webinars can be seen at: https://adobe.ly/2XfXzMs and https://adobe.ly/2SeaR8D. All practitioners were invited to participate in the live webinars, and recordings of the webinars were shared with all practitioners. Primary health care clinics in Ontario, Canada, implementing an existing smoking cessation treatment program, the Smoking Treatment for Ontario Patients (STOP) program, are the delivery system. The STOP program is an established smoking cessation program implemented in health care organizations across Ontario, Canada. The STOP program offers up to 26 weeks of smoking cessation treatment, consisting of nicotine replacement therapy and behavioral counseling, at no cost to the patient. It is a real-world, pragmatic, smoking cessation service in which treatment is individually tailored to the patient by their STOP practitioner who can be a nurse, doctor, or social worker. Within a 1-year program of care, there is no mandated number of clinical care visits between practitioners and participants.
For this study, we examined if a CDSS would facilitate practitioners to deliver a brief alcohol intervention and an appropriate alcohol resource, an alcohol reduction workbook to their STOP patients drinking above the Canadian Cancer Society (CCS) guidelines (defined below) but below the AUDIT cutoff of 20 points, and alcohol abstinence resource to patients scoring above the AUDIT cutoff of 20 points. All brief interventions had to be given face to face by their STOP practitioner at the time they enrolled in the STOP program.
Study design and setting
We conducted a pragmatic cluster randomized controlled trial (COMBAT), with parallel intervention and control groups, in primary health care clinics (clusters) in Ontario implementing the STOP program, between April 2016 and September 2017. At the time the COMBAT trial was implemented, 150 out of 184 family health teams (FHTs), 59 out of 67 community health centers (CHCs), and 17 out of 23 nurse practitioner-led clinics (NPLCs) in Ontario were delivering the STOP program and over 67,000 patients had enrolled by FHTs, CHCs, or NPLCs.
Practitioners can enroll patients in the STOP program using paper-based forms or a web-based data capture tool—the STOP portal. The STOP portal is a centralized system for recording and monitoring patient information, managing nicotine replacement inventory, and receiving real-time progress reports for the practice.
To be included in the COMBAT study, clinics had to be operational in the STOP program as of March 14, 2016, and use the STOP portal. Patients provided consent to enroll in the STOP program. The detailed protocol for this study has been published . The study was approved by the Research Ethics Board of the Centre for Addiction and Mental Health.
A study investigator (DB) stratified allocation assignments by clinic type (FHTs, CHCs, NPLCs) and predicted size (small, large) in a 1:1 allocation ratio to balance clinic-level characteristics between study arms. Actual clinic size was not known a priori therefore the predicted clinic size was estimated based on prior STOP enrollment; for each clinic type, two levels of clinic size were set such that the expected total enrollment in the two levels would be balanced. The allocation schedule was computer generated using statistical computer software Stata v13 . Two study staff were un-blinded to allocation results so as to facilitate implementation of the random allocation sequence within the CDSS. Clinics were randomized en masse and, though not blinded to randomization assignment, were not informed of their allocation until the trial began. Specifically, clinics were informed that alcohol use was being addressed in the STOP study, but were not informed that some clinics were receiving a CDSS (which alerted practitioners of patients drinking above the CCS guidelines and guided them to provide an appropriate alcohol intervention and offer an appropriate alcohol resource) while others were not receiving the CDSS. All patients meeting patient-level eligibility criteria (described below) at enrollment during the study period were included in the study; patients were unaware of their study participation. Except for DB, who conducted the analysis, all investigators remained blinded until the last follow-up survey was completed. DB was blinded until the time of the analysis.
Eligible patients were cigarette smokers who sought help via their clinic to quit smoking, reduce smoking, or maintain an existing quit attempt; who were drinking above Canadian Cancer Society (CCS) guidelines (defined below); and who enrolled in English, with their practitioner completing online (i.e., using the online portal) the enrollment procedures with them present.
The intervention consisted of an online portal-embedded CDSS that (1) identified patients drinking above the CCS guidelines by automatically scoring and interpreting the results of the two evidence-based screening tools, a 7-day timeline followback (TLFB) questionnaire  and the Alcohol Use Disorders Identification Test (AUDIT) . The CCS guidelines  recommend women drink less than one alcoholic beverage and men less than two alcoholic beverages a day. In the absence of explicit guidance on whether these guidelines refer to average consumption over a period of days or consumption on any given day, we interpreted the recommendation as being consistent with average consumption. Thus, patients drinking above the CCS guidelines were operationally defined as women consuming seven or more and men consuming 14 or more alcoholic beverages (13.6 g per standard drink) in the past week and/or any patients consuming five or more alcoholic beverages on one occasion; (2) prompted practitioners to provide a brief alcohol reduction or abstinence intervention; (3) prompted practitioners to provide a resource to stop drinking (to patients scoring above the AUDIT cutoff of 20 points) or reduce drinking (to patients drinking above the CCS guidelines but below the AUDIT cutoff). The alcohol reduction workbook was co-created with STOP patients and based on existing evidence-based resources . The abstinence resource had provincial resources for the patient to help support abstaining from alcohol.
Control clinics continued to use the online portal for enrollment of treatment-seeking smokers. They had access to the same screening questions and resources available to those in the intervention arm but did not receive computer alerts identifying patients who drank above guidelines, nor any guidance on which intervention to provide.
The primary outcome of the study was the offer of an appropriate educational alcohol resource, matched to the severity on the AUDIT score reported in the STOP baseline enrollment survey—an alcohol reduction workbook for patients drinking above the CCS guidelines and an abstinence resource to patients scoring above the AUDIT cutoff of 20 points. A practitioner’s offer of an educational resource was measured dichotomously—yes or no—for each eligible patient in both control and intervention groups.
Given that patients can refuse practitioners’ offer of resources, the secondary outcome of the study measured the acceptance of an educational alcohol resource by patients exceeding alcohol use guidelines. Practitioners recorded whether the patient declined the resource in the online portal. The secondary outcome was also measured dichotomously—yes or no—for each eligible patient in both study arms.
The tertiary outcome was abstinence from smoking, and alcohol consumption within the CCS guidelines, measured via a 6-month follow-up survey sent to all eligible patients. Smoking abstinence was defined by a negative response to the question “Have you had a cigarette, even a puff, in the last 7 days?” Alcohol consumption at follow-up was measured using the same survey items as those used in the baseline survey (described previously).
Sample size determination
Based on measures of alcohol consumption [36, 37] used in the STOP program prior to the start of the COMBAT trial, and accounting for intra-cluster correlation within each clinic as well as unequal enrollment by clinic, an enrollment of 23 participants per clinic was assumed over the 12-month course of this trial, in 189 clinics, for a total of 4347 subjects exceeding the CCS guidelines, with enrollment size varying by a coefficient of 1.04. This analysis set alpha = 0.05, power = 80%, and estimated an intra-cluster correlation coefficient of 0.04. Since there were no available estimates of the trial’s primary outcome measure prior to the initiation of the trial, the minimum detectable effect size was estimated for a range of values of P1, the proportion of control group enrollments in which practitioners delivered the brief intervention. The estimated detectable effect size ranged from a relative risk of 1.45 (if P1 = 0·1) to 1.04 (if P1 = 0·9).
An un-blinded third-party consultant conducted an interim analysis in the form of a power calculation 8 months following the study launch, once estimates of P1 (defined above) were available. As described above, a method was used that accounts for intra-cluster correlation within each clinic as well as unequal enrollment by clinic [38, 39]. The observed average cluster size was 30 and cluster sizes varied by a coefficient of 1.12, resulting in a design effect of 6.13. Setting alpha = 0.05, the consultant, un-blinded to treatment allocation, obtained an estimate of P1 from the data collected to that date. To detect a relative risk of 1.20, the required sample size was estimated to be 5308. Therefore, the recruitment period was extended to 17 months, when that sample size was achieved.
Descriptive statistics compared cluster-level and patient-level baseline characteristics between the two treatment groups. Results were analyzed using a generalized estimation approach for fitting logistic regression using a population-averaged method. Stratification variables were included as covariates. To account for clustering, an exchangeable correlation matrix and robust standard errors were specified . The following self-reported baseline variables were treated as potential confounders: sex; age; body mass index; identifying as First Nations, Inuit, or Métis; household income; employment status; educational attainment; depression; heaviness of smoking index; Audit C score, marijuana use; opioid use; treatment for mental health problem; drug treatment; and comorbid conditions. None of the listed potential confounders changed the estimated treatment effect by at least 10% and therefore were not included in the final models. As the primary and secondary outcomes were captured by the online portal, there were no missing outcome data. The tertiary outcome was missing for 53% of participants; therefore, imputation was not conducted and complete case analyses were conducted for the purposes of hypothesis generation. Because the intra-cluster correlation coefficient was estimated to be negative, logistic regression without adjustment for clustering was used . All analyses followed an intention-to-treat approach in which clusters were analyzed in the intervention arm to which they were originally assigned and participants that in which they enrolled.
Of the 222 practices (148 FHTs, 57 CHCs, and 17 NPLCs) that were assessed for eligibility, one practice was excluded because it was not using the STOP online portal. The remaining 221 practices were randomized: 110 practices (74 FHTs, 28 CHCs, and 8 NPLCs) were assigned to the intervention group, and 111 practices (74 FHTs, 28 CHCs, and 9 NPLCs) were assigned to the control group. Seventeen practices in the intervention group and 19 practices in the control group did not recruit any eligible patients during the study period (one site stopped recruiting STOP participants; 35 enrolled patients into STOP, but none were eligible for COMBAT); thus, data was only collected from 185 practices (93 intervention sites and 92 control sites). In total, 5715 patients drinking above the CCS guidelines were enrolled (Fig. 1). These patients comprise our main analytic sample. Figure 1 shows the number and types of practices who were enrolled, allocated, and analyzed in the COMBAT study.
Baseline characteristics for the individual and cluster level were similar in the intervention and the control groups (Table 1). Most patients had graduated high school, were daily smokers, and reported having an average of ten drinks containing alcohol in the week prior to their STOP enrollment. Approximately a third of patients had a household income below $40,000, which is below the low-income threshold for a family of Ontario’s average size of three . Sites were located in all 14 local health integration networks (LHINs) across the province. Most sites had been implementing the smoking cessation program for at least 4 years prior to the launch of this study.
Patient and clinic characteristics in each study arm are provided in Table 1.
As shown in Table 2, there was no significant difference between study arms in patients being offered an appropriate educational alcohol resource or in patients being abstinent from smoking and drinking within the CCS guidelines at the 6-month follow-up survey. However, a significantly greater proportion of patients in the intervention group accepted the educational alcohol resource offered by their practitioner than patients in the control group.
Providing primary care clinics offering a smoking cessation program with a CDSS did not result in an increase in eligible patients being offered an educational alcohol resource compared with usual care. However, providing clinics with a CDSS did result in an increase in the acceptance of an offered resource; patients were significantly more likely to accept the resource if their clinic had access to the CDSS. These results also provide compelling evidence that it is feasible (under the favorable conditions the STOP program provides) to achieve widespread adoption of a CDSS as well as to screen for alcohol use in primary care settings with smokers engaged in treatment for tobacco dependence; over 17 months, 99.6% of patients were screened for alcohol use and 45% of those who were drinking above the CCS guidelines were offered a brief intervention and an educational resource (i.e., referral to treatment). Compared to findings from a recently published study integrating SBIRT into primary care for alcohol abuse, among other substance use disorders and mental health conditions, alcohol screening in this trial was found to be high (56.8% vs 99.6%) . Thus, the intervention was successful in integrating alcohol screening into primary care for alcohol use among smokers wanting to quit smoking.
Even though we developed the CDSS following the recommended features identified in a systematic review (the decision support was part of the routine workflow, a computer system was used to provide decision support, an explicit patient-specific recommendation was given, and the decision support was delivered at the time and location of decision-making) , our study did not find an effect of a CDSS on practitioners’ behavior (i.e., offering of the alcohol resource). This result is consistent with some previous studies; some systematic reviews of the effect of CDSS on practitioners’ behavior have found an effect [26, 28, 45,46,47,48] while others have not [49, 50]. The lack of effect in this study may reflect the health behavior that our CDSS targeted; several studies have shown that practitioners are not comfortable addressing alcohol with their patients [51, 52]. However, if practitioners decide to address alcohol, the CDSS might alter some contextual factor that impacted the likelihood of accepting the resource, helping explain the effect observed between CDSS and our secondary outcome. Unfortunately, the large proportion of non-response for the tertiary outcome measured on the patient follow-up survey limited our ability to answer the research question as intended but is presented nonetheless for the purpose of hypothesis generation. We did not find an association between the CDSS and patient smoking and drinking behavior at follow-up. This is consistent with prior studies , though these have been of small sample size and therefore were underpowered. Compared to findings from a recently published study, alcohol screening in this trial was found to be high (33% vs 99.6%) but providing a brief intervention was lower (54.8% vs 45%) .
Some limitations should be noted. The offer of an educational alcohol resource was only measured at a patient’s initial visit (which was for the purpose of enrolling in a smoking cessation program, not to receive help with the alcohol consumption); any offer that may have occurred during a future visit was not captured by the portal and reflect outcomes that this study is not able to address. In addition, our primary and secondary outcome relied on self-reports from practitioners, which might not be an accurate representation of actually proving a brief alcohol intervention and offering a resource. However, there is no reason to believe that this would be differential between study groups and therefore, if present, is unlikely to have biased the associations.
Although the primary outcome was recorded by the online portal, for seven patients, a malfunction occurred such that the practitioner completing the online enrollment procedures with the patient present was not presented with the option to provide take home alcohol reduction/abstinence resources to the patient, and these patients were treated as not having received an offer. However, this malfunction did not affect internal validity, as even if the malfunction was fully differential with respect to treatment arm, and the seven patients were either treated as having received an offer, or excluded entirely, the study results would not change substantively.
As noted in our protocol manuscript , the practitioner could potentially be employed at multiple clinics that may be assigned to different arms of this study (i.e., control and intervention). In this case, there is the possibility of contamination of knowledge; a practitioner might apply knowledge from the CDSS alerts in the intervention group to patients based at a control group clinic. This contamination could potentially compromise the effect of the trial, leading to a more conservative reporting estimate of the study’s overall effect.
Although all practitioners were offered online SBIRT training, we do not know which practitioners actually attended the training, and thus we cannot analyze the effect of the training on the offering of an educational alcohol resource. This analysis could have helped contextualize our results and offer further implementation recommendations.
Finally, our results may not be generalizable to other clinics seeking to implement similar CDSS since our study was pragmatic and occurred within the context of the STOP program. STOP program offers clinics with various resources (e.g., community of practice, ongoing operational support), which might impact the support system that the clinics received.
This large study augments an evolving literature and shows that the provision of a CDSS may not increase practitioners’ offer of an educational alcohol resource and adherence to guidelines but may increase the likelihood of patients’ being receptive to accepting an alcohol resource. Identifying effective strategies that increase practitioners offering a brief intervention to smokers drinking above the CCS guidelines are still needed. Future studies could investigate strategies that increase practitioners’ adherence to SBIRT based on the CCS guidelines as well as identify contexts in which CDSS use is most effective. Based on the results of this study, future research could also examine if CDSS influence practitioner delivery of a brief intervention and offer of resources (e.g., persuasiveness of messaging) and if that consequently affects patient acceptance of an offer.
Availability of data and materials
The datasets generated and/or analyzed during the current study are not publicly available due to the fact that they contain personal health information, but are available from the corresponding author on reasonable request.
Alcohol Use Disorders Identification Test
Canadian Cancer Society
Clinical decision support system
Community health centers
Personalized patient alerts and care pathways to prompt prevention interventions for combined alcohol and tobacco users in primary care
Family health team
Interactive Systems Framework
Local health integration networks
Nurse practitioner-led clinics
Screening, brief intervention, and referral to treatment
Smoking Treatment for Ontario Patients
Lang ES, Wyer PC, Haynes RB. Knowledge translation: closing the evidence-to-practice gap. Ann Emerg Med. 2007;49(3):355–63.
Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6(1):26.
Epstein RM, Street RLJ. Patient-centered communication in cancer care: promoting healing and reducing suffering. In: Contract No. Bethesda, MD: National Cancer Institute; 2007. p. 07–6225.
Gulliver SB, Kamholz BW, Helstrom AW. Smoking cessation and alcohol abstinence: what do the data tell us? Alcohol Res. 2006;29(3):208.
Baca CT, Yahne CE. Smoking cessation during substance abuse treatment: what you need to know. J Subst Abuse Treat. 2009;36(2):205–19.
Bobo J, Davis C. Cigarette smoking cessation and alcohol treatment. Addiction. 1993;88:405–12.
Bobo JK, McIlvain HE, Lando HA, Walker RD, Leed-Kelly A. Effect of smoking cessation counseling on recovery from alcoholism: findings from a randomized community intervention trial. Addiction (Abingdon, England). 1998;93(6):877–87.
Prochaska J, Delucchi K, Hall S. A meta-analysis of smoking cessation interventions with individuals in substance abuse treatment or recovery. J Consult Clin Psychol. 2004;72(6):1144–56.
Lim AC, Courtney KE, Moallem NR, Allen VC Jr, Leventhal AM, Ray LA. A brief smoking cessation intervention for heavy drinking smokers: treatment feasibility and acceptability. Front Psych. 2018;9:362.
Ahacic K, Allebeck P, Thakker KD. Being questioned and receiving advice about alcohol and smoking in health care: associations with patients’ characteristics, health behavior, and reported stage of change. Subst Abuse Treat Prev Policy. 2010;5(1):30.
Nilsen P, Aalto M, Bendtsen P, Seppa K. Effectiveness of strategies to implement brief alcohol intervention in primary healthcare. A systematic review. Scand J Prim Health Care. 2006;24(1):5–15.
Blot W. Alcohol and cancer. Cancer Res. 1992;52(2119 s):2123 s.
Franceschi S, Talamini R, Barra S, Barón A, Negri E, Bidoli E, et al. Smoking and drinking in relation to cancers of the oral cavity, pharynx, larynx, and esophagus in Northern Italy. Cancer Res. 1990;50(20):6502–7.
Pelucchi C, Gallus S, Garavello W, Bosetti C, La Vecchia C. Cancer risk associated with alcohol and tobacco use: focus on upper aero-digestive tract and liver. Alcohol Res Health. 2006;29(3):193–8.
Chiolero A, Wietlisbach V, Ruffieux C, Paccaud F, Cornuz J. Clustering of risk behaviors with cigarette consumption: a population-based survey. Prev Med. 2006;42(5):348–53.
Dawson D. Drinking as a risk factor for sustained smoking. Drug Alcohol Depend. 2000;59(3):235–49.
Falk D, Yi H, Hiller-Sturmhöfel S. An epidemiologic analysis of co-occurring alcohol and tobacco use and disorders: findings from the National Epidemiologic Survey on Alcohol and Related Conditions. Alcohol Res Health. 2006;29(3):162–71.
De P. The Canadian Cancer Society’s perspective on alcohol and the evidence supporting it. Canadian Cancer Society. 2013.
Durazzo TC, Cardenas VA, Studholme C, Weiner MW, Meyerhoff DJ. Non-treatment-seeking heavy drinkers: effects of chronic cigarette smoking on brain structure. Drug Alcohol Depend. 2007;87(1):76–82.
Meyerhoff DJ, Tizabi Y, Staley JK, Durazzo TC, Glass JM, Nixon SJ. Smoking comorbidity in alcoholism: neurobiological and neurocognitive consequences. Alcohol Clin Exp Res. 2006;30(2):253–64.
Rehm J, Anderson P, Manthey J, Shield KD, Struzzo P, Wojnar M, et al. Alcohol use disorders in primary health care: what do we know and where do we go? Alcohol Alcohol (Oxford, Oxfordshire). 2016;51(4):422–7.
Schiff GD, Rucker TD. Computerized prescribing: building the electronic infrastructure for better medication usage. JAMA. 1998;279(13):1024–9.
Bennett JW, Glasziou PP. Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials. Med J Aust. 2003;178(5):217–22.
Walton RT, Harvey E, Dovey S, Freemantle N. Computerised advice on drug dosage to improve prescribing practice. Cochrane Database Syst Rev. 2001;(1):Cd002894.
Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43.
Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003;163(12):1409–16.
Balas EA, Weingarten S, Garb CT, Blumenthal D, Boren SA, Brown GD. Improving preventive care by prompting physicians. Arch Intern Med. 2000;160(3):301–8.
Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. Jama. 1998;280(15):1339–46.
McGinn TG, McCullagh L, Kannry J, Knaus M, Sofianou A, Wisnivesky JP, et al. Efficacy of an evidence-based clinical decision support in primary care practices: a randomized clinical trial. JAMA Intern Med. 2013;173(17):1584–91.
Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3-4):171–81.
Minian N, Baliunas D, Zawertailo L, Noormohamed A, Giesbrecht N, Hendershot CS, et al. Combining alcohol interventions with tobacco addictions treatment in primary care-the COMBAT study: a pragmatic cluster randomized trial. Implement Sci. 2017;12(1):65.
StataCorp. Stata Statistical Software: Release 13. Release 13 ed. College Station. TX: StataCorp; 2013.
Sobell LC, Sobell MB. Alcohol timeline followback users’ manual. Toronto, Canada: Addiction Research Foundation; 1995.
Gomez A, Conde A, Santana JM, Jorrin A. Diagnostic usefulness of brief versions of Alcohol Use Disorders Identification Test (AUDIT) for detecting hazardous drinkers in primary care settings. J Stud Alcohol. 2005;66(2):305–8.
Minian N, Noormohamed A, Zawertailo L, Baliunas D, Giesbrecht N, Le Foll B, et al. A method for co-creation of an evidence-based patient workbook to address alcohol use when quitting smoking in primary care: a case study. Res Involv Engagem. 2018;4(1):4.
Statistics Canada. Canadian Community Health Survey Annual Component (CCHS) cycle 3.1.; 2005.
National Institute on Alcohol Abuse and Alcoholism (NIAAA). Recommended alcohol questions [Available from: https://www.niaaa.nih.gov/research/guidelines-and-resources/recommended-alcohol-questions.
Rutterford C, Copas A, Eldridge S. Methods for sample size determination in cluster randomized trials. Int J Epidemiol. 2015;44(3):1051–67.
Eldridge SM, Ashby D, Kerry S. Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. Int J Epidemiol. 2006;35(5):1292–300.
Eldridge S, Kerry S. Introduction. A practical guide to cluster randomised trials in health services research. West Sussex, UK: Wiley; 2012.
Eldridge S, Kerry S. The Intra-cluster correlation coefficient. A practical guide to cluster randomised trials in healthservices research. West Sussex, UK: Wiley; 2012. p. 172–95.
Statistics Canada. Census of Population, Statistics Canada Catalogue no. 98-400-X2016132.; 2016.
Hargraves D, White C, Frederick R, Cinibulk M, Peters M, Young A, et al. Implementing SBIRT (Screening, Brief Intervention and Referral to Treatment) in primary care: lessons learned from a multi-practice evaluation portfolio. Public Health Rev. 2017;38:31.
Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.
Johnston ME, Langton KB, Haynes RB, Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994;120(2):135–42.
Walton R, Dovey S, Harvey E, Freemantle N. Computer support for determining drug dose: systematic review and meta-analysis. BMJ (Clinical research ed). 1999;318(7189):984–90.
Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.
Liu JL, Wyatt JC, Deeks JJ, Clamp S, Keen J, Verde P, et al. Systematic reviews of clinical decision tools for acute abdominal pain. Health Technol Assess (Winchester, England). 2006;10:47):1–167 iii-iv.
Randell R, Mitchell N, Dowding D, Cullum N, Thompson C. Effects of computerized decision support systems on nursing performance and patient outcomes: a systematic review. J Health Serv Res Policy. 2007;12(4):242–9.
Chatellier G, Colombet I, Degoulet P. An overview of the effect of computer-assisted management of anticoagulant therapy on the quality of anticoagulation. Int J Med Informatics. 1998;49(3):311–20.
Le KB, Johnson JA, Seale JP, Woodall H, Clark DC, Parish DC, et al. Primary care residents lack comfort and experience with alcohol screening and brief intervention: a multi-site survey. J Gen Intern Med. 2015;30(6):790–6.
O'Donnell A, Kaner E. Are brief alcohol interventions adequately embedded in UK primary care? A qualitative study utilising normalisation process theory. Int J Environ Res Public Health. 2017;14:4.
We thank the staff and patients at the FHTs, CHCs, and NPLCs that participated in this trial. Peter Selby would like to acknowledge salary support for his clinician-scientist position from the Centre for Addiction and Mental Health and the Department of Family and Community Medicine at the University of Toronto.
This study was funded by the Canadian Cancer Society Research Institute Innovation Grant (Grant #703404).
Ethics approval and consent to participate
The study was reviewed by the research ethics board at the Centre for Addiction and Mental Health (approval number: 035-2015). Patient consent for participation in the STOP smoking cessation program was obtained at the time of enrollment.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.