Although screening for tobacco use is increasing with electronic health records and standard protocols, other tobacco-control activities, such as referral of patients to cessation resources, is quite low. In the QUIT-PRIMO study, an online referral portal will allow providers to enter smokers' email addresses into the system. Upon returning home, the smokers will receive automated emails providing education about tobacco cessation and encouragement to use the patient smoking cessation website (with interactive tools, educational resources, motivational email messages, secure messaging with a tobacco treatment specialist, and online support group).
The informatics system will be evaluated in a comparative effectiveness trial of 160 community-based primary care practices, cluster-randomized at the practice level. In the QUIT-PRIMO intervention, patients will be provided a paper information-prescription referral and then "e-referred" to the system. In the comparison group, patients will receive only the paper-based information-prescription referral with the website address. Once patients go to the website, they are subsequently randomized within practices to either a standard patient smoking cessation website or an augmented version with access to a tobacco treatment specialist online, motivational emails, and an online support group. We will compare intervention and control practice participation (referral rates) and patient participation (proportion referred who go to the website). We will then compare the effectiveness of the standard and augmented patient websites.
Our goal is to evaluate an integrated informatics solution to increase access to web-delivered smoking cessation support. We will analyze the impact of this integrated system in terms of process (provider e-referral and patient login) and patient outcomes (six-month smoking cessation).
Web-delivered Provider Intervention for Tobacco Control (QUIT-PRIMO) - a randomized controlled trial: NCT00797628.
Tobacco use is the number one behavioral health problem and number one preventable cause of death [1–5]. Interventions to reduce smoking have most frequently targeted patients. Patient self-management interventions for smoking cessation include mass dissemination of tobacco cessation self-help materials, computer-tailored printouts, interactive voice response systems, and more recently, "quitlines" and smoking cessation websites [3, 6–13]. Unfortunately, self-management interventions for smoking cessation have been underutilized. Studies of quitlines note that as little as 3.5% of adult smokers call per year . Because the majority of smokers (70%) see a healthcare provider at least once per year , physician referrals could greatly increase use of publicly available self-management interventions for smoking.
Quality improvement and implementation interventions have tried to change processes of care or provider behavior related to tobacco control with some success. Brief clinical interventions, based on tobacco use screening and brief, structured cessation advice from a provider, have been documented to improve patient cessation rates [15–18]. The current US Department of Health and Human Services clinical practice guideline entitled "Treating Tobacco Use and Dependence" provides a summary of evidence-based recommendations . The current guideline includes a framework for structured, brief clinical interventions using the "5 A s" of counseling:
Ask: Identify and document tobacco use status for every patient at every visit.
Advise: In a clear, strong, and personalized manner, urge every tobacco user to quit.
Assess: Is the tobacco user willing to make a quit attempt at this time?
Assist: Refer to resources and provide pharmacotherapy and counseling.
Arrange: Schedule follow-up contact, preferably within the first week after the quit date.
The first two A s (Ask and Advise) have increased through system-based interventions (i.e., smoking status as a vital sign) [19, 20] and audit and feedback of smoking counseling performance [21, 22]. However, implementation of Assist and Arrange has been lower [21, 23, 24]. One important component of assisting patients mentioned in the guideline is to refer patients to community resources, such as quitlines . As quitlines and websites have proliferated, "Refer," as part of the Assist agenda, has been increasingly emphasized . In practice, rates of referral to cessation resources have been measured to be as high as 28% at the VA  and 37% in managed care  and as low as 10% in community-based practices . Providers do refer some patients to quitlines. In one study, 20% of quitline users were referred by providers . Barriers to Refer include provider's lack of (a) time due to competing demands, (b) awareness of referral resources, (c) prompts, (d) materials to facilitate referrals, and (e) feedback on referral's success . Both patient and provider barriers to using resources for smoking cessation could potentially be addressed with an integrated system.
In this report, we describe the protocol for the QUIT-PRIMO-quality improvement in tobacco-provider referrals and Internet-delivered microsystem optimization-provider-to-patient informatics system. The informatics system will allow providers at the point of care to use a simple web portal to "e-refer" patients to a smoking cessation website. Providers simply type the smokers' email into the ReferaSmoker. Patients will then receive motivational emails encouraging them to join the patient intervention website (with interactive tools, educational resources, motivational email messages, secure messaging with tobacco treatment specialists and an online support group). Providers will subsequently get reports of patient activity on the smoking cessation website.
Our overall goal is to advance science related to the use and impact of the Internet in health services delivery of tobacco control. Because the informatics system is designed to engage all providers in a primary care clinic, including physicians and nurses, we will evaluate the system in a cluster-randomized trial. We will randomize 160 primary care clinical microsystems to the intervention or comparison group. For both the intervention and comparison groups, we will adapt protocols used in prior successful Internet-delivered provider interventions to recruit practices and implement the system in practices [31, 32]. Because our trial targets both practices and patients, patients within practices undergo a second level of randomization, as described below. We will use the discussion of our cluster-randomized trial to detail our approach to inherent measurement challenges in this randomized trial of a mixed provider-patient informatics intervention.
We will recruit 160 primary care physician practices to our trial. As further detailed below, our primary intervention target is the clinical practices. Patients nested within these practices will be cluster-randomized to receive either a simple paper referral or the full intervention-a paper referral plus an "e-referral" (smoker's email will be entered into a referral system and the smoker will receive encouraging emails to participate). In addition to our primary cluster-randomized trial, patients who participate in the website will be further randomized (patient-level, within-practice randomization) to receive either a standard or augmented patient website. Thus, our design is a randomized trial of a patient smoking cessation intervention, nested within a cluster-randomized practice intervention.
Our target is the primary care clinical microsystem within family practice and general internal medicine practices from across the United States. A clinical microsystem is defined as the smallest functional healthcare unit. A clinical microsystem is not simply equivalent to a group of doctors, but includes the clinical team of nurses, the processes of care that are used, and the panel of patients cared for by the providers. The Institute for Healthcare Improvement states that interventions targeted to clinical microsystems are "a crucial component in improving health care quality."  Our informatics intervention targets both the practice staff and their patients, and thus, both practices and patients are described as participants.
Practices will be recruited using a database of registered internal medicine and family/general practitioners. Initial interest will be ascertained via mass mailing of an interest survey. Once initial interest is expressed by return of the brief interest survey, each practice will be assessed for inclusion.
We are including community-based primary care practices (general internal medicine and family practice). Exclusion criteria include those practices that do not have Internet access available to staff and practices that do not see at least five or more smokers in one week. In addition, we will selectively recruit practices that have five or less providers. Based on our prior experience, enrollment of practices in these studies is complex and is somewhat easier if the number of providers in the practice is lower. Thus, we will exclude practices that have greater than five physicians. We will also exclude practices with ongoing computer-based smoking cessation programs, and we will not recruit from practices participating in ongoing studies or similar prior studies, especially those focused on tobacco control.
Patients will be referred to an online smoking cessation system (Decide2Quit.org). Patients referred will be adult smokers in the intervention and comparison practices. Decide2Quit.org is designed as a cessation induction and support for quitting system, tailored to readiness to quit. Thus, we are including those ready to quit, thinking about quitting, or not thinking about quitting.
Our discussion of the interventions begins with a comparison of the practice-level intervention.
ReferaSmoker.org, the practice-level intervention
Intervention practices will be provided preprinted pads of "information prescriptions" with their office information, a space for the provider to sign, and the smoking cessation website address (Decide2Quit.org). The information prescriptions are perforated; half will be retained by the practice (including the patient email to be used for e-referral) and half will be provided to the patient (see Additional File 1, Appendix 1). Practices will then use this patient email collection to e-refer them through ReferaSmoker.org. The core of the ReferaSmoker.org provider portal is a secure sockets layer (SSL) encrypted web form where providers can enter patients' email addresses into the system if they agree to be referred (Figure 1). The form has been designed to be easily completed by nursing or front office staff as the patient is discharged from the visit. Online referrals through the SSL form will be tracked by the server. The practice-reports function will provide feedback reports to providers on their patients' progress and their practice's referral rates. These feedback reports will act as a proximal outcome, where providers of all types can actually observe the impact of their efforts. To maximize the use of ReferaSmoker.org, we also provide supportive sub modules designed to prompt providers to use the system and maximize their smoking cessation activities (Figure 1, ReferaSmoker #3).
ReferaSmoker.org implementation program
After practices are enrolled, we will then schedule and conduct individualized telephone trainings with two implementation coordinators (physicians, nurses, or other staff) chosen at each practice. We chose two implementation coordinators per practice because of high rates of turnover of office staff in our prior experiences. Two coordinators can provide each other backup and further enhance use of ReferaSmoker.org. Using an academic detailing approach, our study team will walk the implementation coordinators through the ReferaSmoker website, including initial registration, and practice e-referring a test patient.
Using motivational interviewing, we will work with the implementation coordinators to identify barriers and strategize solutions to enhance participation. Implementation coordinators will set a goal for number of referrals per week based on their practice volume. Implementation coordinators will be trained on registering other providers in the practice into the system.
Based on pilot testing and focus groups, we have identified specific incentives, including provision of continuing education credits to participating providers and a $1,000 per practice "implementation budget" for completing training and referring their first 20 smokers. Proactive booster calls will be scheduled one month after initial registration to assess progress, respond to any questions, and continue to motivate participation.
The practice-level comparison
The practice-comparison referral process ends at the information prescriptions. Comparison practices will be enrolled in the same manner and will participate in the implementation program training calls. Randomization will occur on the calls once registration is complete, as further described below. The ReferaSmoker.org portal changes dynamically based on the randomization status of the practice, and comparison practices will only receive the supportive educational materials (Figure 1, ReferaSmoker #3). Comparison practices do not have access to the e-referral system, the practice feedback dashboard, or the secure messaging system.
As noted, comparison practices are provided preprinted pads of information prescriptions, exactly like those the intervention practice received, save one detail. There is no space for the patient email because control providers will not use the e-referral system (see Additional File 2, Appendix 2). Smokers will be provided half the information prescriptions, with the Decide2Quit.org address, just as with the intervention practices. All other components of the implementation program, motivational interviewing and goal-setting, incentives, and booster calls are kept constant across the two arms. Practices randomized to the comparison do receive a more limited training, focusing on the paper information prescriptions.
Decide2Quit.org, the patient-level intervention
Providers refer patients to Decide2Quit.org by paper prescription in the comparison group or by paper plus e-referral in the intervention group. Patients e-referred to Decide2Quit.org will receive reminder emails (two per week for four weeks) as cues to participation.
Patients who follow the referral and register with Decide2Quit.org will complete an online consent form and a baseline survey, including assessment of their readiness to quit smoking. This baseline data will be used to tailor the website to the individual.
Once registration is complete, smokers from both intervention and control practices will be further randomized. This within-practice randomization will allow smokers to receive one of two versions of Decide2Quit.org: a standard Decide2Quit.org or an augmented version of Decide2Quit.org (Table 1).
The standard comparison Decide2Quit.org includes a library of information about quitting smoking, including educational content about talking to a doctor about quitting smoking and detailed information on medications and behavioral treatments. The system also includes content about seeking help from friends and family, a chemicals-in-smoking matching game, and a decisional-balance "what will I have to overcome" calculator with individualized feedback. Smokers can complete a personalized "Quit Plan" that they can print and share with their provider.
The augmented Decide2Quit.org intervention includes all the components of the standard intervention plus (a) pushed motivational emails tailored to readiness to quit and designed to motivate cessation and market the Decide2Quit.org intervention; (b) secure asynchronous messaging with a personal advisor, a trained tobacco treatment specialist; and (c) an online support group community (Table 1).
Thus, our study is a cluster-randomized trial, with patients clustered at the practice level, and a subsequent, within-practice, patient-level randomization (Figure 2). This is further detailed under Randomization below.
As conceptualized for one patient in an example practice depicted in Figure 3, the intervention is designed to have a sequence of effects on the process of care within each clinical microsystem. The system has the potential to impact provider behavior (nurses and physicians), processes of care, and patient behavior. Thus, we have designed our main evaluation to assess several key areas of influence, which we have abbreviated as Refer → Go → Quit. To evaluate the impact of the provider and patient intervention, we have proposed the following three hypotheses:
Hypothesis 1 (Refer): More patients will be Refer red to the Decide2Quit self-management resource website in the QUIT-PRIMO e-referral practices compared with information prescription practices.
Hypothesis 2 (Go): The proportion of referred patients who Go to the patient self-management website due to the QUIT-PRIMO practice proactive e-referrals will be greater compared with the paper information-prescription practices.
Hypothesis 3 (Quit): The proportion of referred smokers who Quit at six months will be greater among those in the augmented Decide2Quit.org intervention compared with the standard intervention.
For our three hypotheses, we have three primary outcome variables (i.e., Refer, Go, Quit). For the primary analysis for hypothesis 1, the outcome will be the number of smokers referred from each group transformed into an average count per month by dividing the total by the length of time in months from the practice's first referral. As discussed above, in both arms, practices will use paper information prescriptions. The leave-behind part of the information prescription (see Appendix 1) will allow a consistent measure of referrals. In the QUIT-PRIMO intervention, the server will track the number of electronic referrals, allowing us to compare rates of referral based on paper and server in the intervention arm.
For hypothesis 2, our outcome will be the proportion of those referred who go to the website. Our interest in hypothesis 2, expressed as a proportion, will be the proportion of patients referred who log on, or "Go," to the website (% who go = number who visit/number referred). The number of smokers who visit will be recorded by the Decide2Quit system, linking each visitor to their primary care provider at initial registration. The number referred is continuously registered directly by the leave-behind referral receipts of the information prescriptions.
For hypothesis 3, we will define the outcome in two ways. In both approaches, the numerator will be the number of patients who report cessation at six-month follow-up calls. In our primary intent-to-treat analysis, the denominator will be all smokers who are referred (the same denominator used in hypothesis 2), estimating a population effect. This represents a conservative assessment since we assume that many patients will not go, and for the purposes of analyses, we will assume that these patients will not have quit. As a secondary analysis, we will assign the denominator as the number of patients who go to the website. For this secondary outcome, consistent with current guidelines for smoking cessation trials, we will assume that patients who are lost to follow-up, including those who go and do not agree to follow-up, are smokers .
We calculated sample size for each of our three hypotheses. Power was primarily driven by hypothesis 3 (six-month cessation). We first estimated the number of smokers per practice that will participate in the website over time. The average patient panel of a primary care provider is approximately 2,300, although not all are seen in a given year. We estimated 1,500 visits per year. Based on tobacco use prevalence, approximately 22% of the patients will be smokers. To be conservative, we assume that we will have only two providers per practice actively participating in the intervention. Using these numbers, we have estimated the number that will participate per practice yearly (Table 2). We expect 158 referrals from each intervention practice and 79 from each control practice. Based on these samples, and assuming a cessation rate of 10% among patients randomized to the standard Decide2Quit.org, we have 80% power to detect a 5% difference in cessation, comparing the standard and augmented Decide2Quit.org.
Sequence generation and implementation
Practices will be recruited utilizing a mass mailing. An initial interest letter will be sent describing the study and that participation will provide access to tools aimed at enhancing referral of patients to a customized smoking cessation intervention website. Practice eligibility will be determined based on the interest survey, and practices will subsequently be asked to complete a practice consent form and baseline practice survey. With survey and consent returned, our study staff will contact practices and identify and train two implementation coordinators, nurses, or other practice staff who will participate in the referral process. Our staff will talk the implementation coordinators through registration and the referral process. During training, the first implementation coordinator will complete an online consent and survey, followed by randomization.
We developed an online randomization program, based on a block-randomization strategy (a randomization table with blocks of 10) linked to registration. Our statistician, JR, developed the randomization table and only JR and RSS (who developed the randomization system) have access to the table. When the first user from a practice is randomized, the system will look up the next allocation in the randomization table and the user-provider then has access to the intervention or comparison version of ReferaSmoker.org. All subsequent providers from the sample practice will then be randomized to the same arm.
Patients will also be randomized to the standard Decide2Quit.org or augmented Decide2Quit.org using the online randomization program but using a separate randomization table, also generated by JR.
Because each practice is informed, they will be provided tools aimed at enhancing referral, and since specifics of either arm are not described at any time, the practice is blind to group assignment. During the training process up to the point of randomization, the study coordinator is blind to which arm the practice will be assigned; however, they are unblinded once randomization occurs in order to provide direction for the appropriate referral process. Each study coordinator is trained to minimize any bias in communication with the implementation coordinators based on which arm they are assigned. Practices remain blind. In turn, all patients are blind to website characteristics and which randomized group they will be assigned to. Patients remain blind until completion of the study. At completion of the study, all practices and patients are unblinded and given the opportunity to utilize all features of both websites.
The mean number of referrals per month will be compared by study group using a two-sided t-test, employing Satterthwaite's approximation if the variances are substantially different. We will also examine the distribution of the referrals per month by study group and will use the two-sided Wilcoxon test if they appear non-Gaussian. We will assess the adequacy of randomization on characteristics of the practice that might influence referral rates. We will have data from an administrative database (size of practice, number of providers and staff) and provider reports of proportion of smokers in the practice. We will also conduct adjusted (using Poisson or negative binomial models based on distribution) analyses accounting for these factors.
For hypothesis 2, whether or not a patient goes will be considered a dichotomous outcome in a patient-level analysis. The main patient-level analysis will use a generalized linear model with a logit link to evaluate whether a referred smoker goes to the patient website. As this hypothesis represents a cluster-randomized trial, because each website links patients back to their practice, we will use generalized estimating equation (GEE) methods to account for clustering within practices.
For hypothesis 3, patients will be randomized within practices to standard Decide2Quit and augmented Decide2Quit. Because we are comparing rates in all instances between the standard Decide2Quit system and the augmented Decide2Quit, we will use a two-group chi-square test of equal proportions to test the statistical difference between the quit rates. We will next use a generalized linear model with a logit link to model tobacco cessation by treatment assignment adjusted for baseline readiness to change as entered into the website by the patient.
Despite some success in targeting one aspect or another of health services, single-dimension provider or patient implementation strategies are inherently limited. Using the Internet as a delivery method provides the potential to link multiple provider and patient intervention components, but this potential has not yet been realized. Our goal is to link providers and patients through an innovative electronic system with redundant cues and reminders to encourage participation at all levels of the clinical microsystem. Within the intervention group, the system will provide the practices with feedback and the patients with encouragement.
Once referred, the patient system has been developed to include current innovations in online smoking cessation interventions. Standard components include educational materials, interactive decision support tools (e.g., "What do I have to overcome?"-an assessment of triggers to smoking), and a quit plan tailored to readiness to quit. Additional, more innovative components, including online counseling with a tobacco treatment specialist through an asynchronous secure messaging system, are available in the augmented Decide2Quit.org. Our goal is to analyze the impact of this integrated system in terms of process (Refer and Go) and outcomes (six-month smoking cessation).
Murray CJ, Lopez AD: Alternative projections of mortality and disability by cause 1990-2020: global burden of disease study. The Lancet. 1997, 349: 1498-1504. 10.1016/S0140-6736(96)07492-2.
Fiore MC, Croyle RT, Curry SJ, Cutler CM, Davis RM, Gordon C, Healton C, Koh HK, Orleans CT, Richling D: Preventing 3 million premature deaths and helping 5 million smokers quit: a national action plan for tobacco cessation. Am J Public Health. 2004, 94: 205-210. 10.2105/AJPH.94.2.205.
Fiore C, Jaen CR, Baker TB: Treating Tobacco Use And Dependence: 2008 update. Book Treating Tobacco Use And Dependence: 2008 update. 2008, City: U.S. Department of Health and Human Services. Public Health Service, (Editor ed.^eds.)
Fiore C, Bailey W, Cohen S: Treating Tobacco Use And Dependence. Book Treating Tobacco Use And Dependence. 2000, City: U.S. Department of Health and Human Services. Public Health Service, (Editor ed.^eds.)
Ockene JK, Kristeller J, Pbert L, Hebert JR, Luippold R, Goldberg RJ, Landon J, Kalan K: The physician-delivered smoking intervention project: can short-term interventions produce long-term effects for a general outpatient population?. Health Psychol. 1994, 13: 278-281. 10.1037/0278-6188.8.131.528.
Piper ME, Fiore MC, Smith SS, Jorenby DE, Wilson JR, Zehner ME, Baker TB: Use of the vital sign stamp as a systematic screening tool to promote smoking cessation. Mayo Clin Proc. 2003, 78: 716-722. 10.4065/78.6.716.
Quinn VP, Stevens VJ, Hollis JF, Rigotti NA, Solberg LI, Gordon N, Ritzwoller D, Smith KS, Hu W, Zapka J: Tobacco-cessation services and patient satisfaction in nine nonprofit HMOs. Am J Prev Med. 2005, 29: 77-84. 10.1016/j.amepre.2005.04.006.
Jonk YC, Sherman SE, Fu SS, Hamlett-Berry KW, Geraci MC, Joseph AM: National trends in the provision of smoking cessation aids within the Veterans Health Administration. Am J Manag Care. 2005, 11: 77-85.
Sherman SE, Yano EM, Lanto AB, Simon BF, Rubenstein LV: Smokers' interest in quitting and services received: using practice information to plan quality improvement and policy for smoking cessation. Am J Med Qual. 2005, 20: 33-39. 10.1177/1062860604273776.
Stevens VJ, Solberg LI, Quinn VP, Rigotti NA, Hollis JA, Smith KS, Zapka JG, France E, Vogt T, Gordon N: Relationship between tobacco control policies and the delivery of smoking cessation services in nonprofit HMOs. J Natl Cancer Inst Monogr. 2005, 75-80. 10.1093/jncimonographs/lgi042.
Houston TK, Richman JS, Ray MN, Allison JJ, Gilbert GH, Shewchuk RM, Kohler CL, Kiefe CI: Internet delivered support for tobacco control in dental practice: randomized controlled trial. J Med Internet Res. 2008, 10: e38-10.2196/jmir.1095.
Houston TK, Funkhouser E, Allison JJ, Levine DA, Williams OD, Kiefe CI: Multiple measures of provider participation in Internet delivered interventions. Stud Health Technol Inform. 2007, 129: 1401-1405.
The authors declare that they have no competing interests.
TKH, the principal investigator of the study, conducted the data analysis with the oversight of JR, drafted the initial manuscript, and reviewed and approved the final draft. RSS developed the figures and wrote part of the manuscript. RSS, JR, DEF, MNR, and JJA participated in study design and data collection and critically reviewed, edited, and approved the final draft.
Additional File 1: Information prescription sheet for the Intervention. A copy of the information prescription that will be provided to the Intervention practices. This sheet contains a space for the patient's email, provider signature, and the smoking cessation website address (Decide2Quit.org). (PDF 126 KB)
Additional File 2: Information prescription sheet for the practice-level comparison arm. A copy of the information prescription that will be provided to the Comparison practices. This sheet does not contain a space for the patient's email denoting the difference between the intervention and comparison arm referral process. (PDF 93 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License (
), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.