This article has Open Peer Review reports available.
The QUIT-PRIMO provider-patient Internet-delivered smoking cessation referral intervention: a cluster-randomized comparative effectiveness trial: study protocol
© Houston et al; licensee BioMed Central Ltd. 2010
Received: 23 July 2010
Accepted: 17 November 2010
Published: 17 November 2010
Although screening for tobacco use is increasing with electronic health records and standard protocols, other tobacco-control activities, such as referral of patients to cessation resources, is quite low. In the QUIT-PRIMO study, an online referral portal will allow providers to enter smokers' email addresses into the system. Upon returning home, the smokers will receive automated emails providing education about tobacco cessation and encouragement to use the patient smoking cessation website (with interactive tools, educational resources, motivational email messages, secure messaging with a tobacco treatment specialist, and online support group).
The informatics system will be evaluated in a comparative effectiveness trial of 160 community-based primary care practices, cluster-randomized at the practice level. In the QUIT-PRIMO intervention, patients will be provided a paper information-prescription referral and then "e-referred" to the system. In the comparison group, patients will receive only the paper-based information-prescription referral with the website address. Once patients go to the website, they are subsequently randomized within practices to either a standard patient smoking cessation website or an augmented version with access to a tobacco treatment specialist online, motivational emails, and an online support group. We will compare intervention and control practice participation (referral rates) and patient participation (proportion referred who go to the website). We will then compare the effectiveness of the standard and augmented patient websites.
Our goal is to evaluate an integrated informatics solution to increase access to web-delivered smoking cessation support. We will analyze the impact of this integrated system in terms of process (provider e-referral and patient login) and patient outcomes (six-month smoking cessation).
Web-delivered Provider Intervention for Tobacco Control (QUIT-PRIMO) - a randomized controlled trial: NCT00797628.
Tobacco use is the number one behavioral health problem and number one preventable cause of death [1–5]. Interventions to reduce smoking have most frequently targeted patients. Patient self-management interventions for smoking cessation include mass dissemination of tobacco cessation self-help materials, computer-tailored printouts, interactive voice response systems, and more recently, "quitlines" and smoking cessation websites [3, 6–13]. Unfortunately, self-management interventions for smoking cessation have been underutilized. Studies of quitlines note that as little as 3.5% of adult smokers call per year . Because the majority of smokers (70%) see a healthcare provider at least once per year , physician referrals could greatly increase use of publicly available self-management interventions for smoking.
Ask: Identify and document tobacco use status for every patient at every visit.
Advise: In a clear, strong, and personalized manner, urge every tobacco user to quit.
Assess: Is the tobacco user willing to make a quit attempt at this time?
Assist: Refer to resources and provide pharmacotherapy and counseling.
Arrange: Schedule follow-up contact, preferably within the first week after the quit date.
The first two A s (Ask and Advise) have increased through system-based interventions (i.e., smoking status as a vital sign) [19, 20] and audit and feedback of smoking counseling performance [21, 22]. However, implementation of Assist and Arrange has been lower [21, 23, 24]. One important component of assisting patients mentioned in the guideline is to refer patients to community resources, such as quitlines . As quitlines and websites have proliferated, "Refer," as part of the Assist agenda, has been increasingly emphasized . In practice, rates of referral to cessation resources have been measured to be as high as 28% at the VA  and 37% in managed care  and as low as 10% in community-based practices . Providers do refer some patients to quitlines. In one study, 20% of quitline users were referred by providers . Barriers to Refer include provider's lack of (a) time due to competing demands, (b) awareness of referral resources, (c) prompts, (d) materials to facilitate referrals, and (e) feedback on referral's success . Both patient and provider barriers to using resources for smoking cessation could potentially be addressed with an integrated system.
In this report, we describe the protocol for the QUIT-PRIMO-quality improvement in tobacco-provider referrals and Internet-delivered microsystem optimization-provider-to-patient informatics system. The informatics system will allow providers at the point of care to use a simple web portal to "e-refer" patients to a smoking cessation website. Providers simply type the smokers' email into the ReferaSmoker. Patients will then receive motivational emails encouraging them to join the patient intervention website (with interactive tools, educational resources, motivational email messages, secure messaging with tobacco treatment specialists and an online support group). Providers will subsequently get reports of patient activity on the smoking cessation website.
Our overall goal is to advance science related to the use and impact of the Internet in health services delivery of tobacco control. Because the informatics system is designed to engage all providers in a primary care clinic, including physicians and nurses, we will evaluate the system in a cluster-randomized trial. We will randomize 160 primary care clinical microsystems to the intervention or comparison group. For both the intervention and comparison groups, we will adapt protocols used in prior successful Internet-delivered provider interventions to recruit practices and implement the system in practices [31, 32]. Because our trial targets both practices and patients, patients within practices undergo a second level of randomization, as described below. We will use the discussion of our cluster-randomized trial to detail our approach to inherent measurement challenges in this randomized trial of a mixed provider-patient informatics intervention.
We will recruit 160 primary care physician practices to our trial. As further detailed below, our primary intervention target is the clinical practices. Patients nested within these practices will be cluster-randomized to receive either a simple paper referral or the full intervention-a paper referral plus an "e-referral" (smoker's email will be entered into a referral system and the smoker will receive encouraging emails to participate). In addition to our primary cluster-randomized trial, patients who participate in the website will be further randomized (patient-level, within-practice randomization) to receive either a standard or augmented patient website. Thus, our design is a randomized trial of a patient smoking cessation intervention, nested within a cluster-randomized practice intervention.
Our target is the primary care clinical microsystem within family practice and general internal medicine practices from across the United States. A clinical microsystem is defined as the smallest functional healthcare unit. A clinical microsystem is not simply equivalent to a group of doctors, but includes the clinical team of nurses, the processes of care that are used, and the panel of patients cared for by the providers. The Institute for Healthcare Improvement states that interventions targeted to clinical microsystems are "a crucial component in improving health care quality."  Our informatics intervention targets both the practice staff and their patients, and thus, both practices and patients are described as participants.
Practices will be recruited using a database of registered internal medicine and family/general practitioners. Initial interest will be ascertained via mass mailing of an interest survey. Once initial interest is expressed by return of the brief interest survey, each practice will be assessed for inclusion.
We are including community-based primary care practices (general internal medicine and family practice). Exclusion criteria include those practices that do not have Internet access available to staff and practices that do not see at least five or more smokers in one week. In addition, we will selectively recruit practices that have five or less providers. Based on our prior experience, enrollment of practices in these studies is complex and is somewhat easier if the number of providers in the practice is lower. Thus, we will exclude practices that have greater than five physicians. We will also exclude practices with ongoing computer-based smoking cessation programs, and we will not recruit from practices participating in ongoing studies or similar prior studies, especially those focused on tobacco control.
Patients will be referred to an online smoking cessation system (Decide2Quit.org). Patients referred will be adult smokers in the intervention and comparison practices. Decide2Quit.org is designed as a cessation induction and support for quitting system, tailored to readiness to quit. Thus, we are including those ready to quit, thinking about quitting, or not thinking about quitting.
Our discussion of the interventions begins with a comparison of the practice-level intervention.
ReferaSmoker.org, the practice-level intervention
ReferaSmoker.org implementation program
After practices are enrolled, we will then schedule and conduct individualized telephone trainings with two implementation coordinators (physicians, nurses, or other staff) chosen at each practice. We chose two implementation coordinators per practice because of high rates of turnover of office staff in our prior experiences. Two coordinators can provide each other backup and further enhance use of ReferaSmoker.org. Using an academic detailing approach, our study team will walk the implementation coordinators through the ReferaSmoker website, including initial registration, and practice e-referring a test patient.
Using motivational interviewing, we will work with the implementation coordinators to identify barriers and strategize solutions to enhance participation. Implementation coordinators will set a goal for number of referrals per week based on their practice volume. Implementation coordinators will be trained on registering other providers in the practice into the system.
Based on pilot testing and focus groups, we have identified specific incentives, including provision of continuing education credits to participating providers and a $1,000 per practice "implementation budget" for completing training and referring their first 20 smokers. Proactive booster calls will be scheduled one month after initial registration to assess progress, respond to any questions, and continue to motivate participation.
The practice-level comparison
The practice-comparison referral process ends at the information prescriptions. Comparison practices will be enrolled in the same manner and will participate in the implementation program training calls. Randomization will occur on the calls once registration is complete, as further described below. The ReferaSmoker.org portal changes dynamically based on the randomization status of the practice, and comparison practices will only receive the supportive educational materials (Figure 1, ReferaSmoker #3). Comparison practices do not have access to the e-referral system, the practice feedback dashboard, or the secure messaging system.
As noted, comparison practices are provided preprinted pads of information prescriptions, exactly like those the intervention practice received, save one detail. There is no space for the patient email because control providers will not use the e-referral system (see Additional File 2, Appendix 2). Smokers will be provided half the information prescriptions, with the Decide2Quit.org address, just as with the intervention practices. All other components of the implementation program, motivational interviewing and goal-setting, incentives, and booster calls are kept constant across the two arms. Practices randomized to the comparison do receive a more limited training, focusing on the paper information prescriptions.
Decide2Quit.org, the patient-level intervention
Providers refer patients to Decide2Quit.org by paper prescription in the comparison group or by paper plus e-referral in the intervention group. Patients e-referred to Decide2Quit.org will receive reminder emails (two per week for four weeks) as cues to participation.
Patients who follow the referral and register with Decide2Quit.org will complete an online consent form and a baseline survey, including assessment of their readiness to quit smoking. This baseline data will be used to tailor the website to the individual.
Major components of Decide2Quit.org
Receive messages from a tobacco treatment specialist
Receive encouraging email messages from experts; messages tailored to stage of change
Your Online Communitya
View messages and dialogue from smokers and ex-smokers through a resource website
My Health Risksb
Learn about specific health risks, including physical symptoms and harmful chemicals
Thinking About Quittingb
Helpful ideas and motivational recommendations (e.g., interactive calculators assessing triggers, decisional balance)
How to get help from your family, deal with nagging, learn what kids think about smoking
Healthcare Provider Toolsb
How to include your healthcare provider in your quit smoking plan
Download articles and helpful tools about smoking cessation and smoking treatments
Valuable additional websites for smokers
The standard comparison Decide2Quit.org includes a library of information about quitting smoking, including educational content about talking to a doctor about quitting smoking and detailed information on medications and behavioral treatments. The system also includes content about seeking help from friends and family, a chemicals-in-smoking matching game, and a decisional-balance "what will I have to overcome" calculator with individualized feedback. Smokers can complete a personalized "Quit Plan" that they can print and share with their provider.
The augmented Decide2Quit.org intervention includes all the components of the standard intervention plus (a) pushed motivational emails tailored to readiness to quit and designed to motivate cessation and market the Decide2Quit.org intervention; (b) secure asynchronous messaging with a personal advisor, a trained tobacco treatment specialist; and (c) an online support group community (Table 1).
Hypothesis 1 (Refer): More patients will be Refer red to the Decide2Quit self-management resource website in the QUIT-PRIMO e-referral practices compared with information prescription practices.
Hypothesis 2 (Go): The proportion of referred patients who Go to the patient self-management website due to the QUIT-PRIMO practice proactive e-referrals will be greater compared with the paper information-prescription practices.
Hypothesis 3 (Quit): The proportion of referred smokers who Quit at six months will be greater among those in the augmented Decide2Quit.org intervention compared with the standard intervention.
For our three hypotheses, we have three primary outcome variables (i.e., Refer, Go, Quit). For the primary analysis for hypothesis 1, the outcome will be the number of smokers referred from each group transformed into an average count per month by dividing the total by the length of time in months from the practice's first referral. As discussed above, in both arms, practices will use paper information prescriptions. The leave-behind part of the information prescription (see Appendix 1) will allow a consistent measure of referrals. In the QUIT-PRIMO intervention, the server will track the number of electronic referrals, allowing us to compare rates of referral based on paper and server in the intervention arm.
For hypothesis 2, our outcome will be the proportion of those referred who go to the website. Our interest in hypothesis 2, expressed as a proportion, will be the proportion of patients referred who log on, or "Go," to the website (% who go = number who visit/number referred). The number of smokers who visit will be recorded by the Decide2Quit system, linking each visitor to their primary care provider at initial registration. The number referred is continuously registered directly by the leave-behind referral receipts of the information prescriptions.
For hypothesis 3, we will define the outcome in two ways. In both approaches, the numerator will be the number of patients who report cessation at six-month follow-up calls. In our primary intent-to-treat analysis, the denominator will be all smokers who are referred (the same denominator used in hypothesis 2), estimating a population effect. This represents a conservative assessment since we assume that many patients will not go, and for the purposes of analyses, we will assume that these patients will not have quit. As a secondary analysis, we will assign the denominator as the number of patients who go to the website. For this secondary outcome, consistent with current guidelines for smoking cessation trials, we will assume that patients who are lost to follow-up, including those who go and do not agree to follow-up, are smokers .
Flow of 3,000a patients through the intervention--Refer → Go → Quit
Start with 3,000 patient visits
Smokers REFER red
Smokers referred who GO
Smokers that go who QUIT
Sequence generation and implementation
Practices will be recruited utilizing a mass mailing. An initial interest letter will be sent describing the study and that participation will provide access to tools aimed at enhancing referral of patients to a customized smoking cessation intervention website. Practice eligibility will be determined based on the interest survey, and practices will subsequently be asked to complete a practice consent form and baseline practice survey. With survey and consent returned, our study staff will contact practices and identify and train two implementation coordinators, nurses, or other practice staff who will participate in the referral process. Our staff will talk the implementation coordinators through registration and the referral process. During training, the first implementation coordinator will complete an online consent and survey, followed by randomization.
We developed an online randomization program, based on a block-randomization strategy (a randomization table with blocks of 10) linked to registration. Our statistician, JR, developed the randomization table and only JR and RSS (who developed the randomization system) have access to the table. When the first user from a practice is randomized, the system will look up the next allocation in the randomization table and the user-provider then has access to the intervention or comparison version of ReferaSmoker.org. All subsequent providers from the sample practice will then be randomized to the same arm.
Patients will also be randomized to the standard Decide2Quit.org or augmented Decide2Quit.org using the online randomization program but using a separate randomization table, also generated by JR.
Because each practice is informed, they will be provided tools aimed at enhancing referral, and since specifics of either arm are not described at any time, the practice is blind to group assignment. During the training process up to the point of randomization, the study coordinator is blind to which arm the practice will be assigned; however, they are unblinded once randomization occurs in order to provide direction for the appropriate referral process. Each study coordinator is trained to minimize any bias in communication with the implementation coordinators based on which arm they are assigned. Practices remain blind. In turn, all patients are blind to website characteristics and which randomized group they will be assigned to. Patients remain blind until completion of the study. At completion of the study, all practices and patients are unblinded and given the opportunity to utilize all features of both websites.
The mean number of referrals per month will be compared by study group using a two-sided t-test, employing Satterthwaite's approximation if the variances are substantially different. We will also examine the distribution of the referrals per month by study group and will use the two-sided Wilcoxon test if they appear non-Gaussian. We will assess the adequacy of randomization on characteristics of the practice that might influence referral rates. We will have data from an administrative database (size of practice, number of providers and staff) and provider reports of proportion of smokers in the practice. We will also conduct adjusted (using Poisson or negative binomial models based on distribution) analyses accounting for these factors.
For hypothesis 2, whether or not a patient goes will be considered a dichotomous outcome in a patient-level analysis. The main patient-level analysis will use a generalized linear model with a logit link to evaluate whether a referred smoker goes to the patient website. As this hypothesis represents a cluster-randomized trial, because each website links patients back to their practice, we will use generalized estimating equation (GEE) methods to account for clustering within practices.
For hypothesis 3, patients will be randomized within practices to standard Decide2Quit and augmented Decide2Quit. Because we are comparing rates in all instances between the standard Decide2Quit system and the augmented Decide2Quit, we will use a two-group chi-square test of equal proportions to test the statistical difference between the quit rates. We will next use a generalized linear model with a logit link to model tobacco cessation by treatment assignment adjusted for baseline readiness to change as entered into the website by the patient.
Despite some success in targeting one aspect or another of health services, single-dimension provider or patient implementation strategies are inherently limited. Using the Internet as a delivery method provides the potential to link multiple provider and patient intervention components, but this potential has not yet been realized. Our goal is to link providers and patients through an innovative electronic system with redundant cues and reminders to encourage participation at all levels of the clinical microsystem. Within the intervention group, the system will provide the practices with feedback and the patients with encouragement.
Once referred, the patient system has been developed to include current innovations in online smoking cessation interventions. Standard components include educational materials, interactive decision support tools (e.g., "What do I have to overcome?"-an assessment of triggers to smoking), and a quit plan tailored to readiness to quit. Additional, more innovative components, including online counseling with a tobacco treatment specialist through an asynchronous secure messaging system, are available in the augmented Decide2Quit.org. Our goal is to analyze the impact of this integrated system in terms of process (Refer and Go) and outcomes (six-month smoking cessation).
For this project, the authors and manuscript preparation were supported by grant 5R01CA129091-04 from the National Cancer Institute.
- Murray CJ, Lopez AD: Alternative projections of mortality and disability by cause 1990-2020: global burden of disease study. The Lancet. 1997, 349: 1498-1504. 10.1016/S0140-6736(96)07492-2.View ArticleGoogle Scholar
- Critchley JA, Capewell S: Mortality risk reduction associated with smoking cessation in patients with coronary heart disease: a systematic review. Jama. 2003, 290: 86-97. 10.1001/jama.290.1.86.View ArticlePubMedGoogle Scholar
- Fiore MC, Croyle RT, Curry SJ, Cutler CM, Davis RM, Gordon C, Healton C, Koh HK, Orleans CT, Richling D: Preventing 3 million premature deaths and helping 5 million smokers quit: a national action plan for tobacco cessation. Am J Public Health. 2004, 94: 205-210. 10.2105/AJPH.94.2.205.View ArticlePubMedPubMed CentralGoogle Scholar
- Trosclair A, Husten C, Pederson L, Dhillon I: Cigarette smoking among adults - United States, 2000. Morbidity and Mortality Weekly Report. 2002, 51: 642-645.Google Scholar
- Fiore C, Jaen CR, Baker TB: Treating Tobacco Use And Dependence: 2008 update. Book Treating Tobacco Use And Dependence: 2008 update. 2008, City: U.S. Department of Health and Human Services. Public Health Service, (Editor ed.^eds.)Google Scholar
- Lancaster T, Stead LF: Self-help interventions for smoking cessation. Cochrane Database Syst Rev. 2005, CD001118-Google Scholar
- Sciamanna CN, Ford DE, Flynn JA, Langford C: An evidence-based interactive computer program to assist physicians in counseling smokers to quit. MD Computing. 1999, 16: 54-60.PubMedGoogle Scholar
- Strecher VJ: Computer-tailored smoking cessation materials: a review and discussion. Patient Education and Counseling. 1999, 36: 107-117. 10.1016/S0738-3991(98)00128-1.View ArticlePubMedGoogle Scholar
- Bental DS, Cawsey A, Jones R: Patient information systems that tailor to the individual. Patient Education and Counseling. 1999, 36: 171-180. 10.1016/S0738-3991(98)00133-5.View ArticlePubMedGoogle Scholar
- Ramelson HZ, Friedman RH, Ockene JK: An automated telephone-based smoking cessation education and counseling system. Patient Education and Counseling. 1999, 36: 131-144. 10.1016/S0738-3991(98)00130-X.View ArticlePubMedGoogle Scholar
- Lubalin J: Consumer Health Informatics and Patient Decision-Making. 1997, Rockville MD: U.S. Department of Health and Human Services, U.S. Government Printing OfficeGoogle Scholar
- Ossip-Klein DJ, McIntosh S: Quitlines in North America: evidence base and applications. Am J Med Sci. 2003, 326: 201-205. 10.1097/00000441-200310000-00010.View ArticlePubMedGoogle Scholar
- HHS 'Quitline' helps Americans stop smoking. FDA Consum. 2005, 39: 4-5.Google Scholar
- Miller CL, Wakefield M, Roberts L: Uptake and effectiveness of the Australian telephone Quitline service in the context of a mass media campaign. Tob Control. 2003, 12 (Suppl 2): ii53-58.PubMedPubMed CentralGoogle Scholar
- Fiore C, Bailey W, Cohen S: Treating Tobacco Use And Dependence. Book Treating Tobacco Use And Dependence. 2000, City: U.S. Department of Health and Human Services. Public Health Service, (Editor ed.^eds.)Google Scholar
- Lancaster T, Stead L: Physician advice for smoking cessation. Cochrane Database Syst Rev. 2004, CD000165-Google Scholar
- Ockene JK, Kristeller J, Pbert L, Hebert JR, Luippold R, Goldberg RJ, Landon J, Kalan K: The physician-delivered smoking intervention project: can short-term interventions produce long-term effects for a general outpatient population?. Health Psychol. 1994, 13: 278-281. 10.1037/0278-6220.127.116.118.View ArticlePubMedGoogle Scholar
- Whitlock EP, Orleans CT, Pender N, Allan J: Evaluating primary care behavioral counseling interventions: an evidence-based approach. Am J Prev Med. 2002, 22: 267-284. 10.1016/S0749-3797(02)00415-4.View ArticlePubMedGoogle Scholar
- Piper ME, Fiore MC, Smith SS, Jorenby DE, Wilson JR, Zehner ME, Baker TB: Use of the vital sign stamp as a systematic screening tool to promote smoking cessation. Mayo Clin Proc. 2003, 78: 716-722. 10.4065/78.6.716.View ArticlePubMedGoogle Scholar
- Turner-Henson A, Kohler C, Lyrene R, Johnston J: Smoking status as a vital sign in pediatric settings. Pediatrics. 1999, 103: 1079-1080. 10.1542/peds.103.5.1079.View ArticlePubMedGoogle Scholar
- Quinn VP, Stevens VJ, Hollis JF, Rigotti NA, Solberg LI, Gordon N, Ritzwoller D, Smith KS, Hu W, Zapka J: Tobacco-cessation services and patient satisfaction in nine nonprofit HMOs. Am J Prev Med. 2005, 29: 77-84. 10.1016/j.amepre.2005.04.006.View ArticlePubMedGoogle Scholar
- Andrews JO, Tingen MS, Waller JL, Harper RJ: Provider feedback improves adherence with AHCPR Smoking Cessation Guideline. Prev Med. 2001, 33: 415-421. 10.1006/pmed.2001.0907.View ArticlePubMedGoogle Scholar
- Jonk YC, Sherman SE, Fu SS, Hamlett-Berry KW, Geraci MC, Joseph AM: National trends in the provision of smoking cessation aids within the Veterans Health Administration. Am J Manag Care. 2005, 11: 77-85.PubMedGoogle Scholar
- Sherman SE, Yano EM, York LS, Lanto AB, Chernof BA, Mittman BS: Assessing the structure of smoking cessation care in the Veterans Health Administration. Am J Health Promot. 2006, 20: 313-318.View ArticlePubMedGoogle Scholar
- Revell CC, Schroeder SA: Simplicity matters: using system-level changes to encourage clinician intervention in helping tobacco users quit. Nicotine Tob Res. 2005, 7 (Suppl 1): S67-69. 10.1080/14622200500078162.View ArticlePubMedGoogle Scholar
- Sherman SE, Yano EM, Lanto AB, Simon BF, Rubenstein LV: Smokers' interest in quitting and services received: using practice information to plan quality improvement and policy for smoking cessation. Am J Med Qual. 2005, 20: 33-39. 10.1177/1062860604273776.View ArticlePubMedGoogle Scholar
- Stevens VJ, Solberg LI, Quinn VP, Rigotti NA, Hollis JA, Smith KS, Zapka JG, France E, Vogt T, Gordon N: Relationship between tobacco control policies and the delivery of smoking cessation services in nonprofit HMOs. J Natl Cancer Inst Monogr. 2005, 75-80. 10.1093/jncimonographs/lgi042.Google Scholar
- Smith SS, Beckley T, Fiore MC: Health care provider use of guideline-based smoking cessation interventions: results from the 2003 Wisconsin Tobacco Survey. Wmj. 2005, 104: 28-31.PubMedGoogle Scholar
- Zhu SH, Anderson CM, Johnson CE, Tedeschi G, Roeseler A: A centralised telephone service for tobacco cessation: the California experience. Tob Control. 2000, 9 (Suppl 2): II48-55.PubMedPubMed CentralGoogle Scholar
- Meredith LS, Yano EM, Hickey SC, Sherman SE: Primary care provider attitudes are associated with smoking cessation counseling and referral. Med Care. 2005, 43: 929-934. 10.1097/01.mlr.0000173566.01877.ac.View ArticlePubMedGoogle Scholar
- Houston TK, Richman JS, Ray MN, Allison JJ, Gilbert GH, Shewchuk RM, Kohler CL, Kiefe CI: Internet delivered support for tobacco control in dental practice: randomized controlled trial. J Med Internet Res. 2008, 10: e38-10.2196/jmir.1095.View ArticlePubMedPubMed CentralGoogle Scholar
- Houston TK, Funkhouser E, Allison JJ, Levine DA, Williams OD, Kiefe CI: Multiple measures of provider participation in Internet delivered interventions. Stud Health Technol Inform. 2007, 129: 1401-1405.PubMedGoogle Scholar
- Institute for Healthcare Improvement: System-Minded Design: Optimizing the Microsystem for Workforce Development. 2009, [http://tinyurl.com/3859r2v]Google Scholar
- West R, Hajek P, Stead L, Stapleton J: Outcome criteria in smoking cessation trials: proposal for a common standard. Addiction. 2005, 100: 299-303. 10.1111/j.1360-0443.2004.00995.x.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.