Skip to main content
  • Systematic review
  • Open access
  • Published:

A systematic review of the quality of reporting in published smoking cessation trials for pregnant women: an explanation for the evidence-practice gap?

Abstract

Background

To facilitate translation of evidence into clinical practice, it is critical that clear, specific, and detailed information about interventions is provided in publications to promote replication, appropriate aggregation in meta-analysis, and implementation. This study examined whether twenty elements of interventions deemed essential for such translational application were reported in sufficient detail in smoking cessation trials with pregnant women.

Methods

Searches of electronic databases using MeSH terms and keywords identified peer-reviewed English language studies published between 2001 and 2012. Eligible studies reported a smoking cessation intervention targeted at pregnant women and met Cochrane’s Effective Practice and Organization of Care group study design criteria. Each intervention arm of eligible studies was assessed against the developed twenty criteria.

Results

Thirty relevant studies reported the findings of 45 intervention arms. The mode of delivery of the intervention was reported in 100% of intervention arms. Other well-reported criteria included reporting of the provider who delivered the intervention (96%), sample characteristics (80%), and the intervention setting (80%). Criteria not reported adequately included care provided to women who relapse (96% not reported), details about training given to providers (77% not reported), and the method of quit advice advised (76% not reported). No studies reported 100% of relevant criteria.

Conclusions

Current standards of reporting of intervention content and implementation are suboptimal. The use of smoking cessation specific checklists for reporting of trials, standard reporting using behaviour change taxonomies, and the publication of protocols as supplements should be considered as ways of improving the specificity of reporting.

Peer Review reports

Background

The importance of detailed and accurate reporting in randomised controlled trials

Effective translation of evidence into clinical practice should follow a logical pathway. First, evidence should be generated through the conduct of well-designed and methodologically rigorous randomised controlled trials, which are considered the gold standard in evaluating the comparative effectiveness of healthcare interventions [1]. Replication of effective interventions should then occur to provide verification of findings, allow for the extension and generalization of results, and ensure that adoption of findings will be effective, efficient, and improve care [2]. The findings of well-designed trials can then be combined in meta-analysis to increase the precision of estimations of intervention effect [3]. Clear, specific, and actionable clinical practice guidelines can then be generated for to guide care, and recommendations communicated and disseminated through training and accreditation processes [4]. This process of evidence generation necessitates that randomised controlled trials, on which other information is based, provide detailed, specific, and easily interpretable information.

Quality of reporting—what is the current state of the literature?

In the early 1990’s, a number of reviews identified systemic failures to fully report the methodological characteristics of intervention studies [2],[5]–[7]. As a result, in 1996 the Consolidated Standards of Reporting Trials (CONSORT) guidelines were developed to ensure uniform reporting of the methodological aspects of randomised controlled trials, reduce bias in estimates of intervention effectiveness, and improve internal and external validity [8]. Use of CONSORT criteria has been shown to improve accuracy and quality of reporting [9]–[12], and is now a pre-requisite for publication in many journals. A number of guidelines aimed at improving the quality of reporting of observational studies [4] and systematic reviews [7],[13],[14] have since also been published and adopted [15]. However, less attention has been paid to ensuring detailed and specific information is provided about the content of interventions and precisely how they are delivered [16]. The adequacy of description of intervention content and implementation is not currently captured by these tools. CONSORT guidelines ask researchers to report the “precise details of the treatments intended for each group, and when and where they were actually administered”, however more specific details including timing of treatment, content of intervention materials, and the intervals between delivery of intervention components that are needed to guide clinical practice are not captured by CONSORT or other methodological quality rating tools including those produced by Cochrane [17].

Several recent studies have examined the extent of accurate and complete reporting of essential elements of interventions across different fields of healthcare [16]–[20]. In one analysis by Glasziou et al. [17], only 50% of intervention studies deemed important for clinical practice selected for abstraction in the journal Evidence Based Medicine were deemed replicable. This was despite studies examined being published in high-impact journals including The New England Journal of Medicine, The Lancet, and The British Medical Journal. Duff et al. [18] examined reporting of therapeutic details required for clinical application of the findings of oncology drug trials, finding that only 11% of trials reported all aspects deemed to be essential for replication and clinical translation. Currow et al. [19] examined reporting of data items deemed essential for interpretation of study generalizability in specialist palliative care research, finding that adequate data was reported only 28% of the time. Most recently, Schroter et al. [16] found that 33% of drug treatments and 73% of non-drug treatments published in the British Medical Journal over one year were considered non-replicable.

Despite known effective interventions, many pregnant women do not receive best-practice smoking cessation care

Smoking is the most significant modifiable cause of adverse pregnancy outcomes. Babies born to mothers who smoke during pregnancy have 50% greater risk of perinatal death [21], 60% greater risk of preterm birth [21], and weigh on average 200 g less than babies born to non-smoking mothers [22]. Smoking cessation during pregnancy reduces negative pregnancy outcomes, including miscarriage, foetal growth retardation, preterm delivery [23], and perinatal mortality [24]. Despite evidence for the effectiveness of smoking cessation interventions for pregnant women [25], the provision of best-evidence care continues to be suboptimal. A recent review [26] found that just over half of all healthcare providers are likely to ask pregnant women if they smoke and provide advice to quit, while less than one-half actually assist women to quit by providing specific intervention or referral. Failure to appropriately intervene with pregnant women who smoke could be the result of a number of factors, including healthcare providers not being aware of or agreeing with the evidence for effective interventions, and perceiving that the results of trials do not apply to their patient group or are too difficult or too expensive to implement [26]. Another explanation may be that poor reporting of data in clinical trials has inhibited the implementation of best-practice care in clinical practice.

What do clinicians need to know to translate evidence from smoking cessation clinical trials into clinical practice?

The information reported in randomised controlled trials should be sufficient to allow readers to assess to whom the trial result can reasonably be applied, and how to replicate the intervention. Several studies have developed checklists for assessment of study external validity and other information deemed important in reporting of randomised controlled trials [27]–[30]. These criteria typically include reporting of the setting of the study; recruitment method; participant information, treatment, or intervention delivered (duration, intensity, dose, delivery format, timing, compliance); outcome assessment; and follow-up. Smoking cessation interventions typically incorporate substantial behavioural components that are difficult to both describe and reproduce. To provide appropriate clinical care, clinicians also need clear advice about: the precise behavioural strategies that should be used, what skill individuals providing behavioural support should have, how intense the intervention should be, whether to use nicotine replacement therapy, how to deal with women who do not want to quit, and those who relapse. No studies have examined the adequacy of reporting of this specific information for smoking cessation trials with pregnant women.

Aims

To examine whether twenty elements of interventions and their implementation deemed essential for replication, implementation, and aggregation of studies in meta-analysis are reported in sufficient detail in smoking cessation trials with pregnant women. Criteria were developed based on previously published checklists developed to assess the external validity and applicability of intervention trials, and critical assessment of the information necessary to effectively provide smoking cessation in line with clinical practice guidelines.

Methods

Literature search

Medline, The Cochrane Library, and PsycINFO databases were searched for relevant studies using MeSH terms and subject headings (see Table 1). Searches were limited to studies published between 2001 and 2012. The reference lists of previous reviews of relevant literature and the reference lists of retrieved articles were also searched to identify any additional relevant studies. The review protocol is available from the authors.

Table 1 Search terms

Inclusion and exclusion criteria

Studies were include if they: evaluated a smoking cessation intervention targeted at pregnant women; had smoking cessation or abstinence as an outcome measure; used a design endorsed by the Effective Practice and Organisation of Care (EPOC) group [31] (randomised controlled trials; controlled clinical trials; controlled before and after studies that provided adjustment for confounders; and interrupted time series studies were included); and were published in an English language peer-reviewed journal. Studies were excluded if: the intervention was targeted at a pregnant or postpartum woman’s partner or family member; the intervention was targeted at changing healthcare provider behaviour only; or the intervention examined relapse prevention only without examining cessation or abstinence.

Study selection

The titles and abstracts of identified studies were assessed for relevance by one reviewer and rejected on initial screening if the reviewer could determine that the study did not meet inclusion criteria. The remaining studies were retained and assessed against eligibility criteria by two reviewers (JB and AH). A backward and forward reference list search was conducted using Web of Science for all included studies to determine whether additional details of any studies were described in other publications reporting the same study.

Development of checklist of essential elements

A concise checklist of elements deemed essential to the reporting of intervention content and implementation was developed based on previously published checklists developed to assess the external validity and applicability of intervention trials [32]–[34]; and critical assessment by the authors of the information required to effectively provide smoking cessation care from prenatal into the postnatal period based on recommendations contained with clinical practice guidelines. A standard data extraction checklist was developed, then pilot tested by two authors (JB and AH) by independently assessing five studies using the checklist, then meeting to refine and resolve any disagreements. The data extraction checklist is described in Table 2.

Table 2 Essential elements for reporting of smoking cessation interventions for pregnant women

Data coding

Studies meeting eligibility criteria were coded by two individuals. Discrepancies were resolved by a third. Each study was coded as to whether the study reported the information (yes or no). As not all criteria were relevant to all studies (for example, some studies did not use nicotine replacement therapy), the proportion of all relevant elements reported for each study was then calculated. A score of 100% indicated complete reporting of all applicable elements.

Results

Search results

The initial search yielded 319 citations, and five additional citations were identified through reference list searches (see Figure 1). After duplicates were removed, 258 unique articles were assessed against eligibility criteria of which, 30 studies [35]–[64] met criteria for inclusion. These studies described 45 intervention arms. One additional publication [65] reporting the same study methodology of an included study [49] was identified through backwards and forwards referencing searching. This manuscript was referred to when coding the primary manuscript, however only the primary publication reporting the cessation or abstinence outcome is cited in the results.

Figure 1
figure 1

Flow chart of search strategy, study selection and assignment.

Description of included studies

Twenty individually randomised controlled trials [35],[37],[38],[41],[43],[45],[46],[48]–[51],[56]–[64], six cluster randomised controlled trials [40],[42],[52]–[55], and four non-randomised controlled trials (which used quasi-randomisation methods) [36],[39],[44],[47] were identified. The majority of studies (n = 20) were conducted in the United States [35]–[38],[41],[43],[45]–[47],[50],[51],[54],[56]–[59],[61]–[64], with five studies conducted in the United Kingdom [39],[42],[49],[53],[60], two in the Netherlands [40],[44], and one study each conducted in Poland [55], Canada [48], and New Zealand [52]. The majority of studies used behavioural counselling approaches. Five studies used nicotine replacement therapy [44],[48],[51],[56],[63].

Quality of reporting of intervention strategies

Table 3 outlines the quality of reporting of the 45 interventions arms against the twenty criteria. The mode of delivery of the intervention was reported in 100% of intervention arms. Other basic details of the study including the person who delivered the intervention (96%), the characteristics of the sample (80%), the setting where the intervention was delivered (80%), and the frequency of contact between healthcare providers and participants (73%) were well described. All eight intervention arms (100%) that used a financial incentive intervention described the type, amount, frequency, and conditions under which the incentives were provided. Five of the six intervention arms (83%) that used nicotine replacement therapy adequately described the type, strength, frequency, and duration of use.

Table 3 Number and proportion of the 45 intervention arms reporting each of the 20 criteria a

Criteria that were not well reported included provision of information about the process of care for women who relapse (96% not reported) and details about the specific training given to providers who delivered the intervention (77% not reported). Seventy-six percent of studies did not provide information about the specific type of quit advice given to participants (e.g., whether to set a quit date or stop immediately), and 70% did not describe the behavioural counselling techniques used in sufficient detail for replication. Only one-half of the intervention arms provided information about the timing of the first and last contacts between providers and participants, and only 45% provided information about the duration of each contact.

Table 4 summarises the proportion of intervention elements reported for each intervention arm. No intervention arms reported 100% of all relevant criteria. One intervention arm reported 94% of relevant criteria. Thirty-six percent of intervention arms reported less than 50% of relevant criteria. Four intervention arms reported less than 30% of relevant criteria.

Table 4 Number and proportion of intervention elements reported for each of the 45 intervention arms a

Discussion

This review assessed the adequacy of reporting of elements deemed essential for replication, implementation, aggregation in meta-analysis, and subsequent adoption of findings into clinical practice in smoking cessation trials with pregnant women. We specifically focused on reporting in intervention studies, the findings of which are typically used in generating recommendations for clinical practice guidelines.

Of the 45 intervention arms, none adequately reported 100% of relevant items. Only one intervention arm reported more than 80% of all items. Important information about the delivery of interventions including the type of quit advice provided, the behavioural intervention and written materials provided, the clinical pathway of care, and the training of interventionists were the most poorly described. Information about the intensity and duration of intervention contacts were generally only reported in about one-half of all intervention arms. These factors are critical for both replication of study findings and implementation in clinical practice. The intensity of an intervention carries cost, resource, and feasibility implications for use in routine clinical practice. When such critical data are either not reported or are vague and non-specific, little guidance is provided about the specific components of interventions that should be delivered as part of routine clinical care, or the policies and resources needed to translate best evidence practice into care. Healthcare providers and policy makers are instead left to interpret incomplete information, and draw their own assumptions to fill in the gaps where detail is missing.

Strategies to improve reporting in trials

A number of studies have made recommendations about ways to improve reporting in scientific studies. One suggested approach is the creation of checklists that dictate the specific elements of interventions that should be reported [32]. As suggested by Glasziou et al. [17], it may be necessary to tailor such checklists to different types of interventions. Several attempts have been made to do this. For example, in an attempt to improve standards in reporting of acupuncture trials, Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) [66] have been developed as an extension to the CONSORT criteria. The STRICTA guidelines have since been adopted by a number of journals publishing in acupuncture research. There has been a similar call for standards of reporting to be developed for drug administration in oncology [18] and surgery [67] in order to ensure consistency in the details reported.

There are clear advantages to adopting a standard of reporting for smoking cessation trials. Smoking cessation interventions usually incorporate behavioural strategies, which by their nature are often multi-factorial and can be heavily dependent on the skills and precise behaviours of the person delivering the intervention. If we are to identify the most effective, successful, and appropriate smoking cessation strategies for pregnant women, we need to understand and be able to replicate the specific components of these trials. Michie [68] and Abraham [69] have written extensively about this issue and suggested a taxonomy of behaviour change techniques may be useful in standardising the reporting of components of interventions. An examination of the use of such behaviour change techniques in published smoking cessation trials with pregnant women was recently conducted, with eleven techniques identified as effective [70]. However, the authors noted that the descriptions of interventions were not detailed enough to allow analysis of the effectiveness of individual techniques across studies, highlighting the critical need for improvement in reporting for advancing the evidence base.

Strict length limitations imposed by peer-reviewed journals may also limit the reporting of intervention detail. Electronic methods of peer-review publication allow for supplements or appendices providing detailed information to be published online alongside traditional journal articles [17], and could be better used by authors to make available study protocols as a supplement to the peer reviewed paper, or linking the publication with the published trial registration [68]. While this recommendation is frequently made in many papers examining quality of reporting [71],[72], it is not yet standard practice. Some journals are however starting to require additional information be provided. For example, the journal Addiction requires studies reporting behavioural interventions to include very detailed descriptions of the full study protocol or intervention manual to be published as supplementary material to the peer-reviewed manuscript.

Strengths and limitations of this review

The findings of this review should be considered in light of several limitations. First, the checklist of essential elements used may not capture all of the elements relevant for clinical translation. However, this checklist was developed based on previous studies in other areas [69],[73], and could be used as a starting point to the development of a more comprehensive smoking cessation specific checklist. Second, it is possible that some eligible relevant articles were not identified by our search strategy and therefore not included in this review. Finally, we only coded the presence or absence of reporting of key information, not the quality or accuracy of the information presented.

Conclusion

In order to adequately translate successful smoking cessation interventions into clinical care for pregnant women, healthcare providers need clear guidance about which interventions are most effective. The current standard of reporting of intervention content and implementation is suboptimal, and prohibits replication, implementation, and generation of higher levels of evidence through aggregation in meta-analysis. This ultimately limits the translation of research findings into practice. Clear standards for reporting of the methodological aspects of trials have been adopted, but there is a demonstrated need for improvement in the reporting of essential aspects of interventions and their implementation. For trials relating to pregnant women, increased focus on accurate and specific reporting of the type of quit advice provided, the precise behavioural intervention and written materials provided to participants, the training of intervention providers, and the clinical pathway of care are all of critical importance.

References

  1. Concato J, Shah N, Horwitz RI: Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000, 342: 1887-1892. 10.1056/NEJM200006223422507.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Muma JR: The need for replication. J Speech Hear Res. 1993, 36: 927-930. 10.1044/jshr.3605.927.

    Article  CAS  PubMed  Google Scholar 

  3. Higgins JPT, Green S (Eds): Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. ᅟ: The Cochrane Collaboration; 2011. Available from ., [www.cochrane-handbook.org]

  4. von Elm E, Altman D, Egger M, Pocock S, Gøtzsche P, Vandenbroucke J: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008, 61: 344-349. 10.1016/j.jclinepi.2007.11.008.

    Article  PubMed  Google Scholar 

  5. Altman DG: The scandal of poor medical research. BMJ. 1994, 308: 283-284. 10.1136/bmj.308.6924.283.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. J Am Med Assoc. 1995, 273: 408-412. 10.1001/jama.1995.03520290060030.

    Article  CAS  Google Scholar 

  7. Stroup D, Berlin J, Morton S, Olkin I, Williamson G, Rennie D, Moher D, Becker B, Sipe T, Thacker S: Meta-analysis of observational studies in epidemiology: a proposal for reporting. JAMA. 2000, 283 (15): 2008-2012. 10.1001/jama.283.15.2008.

    Article  CAS  PubMed  Google Scholar 

  8. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996, 276 (8): 637-639. 10.1001/jama.1996.03540080059030.

    Article  CAS  PubMed  Google Scholar 

  9. Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185 (5): 263-267.

    PubMed  Google Scholar 

  10. Moher D, Jones A, Lepage L: Use of the CONSORT statement and quality of reports of randomized trials. A comparative before-and-after evaluation. JAMA. 2001, 285 (15): 1992-1995. 10.1001/jama.285.15.1992.

    Article  CAS  PubMed  Google Scholar 

  11. Kane RL, Wang J, Garrard J: Reporting in randomized clinical trials improved after adoption of the CONSORT statement. J Clin Epidemiol. 2007, 60 (3): 241-249. 10.1016/j.jclinepi.2006.06.016.

    Article  PubMed  Google Scholar 

  12. Scales CD, Norris RD, Keitz SA, Peterson BL, Preminger GM, Vieweg J, Dahm P: A critical assessment of the quality of reporting of randomized, controlled trials in the urology literature. J Urol. 2007, 177 (3): 1090-1095. 10.1016/j.juro.2006.10.027.

    Article  PubMed  Google Scholar 

  13. Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6 (6): e1000097-10.1371/journal.pmed.1000097.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF: Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Lancet. 1999, 354 (9193): 1896-1900. 10.1016/S0140-6736(99)04149-5.

    Article  CAS  PubMed  Google Scholar 

  15. Moher D, Altman DG, Schulz KF, Elbourne DR: Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond. Can Med Assoc J. 2004, 171 (4): 349-350. 10.1503/cmaj.1040031.

    Article  Google Scholar 

  16. Schroter S, Glasziou P, Heneghan C: Quality of descriptions of treatments: a review of publised randomised controlled trials. BMJ Open. 2012, 2: e001978-10.1136/bmjopen-2012-001978.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. Br Med J. 2008, 336: 1472-1474. 10.1136/bmj.39590.732037.47.

    Article  Google Scholar 

  18. Duff JM, Leather H, Walden EO, LaPlant KD, George TJ: Adequacy of published oncology randomized controlled trials to provide therapeutic details needed for clinical application. J Natl Cancer Inst. 2010, 102 (10): 702-705. 10.1093/jnci/djq117.

    Article  PubMed  Google Scholar 

  19. Currow DC, Tieman JJ, Greene A, Zafar SY, Wheeler JL, Abernethy AP: Refining a checklist for reporting patient populations and service characteristics in hospice and palliative care research. J Pain Symptom Manage. 2012, 43 (5): 902-910. 10.1016/j.jpainsymman.2011.05.015.

    Article  PubMed  Google Scholar 

  20. Pibouleau L, Boutron I, Reeves BC, Nizard R, Ravaud P: Applicability and generalisability of published results of randomised controlled trials and non-randomised studies evaluating four orthopaedic procedures: methodological systematic review. Br Med J. 2009, 339: b4538-10.1136/bmj.b4538.

    Article  Google Scholar 

  21. Laws P, Grayson N, Sullivan EA: Smoking and pregnancy: AIHW National Perinatal Statistics Unit. 2006

    Google Scholar 

  22. The health consequences of smoking. A report of the Surgeon General. Reports of the Surgeon General. 2004, US Department of Health and Human Services, Public Service, Office of the Surgeon General, Rockville, MD

  23. Seybold DJ, Broce M, Siegel E, Findley J, Calhoun BC: Smoking in pregnancy in West Virginia: does cessation/reduction improve perinatal outcomes?. Matern Child Health J. 2012, 16 (1): 133-138. 10.1007/s10995-010-0730-4.

    Article  PubMed  Google Scholar 

  24. Salihu HM, Wilson RE: Epidemiology of prenatal smoking and perinatal outcomes. Early Hum Dev. 2007, 83 (11): 713-720. 10.1016/j.earlhumdev.2007.08.002.

    Article  CAS  PubMed  Google Scholar 

  25. Lumley J, Chamberlain C, Dowswell T, Oliver S, Oakley L, Watson L: Interventions for promoting smoking cessation during pregnancy. Cochrane Database Syst Rev. 2009, 3: CD001055-

    PubMed  Google Scholar 

  26. Okoli CTC, Greaves L, Bottorff JL, Marcellus LM: Health care providers’ engagement in smoking cessation with pregnant smokers. J Obstet Gynecol Neonatal Nurs. 2010, 39 (1): 64-77. 10.1111/j.1552-6909.2009.01084.x.

    Article  PubMed  Google Scholar 

  27. Ahmad N, Boutron I, Dechartres A, Durieux P, Ravaud P: Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials. 2010, 11: 1-9. 10.1186/1745-6215-11-20.

    Article  Google Scholar 

  28. Downs SH, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998, 52 (6): 377-384. 10.1136/jech.52.6.377.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17 (1): 1-12. 10.1016/0197-2456(95)00134-4.

    Article  CAS  PubMed  Google Scholar 

  30. Chalmers TC, Smith H, Blackburn B, Silverman B, Schroeder B, Reitman D, Ambroz A: A method for assessing the quality of a randomized control trial. Control Clin Trials. 1981, 2 (1): 31-49. 10.1016/0197-2456(81)90056-8.

    Article  CAS  PubMed  Google Scholar 

  31. Data Collection Checklist. Accessed 01/02/2012. 2002

  32. Rothwell PM: External validity of randomised controlled trials: “To whom do the results of this trial apply?”. Lancet. 2005, 365: 82-93. 10.1016/S0140-6736(04)17670-8.

    Article  PubMed  Google Scholar 

  33. Davidson KW, Goldstein M, Kaplan RM, Kaufmann PG, Knatterud GL, Orleans CT, Spring B, Trudeau KJ, Whitlock EP: Evidence-based behavioral medicine: what is it and how do we achieve it?. Ann Behav Med. 2003, 26 (3): 161-171. 10.1207/S15324796ABM2603_01.

    Article  PubMed  Google Scholar 

  34. Glasziou P, Chalmers I, Altman DG, Bastian H, Boutron I, Brice A, Jamtvedt G, Farmer A, Ghersi D, Groves T, Heneghan C, Hill S, Lewin S, Michie S, Perera R, Pomeroy V, Tilson J, Shepperd S, Williams JW: Taking healthcare interventions from trial to practice. Br Med J. 2010, 341: 384-387.

    Google Scholar 

  35. Albrecht SA, Caruthers D, Patrick T, Reynolds M, Salamie D, Higgins LW, Braxter B, Kim Y, Mlynarchek S: A randomized controlled trial of a smoking cessation intervention for pregnant adolescents. Nurs Res. 2006, 6: 402-410. 10.1097/00006199-200611000-00004.

    Article  Google Scholar 

  36. Britton GR, Brinthaupt J, Stehle JM, James GD: The effectiveness of a nurse-managed perinatal smoking cessation program implemented in a rural county. Nicotine Tob Res. 2006, 8 (1): 13-28. 10.1080/14622200500431536.

    Article  Google Scholar 

  37. Bullock L, Everett KD, Mullen PD, Geden E, Longo DR, Madsen R: Baby BEEP: a randomized controlled trial of nurses’ individualized social support for poor rural pregnant smokers. Matern Child Health J. 2009, 3: 395-406. 10.1007/s10995-008-0363-z.

    Article  Google Scholar 

  38. Cinciripini PM, Blalock JA, Minnix JA, Robinson JD, Brown VL, Lam C, Wetter DW, Schreindorfer L, McCullough JP, Dolan-Mullen P, Stotts AL, Karam-Hage M: Effects of an intensive depression-focused intervention for smoking cessation in pregnancy. J Consult Clin Psychol. 2010, 1: 44-54. 10.1037/a0018168.

    Article  Google Scholar 

  39. Cope GF, Nayyar P, Holder R: Feedback from a point-of-care test for nicotine intake to reduce smoking during pregnancy. Ann Clin Biochem. 2003, 40 (Pt 6): 674-679. 10.1258/000456303770367289.

    Article  PubMed  Google Scholar 

  40. de Vries H, Bakker M, Mullen PD, van Breukelen G: The effects of smoking cessation counseling by midwives on Dutch pregnant women and their partners. Patient Educ Couns. 2006, 63 (1–2): 177-187. 10.1016/j.pec.2005.10.002.

    Article  PubMed  Google Scholar 

  41. Dornelas EA, Magnavita J, Beazoglou T, Fischer EH, Oncken C, Lando H, Greene J, Barbagallo J, Stepnowski R, Gregonis E: Efficacy and cost-effectiveness of a clinic-based counseling intervention tested in an ethnically diverse sample of pregnant smokers. Patient Educ Couns. 2006, 1–3: 342-349. 10.1016/j.pec.2006.03.015.

    Article  Google Scholar 

  42. Hajek P, West R, Lee A, Foulds J, Owen L, Eiser JR, Main N: Randomized controlled trial of a midwife-delivered brief smoking cessation intervention in pregnancy. Addiction. 2001, 96 (3): 485-494. 10.1046/j.1360-0443.2001.96348511.x.

    Article  CAS  PubMed  Google Scholar 

  43. Haug NA, Svikis DS, Diclemente C: Motivational enhancement therapy for nicotine dependence in methadone-maintained pregnant women. Psychol Addict Behav. 2004, 18 (3): 289-292. 10.1037/0893-164X.18.3.289.

    Article  PubMed  Google Scholar 

  44. Hegaard HK, Kjaergaard H, Møller LF, Wachmann H, Ottesen B: Multimodal intervention raises smoking cessation rate during pregnancy. Acta Obstet Gynecol Scand. 2003, 9: 813-819. 10.1034/j.1600-0412.2003.00221.x.

    Article  Google Scholar 

  45. Heil SH, Higgins ST, Bernstein IM, Solomon LJ, Rogers RE, Thomas CS, Badger GJ, Lynch ME: Effects of voucher-based incentives on abstinence from cigarette smoking and fetal growth among pregnant women. Addiction (Abingdon, England). 2008, 103 (6): 1009-1018. 10.1111/j.1360-0443.2008.02237.x.

    Article  Google Scholar 

  46. Hennrikus D, Pirie P, Hellerstedt W, Lando HA, Steele J, Dunn C: Increasing support for smoking cessation during pregnancy and postpartum: results of a randomized controlled pilot study. Prev Med. 2010, 50 (3): 134-137. 10.1016/j.ypmed.2010.01.003.

    Article  PubMed  Google Scholar 

  47. Higgins ST, Heil SH, Solomon LJ, Bernstein IM, Lussier JP, Abel RL, Lynch ME, Badger GJ: A pilot study on voucher-based incentives to promote abstinence from cigarette smoking during pregnancy and postpartum. Nicotine Tob Res. 2004, 6: 1015-1020. 10.1080/14622200412331324910.

    Article  PubMed  Google Scholar 

  48. Kapur B, Hackman R, Selby P, Klein J, Koren G: Randomized, double-blind, placebo-controlled trial of nicotine replacement therapy in pregnancy. Curr Ther Res Clin Exp. 2001, 4: 274-278. 10.1016/S0011-393X(01)80011-4.

    Article  Google Scholar 

  49. Lawrence T, Aveyard P, Evans O, Cheng KK: A cluster randomised controlled trial of smoking cessation in pregnant women comparing interventions based on the transtheoretical (stages of change) model to standard care. Tob Control. 2003, 12 (2): 168-177. 10.1136/tc.12.2.168.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Malchodi CS, Oncken C, Dornelas EA, Caramanica L, Gregonis E, Curry SL: The effects of peer counseling on smoking cessation and reduction. Obstet Gynecol. 2003, 101 (3): 504-510. 10.1016/S0029-7844(02)03070-3.

    PubMed  Google Scholar 

  51. McBride CM, Baucom DH, Peterson BL, Pollak KI, Palmer C, Westman E, Lyna P: Prenatal and postpartum smoking abstinence: a partner-assisted approach. Am J Prev Med. 2004, 27 (3): 232-238.

    PubMed  Google Scholar 

  52. McLeod D, Pullon S, Benn C, Cookson T, Dowell A, Viccars A, White S, Green R, Crooke M: Can support and education for smoking cessation and reduction be provided effectively by midwives within primary maternity care?. Midwifery. 2004, 20 (1): 37-50. 10.1016/S0266-6138(03)00051-2.

    Article  PubMed  Google Scholar 

  53. Moore L, Campbell R, Whelan A, Mills N, Lupton P, Misselbrook E, Frohlich J: Self help smoking cessation in pregnancy: cluster randomised controlled trial. BMJ. 2002, 325 (7377): 1383-10.1136/bmj.325.7377.1383.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Pbert L, Ockene JK, Zapka J, Ma Y, Goins KV, Oncken C, Stoddard AM: A community health center smoking-cessation intervention for pregnant and postpartum women. Am J Prev Med. 2004, 5: 377-385. 10.1016/j.amepre.2004.02.010.

    Article  Google Scholar 

  55. Polanska K, Hanke W, Sobala W, Lowe JB: Efficacy and effectiveness of the smoking cessation program for pregnant women. Int J Occup Med Environ Health. 2004, 17 (3): 369-377.

    PubMed  Google Scholar 

  56. Pollak KI, Oncken CA, Lipkus IM, Lyna P, Swamy GK, Pletsch PK, Peterson BL, Heine RP, Brouwer RJ, Fish L, Myers ER: Nicotine replacement and behavioral therapy for smoking cessation in pregnancy. Am J Prev Med. 2007, 33 (4): 297-305. 10.1016/j.amepre.2007.05.006.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Reitzel LR, Vidrine JI, Businelle MS, Kendzor DE, Costello TJ, Li Y, Daza P, Mullen PD, Velasquez MM, Cinciripini PM, Cofta-Woerpel L, Wetter DW: Preventing postpartum smoking relapse among diverse low-income women: a randomized clinical trial. Nicotine Tob Res. 2010, 12 (4): 326-335. 10.1093/ntr/ntq001.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Rigotti NA, Park ER, Regan S, Chang Y, Perry K, Loudin B, Quinn V: Efficacy of telephone counseling for pregnant smokers: a randomized controlled trial. Obstet Gynecol. 2006, 1: 83-92. 10.1097/01.AOG.0000218100.05601.f8.

    Article  Google Scholar 

  59. Stotts AL, Diclemente CC, Dolan-Mullen P: One-to-one: a motivational intervention for resistant pregnant smokers. Addict Behav. 2002, 2: 275-292. 10.1016/S0306-4603(01)00174-5.

    Article  Google Scholar 

  60. Tappin DM, Lumsden MA, Gilmour WH, Crawford F, McIntyre D, Stone DH, Webber R, MacIndoe S, Mohammed E: Randomised controlled trial of home based motivational interviewing by midwives to help pregnant smokers quit or cut down. BMJ. 2005, 331 (7513): 373-377. 10.1136/bmj.331.7513.373.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Tsoh JY, Kohn MA, Gerbert B: Promoting smoking cessation in pregnancy with Video Doctor plus provider cueing: a randomized trial. Acta Obstet Gynecol Scand. 2010, 4: 515-523. 10.3109/00016341003678419.

    Article  Google Scholar 

  62. Ondersma S, Dace S, Svikis D, Lam P, Connors-Burge V, Ledgerwood D, Hopper J: A randomized trial of computer-delivered brief intervention and low-intensity contingency management for smoking during pregnancy. Nicotine Tob Res. 2012, 14 (3): 351-360. 10.1093/ntr/ntr221.

    Article  PubMed  Google Scholar 

  63. Oncken C, Dornelas E, Greene J, Sankey H, Glasmann A, Feinn R, Kranzler HR: Nicotine gum for pregnant smokers: a randomized controlled trial. Obstet Gynecol. 2008, 112 (4): 859-867. 10.1097/AOG.0b013e318187e1ec.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  64. Tuten M, Fitzsimons H, Chisolm MS, Nuzzo PA, Jones HE: Contingent incentives reduce cigarette smoking among pregnant, methadone-maintained women: Results of an initial feasibilty and efficacy randomized clinical trial. Addiction. 2012, 107: 1868-1877. 10.1111/j.1360-0443.2012.03923.x.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Lawrence T, Aveyard P, Cheng K, Griffin C, Johnson C, Croghan E: Does stage‐based smoking cessation advice in pregnancy result in long‐term quitters? 18‐month postpartum follow‐up of a randomized controlled trial. Addiction. 2005, 100 (1): 107-116. 10.1111/j.1360-0443.2005.00936.x.

    Article  PubMed  Google Scholar 

  66. MacPherson H, White A, Cummings M, Jobst KA, Niemtzom RC: Standards for Reporting Interventions in Controlled Trials of Acupuncture: The STRICTA Recommendations. J Altern Complement Med. 2002, 8 (1): 85-89. 10.1089/107555302753507212.

    Article  PubMed  Google Scholar 

  67. Jacquier I, Boutron I, Moher D, Roy C, Ravaud P: The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: a systematic review. Ann Surg. 2006, 244 (5): 677-10.1097/01.sla.0000242707.44007.80.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Michie S, Abraham C: Advancing the science of behaviour change: a plea for scientific reporting. Addiction. 2008, 103 (9): 1409-1410. 10.1111/j.1360-0443.2008.02291.x.

    Article  PubMed  Google Scholar 

  69. Abraham C, Michie S: A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008, 27: 379-387. 10.1037/0278-6133.27.3.379.

    Article  PubMed  Google Scholar 

  70. Lorencatto F, West R, Michie S: Specifying evidence-based behavior change techniques to aid smoking cessation in pregnancy. Nicotine Tob Res. 2012, 14 (9): 1019-1026. 10.1093/ntr/ntr324.

    Article  PubMed  Google Scholar 

  71. Altman DG, Furberg CD, Grimshaw JM, Rothwell PM: Lead editorial: trials–using the opportunities of electronic publishing to improve the reporting of randomised trials. Trials. 2006, 7 (6): 6-10.1186/1745-6215-7-6.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Godlee F: Publishing study protocols: making them visible will improve registration, reporting and recruitment. BMC news and views. 2001, 2 (1): 4-

    Google Scholar 

  73. Janda S, Young A, FitzGerald JM, Etminan M, Swiston J: The effect of statins on mortality from severe infections and sepsis: a systematic review and meta-analysis. J Crit Care. 2010, 25 (4): 656-10.1016/j.jcrc.2010.02.013. e657-656. e622

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Dr Jamie Bryant is supported by an Australian Research Council Post-Doctoral Industry fellowship. This review was supported by a Strategic Research Partnership Grant from Cancer Council NSW to the Newcastle Cancer Control Collaborative and infrastructure funding from the Hunter Medical Research Institute. The authors have no financial disclosures. The authors would like to acknowledge the assistance of Breanne Hobden, Shiho Rose and Kristy Forshaw in preparing the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jamie Bryant.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JB, RSF and MP conceived of and designed the review. JB, MP, and AH undertook data extraction. All authors contributed to drafting of the manuscript and have read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bryant, J., Passey, M.E., Hall, A.E. et al. A systematic review of the quality of reporting in published smoking cessation trials for pregnant women: an explanation for the evidence-practice gap?. Implementation Sci 9, 94 (2014). https://doi.org/10.1186/s13012-014-0094-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-014-0094-z

Keywords