Skip to main content
Download PDF

Reporting of context and implementation in studies of global health interventions: a pilot study

Implementation Science volume 9, Article number: 57 (2014) Cite this article

Abstract

Background

There is an increasing push for ‘evidence-based’ decision making in global health policy circles. However, at present there are no agreed upon standards or guidelines for how to evaluate evidence in global health. Recent evaluations of existing evidence frameworks that could serve such a purpose have identified details of program context and project implementation as missing components needed to inform policy. We performed a pilot study to assess the current state of reporting of context and implementation in studies of global health interventions.

Methods

We identified three existing criteria sets for implementation reporting and selected from them 10 criteria potentially relevant to the needs of policy makers in global health contexts. We applied these 10 criteria to 15 articles included in the evidence base for three global health interventions chosen to represent a diverse set of advocated global health programs or interventions: household water chlorination, prevention of mother-to-child transmission of HIV, and lay community health workers to reduce child mortality. We used a good-fair-poor/none scale for the ratings.

Results

The proportion of criteria for which reporting was poor/none ranged from 11% to 54% with an average of 30%. Eight articles had ‘good’ or ‘fair’ documentation for greater than 75% of criteria, while five articles had ‘poor or none’ documentation for 50% of criteria or more. Examples of good reporting were identified.

Conclusions

Reporting of context and implementation information in studies of global health interventions is mostly fair or poor, and highly variable. The idiosyncratic variability in reporting indicates that global health investigators need more guidance about what aspects of context and implementation to measure and how to report them. This lack of context and implementation information is a major gap in the evidence needed by global health policy makers to reach decisions.

Peer Review reports

Background

Policy makers in global health are increasingly adopting ‘evidence-based’ decision making practices [1, 2]. By using the available evidence to inform their decision making, it is believed that resultant policy choices can improve in terms of their appropriateness in being applied to a particular context, or likelihood of achieving their envisioned aims. However, at present there are no commonly accepted guidelines within global public health for how to evaluate evidence. Evaluations of existing evidence frameworks have identified details of program context and project implementation as needed, yet missing, components [3, 4]. In this pilot study, we evaluated how context and implementation were reported in recent studies of global health interventions in order to identify areas reported sufficiently well, and areas where action is needed to improve the design, conduct, and reporting of global health interventions to better enable decision-makers to make sound, evidence-based decisions.

Methods

In this study, we identified candidate criteria for reporting context and implementation, selected a representative sample of published global health intervention studies, and then applied the candidate criteria to the published studies. To assist us in the first two tasks, we assembled an international and multidisciplinary Technical Expert Panel (TEP) consisting of intervention developers, evaluators, practitioners, sponsors and policy makers regarding global health (see acknowledgements for list of technical experts, totaling 17 in number). Experts were identified based on publication records covering global health interventions or program evaluation, as well as suggestions from policymaking organizations and sponsors. This was the second phase of a study assessing the utility of existing global health evidence frameworks, the first phase of which has already been published. That study found that existing evidence frameworks vary in their criteria and judgments, and do not sufficiently take into account all of the many needs of decision-makers in global health contexts [3].

Identifying candidate criteria

As part of the discussion of the utility of existing global health evidence frameworks, the TEP identified information about context and implementation as gaps in current evidence frameworks. More specifically, they identified the need for more information about who delivered the intervention, what the intervention consisted of, how it was implemented, what it cost, and contextual details about the population receiving the intervention. We used this input, plus our own knowledge of implementation science, to guide our selection of candidate criteria for reporting of context and implementation. We chose to use existing criteria, selected according to their applicability to the needs identified by the TEP. We used three existing sets of implementation criteria (IC) identified by experts in implementation science: the Consolidated Framework for Implementation Research (CFIR [5]); the proposed criteria for reporting the development and evaluation of complex interventions in healthcare (CReDECI [6]); and those criteria required by the editors of the journal Implementation Science, themselves based on the WIDER criteria [7]. From these IC sets, we identified specific criteria based on the input described above. We tried to include at least one criterion from each of the five domains in the Consolidated Framework for Implementation Research: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. We ended up selecting 10 implementation criteria as a parsimonious set that were potentially relevant to report for implementation of global health interventions, and therefore worth testing in a pilot study. One criterion had eight components that were each rated separately.

Identifying a representative sample of published global health intervention studies

We identified a diverse set of global health interventions as potential candidates with which to apply these existing implementation criteria by considering the major causes of morbidity and mortality in developing countries or the major diseases of focus among international global health financing bodies. This set of global health interventions was chosen both to apply the selected implementation criteria as well as existing evidence frameworks as part of the first phase of this study (described elsewhere) [3].

We developed a draft set of key dimensions for classifying global health interventions in order to map out these potential exemplar interventions to select a diverse set along these dimensions (e.g., population affected, geographic location, whether the intervention addresses a communicable or non-communicable disease, whether the target is a one-time behavior change or recurring event, etc.). TEP members provided input on the dimensions and on their preferred exemplars. From this exercise, we selected three interventions: household water chlorination, prevention of mother-to-child transmission of HIV (PMTCT), and lay or community health workers to reduce childhood morbidity and mortality. Details of this selection process are presented in more detail elsewhere [8].

For each of the three chosen representative global health interventions, we located published systematic reviews of their effectiveness by conducting a Medline search and selected one review for use in this pilot study. The reviews chosen for each intervention were the most recent ones that we judged best assessed the representative interventions. For each of these reviews, we retrieved the original research studies included in the review and used these original studies as sources of evidence when applying the pilot implementation criteria.

Applying the criteria

For each of the 10 implementation criteria and each of the original research articles used in the systematic reviews on each of the representative global health interventions, one reviewer recorded the exact text that was judged related to the criterion, and assigned an initial score of ‘good,’ ‘fair,’ ‘poor/none’ following a rating scheme used by many other quality and reporting checklists. Then, at a group meeting, each criterion for each article was reviewed in detail, and a group decision was reached regarding the final rating, based on the degree to which we judged the text met the needs of stakeholders regarding that aspect of implementation, as determined by the input received from our technical expert panel.

Results and discussion

Results

Table 1 lists the 10 implementation criteria adapted for this project from the 3 IC sets. The provided text examples accompanying these criteria are ones we identified from the global health research articles. The rationale or clarifying statements are taken directly from the original source, with adaptation to the global health context.

Table 1 Global framework – implementation criteria for pilot test
Full size table

For the pilot testing of these implementation criteria, we applied the 10 implementation criteria in Table 1 to the 15 original research articles that form the evidence base for our three global health interventions. For the exemplar intervention of household water chlorination, we used the three original household chlorination research studies that were included in the Clasen et al. [9] meta-analysis for the outcome of rate-ratios for all-age diarrhea (see Analysis 1.1 stratified by intervention type). Furthermore, we include the published journal version for one of these studies instead of the original dissertation, both due to practical convenience and because this is likely to be what would be available to a policymaker undertaking a similar exercise (we substitute the published version of Sobsey et al. [10] for the original dissertation credit of Handzel [11]). For the representative intervention of PMTCT, we utilized five original research studies included in a 2012 systematic review on community strategies to improve PMTCT programs in the developing world [12]. The primary outcomes were prevention of vertical transmission of HIV as well as program retention. For the intervention of community or lay health workers to reduce child mortality, we utilized all seven trials contributing to the meta-analysis in the sole 2010 Cochrane review on this subject [13]. Thus, we applied 10 criteria to each of 15 articles.

Tables 2 and 3 present summary findings for household water chlorination, prevention of mother-to-child-transmission of HIV, and lay health workers by criterion and by article, respectively. Additional file 1 summarizes findings by article and by criterion together. More detailed tables assessing what text was found and how we judged it meeting the criteria can be found in Additional file 2.

Table 2 Ratings of implementation criteria in published studies of three representative global health interventions
Full size table
Table 3 Ratings of implementation criteria by article
Full size table

We found we could not operationalize criterion 6, about the outer setting, and therefore dropped it. The remaining 9 criteria generated 16 ratings, since criterion 4 includes 8 subcriteria. The proportion of criteria for which reporting was poor or none ranged from 11% to 54% with an average of 30%. The two most common criteria for which reporting was rated poor or none were criteria 5 and 10, which dealt with, respectively, cost (either intervention or implementation) and describing or assessing the implementation process itself, in terms of the function or aims of each of the program components. The three most common criteria for which reporting was rated good were criteria 1, 4c, and 4d, which described the source of the intervention (in almost all cases, these were investigator initiated research projects), the setting, and the mode of delivery (such as face-to-face), respectively.

Discussion

The three most important findings of this pilot study are: overall reporting is poor or none for about one third of a sample of criteria; the quality of reporting varies across articles and interventions; and good reporting is possible, with examples of good reporting for each criterion (except costs).

The reporting of implementation information is highly variable both within and across articles, with some articles reporting a great deal of information about some criteria and almost nothing about others, and likewise some articles report almost nothing about most criteria while others report a great deal about most criteria. For example, the articles by Chandisarewa [19], Kumar [23], and Marsh [28] are examples of good reporting on most criteria. In total, eight articles had ‘good’ or ‘fair’ documentation for greater than 75% of criteria, while five articles had ‘poor or none’ documentation for 50% or more criteria. This degree of variability within and across studies suggests that the decisions by each global health study team about which aspects of context and implementation to measure and report are idiosyncratic and not guided by any commonly accepted norms. This contrasts with the more standardized reporting of other aspects of study design and execution, such as whether or not a study uses random assignment to intervention groups and what the attrition rate may be for study participants. Reporting tools such as the CONSORT statement have helped improve the reporting of features such as these [29, 30], and perhaps reporting of global health interventions could be similarly improved by the development and widespread adoption of reporting criteria.

In this pilot study, we made some observations that may prove useful to future assessments of context and implementation in global health interventions. First, as already noted, we found we could not satisfactorily operationalize the CFIR criterion about the outer setting, since we judged that in most or all of the settings the national and local health authorities would judge the aims of the interventions (e.g., reduce water-borne diarrheal illness, reduce mother-to-child transmission of HIV, reduce infant mortality) to be compatible with their health policies. Scoring this criterion as ‘poor or none’ if there was not an explicit statement in the article about this alignment of the intervention with health goals seemed too harsh, and hence we dropped this criterion. Secondly, because we used criteria from different sources, there were some that overlapped and could be consolidated; for example, criterion 4h, ‘A detailed description of the intervention/program content provided to each study group,’ and criterion 9, ‘Description of all materials or tools used for the implementation.’ Thirdly, we followed the common practice of giving the ‘benefit of the doubt’ when making judgments between categories, meaning our ratings are probably a ‘best case scenario’ for current reporting. More work in making sharper the operational definitions between different categories of reporting will be needed to avoid this upward bias. Lastly, we found some criteria more difficult to rate than others; specifically, criteria 2, 3, 7 and 8 were particularly difficult to judge, and we believe further work is needed to assess and improve inter-rater reliability. Our judgment is that the items 4a to 4h (from the WIDER criteria) are potentially the most immediately useful and applicable, with the addition of criterion 5 about costs, as we found these easiest to rate.

In summary, this pilot study found that reporting of context and implementation information in studies of global health interventions is at best mostly fair or poor, and highly variable. The lack of context and implementation information is a major gap in the evidence needed by global health policy makers to reach decisions. The idiosyncratic variability in reporting indicates global health investigators need more guidance about what aspects of context and implementation to measure and how to report them. This pilot study could be useful to an effort to develop that guidance. Without better reporting, policy makers will be left in the dark about context and implementation details that are key to designing and introducing an effective and sustainable intervention.

Authors’ information

JL (PhD) is an Economist at the RAND Corporation. PS (MD, PhD) is an Internist who serves as the Chief of General Internal Medicine at the West Los Angeles Veterans Affairs Medical Center in Los Angeles. He is also the Director of the Southern California Evidence-based Practice Center based at the RAND Corporation in Santa Monica. MM (MPP) is the Associate Director of the Southern California Evidence-based Practice Center based at the RAND Corporation in Santa Monica. BJ (BS) was a Research Assistant and TP (BHM) was a Project Assistant. Both worked for the Southern California Evidence-Based Practice Center based at the RAND Corporation in Santa Monica.

Abbreviations

CFIR:

Consolidated Framework for Implementation Research

CONSORT:

Consolidated Standards of Reporting Trials

CReDECI:

Criteria for reporting the development and evaluation of complex interventions in healthcare

HIV:

Human immunodeficiency virus

IC:

Implementation criteria

NGO:

Non-governmental organization

PMTCT:

Prevention of mother-to-child transmission of HIV

TEP:

Technical expert panel

WIDER:

Workgroup for Intervention Development and Evaluation Research.

References

  1. 1.

    Yamey G, Feachem R: Evidence-based policymaking in global health - the payoffs and pitfalls. Evid Based Med. 2011, 16: 97-99. 10.1136/ebm.2011.100060.

    Article  PubMed  Google Scholar 

  2. 2.

    Murray CJ, Lopez AD: Evidence-based health policy–lessons from the Global Burden of Disease Study. Science. 1996, 274: 740-743. 10.1126/science.274.5288.740.

    CAS  Article  PubMed  Google Scholar 

  3. 3.

    Luoto J, Maglione MA, Johnsen B, Chang C, S Higgs E, Perry T, Shekelle PG: A comparison of frameworks evaluating evidence for global health interventions. PLoS Med. 2013, 10: e1001469-10.1371/journal.pmed.1001469.

    Article  PubMed  PubMed Central  Google Scholar 

  4. 4.

    Lewin S, Bosch-Capblanch X, Oliver S, Akl EA, Vist GE, Lavis JN, Ghersi D, Rottingen JA, Steinmann P, Gulmezoglu M, Tugwell P, El-Jardali F, Haines A: Guidance for Evidence-Informed Policies about Health Systems: Assessing How Much Confidence to Place in the Research Evidence. PLoS Med. 2012, 9: e1001187-10.1371/journal.pmed.1001187.

    Article  PubMed  PubMed Central  Google Scholar 

  5. 5.

    Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50.

    Article  PubMed  PubMed Central  Google Scholar 

  6. 6.

    Mohler R, Bartoszek G, Kopke S, Meyer G: Proposed criteria for reporting the development and evaluation of complex interventions in healthcare (CReDECI): guideline development. Int J Nurs Stud. 2012, 49: 40-46. 10.1016/j.ijnurstu.2011.08.003.

    Article  PubMed  Google Scholar 

  7. 7.

    Michie S, Fixsen D, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009, 4: 40-10.1186/1748-5908-4-40.

    Article  PubMed  PubMed Central  Google Scholar 

  8. 8.

    Shekelle PG, Maglione MA, Luoto J, Johnsen B, Perry TR: Global Health Evidence Evaluation Framework. Research White Paper (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-2007-10062-I). AHRQ Publication No. 13-EHC008-EF. 2013, Rockville, MD: Agency for Healthcare Research and Quality, Available at: http://effectivehealthcare.ahrq.gov/ehc/products/363/1384/White-Paper_Global-Health-Frameworks-1-22-13.pdf. In Book Global Health Evidence Evaluation Framework. Research White Paper (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-2007-10062-I). AHRQ Publication No. 13-EHC008-EF. Rockville, MD: Agency for Healthcare Research and Quality. January 2013. Available at: http://effectivehealthcare.ahrq.gov/ehc/products/363/1384/White-Paper_Global-Health-Frameworks-1-22-13.pdf (Editor ed.^eds.). City; 2013

    Google Scholar 

  9. 9.

    Clasen T, Schmidt WP, Rabie T, Roberts I, Cairncross S: Interventions to improve water quality for preventing diarrhoea: systematic review and meta-analysis. BMJ. 2007, 334: 782-10.1136/bmj.39118.489931.BE.

    Article  PubMed  PubMed Central  Google Scholar 

  10. 10.

    Sobsey MD, Handzel T, Venczel L: Chlorination and safe storage of household drinking water in developing countries to reduce waterborne disease. Water Sci Technol. 2003, 47: 221-228.

    CAS  PubMed  Google Scholar 

  11. 11.

    Handzel T: The Effect of Improved Drinking Water Quality on the Risk of Diarrhoeal Disease in an Urban Slum of Dhaka, Bangladesh: A Home Chlorination Intervention Trial. 1998, University of North Carolina, Department of Environmental Sciences and Engineering

    Google Scholar 

  12. 12.

    Marcos Y, Phelps BR, Bachman G: Community strategies that improve care and retention along the prevention of mother-to-child transmission of HIV cascade: a review. J Int AIDS Soc. 2012, 15 (2): 17394-

    PubMed  PubMed Central  Google Scholar 

  13. 13.

    Lewin S, Munabi-Babigumira S, Glenton C, Daniels K, Bosch-Capblanch X, van Wyk BE, Odgaard-Jensen J, Johansen M, Aja GN, Zwarenstein M, Scheel IB: Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. Cochrane Database Syst Rev. 2010, 17: 1-210. CD004015

    Google Scholar 

  14. 14.

    Lule JR, Mermin J, Ekwaru JP, Malamba S, Downing R, Ransom R, Nakanjako D, Wafula W, Hughes P, Bunnell R, Kaharuza F, Coutinho A, Kigozi A, Quick R: Effect of home-based water chlorination and safe storage on diarrhea among persons with human immunodeficiency virus in Uganda. Am J Trop Med Hyg. 2005, 73: 926-933.

    PubMed  Google Scholar 

  15. 15.

    Luby SP, Agboatwalla M, Hoekstra RM, Rahbar MH, Billhimer W, Keswick BH: Delayed effectiveness of home-based interventions in reducing childhood diarrhea, Karachi, Pakistan. Am J Trop Med Hyg. 2004, 71: 420-427.

    PubMed  Google Scholar 

  16. 16.

    Futterman D, Shea J, Besser M, Stafford S, Desmond K, Comulada WS, Greco E: Mamekhaya: a pilot study combining a cognitive-behavioral intervention and mentor mothers with PMTCT services in South Africa. AIDS care. 2010, 22: 1093-1100. 10.1080/09540121003600352.

    Article  PubMed  PubMed Central  Google Scholar 

  17. 17.

    Torpey K, Kabaso M, Kasonde P, Dirks R, Bweupe M, Thompson C, Mukadi YD: Increasing the uptake of prevention of mother-to-child transmission of HIV services in a resource-limited setting. BMC Health Serv Res. 2010, 10: 29-10.1186/1472-6963-10-29.

    Article  PubMed  PubMed Central  Google Scholar 

  18. 18.

    Faraquhar C, Kiarie JN, Richardson BA, Kabura MN, John FN, Nduati RW: Antenatal couple counseling increases uptake of interventions to prevent HIV-1 transmission. J Acquir Immune Defic Syndr. 2004, 37: 1620-1626. 10.1097/00126334-200412150-00016.

    Article  Google Scholar 

  19. 19.

    Chandisarewa W, Stranix-Chibanda L, Chirapa E, Miller A, Simoyi M, Mahomva A, Maldonado Y, Shetty AK: Routine offer of antenatal HIV testing ("opt-out" approach) to prevent mother-to-child transmission of HIV in urban Zimbabwe. Bull World Health Organ. 2007, 85: 843-850.

    Article  PubMed  PubMed Central  Google Scholar 

  20. 20.

    Bekker LG, Myer L, Orrell C, Lawn S, Wood R: Rapid scale-up of a community-based HIV treatment service: programme performance over 3 consecutive years in Guguletu, South Africa. S Afr Med J. 2006, 96: 315-320.

    PubMed  Google Scholar 

  21. 21.

    Sloan NL, Ahmed S, Mitra SN, Choudhury N, Chowdhury M, Rob U, Winikoff B: Community-based kangaroo mother care to prevent neonatal and infant mortality: a randomized, controlled cluster trial. Pediatrics. 2008, 121: e1047-1059. 10.1542/peds.2007-0076.

    Article  PubMed  Google Scholar 

  22. 22.

    Kouyate B, Some F, Jahn A, Coulibaly B, Eriksen J, Sauerborn R, Gustafsson L, Tomson G, Becher H, Mueller O: Process and effects of a community intervention on malaria in rural Burkina Faso: randomized controlled trial. Malar J. 2008, 7: 50-10.1186/1475-2875-7-50.

    Article  PubMed  PubMed Central  Google Scholar 

  23. 23.

    Kumar V, Mohanty S, Kumar A, Misra RP, Santosham M, Awasthi S, Baqui AH, Singh P, Singh V, Ahuja RC, Singh JV, Malik GK, Ahmed S, Black RE, Bhandari M, Darmstadt GL: Effect of community-based behaviour change management on neonatal mortality in Shivgarh, Uttar Pradesh, India: a cluster-randomised controlled trial. Lancet. 2008, 372: 1151-1162. 10.1016/S0140-6736(08)61483-X.

    Article  PubMed  Google Scholar 

  24. 24.

    Bari S, Mannan I, Rahman MA, Darmstadt GL, Serajil MH, Baqui AH, El Arifeen S, Rahman SM, Saha SK, Ahmed AS, Santosham M, Black RE, Winch PJ: Trends in use of referral hospital services for care of sick newborns in a community-based intervention in Tangail District, Bangladesh. J Health Popul Nutr. 2006, 24: 519-529.

    PubMed  PubMed Central  Google Scholar 

  25. 25.

    Chongsuvivatwong V, Mo-Suwan L, Tayakkanonta K, Vitsupakorn K, McNeil R: Impacts of training of village health volunteers in reduction of morbidity from acute respiratory infections in childhood in southern Thailand. Southeast Asian J Trop Med Public Health. 1996, 27: 333-338.

    CAS  PubMed  Google Scholar 

  26. 26.

    Manandhar DS, Osrin D, Shrestha BP, Mesko N, Morrison J, Tumbahangphe KM, Tamang S, Thapa S, Shrestha D, Thapa B, Shrestha JR, Wade A, Borghi J, Standing H, Manandhar M, Costello AM: Effect of a participatory intervention with women's groups on birth outcomes in Nepal: cluster-randomised controlled trial. Lancet. 2004, 364: 970-979. 10.1016/S0140-6736(04)17021-9.

    Article  PubMed  Google Scholar 

  27. 27.

    Sripaipan T, Schroeder DG, Marsh DR, Pachon H, Dearden KA, Ha TT, Lang TT: Effect of an integrated nutrition program on child morbidity due to respiratory infection and diarrhea in northern Viet Nam. Food Nutr Bull. 2002, 23: 70-77.

    Article  PubMed  Google Scholar 

  28. 28.

    Marsh DR, Pachon H, Schroeder DG, Ha TT, Dearden K, Lang TT, Hien ND, Tuan DA, Thach TD, Claussenius DR: Design of a prospective, randomized evaluation of an integrated nutrition program in rural Viet Nam. Food Nutr Bull. 2002, 23: 36-47.

    PubMed  Google Scholar 

  29. 29.

    Moher D, Jones A, Lepage L, Group C: Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.

    CAS  Article  PubMed  Google Scholar 

  30. 30.

    Turner L, Shamseer L, Altman DG, Schulz KF, Moher D: Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review. Sys Rev. 2012, 1: 60-10.1186/2046-4053-1-60.

    Article  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the following individuals for their contributions to this project: Elizabeth Higgs, M.D., M.I.A., D.T.M.H., National Institute of Allergy and Infectious Diseases—Bethesda, MD. U.S. Agency for International Development – Washington, DC. Christine Chang, M.D., M.P.H., Evidence-based Practice Center Program Task Order Officer, Center for Outcomes and Evidence, Agency for Healthcare Research and Quality.

The following experts in global health and in program evaluation helped advise this project as part of a Technical Expert Panel (TEP): Robert Balster, PhD: Jefferson Science Fellow, USAID, Washington, DC, USA; Stefan Baral, MD, MPH: Assistant Scientist, Johns Hopkins University, Baltimore, Maryland, USA; Al Bartlett, MD: Director, Saving Newborn Lives Program, Save The Children, Washington, DC, USA; Leonard Bickman, PhD: Professor of Psychology, Psychiatry and Public Policy; Director, Center for Evaluation and Program Improvement (CEPI), Vanderbilt University’s Peabody College, Nashville, Tennessee, USA; Kevin M. De Cock, MD: Director, Center for Global Health, Centers for Disease Control and Prevention, Atlanta, Georgia, USA; Donna Farley, PhD, MPH: Senior Health Policy Researcher, RAND Corporation, Pittsburgh, Pennsylvania, USA; Geoff Garnett, PhD: Professor of Microparasite Epidemiology, Imperial College London, London, UK; Paul Gertler, PhD: Professor of Economics, University of California at Berkeley, Berkeley, California, USA; Irene Koek, PhD: Director of the Health office for USAID/Indonesia, USAID, Indonesia; Cliff Lane, MD: Director Division of Clinical Research, NIAID, NIH, Bethesda, Maryland, USA; Jack Molyneaux, MD: Director of Impact Evaluation, Millennium Challenges Corporation, Washington, DC, USA;

Pierre Ongolo-Zogo, MD: Head - Centre for Development of Best Practices in Health, Yaoundé Central Hospital, Yaoundé, Cameroon; Mead Over, PhD: Senior VP, Healthcare Improvement Division, Center for Global Development, Washington, DC, USA; Ariel Pablos-Méndez, MD, MPH: Assistant Administrator for Global Health, USAID, Washington, DC, USA; Tikki Pangestu, PhD: Director, Research Policy & Cooperation, World Health Organization, Geneva, Switzerland; Laurence Slutsker, MD, MPH: Associate Director for Science, Centers for Disease Control and Prevention, Atlanta, Geogia, USA; Kieran Walshe, PhD: Professor of Health Policy & Management, Manchester Business School, University of Manchester, Manchester, UK.

Author information

Author notes

    Affiliations

    1. RAND Corporation, 1776 Main Street, Santa Monica, CA, USA

      Jill Luoto, Paul G Shekelle, Margaret A Maglione, Breanne Johnsen & Tanja Perry

    2. West Los Angeles Veterans Affairs Medical Center, Los Angeles, CA, USA

      Paul G Shekelle

    Authors
    1. Jill Luoto
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Paul G Shekelle
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Margaret A Maglione
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Breanne Johnsen
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Tanja Perry
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Jill Luoto.

    Additional information

    Competing interests

    The authors declare no competing interests. This article is based on research conducted by the Southern California Evidence-Based Practice Center under contract with the Agency for Healthcare Research and Quality http://www.ahrq.gov (AHRQ; contract No. HHSA290200710062I). The authors of this article are responsible for its contents. No statement in this article should be construed as an official position of AHRQ or the US Department of Health and Human Services. The funder had no role in the study design, data collection and analysis, or decision to publish.

    Authors’ contributions

    Analyzed the data: JL, MAM, PGS. Wrote the first draft of the manuscript: JL. Contributed to the writing of the manuscript: JL, MAM, PGS. Agree with manuscript results and conclusions: JL, MAM, BJ, TP, PGS. Obtained funding: PGS. Administrative, technical or material support: BJ, TP. Critical revision of the manuscript for important intellectual content: JL, MAM, PGS. Study supervision: PGS. All authors read and approved the final manuscript.

    Jill Luoto, Paul G Shekelle, Margaret A Maglione contributed equally to this work.

    Electronic supplementary material

    Rights and permissions

    This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

    Reprints and Permissions

    About this article

    Verify currency and authenticity via CrossMark

    Cite this article

    Luoto, J., Shekelle, P.G., Maglione, M.A. et al. Reporting of context and implementation in studies of global health interventions: a pilot study. Implementation Sci 9, 57 (2014). https://doi.org/10.1186/1748-5908-9-57

    Download citation

    Keywords

    • Global Health
    • Rand Corporation
    • Original Research Article
    • Outer Setting
    • Good Reporting

    Implementation Science

    ISSN: 1748-5908