Skip to main content

Developing the next generation of dissemination and implementation researchers: insights from initial trainees

Abstract

Background

Dissemination and implementation (D&I) research is a relatively young discipline, underscoring the importance of training and career development in building and sustaining the field. As such, D&I research faces several challenges in designing formal training programs and guidance for career development. A cohort of early-stage investigators (ESI) recently involved in an implementation research training program provided a resource for formative data in identifying needs and solutions around career development.

Results

Responses outlined fellows’ perspectives on the perceived usefulness and importance of, as well as barriers to, developing practice linkages, acquiring additional methods training, academic advancement, and identifying institutional supports. Mentorship was a cross-cutting issue and was further discussed in terms of ways it could foster career advancement in the context of D&I research.

Conclusions

Advancing an emerging field while simultaneously developing an academic career offers a unique challenge to ESIs in D&I research. This article summarizes findings from the formative data that outlines some directions for ESIs and provides linkages to the literature and other resources on key points.

Peer Review reports

Background

Dissemination and implementation (D&I) research is a relatively young discipline, underscoring the importance of training and career development in building and sustaining the field[1]. As an emerging field built upon a transdisciplinary blend of sciences and oriented toward the application of research into practice settings, D&I research faces several challenges in designing formal training programs and guidance for career development: the evidence-base is small, though growing, with measures and methods still developing[2]; there are few established ‘experts’ and thus few senior mentors; institutional supports may be lacking; inconsistencies exist in terminology across settings and countries[3]; research often strays (by necessity and/or design) from the more widely-accepted randomized controlled trial[4, 5]; and it often addresses highly intractable problems in complex systems that require team efforts[6]. Thus, the challenges for career development may extend beyond the need to enhance individual research competencies to a broader set of supports. However, these same challenges also point to opportunities for innovation in building a career in the field of D&I research. This brief report explores some issues in career development as described by a small cohort of early-stage investigators (ESI) in D&I research, serving as a source of formative data and providing linkages to the literature on key points.

Perspectives from early-stage investigators

A cohort of ESI recently involved in an implementation research training program provided a resource for formative data around career development issues (http://cmhsr.wustl.edu/Training/IRI/Pages/ImplementationResearchTraining.aspx). In March of 2011, following attendance at the first summer training institute, we contacted participating fellows (n = 11), who were MD- and/or PhD-trained with a background in mental health research, and, via email, asked for responses to a brief series of five open-ended questions related to career development in D&I research (see Additional file1). The questions were intended to catalyze discussion for a think-tank session on building the field of D&I research, presented at the 4th Annual NIH Conference on the Science of Dissemination and Implementation. Responses (n = 8) to the series of five semi-structured, open-ended questions were generally brief (< 3 sentences) and were analyzed using principles of applied thematic analysis[7], with the analysis structured to outline fellows’ perspectives on the perceived usefulness, importance, barriers and solutions around career development issues, including: developing practice linkages, acquiring additional methods training, academic advancement, and identifying institutional supports (e.g., mentoring and technical assistance) (Table 1).

Table 1 Exemplary quotations from early stage investigators in dissemination and implementation research

Developing practice linkages

Practice linkages are key to achieving the underlying D&I science goal of moving evidence to practice. Building upon well-established participatory approaches[8, 9], it is essential that ESIs develop linkages to practice settings (e.g., clinics, health departments) and collaborations with community partners to facilitate their research. Early-stage investigators noted that guidance from faculty who have established such collaborations was critical in their development of strong practice linkages. Equally importantly, expert faculty can assist ESIs in their efforts to strike the right balance between activities that are essential to true collaborations, which are typically less valued by academic appointment and promotion committees[10], and the need to publish and obtain extramural funding. Senior investigators can pave the way for ESI development of strong practice linkages by making introductions, inviting ESIs to attend meetings with community partners, helping them to understand service system structures, policies and politics, and identifying mutually beneficial areas of collaboration.

Methods training

Early stage D&I investigators identified additional training in research methods and designs as another key area for enhancing one’s D&I career. Often, given the challenges associated with D&I research, innovative and non-traditional research designs are employed[11]. Many fellows, however, noted that any single discipline rarely provides enough training and background in the variety of methods in D&I research studies, and highlighted the need for those seeking to develop a career in D&I science to gain additional training and experience in such approaches, including mixed-methods, qualitative methods, evaluation methods, comparative effectiveness research, pragmatic or practical clinical trials, quasi-experimental designs, and longitudinal analyses. Fellows suggested that researchers interested in developing and enhancing their skill-set in one or more of these methods seek out additional training opportunities through universities (e.g., professional development seminars), formal training programs (e.g., Canada Summer Institute on Knowledge Translation), conferences (e.g., pre-conference workshops), and cyber-seminar series (e.g., VA HSR&D cyber-seminar series). A selected list of online resources and training programs open to all those who apply across various health and practice settings are included in Table 2. Fellows also suggested seeking input from and collaborating with expert methodologists when designing D&I research studies.

Table 2 Select training programs, conferences and resources in dissemination and implementation science

Academic advancement and incentives

As publications and grant funding are weighted heavily in academic performance reviews, ESIs need to be sure to find ways to translate the collaborations that they build with practice settings and the development of new methods into publications and strong grant applications. Because the development of strong practice linkages and the timeline for implementation studies can span several years, many commented on the importance of opportunities to publish using data that has previously been collected through an existing collaboration. Some stated that they had been able to find a niche within a larger ongoing implementation study that is untapped by other investigators. In the absence of such projects, other ESIs were able to identify areas in which a systematic review or pilot research could make a contribution to the field and lay the foundation for larger projects. ESIs indicated that they benefitted from guidance around the choice of appropriate and feasible funding, career development, and smaller grant funding mechanisms (e.g., Clinical and Translational Science Award pilot grants) to fund pilot research in order to build toward competing for larger, R01-type grant projects. Finally, some early-career investigators noted that they had found ways to leverage their expertise, which may be fairly rare at their university or within their department, to build collaborations with other investigators that will ultimately result in publications and funding.

Institutional supports

Early-stage investigators emphasized the value of institutional support in advancing one’s D&I career. Institutional characteristics cited as being especially important to career development included having a strong history of funded mentoring programs (e.g., K-awards, T32 programs), senior researchers available and interested in mentoring junior faculty, travel funds, protected time — especially for developing working relationships with practice organizations and potential D&I research sites — and grant writing support. Moreover, having a mentor who is well connected to the D&I community and community partners — both within and outside of one’s own institution — is important, as she or he can provide linkages to potential collaborators and co-mentors to help gain additional experience in and exposure to cutting-edge research. While the need for mentoring and institutional supports is common to career development across many fields of research, features of the field of D&I research that may create a unique set of needs and opportunities are discussed below.

Mentorship as a cross-cutting issue

The importance of mentorship and guidance from senior investigators was a recurring theme that cross-cut other issues discussed, likely reflecting the need for guidance to offset the uncertainty inherent in developing a research career in an emerging field. While there is a broad literature showing the importance of academic mentorship in the sciences in general[12], it may be particularly fundamental in building capacity in a new area of research such as D&I[1]. Mentorship of junior faculty in D&I research is a cross-cutting issue, certainly as far as the themes discussed above, since an effective mentor can help junior investigators initiate and strengthen practice linkages, guide and find sources for additional methods training, provide access to data, and advise on issues around academic advancement and potential funding sources. An experienced mentor may provide guidance toward applying useful theories, insights into D&I processes, and exemplary interventions from previous work[13]. Issues around mentoring in D&I research are likely to be mostly similar to those in other fields of scientific research, particularly those aimed at translational research[14, 15]. One difference may be that there are not many mentors to foster the careers of the growing number of junior investigators in D&I research at the current early stage of the field’s growth. This potential imbalance may increase the burden on mentors such that the risks in time and effort end up outweighing the personal and professional benefits[16]. However, the nature of research in D&I, which requires links with practice settings and across disciplines, also calls for the need to find mentorship from more than one source to guide specific areas of the research. For example, in addition to a D&I investigator, mentorship from an experienced practitioner-advisor can uniquely prepare ESIs for D&I research.

Another important dimension to mentorship involves advancing the careers of members of underrepresented groups in the scientific community, especially given the prominence of reaching underserved and disparately burdened populations as a priority for D&I research[17]. There is some evidence that for minorities, having a mentor of the same demographic background is beneficial[18], although successful mentorship can be achieved across racial and other divides and may benefit from training in providing guidance and thoughtful critical feedback[19].

Context for future directions

The focus of this article is primarily on research situated in US academic settings, though many of the ideas may be applicable to other research settings, geographic areas, and funding sources[20]. Given the background of the current study sample, these findings may be most relevant to ESIs in academic medical centers with traditional promotion policies. We found some common themes with previous work that identified challenges for implementation scientists working in a large, healthcare system[21]. Future work building upon the current study could aim to include a broader sample of ESIs (e.g., not limited to mental health research) as well as senior investigators, who may offer a different perspective on training needs and institutional supports for career advancement. To provide some context for the current cohort of D&I researchers in the US, we examined the rank and gender of the 50 principal investigators (PI) funded through the NIH Program Announcement for Dissemination and Implementation Research in Health, which included R01, R21 and R03 mechanisms[22]. Of the 41 funded PIs whose academic ranking was ascertainable from their academic website, most were mid-to-senior ranked, with only 19.5% assistant professors (Table 3).

Table 3 Characteristics (academic ranking and gender) of NIH-funded principal investigators* in dissemination and implementation research

Advancing an emerging field while simultaneously developing an academic career offers a unique challenge to ESIs in D&I research. We hope this paper outlines some directions for future investigations into building a stronger career foundation that may include developing practice linkages, filling additional methods training, identifying institutional supports (particularly around academic advancement), and strategically seeking training and guidance from senior mentors. As we have learned from related fields, the adage ‘all teach, all learn, all improve’ is an important guiding philosophy[23], and strengthening linkages among D&I researchers at all career stages is an implicit — and worthy — goal.

Abbreviations

D&I:

Dissemination and implementation

NIH:

National Institutes of Health

KT:

Knowledge translation

VA:

Veterans Administration

NIMH:

National Institute of Mental Health

IRI:

Implementation Research Institute

TIDIRH:

Training Institute on Dissemination and Implementation Research in Health

References

  1. Brownson R, Dreisinger M, Colditz G, Proctor E: The path forward in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press, 498-508.

    Chapter  Google Scholar 

  2. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M: Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011, 38: 65-76. 10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  3. McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus SE: A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel?. Implement Sci. 2010, 5: 16-10.1186/1748-5908-5-16.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.

    Article  PubMed  Google Scholar 

  5. Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.

    Article  CAS  PubMed  Google Scholar 

  6. Best A, Holmes B: Systems thinking, knowledge, and action: towards better models and methods. Policy Press. 2010, 6: 145-159.

    Google Scholar 

  7. Guest G, MacQueen KM, Namey EE: Applied Thematic Analysis. 2012, Thousand Oaks: Sage Publications

    Book  Google Scholar 

  8. Cargo M, Mercer SL: The value and challenges of participatory research: Strengthening its practice. Annu Rev Public Health. 2008, 29: 325-350. 10.1146/annurev.publhealth.29.091307.083824.

    Article  PubMed  Google Scholar 

  9. Minkler M, Salvatore A: Participatory approaches for study design and analysis in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press, 192-212.

    Chapter  Google Scholar 

  10. Sieber JE: When academicians collaborate with community agencies in effectiveness research. Clin Psychol: Sci Pract. 2008, 15: 137-143. 10.1111/j.1468-2850.2008.00122.x.

    Google Scholar 

  11. Landsverk J, Brown C, Chamberlain P, Palinkas L, Ogihara M, Czaja S, Goldhaber-Fiebert J, Rolls Reutz J, Horwitz S: Design and Analysis in Dissemination and Implementation Research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press

    Google Scholar 

  12. Sambunjak D, Straus SE, Marusic A: Mentoring in academic medicine: a systematic review. JAMA. 2006, 296: 1103-1115. 10.1001/jama.296.9.1103.

    Article  CAS  PubMed  Google Scholar 

  13. Gagliardi AR, Perrier L, Webster F, Leslie K, Bell M, Levinson W, Rotstein O, Tourangeau A, Morrison L, Silver IL, Straus SE: Exploring mentorship as a strategy to build capacity for knowledge translation research and practice: protocol for a qualitative study. Implement Sci. 2009, 4: 55-10.1186/1748-5908-4-55.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Abedin Z, Biskup E, Silet K, Garbutt JM, Kroenke K, Feldman MD, McGee R, Fleming M, Pincus HA: Deriving competencies for mentors of clinical and translational scholars. Clin Transl Sci. 2012, 5: 273-280. 10.1111/j.1752-8062.2011.00366.x.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Burnham EL, Schiro S, Fleming M: Mentoring K scholars: strategies to support research mentors. Clin Transl Sci. 2011, 4: 199-203. 10.1111/j.1752-8062.2011.00286.x.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Pololi L, Knight S: Mentoring faculty in academic medicine. A new paradigm?. J Gen Intern Med. 2005, 20: 866-870. 10.1111/j.1525-1497.2005.05007.x.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Yancey A, Glenn B, Bell-Lewis L, Ford C: Dissemination and implementation research in populations with health disparities. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press, 459-482.

    Chapter  Google Scholar 

  18. Sonnert G, Holton G: Who Succeeds in Science? The Gender Dimension. 1995, New Brunswick, NJ: Rutgers University Press

    Google Scholar 

  19. Cohen GL, Steele CM, Ross LD: The mentor's dilemma: providing critical feedback across the racial divide. Pers Soc Psychol Bull. 1999, 25: 1302-1318. 10.1177/0146167299258011.

    Article  Google Scholar 

  20. Straus SE, Brouwers M, Johnson D, Lavis JN, Legare F, Majumdar SR, McKibbon KA, Sales AE, Stacey D, Klein G, Grimshaw J: Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011, 6: 127-10.1186/1748-5908-6-127.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Sobo EJ, Bowman C, Gifford AL: Behind the scenes in health care improvement: The complex structures and emergent strategies of implementation science. Soc Sci Med. 2008, 67: 1530-1540. 10.1016/j.socscimed.2008.06.001.

    Article  PubMed  Google Scholar 

  22. US Department of Health and Human Services: Office of Behavioral and Social Sciences Research, National Institutes of Health. http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/index.aspx]. Accessed 11/15/11

  23. The Breakthrough Series: IHI’s Collaborative Model for Achieving Breakthrough Improvement. IHI Innovation Series white paper. 2003, Boston: Institute for Healthcare Improvement, Available onhttp://www.IHI.org,

Download references

Acknowledgments

This publication was supported by the Washington University Institute of Clinical and Translational Sciences grant UL1 TR000448 and KL2 TR000450 from the National Center for Advancing Translational Sciences. The preparation of this article was also supported in part by the Implementation Research Institute (IRI), at the George Warren Brown School of Social Work, Washington University in St. Louis; through an award from the National Institute of Mental Health (R25 MH080916-01A2) and the Department of Veterans Affairs, Health Services Research & Development Service, Quality Enhancement Research Initiative (QUERI), in part by R00 MH 080100, and in part by Cooperative Agreement Number U48/DP001903 from the Centers for Disease Control and Prevention (the Prevention Research Centers Program). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH, VA, or CDC.

The authors would like to extend sincere thanks to Dr. Enola Proctor, for her leadership of a think-tank session at the 4th Annual NIH Conference on the Science of Dissemination and Implementation that led to this paper, and to Dr. Ana A. Baumann, for her assistance in collecting the data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katherine A Stamatakis.

Additional information

Competing interests

Wynne E. Norton is on the Editorial Board of Implementation Science. There are no other competing interests to report.

Authors’ contributions

KAS contributed to the study design, carried out the content analysis, supervised all other data analysis, and drafted the manuscript. WEN and SWS contributed to the analysis, writing the draft and reviewing the manuscript. CM contributed to writing and reviewing the manuscript. RCB coordinated the study development and contributed to writing and reviewing the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Stamatakis, K.A., Norton, W.E., Stirman, S.W. et al. Developing the next generation of dissemination and implementation researchers: insights from initial trainees. Implementation Sci 8, 29 (2013). https://doi.org/10.1186/1748-5908-8-29

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1748-5908-8-29

Keywords