Developing the next generation of dissemination and implementation researchers: insights from initial trainees
Implementation Science volume 8, Article number: 29 (2013)
Dissemination and implementation (D&I) research is a relatively young discipline, underscoring the importance of training and career development in building and sustaining the field. As such, D&I research faces several challenges in designing formal training programs and guidance for career development. A cohort of early-stage investigators (ESI) recently involved in an implementation research training program provided a resource for formative data in identifying needs and solutions around career development.
Responses outlined fellows’ perspectives on the perceived usefulness and importance of, as well as barriers to, developing practice linkages, acquiring additional methods training, academic advancement, and identifying institutional supports. Mentorship was a cross-cutting issue and was further discussed in terms of ways it could foster career advancement in the context of D&I research.
Advancing an emerging field while simultaneously developing an academic career offers a unique challenge to ESIs in D&I research. This article summarizes findings from the formative data that outlines some directions for ESIs and provides linkages to the literature and other resources on key points.
Dissemination and implementation (D&I) research is a relatively young discipline, underscoring the importance of training and career development in building and sustaining the field. As an emerging field built upon a transdisciplinary blend of sciences and oriented toward the application of research into practice settings, D&I research faces several challenges in designing formal training programs and guidance for career development: the evidence-base is small, though growing, with measures and methods still developing; there are few established ‘experts’ and thus few senior mentors; institutional supports may be lacking; inconsistencies exist in terminology across settings and countries; research often strays (by necessity and/or design) from the more widely-accepted randomized controlled trial[4, 5]; and it often addresses highly intractable problems in complex systems that require team efforts. Thus, the challenges for career development may extend beyond the need to enhance individual research competencies to a broader set of supports. However, these same challenges also point to opportunities for innovation in building a career in the field of D&I research. This brief report explores some issues in career development as described by a small cohort of early-stage investigators (ESI) in D&I research, serving as a source of formative data and providing linkages to the literature on key points.
Perspectives from early-stage investigators
A cohort of ESI recently involved in an implementation research training program provided a resource for formative data around career development issues (http://cmhsr.wustl.edu/Training/IRI/Pages/ImplementationResearchTraining.aspx). In March of 2011, following attendance at the first summer training institute, we contacted participating fellows (n = 11), who were MD- and/or PhD-trained with a background in mental health research, and, via email, asked for responses to a brief series of five open-ended questions related to career development in D&I research (see Additional file1). The questions were intended to catalyze discussion for a think-tank session on building the field of D&I research, presented at the 4th Annual NIH Conference on the Science of Dissemination and Implementation. Responses (n = 8) to the series of five semi-structured, open-ended questions were generally brief (< 3 sentences) and were analyzed using principles of applied thematic analysis, with the analysis structured to outline fellows’ perspectives on the perceived usefulness, importance, barriers and solutions around career development issues, including: developing practice linkages, acquiring additional methods training, academic advancement, and identifying institutional supports (e.g., mentoring and technical assistance) (Table 1).
Developing practice linkages
Practice linkages are key to achieving the underlying D&I science goal of moving evidence to practice. Building upon well-established participatory approaches[8, 9], it is essential that ESIs develop linkages to practice settings (e.g., clinics, health departments) and collaborations with community partners to facilitate their research. Early-stage investigators noted that guidance from faculty who have established such collaborations was critical in their development of strong practice linkages. Equally importantly, expert faculty can assist ESIs in their efforts to strike the right balance between activities that are essential to true collaborations, which are typically less valued by academic appointment and promotion committees, and the need to publish and obtain extramural funding. Senior investigators can pave the way for ESI development of strong practice linkages by making introductions, inviting ESIs to attend meetings with community partners, helping them to understand service system structures, policies and politics, and identifying mutually beneficial areas of collaboration.
Early stage D&I investigators identified additional training in research methods and designs as another key area for enhancing one’s D&I career. Often, given the challenges associated with D&I research, innovative and non-traditional research designs are employed. Many fellows, however, noted that any single discipline rarely provides enough training and background in the variety of methods in D&I research studies, and highlighted the need for those seeking to develop a career in D&I science to gain additional training and experience in such approaches, including mixed-methods, qualitative methods, evaluation methods, comparative effectiveness research, pragmatic or practical clinical trials, quasi-experimental designs, and longitudinal analyses. Fellows suggested that researchers interested in developing and enhancing their skill-set in one or more of these methods seek out additional training opportunities through universities (e.g., professional development seminars), formal training programs (e.g., Canada Summer Institute on Knowledge Translation), conferences (e.g., pre-conference workshops), and cyber-seminar series (e.g., VA HSR&D cyber-seminar series). A selected list of online resources and training programs open to all those who apply across various health and practice settings are included in Table 2. Fellows also suggested seeking input from and collaborating with expert methodologists when designing D&I research studies.
Academic advancement and incentives
As publications and grant funding are weighted heavily in academic performance reviews, ESIs need to be sure to find ways to translate the collaborations that they build with practice settings and the development of new methods into publications and strong grant applications. Because the development of strong practice linkages and the timeline for implementation studies can span several years, many commented on the importance of opportunities to publish using data that has previously been collected through an existing collaboration. Some stated that they had been able to find a niche within a larger ongoing implementation study that is untapped by other investigators. In the absence of such projects, other ESIs were able to identify areas in which a systematic review or pilot research could make a contribution to the field and lay the foundation for larger projects. ESIs indicated that they benefitted from guidance around the choice of appropriate and feasible funding, career development, and smaller grant funding mechanisms (e.g., Clinical and Translational Science Award pilot grants) to fund pilot research in order to build toward competing for larger, R01-type grant projects. Finally, some early-career investigators noted that they had found ways to leverage their expertise, which may be fairly rare at their university or within their department, to build collaborations with other investigators that will ultimately result in publications and funding.
Early-stage investigators emphasized the value of institutional support in advancing one’s D&I career. Institutional characteristics cited as being especially important to career development included having a strong history of funded mentoring programs (e.g., K-awards, T32 programs), senior researchers available and interested in mentoring junior faculty, travel funds, protected time — especially for developing working relationships with practice organizations and potential D&I research sites — and grant writing support. Moreover, having a mentor who is well connected to the D&I community and community partners — both within and outside of one’s own institution — is important, as she or he can provide linkages to potential collaborators and co-mentors to help gain additional experience in and exposure to cutting-edge research. While the need for mentoring and institutional supports is common to career development across many fields of research, features of the field of D&I research that may create a unique set of needs and opportunities are discussed below.
Mentorship as a cross-cutting issue
The importance of mentorship and guidance from senior investigators was a recurring theme that cross-cut other issues discussed, likely reflecting the need for guidance to offset the uncertainty inherent in developing a research career in an emerging field. While there is a broad literature showing the importance of academic mentorship in the sciences in general, it may be particularly fundamental in building capacity in a new area of research such as D&I. Mentorship of junior faculty in D&I research is a cross-cutting issue, certainly as far as the themes discussed above, since an effective mentor can help junior investigators initiate and strengthen practice linkages, guide and find sources for additional methods training, provide access to data, and advise on issues around academic advancement and potential funding sources. An experienced mentor may provide guidance toward applying useful theories, insights into D&I processes, and exemplary interventions from previous work. Issues around mentoring in D&I research are likely to be mostly similar to those in other fields of scientific research, particularly those aimed at translational research[14, 15]. One difference may be that there are not many mentors to foster the careers of the growing number of junior investigators in D&I research at the current early stage of the field’s growth. This potential imbalance may increase the burden on mentors such that the risks in time and effort end up outweighing the personal and professional benefits. However, the nature of research in D&I, which requires links with practice settings and across disciplines, also calls for the need to find mentorship from more than one source to guide specific areas of the research. For example, in addition to a D&I investigator, mentorship from an experienced practitioner-advisor can uniquely prepare ESIs for D&I research.
Another important dimension to mentorship involves advancing the careers of members of underrepresented groups in the scientific community, especially given the prominence of reaching underserved and disparately burdened populations as a priority for D&I research. There is some evidence that for minorities, having a mentor of the same demographic background is beneficial, although successful mentorship can be achieved across racial and other divides and may benefit from training in providing guidance and thoughtful critical feedback.
Context for future directions
The focus of this article is primarily on research situated in US academic settings, though many of the ideas may be applicable to other research settings, geographic areas, and funding sources. Given the background of the current study sample, these findings may be most relevant to ESIs in academic medical centers with traditional promotion policies. We found some common themes with previous work that identified challenges for implementation scientists working in a large, healthcare system. Future work building upon the current study could aim to include a broader sample of ESIs (e.g., not limited to mental health research) as well as senior investigators, who may offer a different perspective on training needs and institutional supports for career advancement. To provide some context for the current cohort of D&I researchers in the US, we examined the rank and gender of the 50 principal investigators (PI) funded through the NIH Program Announcement for Dissemination and Implementation Research in Health, which included R01, R21 and R03 mechanisms. Of the 41 funded PIs whose academic ranking was ascertainable from their academic website, most were mid-to-senior ranked, with only 19.5% assistant professors (Table 3).
Advancing an emerging field while simultaneously developing an academic career offers a unique challenge to ESIs in D&I research. We hope this paper outlines some directions for future investigations into building a stronger career foundation that may include developing practice linkages, filling additional methods training, identifying institutional supports (particularly around academic advancement), and strategically seeking training and guidance from senior mentors. As we have learned from related fields, the adage ‘all teach, all learn, all improve’ is an important guiding philosophy, and strengthening linkages among D&I researchers at all career stages is an implicit — and worthy — goal.
Dissemination and implementation
National Institutes of Health
National Institute of Mental Health
Implementation Research Institute
Training Institute on Dissemination and Implementation Research in Health
Brownson R, Dreisinger M, Colditz G, Proctor E: The path forward in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press, 498-508.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M: Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011, 38: 65-76. 10.1007/s10488-010-0319-7.
McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus SE: A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel?. Implement Sci. 2010, 5: 16-10.1186/1748-5908-5-16.
Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.
Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.
Best A, Holmes B: Systems thinking, knowledge, and action: towards better models and methods. Policy Press. 2010, 6: 145-159.
Guest G, MacQueen KM, Namey EE: Applied Thematic Analysis. 2012, Thousand Oaks: Sage Publications
Cargo M, Mercer SL: The value and challenges of participatory research: Strengthening its practice. Annu Rev Public Health. 2008, 29: 325-350. 10.1146/annurev.publhealth.29.091307.083824.
Minkler M, Salvatore A: Participatory approaches for study design and analysis in dissemination and implementation research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press, 192-212.
Sieber JE: When academicians collaborate with community agencies in effectiveness research. Clin Psychol: Sci Pract. 2008, 15: 137-143. 10.1111/j.1468-2850.2008.00122.x.
Landsverk J, Brown C, Chamberlain P, Palinkas L, Ogihara M, Czaja S, Goldhaber-Fiebert J, Rolls Reutz J, Horwitz S: Design and Analysis in Dissemination and Implementation Research. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press
Sambunjak D, Straus SE, Marusic A: Mentoring in academic medicine: a systematic review. JAMA. 2006, 296: 1103-1115. 10.1001/jama.296.9.1103.
Gagliardi AR, Perrier L, Webster F, Leslie K, Bell M, Levinson W, Rotstein O, Tourangeau A, Morrison L, Silver IL, Straus SE: Exploring mentorship as a strategy to build capacity for knowledge translation research and practice: protocol for a qualitative study. Implement Sci. 2009, 4: 55-10.1186/1748-5908-4-55.
Abedin Z, Biskup E, Silet K, Garbutt JM, Kroenke K, Feldman MD, McGee R, Fleming M, Pincus HA: Deriving competencies for mentors of clinical and translational scholars. Clin Transl Sci. 2012, 5: 273-280. 10.1111/j.1752-8062.2011.00366.x.
Burnham EL, Schiro S, Fleming M: Mentoring K scholars: strategies to support research mentors. Clin Transl Sci. 2011, 4: 199-203. 10.1111/j.1752-8062.2011.00286.x.
Pololi L, Knight S: Mentoring faculty in academic medicine. A new paradigm?. J Gen Intern Med. 2005, 20: 866-870. 10.1111/j.1525-1497.2005.05007.x.
Yancey A, Glenn B, Bell-Lewis L, Ford C: Dissemination and implementation research in populations with health disparities. Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by: Brownson R, Colditz G, Proctor E. 2012, New York: Oxford University Press, 459-482.
Sonnert G, Holton G: Who Succeeds in Science? The Gender Dimension. 1995, New Brunswick, NJ: Rutgers University Press
Cohen GL, Steele CM, Ross LD: The mentor's dilemma: providing critical feedback across the racial divide. Pers Soc Psychol Bull. 1999, 25: 1302-1318. 10.1177/0146167299258011.
Straus SE, Brouwers M, Johnson D, Lavis JN, Legare F, Majumdar SR, McKibbon KA, Sales AE, Stacey D, Klein G, Grimshaw J: Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011, 6: 127-10.1186/1748-5908-6-127.
Sobo EJ, Bowman C, Gifford AL: Behind the scenes in health care improvement: The complex structures and emergent strategies of implementation science. Soc Sci Med. 2008, 67: 1530-1540. 10.1016/j.socscimed.2008.06.001.
US Department of Health and Human Services: Office of Behavioral and Social Sciences Research, National Institutes of Health. http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/index.aspx]. Accessed 11/15/11
The Breakthrough Series: IHI’s Collaborative Model for Achieving Breakthrough Improvement. IHI Innovation Series white paper. 2003, Boston: Institute for Healthcare Improvement, Available onhttp://www.IHI.org,
This publication was supported by the Washington University Institute of Clinical and Translational Sciences grant UL1 TR000448 and KL2 TR000450 from the National Center for Advancing Translational Sciences. The preparation of this article was also supported in part by the Implementation Research Institute (IRI), at the George Warren Brown School of Social Work, Washington University in St. Louis; through an award from the National Institute of Mental Health (R25 MH080916-01A2) and the Department of Veterans Affairs, Health Services Research & Development Service, Quality Enhancement Research Initiative (QUERI), in part by R00 MH 080100, and in part by Cooperative Agreement Number U48/DP001903 from the Centers for Disease Control and Prevention (the Prevention Research Centers Program). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH, VA, or CDC.
The authors would like to extend sincere thanks to Dr. Enola Proctor, for her leadership of a think-tank session at the 4th Annual NIH Conference on the Science of Dissemination and Implementation that led to this paper, and to Dr. Ana A. Baumann, for her assistance in collecting the data.
Wynne E. Norton is on the Editorial Board of Implementation Science. There are no other competing interests to report.
KAS contributed to the study design, carried out the content analysis, supervised all other data analysis, and drafted the manuscript. WEN and SWS contributed to the analysis, writing the draft and reviewing the manuscript. CM contributed to writing and reviewing the manuscript. RCB coordinated the study development and contributed to writing and reviewing the manuscript. All authors read and approved the final manuscript.
Electronic supplementary material
About this article
Cite this article
Stamatakis, K.A., Norton, W.E., Stirman, S.W. et al. Developing the next generation of dissemination and implementation researchers: insights from initial trainees. Implementation Sci 8, 29 (2013). https://doi.org/10.1186/1748-5908-8-29