This article has Open Peer Review reports available.
Influence network linkages across implementation strategy conditions in a randomized controlled trial of two strategies for scaling up evidence-based practices in public youth-serving systems
© Palinkas et al.; licensee BioMed Central Ltd. 2013
Received: 1 April 2013
Accepted: 16 October 2013
Published: 14 November 2013
Given the importance of influence networks in the implementation of evidence-based practices and interventions, it is unclear whether such networks continue to operate as sources of information and advice when they are segmented and disrupted by randomization to different implementation strategy conditions. The present study examines the linkages across implementation strategy conditions of social influence networks of leaders of youth-serving systems in 12 California counties participating in a randomized controlled trial of community development teams (CDTs) to scale up use of an evidence-based practice.
Semi-structured interviews were conducted with 38 directors, assistant directors, and program managers of county probation, mental health, and child welfare departments. A web-based survey collected additional quantitative data on information and advice networks of study participants. A mixed-methods approach to data analysis was used to create a sociometric data set (n = 176) to examine linkages between treatment and standard conditions.
Of those network members who were affiliated with a county (n = 137), only 6 (4.4%) were directly connected to a member of the opposite implementation strategy condition; 19 (13.9%) were connected by two steps or fewer to a member of the opposite implementation strategy condition; 64 (46.7%) were connected by three or fewer steps to a member of the opposite implementation strategy condition. Most of the indirect steps between individuals who were in different implementation strategy conditions were connections involving a third non-county organizational entity that had an important role in the trial in keeping the implementation strategy conditions separate. When these entities were excluded, the CDT network exhibited fewer components and significantly higher betweenness centralization than did the standard condition network.
Although the integrity of the RCT in this instance was not compromised by study participant influence networks, RCT designs should consider how influence networks may extend beyond boundaries established by the randomization process in implementation studies.
KeywordsImplementation Randomized controlled trial Design Social networks Evidence-based practice
The Randomized Controlled Trial (RCT) design has long served as the ‘gold standard’ for efficacy and effectiveness research for programs and practices designed to treat or prevent a wide array of physical and mental health problems, tested against standard conditions or other interventions. There is currently an active debate about the role that RCT designs should play in implementation and translational science. In particular, the use of randomized trials in effectiveness and implementation research has been challenged on the grounds that the ‘controlling’ part of the RCT limits important naturally occurring processes in complex systems and therefore has limited external validity [1–3]. In addition to external validity, such designs may also compromise a study’s internal validity in various ways, especially when implementors move to different organizations or transmit knowledge or skills related to implementation.
While its ultimate role is still being debated , there is no question that RCTs are being used in implementation research , particularly in comparing two different implementation strategies of an evidence-based practice (EBP) or empirically-supported intervention (ESI) [6, 7]. In a recent study that relied upon an adapted randomized design, we found that the implementation of an EBP was associated with certain characteristics of the social networks of directors and senior administrators of child welfare agencies, probation departments and mental health departments . Further, these networks cut across organizational and jurisdictional boundaries used to define the unit of randomization, i.e., the county. We concluded from this study that while the organizations may be responsible for the implementation of EBPs, the influence networks of the leaders of these organizations may represent more relevant units to consider, and possibly to randomize, in implementation research.
In the present study, we further examined these influence networks to determine whether they cut across implementation strategy conditions and thus, posed a threat to the study’s internal validity. Our objectives were to identify the network characteristics of the intervention and standard conditions of this RCT and determine the number of direct and indirect influence linkages across the two study arms.
The present study used data from the Cal-40 Study, a randomized implementation trial of a strategy to scale up the use of an EBP for treatment of externalizing behaviors and mental health problems (R01MH076158-01A1) [7, 9]. This EBP, called Multidimensional Treatment Foster Care (MTFC) , has been shown to reduce out-of-home placement in group and residential care, juvenile arrests, substance abuse, youth violence, pregnancy, and behavioral and emotional problems. The implementation strategy tested was the Community Development Team (CDT) approach [11, 12] to scale up MTFC in public youth serving systems in California. CDT involves peer-to-peer interactions among counties who are undergoing the training in the steps required to implement this complex program. A broker agent, the California Institute of Mental Health (CiMH), which already had relationships with all the counties, provided this CDT training. CDT was delivered to six to seven counties who worked together over a period of months to address the infrastructure, logistic and resource challenges in implementing MTFC in their counties. Comparison sites received the standard version of technical assistance for implementing MTFC without the use of CDTs; that is, each county worked alone with the MTFC purveyors who provided equivalent but individual county training. The key research question was whether the peer-to-peer CDT training would foster more rapid implementation than the standard condition. Implementation progress was measured by the Stages of Implementation Completion (SIC) [13, 14].
The CAL-40 study targeted 40 California counties that had not already adopted MTFC. They were matched to form six nearly equivalent groups of six to seven counties in order to balance the design across population composition and service delivery factors. The matched groups were then randomly assigned to one of three sequential cohorts in a waitlist design with staggered start-up timelines (at months 6, 18 or 30). Further, one matched set of counties in each cohort was randomly assigned to CDT and the other to standard implementation condition, thereby generating six groups of counties with three assigned to CDT. While the trial design protocol directly inhibited CiMH from engaging in communications with standard setting counties around MTFC implementation, there were no restrictions placed on individual counties in communicating with counties in the other condition.
Embedded in the CAL-40 study was a smaller project, funded by the William T. Grant Foundation. Using both quantitative and qualitative data, we sought to accomplish the following: first, describe the structure and operation of information and advice networks of public-youth-serving systems in the first cohort of California counties; and then determine the influence of these networks in the implementation of MTFC.
Participants for this smaller T. T. Grant-funded study included members of the influence networks of the agencies that comprised the first cohort of counties (n = 13) of the CAL-40 Study. Agencies from counties comprising the first cohort began participating in the larger RCT in May 2007. Subsequently, directors of the child welfare, mental health, and probation departments of all 13 counties (n = 39 agencies) were invited to participate in the smaller W.T. Grant-funded study of social networks and EBP implementation. In some instances, associate directors or senior program managers were recommended by the directors to be interviewed in their place.
Information on the social networks of study participants was obtained from two sources, a web-based survey and semi-structured interviews. Details on the procedures for constructing networks using these two sets of data have been published elsewhere . Each participant completed a semi-structured interview conducted between July and September 2008. The interview centered on knowledge and implementation of MTFC and other EBPs at the county level. Interviewees were asked if they had ever heard of the Cal-40 Project or MTFC and what their motivations were to participate or not participate in the program. Participants were then asked who they had talked to about participation in MTFC or other EBPs; prompts were given to participants as necessary to identify individuals with whom they communicated, their relationship to that person, their reasons for talking to that person, and the amount of influence that person had on their decision to participate in MTFC or a similar EBP. Then participants were asked about collaborations both within and between county agencies (i.e., child welfare, mental health, probation) and the nature of these collaborations. Specifically, participants were asked to identify what made for a successful versus an unsuccessful collaboration. Finally, participants were asked about who usually suggested that their agency take on new programs or initiatives. Probes to solicit influential actors included: agency staff, other agencies, community based organizations, other county officials, consultants, representatives from federal and state agencies and private foundations, treatment developers, and representatives from broker organizations including CiMH. A copy of the interview guide is found in Additional file 1. Participants’ written informed consent was obtained, and the research study was approved by the Institutional Review Board at the University of Southern California (USC UPIRB #UP-08-00033).
All those interviewed were then asked to complete a web-based social network survey to identify individuals on whom they relied for advice regarding EBP implementation. The survey asked participants to provide general demographic information (i.e., gender, age, number of years in occupation, current position, and time with agency). Per criteria established by Valente and colleagues [16, 17], each study participant was asked to identify as many as 10 individuals for whom they have relied for advice on whether and how to use evidence-based practices for meeting the mental health needs of youth served by their agency. In order to assess whether connections across implementation strategy conditions may have been established through third-party individuals not involved with the Cal-40 study, no limitations were placed on whom could be nominated by study participants. A copy of the survey is found in Additional file 2.
Network analyses were then conducted to determine whether participants in the CDT condition had more ties than those in the standard version, as hypothesized from the peer-to-peer nature of CDT. A second analysis was conducted to determine whether network ties spanned across conditions, which would be a threat to the trial's internal validity. Network analyses were conducted using Ucinet for Windows, Version 6 . To understand differences between treatment and standard conditions, several network level measures of structure were assessed by treatment group, including: network size, density (the number of reported links divided by the maximum number of possible links), average distance between actors, and the number of components (i.e., distinct non-connected groups). To assess communication across implementation strategy conditions we opted for a set of metrics commonly used to understand communication between network actors, namely, out-degree centrality and betweenness. Out-degree centrality refers to the number of network members nominated by a particular actor. Betweenness refers to the frequency an actor falls on the shortest path connecting other actors in the network .
We calculated the minimum path length between any two dyads using the ‘dist’ function in the matrix algebra feature of Ucinet . This creates a dyad-by-dyad assessment of minimum distance between any two nodes in the matrix. Merging this information with attribute-level information about implementation strategy condition (experimental, standard, non-county agency node), using SAS® 9.2 (Statistical Analysis Systems 9.2) , we then calculated the minimum distance needed for each of the agency-based actors to reach an actor of the opposite implementation strategy condition. These path lengths can be interpreted as the degree of separation  between two actors in different conditions, such that path length 1 represents 1 degree of separation, path length 2 represents 2 degrees of separation, and so on. Special handling of ties involving CiMH was examined as well. Because CiMH already had many relationships with county leaders and they led the training of CDT assigned counties, the trial protocol required CiMH to limit their involvement with standard implementation counties to issues not concerning MTFC implementation. Weekly meetings reinforced this limited role throughout the study, effectively closing down these potential channels of communication between CiMH and standard setting counties. We thus repeated our network analyses, removing links involving CiMH.
Participant characteristics for social network data (n = 38)
Control (n = 15)
CDT (n =23)
Mean (SD) age in years*
Number (SD) of participants
Proportion same county
Proportion same agency
Proportion same implementation stage
Comparison of treatment and standard conditions (w/ non-county actors) with and without CiMH representatives
With CiMH nodes
Without CiMH nodes
# of steps
# of components1
Post-hoc analyses using pairwise independent sample t-tests showed no statistically significant differences in out-degree centrality between the two networks (CDT mean = 1.899, SD = 3.510 versus Standard mean = 1.259, SD = 3.160). However, average betweenness centrality was greater in the CDT condition (mean = 5.544, SD = 14.883) compared to the standard condition (mean = 0.741, SD = 2.970) (t = 2.37; p = 0.0191). This statistically significant result (p <0.01) demonstrates the high interconnectivity of the peer-to-peer networked CDT group compared to the standard group. Statistically significant differences between the two conditions on betweenness centrality remained even after CiMH actors were removed from the network.
Minimum path length connecting organizations in opposing implementation strategy conditions, with and without CIMH nodes (n = 137)
Minimum path length
With CiMH nodes
Without CiMH nodes
It is useful to look at the three dyads that cross intervention boundaries as illustrated in Figure 2 where the shape of the node indicates condition (triangle for CDT, circle for standard, and square for other organizations), and the color represents implementation stage (low = red, moderate = yellow, high = green). One leader in a CDT county sought advice about EBPs from another leader in a standard county; both counties were at the highest stage of implementation as of October 2010. Another leader in a CDT county at a moderate level of implementation sought advice from a leader in a standard county at a lower stage of implementation. A third leader in a standard county at a high level of implementation sought advice from a CDT county leader at the same stage of implementation. Two of the other pairs came from similar regions (Northern and Southern California). Two participants from one CDT county were directly connected to individuals from standard counties. Figure 2 also shows the higher density of steps among leaders in the CDT condition compared to that for the standard condition. There are a substantial number of steps that CDT leaders have with others who are not part of the formal study, even when we exclude the CiMH brokers who have a special role in this project.
When individuals in counties not participating in the RCT are excluded from analysis, the networks in the CDT condition and the standard condition take the forms as illustrated in Figures 3 and 4, respectively. Removal of Node 92 leads to the development of two additional components (unconnected networks) in the CDT condition and a complete separation of the largest component in the standard condition into two components.
Finally, we conducted a post hoc analysis of these data in which we limited the network to the original 38 study participants. One participant had a direct tie to a participant in a different implementation strategy condition, and a second participant had a two link path to a participant in a different condition. The remaining 34 participants never connected to a participant in the opposing implementation strategy condition. Limiting the analyses to these 38 nodes ignores the potential for actors between conditions to be linked indirectly.
Interpersonal contacts within and between individuals in organizations and communities are important influences on the adoption of new behaviors [24–26]. Based on Diffusion of Innovations Theory  and Social Learning Theory , Valente’s  social network thresholds model calls for identification of champions within peer networks that manage organizational agenda setting, change, and evaluation of change (e.g., data collection, evaluation, and feedback). Studies and meta-analyses have also shown that both the influence of trusted others in one’s personal network and having access and exposure to external information are important influences on rates of adoption of innovative practices [29–32].
This study found relatively few direct crossover contacts between system leaders in the two study conditions, suggesting that the integrity of the RCT was not compromised by the existence of overlapping influence networks. Only six individuals had direct (first order) steps with individuals in the other condition, and the relationships among these six individuals appeared to be unrelated to the stage of implementation of MTFC in their respective counties. However, there are many more indirect connections between the two study conditions indicating potential threats to the internal validity of the study due to communication between and possible influence of system leaders on each other through third-party actors. In fact, system leaders of child public service systems have much in common in terms of the complex and multifaceted issues and problems that they routinely deal with, and it is not surprising that they go to each other for advice and support. Therefore, in this randomized trial as in others, the potential for contamination through cross condition network ties is a clear concern when grouping of contrasting conditions occurs within contexts that are in close social proximity of each other (e.g., in classrooms within the same schools, therapists in the same mental health clinics, professional relationships in social service settings). Such threats to internal consistency are real and should be considered and measured as part of these trials.
There were very few direct ties in this study across condition and only a modest number of second degree ties. Most of the potential for crossover effects in the present study would have happened through third-party actors, who were not affiliated with a specific county. For example, one of the most popular connections between the two implementation strategy conditions was an actor within CiMH. This finding is not surprising as one of the roles of CiMH is to provide information to all counties regarding best practices. These results indicate that when conducting RCTs in which the county is the unit of randomization, specific instructions to non-county agency leaders that specify limiting communication of treatment practices across conditions will improve the integrity of the study design. However, this recommendation should be interpreted with caution given the real-world requirements of these third-party agencies. If a particular practice is working in an implementation strategy condition, it may be unethical to withhold information regarding this practice from non-treatment counties simply to adhere to randomization procedures of research. In this particular implementation trial, the issue of limiting information through CiMH communications did not raise ethical issues because the remaining counties were provided with the standard implementation model and the same evidence-based intervention.
In the current study, there is no evidence to suggest that the observed crossover had direct effects on the study results. In fact, if the results from the main study indicate that there are differences in outcomes from the CDT and standard implementation conditions, the concerns about internal validity threats will be obviated. However, the results of this study also show that the randomized trial protocol disrupted some of the naturally occurring influence networks in the standard condition, at least with regard to CiMH. Also, most of the study participants and the organizations they represent had indirect steps to organizations in the opposite condition. In particular, 104 (75.9%) of the participants were connected to a participant and organization in the opposite condition in less than four degrees of separation. These connections occurred through individuals or organizations not part of the study. As these non-study network members serve as important sources of information and advice , and as this information and advice appears to be associated with implementation outcomes , the exclusion of this segment of the social networks of either implementation strategy condition creates the potential for attenuating the effect of the implementation strategy by limiting existing network influences.
In the context of this particular study, the role of this potential confounder is illustrated by the results from the post hoc analyses showing significant differences in the network segments of individuals and organizations that were randomized into the two implementation strategy conditions. The network of the counties in the CDT condition had fewer components (one versus five), exhibited greater size and density, and significantly greater betweenness centrality than the network in the standard condition. These results confirm, as we had hypothesized, that there was more cohesion and connectivity among members of the CDT condition than among members in the standard condition. This result is consistent with one of the six core processes of the CDT model, which is the use of Peer-to-Peer exchange and support to promote engagement, commitment, and learning by a group of sites, and encourage cross-fertilization of ideas . As the CDT counties had participated in two CDT meetings prior to data collection, these results suggest that the intervention was successful in creating or strengthening network steps among counties engaged in the shared goal of implementing MTFC. Furthermore, network size and centrality were found to be significant independent predictors of implementation stage in an earlier study of this cohort . Inasmuch as one of the aims of the CDT intervention is to foster the development of influence networks for the purpose of facilitating EBP implementation, and that such networks are associated with the pace of implementation, it becomes particularly important to take into consideration in both design and analysis the roles of influence networks that are not directly involved in the RCT but which nevertheless may influence the study outcomes.
There are several limitations to our study that deserve mention. First, this investigation was conducted during the initial stage of EBP implementation with a small number of counties. Although our findings suggest that there will be changes in patterns and processes of implementation over time, we were primarily interested in examining networks at the initial stages of the implementation process. Second, systems leaders who participated in interviews at this stage of the CAL-40 Study represent almost all of the first cohort, and while this cohort was created to match the population of systems leaders participating in other cohorts, they may not represent the broader population of systems leaders engaged in child and adolescent mental health services across the country. Thus, the results obtained thus far may not generalize to systems outside of California. Third, the 176-member network was constructed based on information from 38 interviewees who were not asked to provide information on sociodemographic and occupational characteristics on those they nominated. In this context, we do not need responses from all 176 members to create the network of linkages between organizations. Our networks, however, are limited in their capacity to show bi-directionality of ties, as most nodes were not interviewed and so linkages are only established by the 38 interviewees. There may be a large number of linkages among the nominated-and-not-interviewed nodes which are missed. Inclusion of these missing linkages, however, would only serve to shorten the number of steps between particular organizations; hence our network is a conservative one, with respect to diffusion across conditions. Consequently, we lacked individual-level measures on the nodes who were not directly interviewed, thereby limiting our statistical power to examine the influence of such characteristics as predictors of network structure. Further, although it was beyond the scope of this study, understanding of the nature and content of relations between the individuals belonging to these networks might have been facilitated by the qualitative information obtained from the semi-structured interviews. Use of qualitative information in this manner in future research on the role of influence networks in evidence-based practice implementation is recommended. Finally, network size and structure may have been influenced by factors such as the number of participants in each county and leadership role (Director, Associate Director, Program Manager). Although we found no difference in the presence of such factors across experimental condition, future studies utilizing RCT designs may wish to examine their potential influence in understanding group differences in social network size and structure.
Despite these limitations, the results of this study suggest that the integrity of the RCT in this instance was not compromised by influence networks of study participants. Nevertheless, RCT designs should take into account the fact that influence networks that are associated with implementation outcomes extend beyond boundaries established by randomization process.
This study was funded through grants from the William T. Grant Foundation (Grant No. 9493: L. Palinkas, PI), National Institute of Mental Health (P30-MH074678: J. Landsverk, PI, P30DA023920: P. Chamberlain, PI and R01MH07658: P. Chamberlain, PI), and National Institute on Drug Abuse (P30 DA027828-01-A1: C. Hendricks Brown, PI).
- Berwick D: The science of improvement. JAMA. 2008, 299 (10): 1182.View ArticlePubMedGoogle Scholar
- Glasgow RE, Magid D, Beck A, Ritzwoller D, Estabrooks P: Practical clinical trials for translating research to practice: Design and measurement recommendations. Med Care. 2005, 43 (6): 551-557.View ArticlePubMedGoogle Scholar
- Proctor E, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B: Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Adm Pol Ment Hlth. 2009, 36: 24-34.View ArticleGoogle Scholar
- Landsverk J, Brown CH, Chamberlain P, Palinkas LA, Horwitz SM: Design and analysis in dissemination and implementation research. Dissemination and implementation research in health: Translating science to practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press, 225-260.View ArticleGoogle Scholar
- Landsverk J, Brown C, Rolls Reutz J, Palinkas L, Horwitz S: Design elements in implementation research: A structured review of child welfare and child mental health studies. Adm Pol Ment Hlth. 2011, 38: 54-63.View ArticleGoogle Scholar
- Chamberlain P, Saldana L, Brown CH, Leve LD: Implementation of MTFC in California: A randomized trial of an evidence-based practice. Empirically Supported Interventions for Community and Organizational Change. Edited by: Roberts-DeGennaro M, Fogel SJ. 2010, Inc: Lyceum BooksGoogle Scholar
- Chamberlain P, Brown CH, Saldana L, Reid J, Wang W, Marsenich L, Sosna T, Padgett C, Bouwman G: Engaging and recruiting counties in an experiment on implementing evidence-based practice in California. Adm Pol Ment Hlth. 2008, 35: 250-260.View ArticleGoogle Scholar
- Palinkas LA, Holloway IW, Rice E, Fuentes D, Wu Q, Chamberlain P: Social networks and implementation of evidence-based practices in public youth-serving systems: a mixed methods study. Implement Sci. 2011, 6: 113.View ArticlePubMedPubMed CentralGoogle Scholar
- Wang W, Saldana L, Brown CH, Chamberlain P: Factors that influenced county system leaders to implement an evidence-based program: A baseline survey within a randomized controlled trial. Implement Sci. 2010, 5: 72.View ArticlePubMedPubMed CentralGoogle Scholar
- Chamberlain P, Leve LD, Degarmo DS: Multidimensional treatment foster care for girls in the juvenile justice system: 2-year follow-up of a randomized clinical trial. J Consult Clin Psychol. 2007, 75: 187-193.View ArticlePubMedGoogle Scholar
- Sosna T, Marsenich L: Community Development Team Model: Supporting the Model Adherent Implementation of Programs and Practices. 2006, Sacramento: California Institute of Mental Health,http://www.cimh.org/sites/main/files/file-attachments/cdt_report_0.pdf,Google Scholar
- Saldana L, Chamberlain P: Supporting implementation: The role of community development teams to build infrastructure. Am J Community Psychol. 2012, 50: 334-345.View ArticlePubMedPubMed CentralGoogle Scholar
- Chamberlain P, Brown CH, Saldana L: Observational measure of implementation progress in community based settings: The stages of implementation completion (SIC). Implement Sci. 2011, 6: 116.View ArticlePubMedPubMed CentralGoogle Scholar
- Saldana L, Chamberlain P, Wang W, Brown CH: Predicting program start-up using the stages of implementation measure. Adm Pol Ment Hlth. 2012, 39: 419-425.View ArticleGoogle Scholar
- Rice ER, Holloway IW, Barman-Adhikari A, Fuentes D, Brown CH, Palinkas LA: A mixed methods approach to network data collection. Field Methods. 2013, in pressGoogle Scholar
- Valente TW, Chou CP, Pentz MA: Community coalitions as a system: Effects of network change and adoption of evidence-based substance abuse prevention. Am J Public Health. 2007, 97: 880-886.View ArticlePubMedPubMed CentralGoogle Scholar
- Valente TW, Pumpuang P: Identifying opinion leaders to promote behavior change. Health Educ Behav. 2007, 34: 881-896.View ArticlePubMedGoogle Scholar
- Borgotti SP: NetDraw: Graph Visualization Software. 2002, Cambridge, MA: Analytic TechnologiesGoogle Scholar
- Freeman LC: Visualizing social networks. J Social Structure. 2000, 4:Google Scholar
- Borgatti SP, Everett MG, Freeman LC: Ucinet for Windows: Software for Social Network Analysis. 2002, Cambridge, MA: Analytic TechnologiesGoogle Scholar
- Freeman LC: Centrality in social networks: I Conceptual clarification. Soc Networks. 1979, 1: 215-239.View ArticleGoogle Scholar
- SAS Institute Inc: SAS/STAT® 9.2. 2008, Cary, NC: SAS Institute IncGoogle Scholar
- Milgram S: The small world problem. Psychology Today. 1967, 2 (1): 60-67.Google Scholar
- Rogers EM: Diffusion of innovations (5th Ed). 2003, New York: Free PressGoogle Scholar
- Palinkas LA, Allred CA, Landsverk J: Models of research-operational collaboration for behavioral health in space. Aviat Space Environ Med. 2005, 76 (Suppl 6): B52-60.PubMedGoogle Scholar
- Brekke JS, Ell K, Palinkas LA: Translational science at the National Institutes of Mental Health: Can Social Work take its rightful place?. Res Soc Work Pract. 2007, 17: 123-133.View ArticleGoogle Scholar
- Bandura A: Social foundations of thought and action: A social cognitive theory. 1986, Prentice Hall: Englewood Cliffs, NJGoogle Scholar
- Valente TW: Network models in the diffusion of innovations. 1995, Creskill, NJ: Hampton PressGoogle Scholar
- Jung DI, Chow C, Wu A: The role of transformational leadership in enhancing organizational innovation: Hypotheses and some preliminary findings. Leadership Q. 2003, 14: 525-544.View ArticleGoogle Scholar
- Valente TW, Davis RL: Accelerating the diffusion of innovations using opinion leaders. Ann Am Acad Pol Soc Sci. 1999, 566: 55-67.View ArticleGoogle Scholar
- Valente TW, Hoffman BR, Rin-Olson A, Lichtman K, Johnson CA: The effects of a social network method for group assignment strategies on peer led tobacco prevention programs in schools. Am J Public Health. 2003, 93: 1837-1843.View ArticlePubMedPubMed CentralGoogle Scholar
- Valente TW: Opinion leader intervention in social networks can change HIV risk behavior in high risk communities. Brit Med J. 2006, 333: 1082-1083.View ArticlePubMedPubMed CentralGoogle Scholar
- Palinkas LA, Fuentes D, Finno M, Garcia AR, Holloway I, Chamberlain P: Inter-organizational collaboration in the implementation of evidence-based practices in public agencies serving abused and neglected youth. Adm Pol Ment Hlth. 2012, Aug 11, epub ahead of print, doi:10.1007/s10488-012-0437-5Google Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.