- Open Access
Finding what works: identification of implementation strategies for the integration of methadone maintenance therapy and HIV services in Vietnam
Implementation Science volume 11, Article number: 54 (2015)
Integration of methadone maintenance therapy (MMT) and HIV services is an evidence-based intervention (EBI) that benefits HIV care and reduces costs. While MMT/HIV integration is recommended by the World Health Organization and the Centers for Disease Control and Prevention, it is not widely implemented, due to organizational and operational barriers. Our study applied an innovative process to identify implementation strategies to address these barriers.
Our process was adapted from the Expert Recommendations for Implementing Change (ERIC) protocol and consisted of two main phases. In Phase 1, we conducted 16 in-depth interviews with stakeholders and developed matrices to display barriers to integration. In Phase 2, we selected implementation strategies that addressed the barriers identified in Phase 1 and conducted a poll to vote on the most important and feasible strategies among a panel with expertise in cultural context and implementation science.
Barriers fell into two broad categories: policy and programmatic. At the policy level, barriers included lack of a national mandate, different structures (MMT vs. HIV clinic) for cost reimbursement and staff salaries, and resistance on the part of staff to take on additional tasks without compensation. Programmatic barriers included the need for cross-training in MMT and HIV tasks, staff accountability, and commitment from local leaders. In Phase 2, we focused on programmatic challenges. Based on voting results and iterative dialogue with our expert panel, we selected several implementation strategies in the domains of technical assistance, staff accountability, and local commitment that targeted these barriers.
Key programmatic barriers to MMT/HIV integration in Vietnam may be addressed through implementation strategies that focus on technical assistance, staff accountability, and local commitment. Our process of identifying implementation strategies was simple, low cost, and potentially replicable to other settings.
The process of translating evidence-based interventions (EBIs) to real-world settings is a critical step in the research to practice continuum. But this step is frequently neglected in the public health sector [1–4]. The field of implementation science has rapidly expanded to address this gap within public health  and, more specifically, within HIV research [6–8]. While the effectiveness of EBIs can be achieved in a real-world HIV context [9–11], how EBIs are implemented clearly affects their effectiveness and sustainability . In other words, implementation outcomes, such as feasibility and acceptability, are directly linked to HIV effectiveness outcomes in the real world .
Several evidence-based implementation strategies are being used to facilitate the complex process of moving EBIs into real-world settings [2, 4, 13, 14]. Although many implementation strategies [15, 16] and taxonomies [16–18] have been developed, the potential effectiveness of these implementation strategies in specific settings is uncertain [4, 14]. Service settings vary substantially with regard to contextual factors such as patient characteristics [19, 20], provider attitudes toward an EBI , organizational readiness , leadership , and policies . These contextual factors can, in turn, influence the success of implementation strategies [4, 14]. While strategies designed to address context-specific barriers and facilitators are more likely to succeed [4, 14], the process of selecting the most effective strategy for an EBI in a given context can be overwhelming. Recently, guidelines to facilitate this process of selecting implementation strategies for specific contexts have been developed . For example, the Expert Recommendations for Implementing Change (ERIC) protocol is a four-stage, mixed-methods process to develop expert recommendations regarding implementation strategies for a given context .
Integration of opioid substitution therapy, such as methadone maintenance therapy (MMT), and HIV related services is an EBI that leads to increased engagement of people who inject drugs (PWID) in HIV prevention and treatment [25–33]. HIV-infected PWID who participate in integrated drug treatment and HIV services experience several benefits . They experience less bureaucracy accessing and engaging in services; increased monitoring of drug interactions and side effects from MMT and the provision of antiretroviral treatment (ART) for HIV [35–45]; reduced HIV stigma from providers; consolidated drug use and HIV counseling; and health care delivery systems that are targeted and user-friendly [46–48]. In addition, integration of drug treatment and HIV care services reduces costs [49, 50] and is cost-effective [51, 52], which is critically important in low- and middle-income countries. Combining services increases efficiency and lowers costs by reducing space requirements and building a cadre of providers with multiple skillsets.
Opioid substitution/HIV care integration is endorsed by international agencies [53, 54] to address disproportionately low access to ART among HIV-infected PWID . Only one in ten PWID living with HIV receives ART . Those who have accessed ART have generally low adherence and poor HIV disease-related outcomes [57–59]. When PWID living with HIV have access to MMT, they increase ART uptake [60–62] and ART adherence [58, 60, 63–69], have improved HIV viral suppression [68–70], and live longer . Additionally, integrating MMT and HIV services optimizes these effects by increasing ART initiation and adherence [25–27] and improving viral suppression [26, 27].
Despite improved outcomes for PWID with MMT/HIV service integration, the most effective approaches to the implementation of MMT/HIV integration have not been identified , and integrated services have not been implemented widely [73, 74]. Past integration efforts have faced multiple barriers including organizational and political constraints, overburdened clinicians struggling to take on new responsibilities, and a lack of leadership investment at all levels [50, 75–77]. In Vietnam, integrated MMT/HIV clinics, piloted by the Vietnam Administration for HIV/AIDS Control (VAAC), the division of the Ministry of Health responsible for HIV services, have had varied success [78, 79], underscoring the need for implementation strategies to ensure effective implementation across integrated clinics. In this study, we sought to understand common barriers and subsequently select implementation strategies that could effectively address core challenges for integrated MMT/HIV clinics in Vietnam. We applied an innovative implementation science approach based on the ERIC protocol, to assess barriers and facilitators to MMT/HIV integration and used this assessment as a foundation for identifying appropriate implementation strategies within the Vietnam context.
To identify implementation strategies, we used a streamlined process adapted from the ERIC protocol by Waltz et al. although we omitted the Delphi process and concept mapping given limited resources and time . We used the ERIC methodological template to advance our two core aims: (1) understanding barriers and facilitators to MMT/HIV integration using qualitative interviews and a process of prioritization with multiple stakeholders and (2) identifying the most important and feasible implementation strategies for effective MMT/HIV integration through voting and an iterative dialogue with our expert panel.
We conducted semi-structured in-depth interviews (IDIs) with key stakeholders in Vietnam between December 2014 and February 2015 to explore the range of definitions and attitudes regarding MMT/HIV integration as well as barriers and facilitators to the process. The study was reviewed and approved by the University of North Carolina at Chapel Hill (UNC) Institutional Review Board and the Hanoi School of Public Health Institutional Review Board.
Participants (n = 16) were purposively selected based on their role in the Vietnam health system and their experience with integrated MMT/HIV clinics. They represented three categories: (1) central-level stakeholders: VAAC staff (n = 3) and a staff member from a non-governmental organization (NGO) that provides technical assistance to MMT/HIV pilot integration clinics throughout Vietnam (n = 1); (2) Department of Health and clinic directors (n = 5): and (3) clinic staff: care providers (n = 7) from stand-alone clinics in one province and pilot integration clinics in two provinces. Interview guide content was based on our literature review of MMT/HIV integration and informal meetings with NGO staff members with experience in integration in Vietnam. Separate guides were developed for each participant category (Additional files 1, 2, 3, 4, 5). Content was similar across guides but tailored to probe on specific experiences and glean insights from each participant category. For example, central-level stakeholders were asked, “Let’s say that you wanted to initiate a national goal to integrate HIV and MMT services in Vietnam for the VAAC. Walk me through what exactly would need to be done in order to integrate services from the national level, down to the clinic level” whereas clinic staff level were asked, “Can you tell me how (you think) integration of services [would] affect you and your role?”
IDIs were conducted by experienced ethnographers who participated in an intensive 1-week training on the objectives of the study and the interview guides. The interviews were conducted privately in participants’ offices or at the clinics for about 1 hour. Interviews were audiotaped, transcribed, and translated from Vietnamese to English. Permanent UNC Vietnamese staff, who are fluent in English and who have more than 5 years of experience in technical translations for our research team, conducted the translations. The codebook was developed based on the interview guides and an initial review of the translated interviews. Codes included definitions, attitudes, barriers, facilitators, and outcomes of MMT/HIV integration. Translated interviews were coded and reports were generated for analysis using Atlas.ti v.7 data analysis software. Ten percent of transcripts were double-coded by two coders to ensure coding reliability. Any inconsistencies were discussed and resolved. The analysis consisted of a search for themes, trends, and emerging patterns among the three stakeholder categories: (1) central-level stakeholders, (2) Department of Health and clinic directors, and (3) clinic staff. Based on coded and categorized data, we created a comprehensive matrix to identify common threads and contrasts across and within stakeholder levels. For example, stakeholders at all levels identified ongoing technical assistance as an important facilitator while only clinic directors and staff voiced concerns about low staff morale due to the addition of new tasks to existing duties.
We reviewed the matrix and divided barriers and facilitators into two categories: policy and programmatic. We confirmed findings at this stage through a separate face-to-face meeting with each of the central-level stakeholders in Vietnam, with bi-directional translation provided by a Vietnamese member of our UNC research team as needed. Policy barriers comprised inconsistencies in service structures and staffing in MMT and HIV clinics. Programmatic challenges comprised technical assistance for clinic staff, staff accountability, and local commitment. In Phase 2, we focused on implementation strategies to address programmatic challenges since they were potentially modifiable through external intervention.
Using a compilation of 73 implementation strategies , we identified 20 specific implementation strategies that aligned with the three domains of programmatic barriers and facilitators identified in Phase 1. For example, under “Training,” we listed Distribute Educational Materials; Use Train-the Trainer Strategies; Conduct Educational Outreach Visits; Conduct Ongoing Training; Develop Educational Materials; Make Training Dynamic; Provide Local Technical Assistance; and Provide Ongoing Consultation. A challenge was to create a list that was comprehensive, concise, and where strategies were discrete. Working with two experts from the Implementation Research Institute in Washington University in St. Louis  and the Gillings School of Global Public Health at UNC, we circulated our preliminary list, identified overlapping strategies, and, where appropriate, combined complementary strategies. For example, we determined that the strategy, “Provide Ongoing Consultation” overlapped with the strategy “Provide Local Technical Assistance” and so created a combined strategy: “External Technical Assistance and Ongoing Consultation.” By combining strategies where appropriate, we were able to reduce the total number of potential implementation strategies to 16 within the three programmatic domains.
To select the most appropriate implementation strategies from the 16, we asked our panel to vote using a web-based, self-administered survey. The panel comprised four Vietnamese stakeholders who were familiar with the Vietnamese context of MMT/HIV integration and five implementation science experts who were familiar with the application of implementation strategies in a range of settings. Implementation science experts were selected on the basis of their implementation science-related publications, mentorship, and grant records (i.e., participation in at least one of each). The size of our expert panel (n = 9) was determined by balancing considerations of practicality with the ability to capture a range of perspectives. The survey briefly introduced MMT/HIV integration, the EBI, and the Vietnam context. Our expert panel scored each potential strategy from 1 to 10 in terms of feasibility and importance, 1 being the least feasible and important and 10 being the most feasible and important. We asked members to consider feasibility and importance jointly in their score. Members were able to weigh the relative significance of feasibility and importance into their overall recommendation score, as they felt appropriate. The survey also included space to comment on scoring of the technical assistance, staff accountability and local commitment sections. These qualitative data allowed us to characterize variability around the recommendations and recognize the importance of cultural specificity of implementation strategies. The median, mean, and range of scores of each strategy, in combination with the open-ended comments, determined the final selection of implementation strategies.
First, we present Phase 1 findings that include definitions of integration, attitudes toward integration, and barriers and facilitators to integration. We then present Phase 2 findings, which describe the identification of implementation strategies.
Definitions of integration
Not all stakeholders had direct experience with MMT/HIV integration, yet all knew about integration and identified co-location of services, shared clinic staff, and joint management as essential components of integration. Clinic providers from a pilot integration clinic emphasized the need for all three components, noting that their clinic has co-located MMT and HIV departments but is not fully integrated since the departments do not share a management board or staff. In addition to these three components, central-level stakeholders suggested integrated records as an important dimension of integration.
Three approaches to the integration of clinics were identified, (1) building an MMT/HIV clinic from the start if neither MMT nor HIV clinic already exists, (2) adding MMT services to an existing HIV clinic using existing facilities and staff, and (3) combining two or more existing MMT and HIV clinics by reducing facilities and staffing structures. The third model was considered the most challenging model to implement by central-level stakeholders.
Attitudes toward integration
Overall, participants were receptive to service integration, noting the benefits to both patients and the health system. The most important benefit was identified as better access to services and care for MMT and HIV patients. Specifically, integration was seen as reducing transportation, financial, and logistical barriers to accessing and engaging in MMT/HIV services. At the clinic level, integration was viewed as enabling staff to provide better care and treatment for patients. In integrated clinics, staff can monitor treatment progress and ensure patients receive appropriate counseling and dosages. One clinic director’s experience illustrates the value of integration from the perspective of a stand-alone clinic:
When we implement, there are many advantages, the biggest advantage is for the patients…they do not have to go anywhere, the methadone treatment doctors are also the ones who treat HIV, they understand both methadone, ARV [antiretroviral] for appropriate treatment for patients. They monitor their patients daily, then they can extract early and timely all the side effects as well as the challenges, obstacles to the patients… I think that whatever is beneficiary for the community, useful for the patients, we should do. (Clinic Director, Stand-alone Clinic)
Central-level stakeholders and some clinic directors and providers also noted that integration could save resources by combining or reducing staff and space. The cost-effectiveness of integration is particularly important for MMT and HIV programs, which have been supported almost exclusively by external funders, and which are now facing imminent withdrawal of external funding. Stakeholders at the central and clinic director levels identified the need to transfer program support to the VAAC. Clinic directors in particular explained that government funds would need to replace external funds to ensure the successful implementation and sustainability of MMT and/or HIV services. Central-level stakeholders reiterated this point: “Integration is the solution [to international withdrawal of funds]. Integration is a form of personnel and cost saving for both government and patients.” (VAAC)
Barriers and facilitators to integration
Although a range of barriers and facilitators to integration were described during the interviews, most stakeholders referenced five main domains. Two of these are modifiable at the policy level (service and staffing structures) and three are modifiable at the programmatic level (technical assistance for clinic staff, staff accountability, and local commitment). Domains that were mentioned by the simple majority of participants are included in Tables 1 and 2.
Modifiable at the policy level
All clinic directors cited the need for a central-level decree or legal framework to successfully implement integration. They noted that official guidance would be helpful for integrated MMT/HIV services due to the inconsistent requirements and procedures between the two services and the sensitive nature of substance abuse and HIV treatment.
While current systems for medical records, administrative procedures, forms, and bookkeeping in MMT and HIV clinics have been established separately, many expressed the belief that one integrated system would be more effective. Clinic providers noted that an integrated record system would provide complete patient records and would enable them to monitor drug interactions and provide appropriate care and treatment. In addition, staffing and medical dispensing guidelines between MMT and HIV services are currently inconsistent. For example, methadone doses are dispensed daily while ARV doses are dispensed monthly. In MMT clinics, staff are often required to work on weekends and holidays. A few stakeholders provided suggestions to overcome these barriers, such as permitting clinic staff to administer methadone doses for weekends and holidays in advance.
In addition to intra-service operational inconsistencies, differences in client fees and provider salaries are challenges to integration. Specifically, HIV services currently are covered by health insurance but MMT services are not. Furthermore, MMT providers receive a “hardship” allowance that HIV providers do not receive. Central-level stakeholders recognized these differences and the need to align fee and salary differences between services.
Clinic directors and providers frequently cited heavy workloads and staff shortages as challenges to integration. While the need to invest in additional staff was widely recognized at the clinic level, the lack of permanent positions, low salaries, high-risk working environments, and stigma against PWID and HIV patients were barriers to recruiting additional staff.
Clinic directors in integration pilot clinics viewed training providers on new tasks as an alternative to recruiting additional staff. However, most clinic providers in the integrated clinics reported feeling tired and overwhelmed at the prospect of additional tasks being added to their existing responsibilities. In several cases, clinic providers expressed dissatisfaction with the idea of taking on additional responsibilities with no additional salary, noting that their salary should be commensurate with their responsibilities. This disparity between increased responsibilities and static salary has decreased staff morale in both successful and unsuccessful integration pilot clinics.
Clinic directors recognized the potential (or reality) of decreased staff morale and discussed strategies that have successfully facilitated a collaborative, supportive environment to increase staff motivation. These strategies are discussed in further detail below under “staff accountability.” At the policy level, central-level stakeholders are working on addressing issues such as task shifting and staffing reduction.
Modifiable at the programmatic level
Technical assistance for clinic staff
Inadequate staff training was the most commonly perceived barrier to integration at the programmatic level. Both clinic directors and providers reported lack of skills for the provision of integrated services as a challenge. At all levels, staff training and certification were seen as simple but important facilitators to successful integration.
Clinic providers in stand-alone clinics perceived that learning how to provide integrated services would not be difficult. Additionally, clinic providers in both integration pilot clinics and stand-alone clinics suggested practice-based learning as an effective teaching approach. A clinic provider recommended decreasing the lag time between training and integration uptake to ensure that clinic staff are able to apply their training immediately.
Outside of staff training, clinic providers also highlighted technical assistance activities, such as receiving educational materials and coaching assistance as needed, to facilitate the integration process.
At the clinic level, clinic directors and providers from integration pilot clinics explained that increasing staff accountability would also facilitate integration implementation. Staff accountability can be increased through knowledge and information sharing as well as collaboration and social support among clinic staff.
For knowledge and information sharing in an integrated clinic, clinic-level stakeholders highlighted the importance of clarifying staff responsibilities ranging from bookkeeping and counseling to testing and reporting. One clinic provider also mentioned that although information is shared during meetings, information sharing and internal communications should also be proactive and in real time. Additionally, a clinic director suggested implementing reporting criteria, noting that it is essential to monitor and evaluate integrated services at the clinic level:
…from [the] beginning, we haven’t got description on this model in our hospital as well as reporting criteria, thus we don’t know where and how to report MMT results. Our efforts cannot not be measured and evaluated. (Clinic Director, Integration Pilot Clinic 1)
For collaboration and social support, clinic directors and providers observed that heavy workloads had a detrimental effect on clinic staff morale. To motivate clinic staff, a clinic director successfully created a social group for clinic staff, where staff provided support and encouragement for each other. Similarly, clinic providers from a different clinic explained the importance of collaboration between staff in the MMT and HIV sections:
When the MMT section is too crowded, [the HIV provider] will help and vice versa when the HIV section needs assistance, [the MMT provider] will help… People keep working and assisting each other. When it’s too crowded, we all help each other and then get back to normal work. (Clinic Provider, Pilot Clinic 1)
Intra-clinic collaboration increased support and communication among staff and, at the same time, increased knowledge of respective MMT and HIV responsibilities.
Clinic directors from both integration pilot clinics expressed the need for strong and unified support from health and social service authorities, hospital directors, and hospital departments.
To create local champions for integration, a stakeholder at the central level recommended providing local leaders, such as clinic directors, with pilot evidence to generate buy-in. Once buy-in is established, leaders should be provided with technical assistance to facilitate the integration process.
I think that the key driver for success is the local leadership. If neither PAC [Provincial AIDS Center] nor the leaders recognize that important role, it is impossible to work out. The very first thing we did was to convince the leaders, to provide them with project evidence…Once they realize it, they lead, we just provide them technical support, advice on steps. If a challenge occurred, we further advise. We have the developed plan available to facilitate the process, to monitor it and we transfer the technology to them. (NGO)
Some stakeholders also mentioned local leadership commitment as a mechanism for obtaining investments for infrastructure, equipment, human resources, and policies to facilitate integration.
Vietnamese stakeholders (n = 4) and implementation science experts (n = 5) scored each potential implementation strategy from 1 to 10 based on feasibility and importance, noting the rationale for their scores (Table 3).
We provided a short description of the Vietnamese context and of each implementation strategy on the survey. In general and as anticipated, the Vietnamese stakeholders were not as familiar with specific implementation strategies whereas the implementation science experts were not as familiar with the Vietnamese context. This difference in familiarity affected scores on clinic-level strategies such as clinic reminders and relay of clinical data. Several of the strategies had a narrow range of scores, suggesting convergence of opinions across members of the expert panel.
Technical assistance for clinic staff
All potential strategies within this domain were scored highly. The lowest median score was 6.5 (educational materials), the highest median score was 9 (external technical assistance and ongoing consultation), and scores ranged in total between 4 and 10.
Vietnamese stakeholders and implementation science experts provided similar responses with regard to implementation strategies in the area of technical assistance with the exception of educational materials and ongoing and dynamic training. For educational materials, the Vietnamese stakeholders had a median score of 9.5 and a range of between 7 and 10 while the implementation science experts had a median score of 6 and a range of between 4 and 7. One implementation science expert provided a score of 6, noting that educational materials are necessary but not effective for behavior change. This comment offers one explanation for why this strategy had a lower range among the implementation experts. For ongoing and dynamic training, both Vietnamese stakeholders and implementation science experts had a median score of 8. However, Vietnamese stakeholders had a narrower range (6–9) compared to implementation science experts (4–10).
Overall, implementation experts commented that they had a difficult time scoring the strategies within this domain because they felt that the most promising strategies had been identified and that all of these strategies were important and feasible. Vietnamese stakeholders also commented that the strategies within this domain were inherently interconnected.
The median scores within this domain were slightly lower than scores in the areas of technical assistance and local commitment. The lowest median score for a strategy was 6 (reminders to clinicians) while the highest median score for a strategy was 8 (audit and provide feedback, real-time relay of clinical data). Scores ranged between 4 and 10. The median scores of Vietnamese stakeholders and implementation science experts were similar. However, Vietnamese stakeholders had wide ranges (3–10) in their scoring of two strategies (audit and provide feedback, real-time relay of clinical data). These wide ranges were largely attributable to one stakeholder who commented that these proposed strategies were less feasible than others. Vietnamese stakeholders also had a narrow range (7–9) of scores for the strategy of clinical implementation team meetings, suggesting a high level of agreement on the importance and feasibility of this implementation strategy.
Implementation science experts had a wide range of scores (4–10) for the strategy of clinical supervision. However, no additional commentary was provided that would allow us to determine possible reasons for this range. Two implementation science experts did note that lack of context-specific knowledge hampered their ability to evaluate whether clinical reminders would be helpful because in the USA, providers often ignore reminders. This may explain this strategy’s median score of 6, the lowest within this domain.
Similar to technical assistance, all potential strategies within this domain were scored highly with a lowest median score of 6 (executive boards), a highest median score of 9 (identify champions), and a total range of scores between 4 and 10.
Vietnamese stakeholders and implementation science experts scored most of the strategies within this domain similarly. However, there were differences in median scores for two of the strategies (build coalition, identify champions). Vietnamese stakeholders scored “build a coalition” higher (9.5) than the implementation science experts (7). On the other hand, implementation science experts scored “identify champions” higher (10) than the Vietnamese stakeholders (7.5), noting that local champions or opinion leaders are crucial to implementation.
The scores for the strategies within this domain varied widely (range of 4–9 or 4–10) among Vietnamese stakeholders. Some of this disparity is attributable to stakeholders who believed that strategies within this domain are less feasible than those from other domains.
Recommended implementation strategies
Based on the results of this questionnaire and further discussions with our expert panel, we identified the following domains and strategies to be of primary importance for facilitating MMT and HIV service integration: (1) technical assistance including the strategies: centralize ongoing internal or external technical assistance; periodic educational outreach; and development of educational materials; (2) staff accountability including the strategies: create audit and feedback loops; provide clinical supervision; and clinical implementation team meetings;( 3) local commitment including the strategies: identify and prepare champion individual; build inter-clinic coalition where knowledge is shared; and involve an executive board.
Integration of MMT/HIV services is recognized as an EBI and is recommended by the US Centers for Disease Control and Prevention, the US Department of Health and Human Services, and the World Health Organization [53, 54]. Overall, integration benefits PWID through reduced bureaucratic and logistical barriers, increased monitoring of drug interactions, increased attention to stigma among providers, consolidated HIV risk and drug counseling, and targeted, user-friendly service delivery [46–48, 51]. In addition to patient benefits, integration also benefits healthcare systems by reducing costs and improving efficiencies in care [26, 49, 50], with economic models in Ukraine and Vietnam demonstrating that MMT/HIV integration is a more cost-effective intervention than ART alone [51, 52].
Co-locating staff is typically insufficient for ensuring collaboration or continuity of care . Indeed, implementation strategies are needed to address barriers and build on facilitators to guarantee effective integration of MMT and HIV services. Given the strong evidence for integration and the lack of clarity on best practices for implementation in specific settings [4, 14], we identified potential implementation strategies for the Vietnamese context that align with the domains of technical assistance, staff accountability, and local commitment.
In Phase 1 of our study, participants agreed that integration has multiple benefits to both patients and the health care system and were generally open to MMT/HIV integration. However, barriers at multiple levels were noted. Barriers and facilitators to integration fell into two domains modifiable at the policy level, service and staffing structures, and three domains modifiable at the programmatic level, technical assistance for clinic staff, staff accountability, and local commitment. At the policy level, the need for a central-level decree was widely acknowledged and considered essential before clinics could begin the process of integration. In addition, differences in insurance reimbursements and staff salaries for MMT services as compared to HIV services need to be harmonized before these two service structures can integrate. Concerns about staffing reductions and resistance to taking on additional tasks without compensation were voiced by clinic-level staff and recognized by leadership, highlighting the need to develop clear policies for shifting staff and for providing monetary and non-monetary rewards for additional tasks. The VAAC is actively working on these two policy barriers.
At the programmatic level, clinic staff provided detailed feedback on what would be needed to operationalize clinic integration. Main challenges within clinics were lack of cross-training in HIV and MMT related tasks among clinic staff, lack of communication between MMT and HIV service providers, and lack of motivation to integrate effectively. Clinic stakeholders from pilot integration clinics reported that they were able to integrate MMT and HIV services effectively, illustrating that policy or programmatic barriers to integration are not insurmountable and that implementation strategies can address challenges to service integration. They observed that programmatic level facilitators, such as staff training, cross-clinic collaboration, real-time information sharing, and local leadership commitment, played a large role in their success.
The key implementation barriers identified in this study, including reluctance to add tasks to provider workloads, lack of staff training, and lack of commitment from local leaders, have been observed in other settings [50, 75–77], although specific combinations of barriers and solutions vary across country contexts. For example, in Ukraine, regulatory bodies at the central level did not permit nurses to simultaneously dispense TB and ART . In contrast, in Tanzania, co-dispensing is easily accomplished without regulatory hurdles while the integration of MMT and HIV services is impeded by a shortage of trained providers . Similar to Vietnam, China has faced inefficient coordination between MMT and HIV clinics driven by barriers including insufficient training and ongoing guidance, resistance to added workload, and PWID-related stigma among HIV providers . Given these varied contexts and the challenges faced, a process for quickly determining barriers and tailored solutions is essential.
Based on the demonstrated need for technical assistance, staff accountability, and local commitment identified in Phase 1, we explored, in Phase 2, potential implementation strategies aligned with these domains and, through a voting process, selected the most promising implementation strategies. Specifically, we used a compilation of strategies  and consulted with implementation experts to select a total of 16 potential strategies for an importance and feasibility poll.
Inclusion of both Vietnamese stakeholders and implementation science experts in the voting panel ensured expertise in both the organizational and cultural context of Vietnam as well as the effectiveness of strategies for implementing a range of EBIs. The number of members in the panel (n = 9) allowed for both a range of perspectives as well as a process that was not overly burdensome in terms of following up with members and managing qualitative responses.
As expected, scoring by Vietnamese stakeholders and implementation scientists tended to cluster, especially in certain domains. For example, Vietnamese stakeholders had a median score of 9 for educational materials under technical assistance, while implementation science experts had a median score of 6. The higher score awarded by the Vietnamese experts reflects the familiarity, feasibility, and acceptability of educational materials in the Vietnamese setting, while the lower score, given by implementation experts, stemmed from experience in the USA where educational materials are not independently effective in changing behaviors.
Combining quantitative and qualitative findings to inform our strategy selection process was particularly helpful given the small size of our voting expert panel. Specifically, rather than simply selecting 3–4 strategies with the highest ranking scores, we also considered the qualitative factors that influenced scores (elicited from both the written comments, and sometimes, verbal or email follow-up for further clarification as needed) as part of our decision-making process. As a result, although educational materials only had a median of 6.5, we included it in the technical assistance package since Vietnamese stakeholders felt it was highly acceptable and feasible and the implementation science experts believed it was a necessary strategy within the technical assistance domain.
Our study applied an adapted ERIC protocol  over a 3-month period to support a streamlined process for identifying culturally salient and context-appropriate EBI implementation strategies. Our process consisted of four steps within two main phases. In Phase 1, we conducted 16 in-depth interviews with particular insight into integration in Vietnam and developed matrices to display barriers and facilitators. In Phase 2, we selected implementation strategies that addressed the barriers identified in Phase 1 and conducted a poll to vote on the most important and feasible strategies with an expert panel that incorporated expertise in cultural context and implementation science. This process was relatively simple, low cost, and potentially replicable in other settings.
Our stakeholders represented three levels of the Vietnamese health system (central-level policy makers, Department of Health and clinic directors, and clinic staff), three provinces, and both stand-alone and integrated clinics. While our sample sizes were relatively small, they provided us with the necessary breadth and depth to address MMT/HIV integration in Vietnam. Qualitative data enhanced the utility of our importance and feasibility poll by providing rich insight into dimensions of each implementation strategy that may have influenced the selection of certain scores. The process of selecting our final strategies relied on a combination of poll results and qualitative dialogue. Our study sheds light on barriers and facilitators to MMT/HIV integration, which may be generalizable to other low-income settings. Furthermore, our process produced promising implementation strategies to facilitate MMT/HIV service integration, addressing gaps in both the substance use and implementation science literature. These implementation strategies must be further evaluated in a field trial, using both effectiveness and implementation outcomes. If these implementation strategies are effective, next steps would include determining whether these implementation strategies can be adapted to other settings and expanded to other comorbid conditions among PWID.
Expert Recommendations for Implementing Change
methadone maintenance therapy
Provincial AIDS Center
people who inject drugs
University of North Carolina at Chapel Hill
Vietnam Administration for HIV/AIDS Control
Glasgow RE, Lichtenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–7.
Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health. 2012;102:1274–81.
Grimshaw J, Eccles M, Thomas R, MacLennan, Ramsay C, Fraser C, et al. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med. 2006;21(Suppl 2):S14-20.
Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50.
Kegeles SM, Rebchook G, Tebbetts S, Arnold E. Facilitators and barriers to effective scale-up of an evidence-based multilevel HIV prevention intervention. Implement Sci. 2015;10:50.
Glasgow RE, Eckstein ET, Elzarrad MK. Implementation science perspectives and opportunities for HIV/AIDS research: integrating science, practice, and policy. J Acquir Immune Defic Syndr. 2013;63 Suppl 1:S26–31.
Padian NS, Holmes CB, McCoy SI, Lyerla R, Bouey PD, Goosby EP. Implementation science for the US President’s Emergency Plan for AIDS Relief (PEPFAR). J Acquir Immune Defic Syndr. 2011;56:199–203.
Schackman BR. Implementation science for the prevention and treatment of HIV/AIDS. J Acquir Immune Defic Syndr. 2010;55 Suppl 1:S27–31.
Heitgerd JL, Kalayil EJ, Patel-Larson A, Uhl G, Williams WO, Griffin T, et al. Reduced sexual risk behaviors among people living with HIV: results from the Healthy Relationships Outcome Monitoring Project. AIDS Behav. 2011;15:1677–90.
Jemmott JB, Jemmott LS, Fong GT, Morales KH. Effectiveness of an HIV/STD risk-reduction intervention for adolescents when implemented by community-based organizations: a cluster-randomized controlled trial. Am J Public Health. 2010;100:720–6.
Neumann MS, O'Donnell L, Doval AS, Schillinger J, Blank S, Ortiz-Rios E, et al. Effectiveness of the VOICES/VOCES sexually transmitted disease/human immunodeficiency virus prevention intervention when administered by health department staff: does it work in the “real world”? Sex Transm Dis. 2011;38(2):133–9.
Feldman MB, Silapaswan A, Schaefer N, Schermele D. Is there life after DEBI? Examining health behavior maintenance in the diffusion of effective behavioral interventions initiative. Am J Community Psychol. 2014;53(3–4):286–313.
Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2:42.
Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert recommendations for implementing change (ERIC): protocol for a mixed methods study. Implement Sci. 2014;9:39.
Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.
Cochrane Effective Practice and Organisation of Care (EPOC) Group. EPOC Taxonomy of professional and organisational interventions. 2002. http://epoc.cochrane.org/epoc-taxonomy. Accessed 2 May 2015.
Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, et al. Refining a taxonomy for guideline implementation: results of an exercise in abstract classification. Implement Sci. 2013;8:32.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Spring B. Health decision making: lynchpin of evidence-based practice. Med Decis Mak. 2008;28:866–74.
Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: the evidence based attitudes scale-50. Adm Policy Ment Health Ment Health Serv Res. 2012;39:331–40.
Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436.
Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012;51:423–31.
Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci. 2008;3:26.
Clarke S, Delamere S, McCullough L, Hopkins S, Bergin C, Mulcahy F. Assessing limiting factors to the acceptance of antiretroviral therapy in a large cohort of injecting drug users. HIV Med. 2003;4(1):33–7.
Cunningham CO, Sohler NL, Cooperman NA, Berg KM, Litwin AH, Arnsten JH. Strategies to improve access to and utilization of health care services and adherence to antiretroviral therapy among HIV-infected drug users. Subst Use Misuse. 2011;46(2–3):218–32.
Selwyn PA, Budner NS, Wasserman WC, Arno PS. Utilization of on-site primary care services by HIV seropositive and seronegative drug users in a methadone maintenance program. Public Health Rep. 1993;108(4):492–500.
Conway B, Prasad J, Reynolds R, Farley J, Jones M, Jutha S, et al. Directly observed therapy for the management of HIV-infected patients in a methadone program. Clin Infect Dis. 2004;38 Suppl 5:S402–8.
Berg KM, Litwin AH, Li X, Heo M, Arnsten JH. Lack of sustained improvement in adherence or viral load following a directly observed antiretroviral therapy intervention. Clin Infect Dis. 2011;53(9):936–43.
Lucas GM, Weidle PJ, Hader S, Moore RD. Directly administered antiretroviral therapy in an urban methadone maintenance clinic: a nonrandomized comparative study. Clin Infect Dis. 2004;38 Suppl 5:S409–13.
Lucas GM, Mullen BA, Weidle PJ, Hader S, McCaul ME, Moore RD. Directly administered antiretroviral therapy in methadone clinics is associated with improved HIV treatment outcomes, compared with outcomes among concurrent comparison groups. Clin Infect Dis. 2006;42(11):1628–35.
Nahvi S, Litwin AH, Heo M, Berg KM, Li X, Arnsten JH. Directly observed antiretroviral therapy eliminates adverse effects of active drug use on adherence. Drug Alcohol Depend. 2012;120(1–3):174–80.
Sorensen JL, Haug NA, Larios S, Gruber VA, Tulsky J, Powelson E, et al. Directly administered antiretroviral therapy: Pilot study of a structural intervention in methadone maintenance. J Subst Abuse Treat. 2012;43(4):418–23.
Samet JH, Friedmann P, Saitz R. Benefits of linking primary medical care and substance abuse services: patient, provider, and societal perspectives. Arch Intern Med. 2001;161:85–91.
Altice FL, Friedland GH, Cooney EL. Nevirapine induced opiate withdrawal among injection drug users with HIV infection receiving methadone. AIDS. 1999;13:957–62.
Bart PA, Rizzardi PG, Gallant S, et al. Methadone blood concentrations are decreased by the administration of abacavir plus amprenavir. Ther Drug Monit. 2001;23:553–5.
Beauverie P, Taburet AM, Dessalles MC, Furlan V, Touzeau D. Therapeutic drug monitoring of methadone in HIV-infected patients receiving protease inhibitors. AIDS. 1998;12:2510–1.
Clarke S, Mulcahy F, Bergin C, et al. Absence of opioid withdrawal symptoms in patients receiving methadone and the protease inhibitor lopinavir-ritonavir. Clin Infect Dis. 2002;34:1143–5.
Clarke SM, Mulcahy FM, Tjia J, et al. Pharmacokinetic interactions of nevirapine and methadone and guidelines for use of nevirapine to treat injection drug users. Clin Infect Dis. 2001;33:1595–7.
Clarke SM, Mulcahy FM, Tjia J, et al. The pharmacokinetics of methadone in HIV-positive patients receiving the non-nucleoside reverse transcriptase inhibitor efavirenz. Br J Clin Pharmacol. 2001;51:213–17.
Gerber JG, Rosenkranz S, Segal Y, et al. Effect of ritonavir/saquinavir on stereoselective pharmacokinetics of methadone: results of AIDS Clinical Trials Group (ACTG) 401. J Acquir Immune Defic Syndr. 2001;27:153–60.
McCance-Katz EF, Farber S, Selwyn PA, O'Connor A. Decrease in methodone levels with nelfinavir mesylate. Am J Psychiatry. 2000;157:481.
McCance-Katz EF, Rainey PM, Friedland G, Jatlow P. The protease inhibitor lopinavir-ritonavir may produce opiate withdrawal in methadone-maintained patients. Clin Infect Dis. 2003;37:476–82.
Shelton MJ, Cloen D, DiFrancesco R, et al. The effects of once-daily saquinavir/minidose ritonavir on the pharmacokinetics of methadone. J Clin Pharmacol. 2004;44:293–304.
Stevens RC, Rapaport S, Maroldo-Connelly L, Patterson JB, Bertz R. Lack of methadone dose alterations or withdrawal symptoms during therapy with lopinavir/ritonavir. J Acquir Immune Defic Syndr. 2003;33:650–1.
Crisp BR, Williams M, Timpson S, Ross MW. Medication compliance and satisfaction with treatment for HIV disease in a sample of African-American crack cocaine smokers. AIDS Behav. 2004;8(2):199–206.
Knowlton A, Arnsten J, Eldred L, Wilkinson J, Gourevitch M, Shade S, et al. Individual, interpersonal, and structural correlates of effective HAART use among urban active injection drug users. J Acquir Immune Defic Syndr. 2006;41(4):486–92.
Parsons JT, Rosof E, Punzalan JC, Di Maria L. Integration of motivational interviewing and cognitive behavioral therapy to improve HIV medication adherence and reduce substance use among HIV positive men and women: results of a pilot project. AIDS Patient Care STDS. 2005;19(1):31–9.
Basu S, Smith-Rohrberg D, Bruce RD, Altice FL. Models for integrating buprenorphine therapy into the primary HIV care setting. Clin Infect Dis. 2006;42:716–21.
Sylla L, Bruce RD, Kamarulzaman A, Altice FL. Integration and co-location of HIV/AIDS, tuberculosis and drug treatment services. Int J Drug Policy. 2007;18(4):306–12.
Alistar SS, Owens DK, Brandeau ML. Effectiveness and cost effectiveness of expanding harm reduction and antiretroviral therapy in a mixed HIV epidemic: a modeling analysis for Ukraine. PLoS Med. 2011;8(3):1–15.
Tran BX, Ohinmaa A, Duong AT, Nguyen LT, Vu PX, Mills S, et al. Cost-effectiveness of integrating methadone maintenance and antiretroviral treatment for HIV-positive drug users in Vietnam’s injection-driven HIV epidemics. Drug Alcohol Depend. 2012;125(3):260–6.
US Department of Health and Human Services. Integrated prevention services for HIV infection, viral hepatitis, sexually transmitted diseases, and tuberculosis for persons who use drugs illicitly: Summary guidance from CDC and the US Department of Health and Human Services. MMWR Recomm Rep. 2012;61:1–40.
World Health Organization. 2013 consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach. 2013. http://www.who.int/hiv/pub/guidelines/arv2013/download/en/. Accessed 2 May 2015.
Wolfe D, Carrieri MP, Shepard D. Treatment and care for injecting drug users with HIV infection: a review of barriers and ways forward. Lancet. 2010;376:355–66.
Joint United Nations Programme on HIV/AIDS. Gap report 2014. 2014. http://www.unaids.org/en/resources/documents/2014/20140716_UNAIDS_gap_report. Accessed 2 May 2015.
Celentano DD, Lucas G. Optimizing treatment outcomes in HIV-infected patients with substance abuse issues. Clin Infect Dis. 2007;45 Suppl 4:S318–23.
Malta M, Strathdee SA, Magnanini MM, Bastos FI. Adherence to antiretroviral therapy for human immunodeficiency virus/acquired immune deficiency syndrome among drug users: a systematic review. Addiction. 2008;103(8):1242–57.
Meyer JP, Althoff AL, Altice FL. Optimizing care for HIV-infected people who use drugs: evidence-based approaches to overcoming healthcare disparities. Clin Infect Dis. 2013;57:1309–17.
Uhlmann S, Milloy MJ, Kerr T, Zhang R, Guillemi S, Marsh D, et al. Methadone maintenance therapy promotes initiation of antiretroviral therapy among injection drug users. Addiction. 2010;105(5):907–13.
Weber R, Huber M, Rickenbach M, Furrer H, Elzi L, Hirschel B, et al. Uptake of and virological response to antiretroviral therapy among HIV-infected former and current injecting drug users and persons in an opiate substitution treatment programme: the Swiss HIV Cohort Study. HIV Med. 2009;10(7):407–16.
Wood E, Hogg RS, Kerr T, Palepu A, Zhang R, Montaner JS. Impact of accessing methadone on the time to initiating HIV treatment among antiretroviral-naive HIV-infected injection drug users. AIDS. 2005;19(8):837–9.
Sherer R. Adherence and antiretroviral therapy in injection drug users. JAMA. 1998;280(6):567–8.
Moatti JP, Carrieri MP, Spire B, Gastaut JA, Cassuto JP, Moreau J. Adherence to HAART in French HIV-infected injecting drug users: the contribution of buprenorphine drug maintenance treatment. The Manif 2000 study group. AIDS. 2000;14(2):151–5.
Spire B, Lucas GM, Carrieri MP. Adherence to HIV treatment among IDUs and the role of opioid substitution treatment (OST). Int J Drug Policy. 2007;18(4):262–70.
Turner BJ, Laine C, Cosler L, Hauck WW. Relationship of gender, depression, and health care delivery with antiretroviral adherence in HIV-infected drug users. J Gen Intern Med. 2003;18(4):248–57.
Hicks PL, Mulvey KP, Chander G, Fleishman JA, Josephs JS, Korthuis PT, et al. The impact of illicit drug use and substance abuse treatment on adherence to HAART. AIDS Care. 2007;19(9):1134–40.
Palepu A, Tyndall MW, Joy R, Kerr T, Wood E, Press N, et al. Antiretroviral adherence and HIV treatment outcomes among HIV/HCV co-infected injection drug users: the role of methadone maintenance therapy. Drug Alcohol Depend. 2006;84(2):188–94.
Roux P, Carrieri MP, Villes V, Dellamonica P, Poizot-Martin I, Ravaux I, et al. The impact of methadone or buprenorphine treatment and ongoing injection on highly active antiretroviral therapy (HAART) adherence: evidence from the MANIF2000 cohort study. Addiction. 2008;103(11):1828–36.
Roux P, Carrieri MP, Cohen J, Ravaux I, Poizot-Martin I, Dellamonica P, et al. Retention in opioid substitution treatment: a major predictor of long-term virological success for HIV-infected injection drug users receiving antiretroviral treatment. Clin Infect Dis. 2009;49(9):1433–40.
Zhao Y, Shi CX, McGoogan JM, Rou K, Zhang F, Wu Z. Methadone maintenance treatment and mortality in HIV-positive people who inject opioids in China. WHO Bull. 2013;91:93–101.
Lombard F, Proescholdbell RJ, Cooper K, Musselwhite L, Quinlivan EB. Adaptations across clinical sites of an integrated treatment model for persons with HIV and substance abuse. AIDS Patient Care STDs. 2009;23:631–8.
Boltaev AA, El-Bassel N, Deryabina AP, Terlikbaeva A, Gilbert L, Hunt T, et al. Scaling up HIV prevention efforts targeting people who inject drugs in Central Asia: a review of key challenges and ways forward. Drug Alcohol Depend. 2013;132 Suppl 1:S41–7.
Kresina TF, Lubran R, Clark HW, Cheever LW. Substance abuse treatment, HIV/AIDS, and the continuum of response for people who inject drugs. Advances in Preventive Medicine. 2012;2012:1–8.
Bruce RD. Report on integrated treatment for HIV-infected opioid dependent persons. USAID: Ukraine; 2010.
Bruce RD, Lambdin B, Chang O, Masao F, Mbwambo J, Mteza I, et al. Lessons from Tanzania on the integration of HIV and tuberculosis treatments into methadone assisted treatment. Int J Drug Policy. 2014;25(1):22–5.
Lin C, Cao X, Li L. Integrating antiretroviral therapy in methadone maintenance therapy clinics: service provider perceptions. Int J Drug Policy. 2014;25(6):1066–70.
Ministry of Health of Vietnam. Vietnam AIDS response progress report 2014: following up the 2011 political declaration on HIV and AIDS (reporting period: January 2012-December 2013). Hanoi: Ministry of Health of Vietnam; 2014.
Vietnam Administration for HIV/AIDS Control, personal communication, January 20, 2015
Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, Glisson C, Chambers D. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:105.
This study was funded by the University of North Carolina at Chapel Hill Center for AIDS Research (P30 AI50410). We acknowledge the support and mentorship of the Implementation Research Institute fellowship program at Washington University in St. Louis. We thank our interviewees, the Vietnam Administration for AIDS Control, FHI 360, and the clinics that participated in this research. We would also like to acknowledge the contribution of our panel of experts. And we thank Diana Zuskov for her facilitation of the voting phase of this study and Wendy Davis for editing this manuscript.
The authors declare that they have no competing interests.
VFG, RB, and WCM were involved in the conceptualization and design of this study. NGM and TVH led the data collection. RB provided guidance on the methodology. VFG and GJM conducted the data analysis. VFG, RB, WCM, and TVH interpreted data. VFG, GJM, and WCM drafted this manuscript. All authors read and approved the final manuscript.
Additional file 1:
Stakeholder interview guide: VAAC. (DOCX 134 kb)
Additional file 2:
Stakeholder interview guide: pilot-integrated clinic staff. (DOCX 130 kb)
Additional file 3:
Stakeholder interview guide: FHI and USAID. (DOCX 125 kb)
Additional file 4:
Stakeholder interview guide: non-pilot director provincial Department of Health. (DOCX 18 kb)
Additional file 5:
Stakeholder interview guide: pilot director provincial Department of Health. (DOCX 18 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Go, V.F., Morales, G.J., Mai, N.T. et al. Finding what works: identification of implementation strategies for the integration of methadone maintenance therapy and HIV services in Vietnam. Implementation Sci 11, 54 (2015). https://doi.org/10.1186/s13012-016-0420-8
- MMT/HIV integration
- People who inject drugs
- Implementation strategies
- Implementation research
- Implementation science