- Open Access
- Open Peer Review
The role of evidence and context for implementing a multimodal intervention to increase HIV testing
© Bokhour et al.; licensee BioMed Central. 2015
- Received: 20 March 2014
- Accepted: 26 January 2015
- Published: 13 February 2015
Increasing the use of routine preventive care such as HIV testing is important, yet implementation of such evidence-based clinical care is complex. The Promoting Action on Research Implementation in Health Services (PARiHS) model for implementation posits that implementation will be most successful when the evidence, context, and facilitation strategies are strong for the clinical practice. We evaluated the relative importance of perceived evidence, context, and facilitation of HIV testing during the implementation of a multimodal intervention in US Department of Veterans Affairs primary care clinics.
A multimodal intervention including clinical reminders (CRs), academic detailing—providing education sessions for providers—and social marketing to improve HIV testing was implemented in 15 VA primary care clinics in three regions. We conducted qualitative formative and process evaluations using semi-structured interviews with HIV lead clinicians, primary care lead clinicians, nurse managers, and social workers. Interviews were analyzed thematically to identify barriers and facilitators to implementation of HIV testing and how these were addressed by the intervention. Sites were then rated high, medium, or low on the dimensions of perceived evidence and the context for testing. We then assessed the relationship of these ratings to improvements in HIV testing rates found in earlier quantitative analyses.
Sites that showed greatest improvements in HIV testing rates also rated high on evidence and context. Conversely, sites that demonstrated the poorest improvements in testing rates rated low on both dimensions. Perceptions of evidence and several contextual aspects resulted in both barriers and facilitators to implementing testing. Evidence barriers included provider perceptions of evidence for routine testing as irrelevant to their population. Contextual barriers included clinical reminder overload, insufficient resources, onerous consent processes, stigma, provider discomfort, and concerns about linking individuals who test positive to HIV treatment. While most barriers were ameliorated by the intervention, HIV stigma in particular regions and concerns about linkage to care persisted.
Interventions to implement evidence-based practices such as HIV testing can be successful when utilizing proven quality improvement techniques. However, it is critical to address providers’ perceptions of evidence and consider aspects of the local context in order to fully implement new routine clinical practices such as HIV testing.
- Health promotion/prevention
- Qualitative research
- Technology adoption/diffusion
- Primary care
Primary care providers are asked to attend to a range of evidence-based preventive care tasks as a central aspect of high-quality care. One such preventive care task, routine HIV testing, has received increasing attention since the CDC released a recommendation in 2006 that all patients, age 13–64, receive an HIV test at least once during their lifetime . Correspondingly, in August 2009, the Department of Veterans Affairs (VA) Healthcare System elevated universal HIV testing in primary health-care settings to a top priority. This was in addition to removal of the requirements for written informed consent, pre-test counseling, and post-test counseling for patients who test negative .
Changes in policy, however, often do not seamlessly translate into implementation of evidence-based practice, and changing clinical practices is a complex task. Thus, among veterans using VA for their health care, as of 2011 (2 years after the change in policy), only 20% had ever had an HIV test .
In the VA, use of electronic clinical reminders (CRs) has become one means to prompt providers to adhere to a wide range of evidence-based practices and improve performance . They are used as reminders and as performance metrics wherein providers are rewarded for meeting particular performance goals.
While careful design of reminders has been shown to be effective , research indicates that providers are resistant to these reminders, finding them onerous and interfering with their practice [5,6]. Our prior study to increase HIV testing in two VA primary care clinics found that enhancing implementation of an HIV CR, using a multimodal approach, led to a three- to fivefold increase in the proportion of at-risk patients offered an HIV test [7,8], but did not explicitly address the implementation barriers and facilitators or the interaction between CRs and the other components of the intervention.
A subsequent programmatic expansion provided an opportunity to prospectively assess those implementation factors using local and central facilitation strategies across 15 facilities nationwide. We thus undertook a mixed-methods study, quantitatively assessing the relative success of two different implementation strategies in comparison to a no-intervention control and concurrently conducting qualitative formative and process evaluations at each implementation site. The quantitative findings reported elsewhere  indicated that while the majority of patients remained untested, after the 6-month intervention, the proportion of patients seen in primary care who had been tested for HIV infection increased by 6.3–9.2% in the two groups of intervention facilities as opposed to 1.1% in the control facilities (p < 0.01). Of note, the variation in implementation strategies only partly accounted for the significant variation in the uptake of testing.
In order to more fully understand factors affecting the successful uptake of the implementation, we turned to the qualitative data using the Promoting Action on Research Implementation in Health Services (PARiHS)  framework, a conceptual framework for understanding how new evidence-based practices and policies are implemented in clinical settings. PARiHS proposes that implementation success depends on three key features—evidence, context, and facilitation. Evidence refers to provider perceptions of the strength of the evidence for the evidence-based practice being implemented. Context includes aspects of the culture, leadership, and evaluation at the particular site. Facilitation refers to how the evidence-based practice is introduced into clinical practice.
The current paper first describes the qualitative findings in which we utilize the PARiHS framework to understand barriers and facilitators to implementation of HIV testing. Then, consistent with a concurrent intervention mixed-methods design , we examine how different contextual factors and perception of evidence relate to the relative success of the implementation efforts described in the quantitative study.
We conducted qualitative formative and process evaluations  to examine providers’ perceptions of the evidence and context for HIV testing. We then compared these findings to the quantitative findings regarding sites that were relatively more or less successful in increasing HIV testing after implementation of the intervention . The research team was separated into a qualitative Evaluation Team and a Project Leadership Team (PLT—an infectious disease clinician (the grant principal investigator), a nurse researcher, and a social worker) which implemented the intervention. This separation was critical to facilitate participant willingness to candidly discuss their experiences and to minimize bias in the analytic process.
Setting of research
The intervention was implemented in 2009–2011 in primary care clinics at Department of Veterans Affairs Medical Centers in three regions of the country. These care clinics are staffed by physicians, physician assistants, and nurse practitioners working in teams with nurses and clerk to serve predominantly male, military veterans.
During the time of the study, changes in policies and procedures at national and local facility levels affected the implementation and analytic plans. When the study was initiated, risk-based HIV testing was the standard of care; we targeted our intervention to testing at-risk patients. However, 3 months into the study, VA policies shifted to a recommend routine testing; our implementation project followed suit. The policy change also included a removal of the requirement for written informed consent and pre-test counseling. These policy changes and our subsequent implementation changes are reflected in the qualitative interviews discussed below.
- 1.Clinical reminder implementation
Reminder loaded into electronic medical record system and tested
Reminder fully activated for all providers on the date of site visit
- 2.Academic detailing—site visit to conduct in person 1.5-h presentation to primary care staff
Overview of prevalence
Benefits of HIV testing
Success of intervention to date
Overview of the HIV clinical reminder and how to resolve
Guidance on informed consent
Tips for proposing HIV testing to patients
- 3.Social marketing
Pocket card—tips for proposing testing; providing HIV education to patients; delivering test results; documenting consent; contact information for local infectious disease clinician
Informal discussions of the basis for and benefits of increased rates of HIV testing by project staff during frequent ad hoc visits to the primary care clinic and presentations to facility and clinic leadership (central facilitation sites only)
HIV mini-poster promoting HIV testing
As the overall study goals were to test different methods of implementation, sites were randomized to receive either monthly conference calls and in-person follow-up site visits with the PLT 3–6 months after launch (‘central facilitation’) or only a single conference call with the team 30 days after launch (‘local facilitation’).
Prior to each site visit, the Evaluation Team conducted qualitative interviews with key informants (see below for details) and shared summaries of potential barriers to implementation with the PLT. The Project Leadership Team used this information to tailor their social marketing approach and communication with providers.
Formative and process evaluation
At each site, the Evaluation Team conducted qualitative formative evaluations at baseline and process evaluations, 4 to 6 months after the site visit and activation of the clinical reminder. The VA central institutional review board approved the study.
Participant sample and recruitment
We identified a purposive sample of providers at each facility, including the HIV lead provider (the primary HIV clinician at each facility and considered champion of HIV testing), the lead primary care provider, a nurse manager, and where present, a social worker, from each primary care clinic. Providers were recruited via e-mail and phone calls. Verbal informed consent was obtained from all participants. Provider and site names were removed from all data to ensure anonymity.
Interview guides for formative and process interviews
1. What is your title/job/role?
a. What role do you play here with regard to HIV disease?
2. First, we want to know more about how, in general, new clinical tasks are introduced in primary care here. What can you tell me about this?
3. Now, can you tell me what is going on here in regard to HIV testing?
a. What are the primary care providers doing with regard to HIV testing?
i. How likely is a patient to be offered an HIV test in primary care?
ii. In your experience, how do patients respond when offered a test?
b. How much of a priority is HIV testing in the context of a clinical appointment?
4. Is there a clinical reminder here for HIV testing?
a. If yes:
i. Have you seen it?
ii. How do you think this is being received by staff? (How do they feel about it?)
iii. Who is responsible for resolving the reminder?
iv. What kind of reminder is in place, routine or at-risk?
a. If no:
i. How do you think a CR for HIV testing would be received by staff?
ii. Who would be responsible for resolving this type of reminder?
iii. What kind of reminder do you think would be well received—at-risk or routine?
5. What is the process here for consenting for an HIV test?
6. What do you think about increasing HIV testing at this facility?
7. Aside from what we’ve already talked about, what else should we know about your facility when it comes to efforts to increase HIV testing rates (e.g., policies, practices, personnel, patients)?
8. If you could change 1 policy or practice to increase HIV testing, what would you do?
Today, I would like to discuss with you how the MVQI HIV implementation of this initiative has gone at your facility, and how it has been received by staff
1. How was this new initiative to increase HIV testing introduced at your facility?
2. In general, can you tell me about the HIV CR that was implemented at your facility?
3. What do you think the impact of the CR has been in regards to HIV screening and testing rates here overall?
4. What did you think about the training session that was conducted by our study staff?
5. How do providers receive feedback on HIV testing rates?
6. What do you think the impact of this feedback has been on providers
7. What problems emerged when trying to increase HIV testing?
8. In the past four to six months, have you offered HIV tests to any patients?
9. How do you think the CR changed practice?
10. What other things have prompted you to offer HIV testing?
11. What else is going on in regards to HIV testing in the VA or community?
12. Aside from what we’ve already talked about, what else should we know about your facility when it comes to increasing HIV testing and clinical reminders?
Baseline interview guides included open-ended questions about 1) facility-specific organizational, structural, and attitudinal barriers and facilitators such as the use of a risk-based clinical reminder, ordering of HIV tests, and the consent and counseling processes in place; 2) beliefs about HIV and the importance and prioritization of HIV testing; and 3) what participants thought would facilitate increased HIV testing. We probed for strategies providers used to accommodate to the program needs and tradeoffs, opportunity costs, and work allocation adjustments required to incorporate routine HIV testing into primary care.
Process evaluation interviews were designed to understand the effect of the intervention on perceived barriers and facilitators. These interviews addressed changes in beliefs about testing and organizational factors for HIV testing and perceptions of the intervention of the CR implementation and the PLT presentation and materials.
The initial analysis was inductive; codes, derived from the data, focused on types of barriers and facilitators described by the participants. This grounded approach was the first analytic step to identify major themes. Subsequently, the PARiHS model and constructs were used as an analytic framework and to organize and interpret these findings.
Inductive analysis involved multiple steps. Two investigators began by assigning descriptive codes to segments of notes. These codes were discussed and reviewed by two additional investigators, and codes were added as subsequent notes were coded. Coded text was reviewed by the Evaluation Team weekly to consolidate codes into discrete themes using constant comparison analysis and tools from grounded theory . Coding focused on the identification of 1) barriers to implementation, 2) facilitating features of the organization that allow for implementation of HIV testing initiative, 3) perceptions of the importance of HIV testing in general and relative to other primary care tasks, 4) unintended consequences of the intervention, and 5) any conflicts that arose during intervention process and how they were resolved.
Second, we turned to the PARiHS constructs to organize and map the findings onto context, perceptions of evidence and facilitation. This step allowed for a further understanding of how barriers and facilitators related to success in testing.
Assessment of rates of testing improvement
In the quantitative study described above, testing rates were ascertained using administrative data prior to intervention and again 6 months later. Adjusted rates of HIV testing were calculated for each site using logistic regression analyses in which the unit of analysis was the patient who was seen at the VHA facilities in each month, but the HIV Testing Clinical Reminder had not previously been resolved. A full description of these methods and more detailed findings can be found in our previous paper .
Comparison of qualitative and quantitative findings
Using the PARiHS model, we then identified themes that indicated a high vs. a low perception of the evidence and a high vs. a low context for implementation. Two coders, blinded to site performance on testing, independently rated each site based on the extent to which the interviews revealed a high, medium, or low perception of the evidence for testing and high, medium, or low context for testing, where medium indicated a mix of themes endorsed for a dimension. Interrater reliability was high (kappa coefficient 0.89 for evidence, 0.78 for context). Through further discussion, coders came to 100% consensus on the ratings. After each site was rated for evidence and context, sites were unblinded and the context and evidence levels were compared to the changes in testing rates at each site.
Distribution of providers by profession and region
HIV lead clinician, 3
HIV lead clinician, 5
HIV lead clinician, 6
Primary care lead clinician, 2
Primary care lead clinician, 5
Primary care lead clinician, 8
PC nurse manager, 1
PC nurse manager, 5
PC nurse manager, 9
PC nurses, 1
PC nurses, 0
PC nurses, 2
HIV social workers, 1
HIV social workers, 2
HIV social workers, 0
Barriers and facilitators to HIV testing—qualitative findings
Barriers and facilitators to implementing a multimodal intervention to increase HIV testing grouped by the PARiHS framework
Little HIV in this populationa
HIV testing is critical a
Population is elderly and monogamousa
Professionalism of providers—believe that HIV testing is doing the right thing a
Testing is a low prioritya
Strong clinical champion b
Strong clinical championb
External environment of HIV testing in the community b
Lots of current testingb
Organizational support for doing testing b
Organizational support for doing testingb
CR viewed as facilitative and not burdensome b
CR viewed as facilitative and not burdensomeb
Little HIV in this populationa
Agree HIV testing is importanta
Population is elderly and monogamousa
Evidence considered good for testinga
Testing is a low prioritya
Difficult to talk about HIV/sex in this regionb
Difficult to talk about HIV/sex in this regionb
Insufficient staff to do testingb
Insufficient staff to do testingb
Poor organizational structureb
Poor organizational structureb
No clinical championb
No clinical championb
Clinical reminder overload
This will not be received well because there are so many clinical reminders. It will go through the ROOF!
There will be a great deal of unhappiness because there are a lot of primary care providers—CR overload!
It’s really easy. All you do is click on it and it only takes a minute. It’s not difficult like the other clinical reminders.
It’s actually easier to order an HIV test through the CR rather than without the CR.
Linkage to care
Geography is a big problem. Two-thirds of the patients may not follow up because they do not live in the city, they are noncompliant.
We don’t actually have an HIV clinic…now HIV patients now have to go to [a large southwestern city] for care over 140 miles away.
Thus, providers considered carefully whether to test someone if they felt unable to link them to care. Linkage to care was not addressed in the intervention. Therefore, inaccessibility of HIV primary care services generally characterized as great distances to HIV care facilities remained an important barrier.
Informed consent requirements
Until granted relief for requested [written] informed consent, there will be a struggle at its very best to get more than a handful tested.
Written informed consent is problematic, it’s labor intensive…without it, there will be less of a barrier and HIV testing will be like any other test we do.
Thus, providers indicated that the process of obtaining written informed consent and conducting pre- and post-test counseling was burdensome and suggested that the process be streamlined.
We’re starved for time and manpower.
The question is [do] we have enough staff for the influx of patients?
In post-intervention interviews, providers indicated that the streamlined consent and testing processes obviated the need for additional staff, noting that it actually took very little time to satisfy the requirement to offer an HIV test.
There is still discrimination and prejudice in this area.
It seems that HIV testing is something people try to avoid here; providers don’t want to be familiar with it, fear giving back results, dealing with treatment and patients questions regarding HIV.
We are in the Bible Belt—we’re hesitant to talk about sex, it’s culturally hard and [patients] feel like it’s an invasion of their privacy.
We are pretty are receptive to HIV testing, we’re in [major east coast city].
In post-implementation interviews, there was no indication that concerns about HIV stigma had changed.
Supportive regional HIV testing culture
[We are] pretty receptive, we’re in [Eastern City]. Patients are aware of HIV disease so it’s positively received. Now more patients are willing to test for it; everyone wants to know their status. Many [Veterans] ask to have the test because of media, people are more educated, and everyone’s talking about it, it’s everywhere.
This city’s significant effort to raise awareness for HIV had helped increase HIV testing and receptivity. Beyond the VA and CDC mandates, regions of this city had an initiative for all adults to be tested for HIV.
Organizational support was frequently mentioned among the key facilitators to increasing HIV testing rates. Generally, providers expressed that supportive staff and administration would facilitate HIV testing: ‘I think senior leadership is very supportive of positive outcomes for patients and very supportive of staff; they’re very engaged and dedicated folks, this initiative will be very successful amongst our staff.’
However, lack of support could yield an ineffective intervention as one provider explained: ‘We don’t have good senior leadership, it [intervention] wasn’t well supported, and therefore it wasn’t well received.’ This particular site had leadership who opposed this project and created ‘so many road blocks’ for the CR to be implemented correctly.
Streamlining HIV testing and consenting
In interviews conducted after the consent rule changed, providers stated that needing only verbal informed consent made testing substantially easier, and some believed that HIV testing had increased, even prior to the intervention: ‘HIV testing is now streamlined since there is no pre-test counseling and removal of written informed consent. Coupling the removal or written informed consent with this CR has helped to increase HIV testing a lot!’ Although providers were worried about the success of this intervention because of their perceived barriers, most interviewees noted that this streamlined intervention helped to increase their HIV testing.
Older patients are not at risk
Older patients are mostly monogamous, so they are low risk, hence low priority. If the patients are younger, sexually active or take drugs then they would be considered high priority.
Perspectives on what age to stop offering HIV tests to patients varied from 50 to 85 years old. Providers often characterized older and younger patients differently in terms of HIV risk.
Belief that HIV prevalence is low
Increasing HIV testing is not very important… our city doesn’t have a large HIV population.
If an MD walks by a department with a lot of heart attacks, he will screen more for heart attacks. Our HIV patients are taken to a different facility, so we don’t see many HIV cases. Doctors need to overcome their out of sight out of mind obstacle that hinders them from HIV testing.
Positive attitude towards the HIV clinical reminder
[HIV CRs] remind doctors to do what they’re supposed to do.
I think the staff will receive the CR fine, it will be ok; especially since we are having new vets coming in and they’re younger, we have a need for it, it will be positive and helpful.
I would educate staff and recommend all of them to use a CR and give feedback. No doctor is happy about a CR but it is helpful to remind the doctor to do everything they are supposed to do.
The CR has changed our practice 180 degrees. We weren’t testing before. Unless the providers were being watched, they wouldn’t test.
Providers considered the HIV CR to be an effortless tool that served as a reminder to offer HIV testing without requiring extra time or staff. At some sites, the reminder was initially for at-risk testing and switched to routine testing with the change in the national directive. While both reminders were viewed favorably, the routine reminder was especially favored in the South as routinizing removed the association of testing with risky behaviors, typically taboo topics in the region.
Professional ethical responsibility
The highest priority for primary care is the welfare of the patient, to do the best job for their wellbeing.
Providers emphasized that the intervention and HIV testing would be supported by staff if the benefit to patients were demonstrated and it was shown to be good medical care.
The implementation of the CR alongside the social marketing and educational intervention facilitated HIV testing, although some gaps in facilitation remained.
Clinical Reminder helps to identify new HIV cases
We tested this blind man that you wouldn’t have expected to have HIV, but he was actually HIV positive! We would have never tested him without this CR.
The staff needs to get educated about the significance of routine testing and see [that] education matters, some education materials [are] very compelling.
There needs to be a shift in the providers’ mindset because historically HIV testing has been seen as time intensive; if providers see only 1 side that its routine without understanding that it’s now less burdensome then providers will still hesitate to test, so doctors need to realize that it’s not as labor intensive and apply it to their routine care.
I think for giving the test results, there needs to be a technique of how to give positive results; we need to have training on how to give positive results to patients.
Post-intervention, providers viewed the CR coupled with the educational social marketing approach as the most influential facilitators of the intervention. The presentations were seen as stimulating awareness of undetected HIV cases and promoting the availability of antiretroviral drugs at the VA which are critical for veterans who are HIV positive.
Relationship of evidence, context, and facilitation to HIV testing rate improvements
We did observe some heterogeneity in that performance at some sites was not easily explained based on these dimensions, indicating that other factors not accounted for in the qualitative design influenced the testing rates for that facility.
Most notable is the site that demonstrated the greatest improvement was rated medium for both evidence and context. It is important to note that this was a central facilitation site; thus, ongoing facilitation by the Project Leadership Team may have had important influence in improving testing rates. Two sites which were rated low on both evidence and contextdemonstrated moderate improvements in testing rates; however, it is notable that the baseline testing rates at these sites were low, leaving greater room for improvement. Both of these sites also were central facilitation sites, indicating the potential effect of ongoing support for testing from the central Project Leadership Team. Notably, in our interviews, participants did not discuss the follow-up from the Project Leadership Team when discussing initiatives.
Testing for HIV infection is one of many tasks that primary care providers are asked to incorporate into their already busy clinical encounters. In our study, the PARiHS model provided an excellent framework for understanding how different barriers and facilitators to testing impacted the effectiveness of implementation. Providers described key issues surrounding relevance of evidence for HIV testing in their population, contextual barriers to testing including staffing, clinical reminder overload, and key facilitators to achieving increased testing rates at their facility. These perceptions were related to the success of the intervention as measured by improvements in HIV testing rates. In follow-up interviews, we found that many of the barriers were successfully addressed using the social marketing, provider education, and clinical reminder systems that were put into place, while a few barriers remained pertinent. Moreover, ongoing support from the centralized project team further facilitated increased testing, even in sites where perceptions of evidence and context were not high.
Providers found the facilitation provided through education in the site visit presentations valuable, providing salient evidence for both at-risk and routine HIV testing. As providers began offering routine testing, identification of HIV-positive patients who were not considered to be at risk further solidified their confidence in the evidence for testing. The use of these types of exemplars of the value of routine testing may provide further evidence to providers at low prevalence sites.
Contextual barriers such as the perception of the CR as burdensome were ameliorated by the design of the reminder which providers found user-friendly. As electronic health record clinical reminders spread, providers are both intrigued by their potential to aid care and aggravated by their insensitivity to context and clinical priorities [18,19]. In this qualitative study, we confirmed previous findings that providers were initially reluctant to adopt additional electronic efforts to manage their care, but that, when ensconced in a multimodal effort to improve HIV testing, their attitudes were more complex. The change in requirements for consent was consistently viewed as a significant facilitator to testing. Thus, our findings support efforts to reduce the documentation burden sometimes required for routine tests.
Nonetheless, our intervention was not successful in ameliorating all contextual factors. In particular, concerns surrounding discussing HIV testing due to persistent stigma remained. In more conservative regions, providers described discomfort in having conversations about sexuality, resulting in reluctance to offer an HIV test. Burke et al. found that across practice settings, fear or concern about offending patients was a significant barrier to testing , and regional cultural differences may intensify this barrier. Efforts to change this cultural barrier may require more intensive and culturally sensitive interventions, beyond those in our evidence-based presentations. Reducing stigma associated with HIV in general may reduce provider resistance to offering HIV testing and increase acceptability among patients. The VA recommendation for routine offers of HIV testing to all veterans, independent of risk factors, has been identified as a means of destigmatizing HIV testing. Yet, this may be insufficient in a culture in which having HIV remains highly stigmatized. Several providers indicated that increasing patient knowledge through education about HIV testing would make testing more routine and may help destigmatize HIV testing. However, just as with provider activation, patient activation must consider cultural variations and sensitivities.
Another contextual barrier that persisted was concern regarding linkage to care. Particularly in sites where patients would need to travel long distances to receive care, providers were concerned that they would not be able to successfully link patients who tested positive to appropriate HIV care. Putting into place clear mechanisms for getting patients into HIV care may facilitate increased testing. Thus, future implementation would need to include providing guidance to providers regarding how to link patients in unique facilities to HIV specialists and treatment.
Having a local clinical champion and opinion leaders advocating for increased testing as well as support of the leadership was also critical to successful implementation. Consistent with diffusion of innovation theory, such opinion leaders positively influenced the adoption of a given intervention by other members of the organization [21,22]. Ongoing support from a more centralized team may also further increase success as noted even in sites where perceptions of evidence and context were not high.
Other studies have found similar barriers to provider engagement with HIV testing including concerns about insufficient time, lack of knowledge or training, and onerous consent processes [20,23]. Our sites varied substantially in the types of barriers faced by clinicians. The customization of program implementation based on the rapid analysis of the formative interviews is likely to have further enhanced the effectiveness of the intervention. Thus, we utilized this data in the process of implementation, not solely as a way to assess how barriers and facilitators contribute the endpoint of the intervention. We found that the use of this tailored social marketing and academic detailing was successful in shifting provider perceptions of evidence for testing and accommodating to the context.
There are some limitations to our study. It is not clear if these findings are easily generalizable to settings outside the VA, which has some distinct advantages for this type of intervention. The VA is unique in its comprehensive medical record system with established clinical reminders and the readily available comprehensive care for HIV including low-cost medications. Other settings might also have additional barriers in cost and payment for testing and treatment, issues that are minimized in the VA. Our interviews were limited to three regions of the country; other issues could arise in other regions. Additionally, we only interviewed three providers at each site; interviewing more primary care front line providers may have given us different insights into their clinical practices. Also, the relationship between evidence, context, and increases in testing is modest and does not fully explain the observed heterogeneity of testing increases. Finally, our conclusions regarding how the qualitative findings informed the intervention are limited in that we did not collect data to evaluate this aspect of the study; such data would have added to our understanding of the effect of the intervention. Future studies of implementation should include rigorous observation of implementation to ascertain how implementation teams can optimally utilize qualitative findings in implementation.
Implementation of important evidence-based practices such as HIV testing is a complex endeavor. Providers’ perceptions of the evidence base and how context supports or hinders implementation are critical to the success of any new initiatives. The PARiHS framework to assess barriers and facilitators is useful for understanding how different facilitation strategies may be effective in implementing disease screening and testing in primary care. While this study focused on HIV testing, similar barriers and facilitators may emerge with new testing initiatives such as recent efforts to increase screening for hepatitis C in certain populations.
The use of social marketing and academic detailing has great potential to improve preventive care practices such as HIV testing. Providers indicated that the multimodal intervention was effective in addressing many pre-implementation perceptions about evidence and the burden of an additional clinical reminder. Future intervention, however, must address contextual issues such as stigma and communication about sexuality in regionally reserved settings and barriers to connecting HIV-positive patients to services. Our findings demonstrate that interventions to increase HIV testing can be successful when utilizing proven quality improvement techniques. By addressing providers’ perceptions of the evidence and taking into consideration the local context, care systems may be better situated to decide where to provide additional resources to support changes in practice.
- Centers for Disease Control and Prevention. Revised recommendations for HIV testing of adults, adolescents, and pregnant women in health-care settings. MMWR. 2006;55:1–17.Google Scholar
- Changes in policies related to HIV testing: informatics support http://www.hiv.va.gov/provider/policy/informed-consent.asp
- Halloran J, Czarnogorski M, Dursa EK, Volpp BD, Durfee JM, Valdiserri RO, et al. HIV testing in the US Department of Veterans Affairs, 2009–2010. Arch Intern Med. 2012;172:61–2.View ArticlePubMedGoogle Scholar
- Fung CH, Tsai JS, Lulejian A, Glassman P, Patterson E, Doebbeling BN, et al. An evaluation of the Veterans Health Administration’s clinical reminders system: a national survey of generalists. J Gen Intern Med. 2008;23:392–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Saleem JJ, Patterson ES, Militello L, Anders S, Falciglia M, Wissman JA, et al. Impact of clinical reminder redesign on learnability, efficiency, usability, and workload for ambulatory clinic nurses. J Am Med Inform Assoc. 2007;14:632–40.View ArticlePubMedPubMed CentralGoogle Scholar
- Saleem JJ, Patterson ES, Militello L, Render ML, Orshansky G, Asch SM. Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005;12:438–47.View ArticlePubMedPubMed CentralGoogle Scholar
- Goetz MB, Bowman C, Hoang T, Anaya H, Osborn T, Gifford AL, et al. Implementing and evaluating a regional strategy to improve testing rates in VA patients at risk for HIV, utilizing the QUERI process as a guiding framework: QUERI Series. Implement Sci. 2008;3:16.View ArticlePubMedPubMed CentralGoogle Scholar
- Goetz MB, Hoang T, Bowman C, Knapp H, Rossman B, Smith R, et al. A system-wide intervention to improve HIV testing in the Veterans Health Administration. J Gen Intern Med. 2008;23:1200–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Goetz MB, Hoang T, Knapp H, Burgess J, Fletcher MD, Gifford AL, et al. Central implementation strategies outperform local ones in improving HIV testing in Veterans Healthcare Administration facilities. J Gen Intern Med. 2013;28:1311–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1.View ArticlePubMedPubMed CentralGoogle Scholar
- Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs—principles and practices. Health Serv Res. 2013;48:2134–56.View ArticlePubMedPubMed CentralGoogle Scholar
- Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21:S1–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Thomson O’Brien MA, Oxman AD, Haynes RB, Davis DA, Freemantle N, Harvey EL. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000;1:CD000125.Google Scholar
- Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006;2:CD000259.PubMedGoogle Scholar
- Thomson O’Brien MA, Oxman AD, Davis DA, Haynes RB, Freemantle N, Harvey EL. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000;4:CD000409.Google Scholar
- Bernard HR. Fieldnotes: how to take them, code them, manage them. In: Research methods in anthropology: qualitative and quantitative approaches. Walnut Creek, CA: AltaMira Press; 2002. p. 365–89.Google Scholar
- Charmaz K. Constructing grounded theory. Thousand Oaks, CA: Sage Publications; 2006.Google Scholar
- Patterson ES, Doebbeling BN, Fung CH, Militello L, Anders S, Asch SM. Identifying barriers to the effective use of clinical reminders: bootstrapping multiple methods. J Biomed Inform. 2005;38:189–99.View ArticlePubMedGoogle Scholar
- Patterson ES, Nguyen AD, Halloran JP, Asch SM. Human factors barriers to the effective use of ten HIV clinical reminders. J Am Med Inform Assoc. 2004;11:50–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Burke R, Sepkowitz K, Bernstein K, Karpati A, Myers J, Tsoi B, et al. Why don’t physicians test for HIV? A review of the US literature. AIDS. 2007;21:1617–24.View ArticlePubMedGoogle Scholar
- Collins BA, Hawks JW, Davis R. From theory to practice: identifying authentic opinion leaders to improve care. Manag Care. 2000;9:56–8.PubMedGoogle Scholar
- Rogers EM. Diffusion of innovations. New York, NY: The Free Press; 1995.Google Scholar
- Bokhour BG, Solomon JL, Knapp H, Asch SM, Gifford AL. Barriers and facilitators to routine HIV testing in VA primary care. J Gen Intern Med. 2009;24:1109–14.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.