Explaining the effects of two different strategies for promoting hand hygiene in hospital nurses: a process evaluation alongside a cluster randomised controlled trial
© Huis et al.; licensee BioMed Central Ltd. 2013
Received: 4 October 2012
Accepted: 19 March 2013
Published: 8 April 2013
There is only limited understanding of why hand hygiene improvement strategies are successful or fail. It is therefore important to look inside the ‘black box’ of such strategies, to ascertain which components of a strategy work well or less well. This study examined which components of two hand hygiene improvement strategies were associated with increased nurses’ hand hygiene compliance.
A process evaluation of a cluster randomised controlled trial was conducted in which part of the nursing wards of three hospitals in the Netherlands received a state-of-the-art strategy, including education, reminders, feedback, and optimising materials and facilities; another part received a team and leaders-directed strategy that included all elements of the state-of-the-art strategy, supplemented with activities aimed at the social and enhancing leadership. This process evaluation used four sets of measures: effects on nurses’ hand hygiene compliance, adherence to the improvement strategies, contextual factors, and nurses’ experiences with strategy components. Analyses of variance and multiple regression analyses were used to explore changes in nurses’ hand hygiene compliance and thereby better understand trial effects.
Both strategies were performed with good adherence to protocol. Two contextual factors were associated with changes in hand hygiene compliance: a hospital effect in long term (p < 0.05), and high hand hygiene baseline scores were associated with smaller effects (p < 0.01). In short term, changes in nurses’ hand hygiene compliance were positively correlated with experienced feedback about their hand hygiene performance (p < 0.05). In the long run, several items of the components ‘social influence’ (i.e., addressing each other on undesirable hand hygiene behaviour p < 0.01), and ‘leadership’ (i.e., ward manager holds team members accountable for hand hygiene performance p < 0.01) correlated positively with changes in nurses’ hand hygiene compliance.
This study illustrates the use of a process evaluation to uncover mechanisms underlying change in hand hygiene improvement strategies. Our study results demonstrate the added value of specific aspects of social influence and leadership in hand hygiene improvement strategies, thus offering an interpretation of the trial effects.
The study is registered in ClinicalTrials.gov, dossier number: NCT00548015.
KeywordsProcess evaluation Quality improvement Implementation Handwashing Infection control Randomised controlled trial Leadership
Explanation of terms used in this article
Hand hygiene improvement strategy
An HH improvement strategy is composed of a number of components intended to change HH behaviour. These various components work best together and support each other in targeting potential barriers to appropriate HH.
A strategy component refers to the specific method used to address a potential barrier to appropriate HH.
Examples: education, reminders, performance feedback, social influence, leadership, setting norms and targets.
Improvement activities refer to the operationalization of strategy components.
Examples: educational website, bar charts of HH rates, posters, ward manager addresses barriers to enable HH as recommended, provision of alcohol-based hand rub.
The intention-to-treat analysis in our study was an analysis based on the initial treatment intent. In this, wards were analysed according to the group (experimental or control) to which they were originally allocated, regardless of whether they actually received the improvement strategy and despite the fact that there may be less impact on those who did not receive the intervention
The as-received analysis in our study is based on the treatment actually received. In this, wards were analysed according to improvement strategy actually received, regardless of their allocation.
Process evaluations are important because they can clarify to what extent the improvement strategy was performed in a uniform way, whether the target population actually received the planned activities, what factors inhibited or promoted effectiveness, and what the participants’ actual experiences with the executed strategy were [5, 10–12]. Process evaluations also provide information important to understanding and validating theory-informed strategies. Identifying the mechanisms for how and why these strategies produce successful change (or fail to produce change) is crucial to refining theory and improving strategy effectiveness .
Combined analysis of process and outcome data allows evaluations to explore associations between strategy delivery and receipt, and outcomes on effectiveness . In this way, insight is gained into the mechanisms responsible for the results, which could improve the validity of the findings and help researchers understand the potential generalizability of the improvement strategy [10, 11, 15].
The case of hand hygiene: the HELPING HANDS study
Hospital acquired infections are the most common complications in hospital care, and a major threat to patient safety [3, 16]. Hand hygiene (HH) is considered the most important measure in the prevention of hospital acquired infections [3, 17, 18]. Unfortunately, compliance with HH recommendations is repeatedly found to be insufficient [3, 17, 18]. Many potentially effective strategies for improving HH compliance are described, but most of the effects are small to moderate [2, 19, 20]. Traditionally, strategies have concentrated on the healthcare professional or focused on the introduction of new products and facilities [2, 20]. However, often experienced barriers like negative role models, lack of management involvement, and poor social culture are rarely addressed . Using insights from the behavioural sciences and performing a strategy that also targets social influence within teams and leadership could be a valuable addition to HH implementation strategies [21–23].
Selected behaviour change theories matching barriers in performing HH
Social learning theory 
Behaviour is learned from the environment through the process of observational learning.
– Demonstration, role modelling.
– Encompasses attention, memory, and motivation.
Social influence theory 
Social norm in a network determines what correct behaviour is.
– Norm and target setting.
– Commitment team members.
– Use of opinion leaders.
– Performance feedback.
– Team members address each other in case of undesirable behaviour.
Orientation on team climate and willingness to change
– Team Vision: clarity, perceived value, and attainability.
– Participation Safety: decision-making, information sharing, interaction and safety.
– Support for Innovation: articulated and enhanced support.
– Task Orientation: commitment to excellence, appraisal and task orientation.
Theories of leadership 
Leading, coaching and managing a team
– Active commitment/participation in performance improvement initiatives.
– Setting norms and targets/direction/expectations.
– Encouragement and support/motivate staff.
– Monitoring performance and feedback.
Description of the implementation strategies with the planned activities
Team and leaders-directed strategy
All elements of the state-of-the-art strategy
Distribution of educational material/ written information (leaflet) about HH that contained:
• Education, reminders, feedback, facilities and products, see above
• The importance of HH
Setting norms and targets within the team
• Misconceptions about alcohol-based HH disinfection
• Three interactive team sessions (1 h-1.5 h each) that included goal setting in HH performance at group level. Team sessions were guided by the team manager and a external coach.
• Theory and practical indications for the use of HH
◦ Exploring nurses’ knowledge and perception of current HH behaviour (individual- and team level) and discussing actual HH compliance rates
◦ Transition from individual responsibility to a shared team responsibility
• Educational material/ written information about HH
◦ Creating a participatory and non-threatening climate for team interaction
• Knowledge quiz with feedback. Visitors could test their knowledge about HH
◦ Commitment to high standards of HH performance
• The nursing ward with the highest number of visitors to the website was rewarded
◦ Defining and documenting improvement activities
Educational sessions on prevention of hospital acquired infections
• Analysis of barriers and facilitators to determine how nurses could best adapt their behaviour in order to reach their goal.
• Launching hospital-wide campaign with practical demonstrations of HH
• Nurses address each other in case of undesirable HH behaviour
Gaining active commitment and initiative of ward management
• Distribution of posters that emphasised the importance of HH, particularly alcohol-based hand disinfection. Posters were displayed in several strategic areas within the units and replaced by another poster after 12 weeks.
• Ward manager designated HH as a priority
• Interviews and messages in newsletters or hospital magazines
• Ward manager actively supported team members and informal leaders
• General reminders by opinion leaders/ ward management
• Ward manager discussed HH compliance rates with team members
Modeling by informal leaders at the ward
• Bar charts of HH rates of every nursing ward were sent to the ward manager twice. This also included a comparison of ward performance and hospital performance
• Informal leaders demonstrated good HH behaviour
Facilities and products
• Informal leaders modeled social skills of team members in addressing HH behaviour of colleagues
• Screening and if necessary adapt products and appropriate facilities
• Informal leaders instructed and stimulated their colleagues in providing good HH behaviour
Both strategies successfully improved hand hygiene compliance, but the team and leaders-directed strategy showed better results . The findings of this study indicated the added value of strategy components aimed at social influence within teams and enhanced leadership of ward managers on nurses’ HH behaviour. However, these results provide no insight into the mechanisms of impact. For instance, the extent to which nursing wards improved their HH compliance varied considerably for both strategies, ranging from −2% to 70% improvement in the long run. In addition, the effect size of the team and leaders-directed group was limited by the intention-to-treat analysis, which is the main statistical approach for RCT analyses. Wards were analysed according to the group state-of-the-art strategy or team and leaders-directed strategy to which they were originally allocated. In the HELPING HANDS study, thirty nursing wards and their managers were randomly assigned to the team and leaders-directed group but ten wards declined to participate in the team and leaders-directed strategy. Therefore, only twenty wards fully participated in the team and leaders-directed group.
What impact might variation in adherence to the improvement strategies as planned have on changes in nurses’ HH compliance?
What impact might specific contextual factors as hospital and ward characteristics have on changes in nurses’ HH compliance?
What impact might differences in nurses’ actual experiences with strategy components have on changes in nurses’ HH compliance?
Setting and participants
The HELPING HANDS study was performed in three hospitals in the Netherlands: two general hospitals and one university medical centre. Within the hospitals, all in-patient nursing wards (n = 67) and all affiliated nurses participated in the study. We included surgical wards (n = 21), internal medicine wards (n = 24), intensive care units (n = 13), and paediatric wards (n = 9). Twenty wards received the team and leaders-directed group, and 47 wards received the state-of-the-art group. Strategies were delivered during a period of six months. Follow-up measurements took place directly after strategy delivery (T2) and at six months after the end of strategy delivery (T3).
Measurements and data collection
Data were collected using a wide range of methods, including: student observations, questionnaires to nurses, a ward structure survey, registration of website visitors, structured logbooks of ward managers and coaches and researchers’ field notes of group meetings. Using these data sources, we constructed four sets of measures.
Effects on nurses’ HH compliance
The primary outcome was the percentage of nurses’ actions in line with HH guidelines in case of an opportunity to perform this action, according to the HH guidelines of the World Health Organization [3, 31]. We monitored nurses’ HH compliance unobtrusively during routine patient care before and directly after strategy delivery, as well as six months later .
Adherence to the improvement strategies as planned
The measurement of adherence captures the following subcategories: content – whether improvement activities were delivered as planned (yes/no); dosage – whether improvement activities were delivered as often and long as planned (yes/no); coverage – the extent to which the intended target group received the improvement activities .
Education was assessed by monitoring the presence of instruction leaflets on the ward and by measuring the number of nurses who completed the knowledge quiz. The use of reminders was checked by measuring the presence of reminders (posters) at random moments during the strategy delivery period. Feedback was assessed by checking the distribution of performance feedback reports to ward managers and by a question from the study’s survey asking if nurses had received performance feedback from the ward manager. In addition, the extent to which products and facilities were available in each ward was also explored by survey questions to ward managers and nurses. The attendance of ward management and informal leaders to the training sessions and the support sessions was derived from an attendance checklist. The use of coaching of ward management and informal leaders was assessed by measuring the number of coaching sessions and the total time spent on coaching. Additional details on coaching activities are available from the authors on request. The use of organised team discussions for norm- and target-setting was checked by measuring the number of team discussions performed, the number of nurses attending per ward, the time investment per ward, and whether norms and targets were established. Leadership was assessed by checking documented agreements on the following points: whether the ward manager had discussed HH compliance rates during the team sessions; whether the ward manager had prioritized good HH as a ward target; and whether the ward manager had formulated specific activities to support the team members and informal leaders. Finally, information on whether informal leaders served as role models was derived from group discussion during the support sessions for ward managers and informal leaders.
We explored the influence of three contextual variables, namely: hospital, ward specialism (e.g., general ward, surgical ward, paediatric ward or critical care ward) and the HH compliance rate at baseline.
Nurses’ experiences with specific components of the improvement strategies
In order to explore the relationship between HH outcomes and nurses’ actual experiences with different strategy components, we drew on the findings of a 7-subscale questionnaire consisting of 24 items. Each item was a proposition on a specific component of the improvement strategies. These components were education, reminders, feedback, facilities and products, setting norms and targets, social influence and leadership. An example of a proposition that explores nurses’ actual experiences with leadership is ‘my ward manager holds team members accountable for HH performance.’ Nurses scored this proposition on a 4-point Likert scale, ranging from strongly agree (4) to strongly disagree (1). Negatively formulated propositions were recoded. Higher scores indicated more positive experiences with respective components (Additional file 1).
In this study, our primary research goal was to understand the working mechanisms of HH improvement strategies embedded in the relationship between strategy performance and nurses’ HH compliance. Therefore, we combined data from the process evaluations with data from the effect evaluation. To serve our research goal, we moved from the original intention-to-treat analysis to an as-received basis, with 47 wards in the state-of-the-art group and 20 wards in the team and leaders-directed group. Inputs for the effect analysis, used in this paper, were based on the HH compliance findings of the previously mentioned HELPING HANDS study. The effectiveness of the HELPING HANDS study was examined using an ‘intention-to-treat’ analysis. However, 10 wards declined to participate in the team and leaders-directed group and did not receive any component of this strategy. We therefore explored whether the inclusion, in our intention-to-treat analysis, of wards who did not receive the team and leaders-directed strategy, might have resulted in different effects in changes in nurses’ HH compliance. All data were analysed using SPSS version 19.0 (SPSS, Inc., Chicago, IL) and analyses were performed at ward level.
Effects on nurses’ HH compliance: intention-to-treat versus as-received analysis
We compared the outcome data on changes in HH compliance of the intention-to-treat analysis (37 wards in the state-of-the-art group and 30 wards in the team and leaders-directed group) with the results of the as-received analysis (47 wards in the state-of-the-art group and 20 wards in the team and leaders-directed group). We used descriptive statistics, including mean and standard deviation, for the change in HH compliance between the measurement points for each of the two strategies. One-way ANOVAs were used to test whether there was a statistically significant difference between the group means for both strategies. A p value of 0.05 or less was considered to indicate the statistical significance of the difference between measurements at baseline (T1), directly after strategy delivery (T2), and at six months after the end of strategy delivery (T3).
Process evaluations linked to effectiveness evaluations
Analysis of adherence to the improvement strategies and related changes in HH compliance
Frequencies and proportions were used to assess the adherence to the several components of the improvement strategies. One-way ANOVAs were used to test the influence from varying strategy components on HH compliance. If a strategy component was significant, correlations between changes in nurses’ HH compliance and the significant term were also examined within each strategy group using the Spearman correlation analysis.
Analysis of contextual factors and related changes in HH compliance
One-way ANOVAs were used to test the influence from the contextual factors hospital, ward specialism, and the HH compliance rate at baseline. The correlation between nurses’ HH baseline scores and changes in nurses’ HH compliance was tested with the Pearson correlation analysis. Next, we applied forced entry multiple regression analyses to assess the impact of several potential explanatory variables on changes in HH compliance. As an estimation for the explained variance of the model, an adjusted R-Squired was determined.
Analysis of nurses’ actual experiences with specific components of the improvement strategies and related changes in HH compliance
Descriptive statistics, including mean and standard deviation, were used to explore differences in nurses’ actual experiences with specific strategy components between nurses in the team and leaders-directed group, and in the state-of-the-art group. Inclusion criteria for analysis were wards whose respondents returned ≥ 3 questionnaires. One-way ANOVAs were used to test whether there was a statistically significant difference between group means for both strategies. To determine whether differences in nurses’ actual experiences with strategy components predicted variation in HH compliance effects, we tested non-parametric correlations with Spearman analyses between groups and within groups.
Characteristics of the wards
University based hospital
University based hospital
General hospital A
General hospital A
General hospital B
General hospital B
Intensive care unit
Intensive care unit
Effects on nurses’ HH compliance: intention-to-treat versus as-received analysis
Changes in HH compliance in participating hospitals during study period
21.8% (37 wards)
40.4% (37 wards)
45.9% (37 wards)
Δ T1-T2 18.6%
Δ T1-T3 24.1%
19.1% (30 wards)
53.1% (30 wards)
52.1% (30 wards)
Δ T1-T2 34.0%
Δ T1-T3 33.0%
TDS vs. SAS
21.5% (47 wards)
40.7% (47 wards)
44.1% (47 wards)
Δ T1-T2 19.2%
Δ T1-T3 22.6%
20.7% (20 wards)
58.6% (20 wards)
59.5% (20 wards)
Δ T1-T2 37.9%
Δ T1-T3 38.8%
TDS vs. SAS
SAS groups randomised to TDS (n=10) vs SAS groups randomised to SAS (n= 37)
Process evaluations linked to effectiveness evaluations
Adherence to the improvement strategies and related changes in HH compliance
Both improvement strategies were carried out with good adherence to protocol. Detailed results on strategy adherence are described in Additional file 2.
Impact of variation in adherence to the components of the state-of-the-art strategy (n = 67)
In the adherence subcategory ‘content,’ we found that the main components of the state-of-the-art strategy were generally delivered as planned. The ‘HH promotion event’ was not delivered in one hospital. The infection control department of this particular hospital had already organised an HH promotion event one year before the start of our study. Despite the variation in delivering the ‘HH promotion event,’ no effect on changes in HH compliance could be demonstrated (p = 0.384). The subcategory ‘coverage’ showed some variation in the extent to which washstands were accessible. The analysis showed that variation within these components had no effect on changes in HH compliance (p = 0.348).
The subcategory ‘coverage’ also demonstrated a significant difference between the number of nurses from wards receiving the state-of-the-art strategy and the number of nurses from wards receiving the team and leaders-directed strategy in completing the knowledge quiz (13% and 37%; p = 0.001). This was positively correlated with changes in HH compliance at both follow-up measurements (T1 to T2: p = 0.019; T1 to T3: p = 0.016) However, completing the knowledge quiz did not predict variation in HH compliance within groups of the state-of-the-art strategy (T1 to T2: p = 0.779; T1 to T3: p = 0.426) or within groups of the team and leaders-directed strategy (T1 to T2: p = 0.354; T1 to T3: p = 0.452).
Impact of variation in adherence to the additional components of the team and leaders-directed strategy (n = 20)
In the adherence subcategory ‘content,’ we found that all components of the team and leaders-directed strategy were delivered as planned. Components that differed in adherence across the wards concerned the subcategories ‘dose’ and ‘coverage.’ Five wards organised only two team sessions instead of three team sessions. Thus, these wards did not receive a full dose. However, this did not affect the course of nurses’ HH compliance (T1 to T2: p = 0.240; T1 to T3: p = 0.254). Full coverage was also not achieved for attending two sessions in support of the role models and ward managers, but everyone took part in at least one session. Variation in adherence within the component ‘support sessions’ had no effect on changes in HH compliance (ward managers T1 to T2: p = 0.262; T1 to T3: p = 0.994; role models T1 to T2: p = 0.184; T1 to T3: p = 0.688). There was also some variation in the average number of nurses that attended the team sessions, related to total number of nurses employed. However, variation within this component had no effect on changes in HH compliance (T1 to T2: p = 0.445; T1 to T3: p = 0.823). In conclusion, the evaluation of strategy adherence did not provide any explanatory variables associated with changes in nurses’ HH compliance.
Contextual factors and related changes in HH compliance
Our next step was to determine the impact of contextual factors on changes in nurses’ HH compliance. Two contextual factors were associated with changes in HH compliance: type of hospital and HH performance at baseline. The ANOVA showed a hospital effect on changes in HH compliance in long term (p = 0.036). HH compliance decreased in one hospital in long term, while the HH compliance in the other two hospitals remained stable or increased further. At baseline, the HH scores of all wards from the state-of-the-art strategy and the wards that participated in the team and leaders-directed group were comparable (p = 0.978). For both study groups, baseline HH scores were negatively correlated with follow-up scores (r = −0.693; p = 0.000). Initially, short-term changes in HH compliance (T1 to T2) revealed a specialism effect (p = 0.002). In particular, the paediatric wards showed a smaller increase in HH compliance than the wards from other specialisms. However, the baseline HH scores of the paediatric wards were significantly higher than the baseline HH scores of other wards (p = 0.000). This alleged specialism effect was, in reality, a baseline effect.
Summary of forced entry multiple regression analysis for variables predicting changes in HH compliance in participating hospitals during study period
Δ HH compliance T1 to T2
Δ HH compliance T1 to T3
F for change in R 2
Nurses’ experiences with the improvement strategies and related changes in HH compliance
In this section, we explored differences in nurses’ actual experiences with strategy components and how these differences affected changes in nurses’ HH compliance. A total of 528 questionnaires out of 1,100 (369 questionnaires from the state-of-the-art group and 159 from the team and leaders-directed group) were returned, giving a response rate of 48%. Questionnaires of 515 nurses from 59 wards met the inclusion criteria for analysis. Of these, 42 wards belonged to the state-of-the-art group (360 questionnaires), and 17 wards to the team and leaders-directed group (155 questionnaires).
The ANOVA showed significant differences in actual experiences with several items of the questionnaire between nurses from the state-of-the-art group and nurses from the team and leaders-directed group. Nurses from the team and leaders-directed group, who unlike the nurses from the state-of-the-art group were exposed to the strategy components ‘setting norms and targets,’ ‘social influence’ and ‘leadership,’ experienced more social support (p = 0.005), social influence (p = 0.046) and leadership (p = 0.011) with respect to HH performance. In addition, these nurses experienced more priority for HH on their ward (p = 0.009) and experienced more feedback about their HH performance (p = 0.000) than did nurses from the state-of-the-art group.
Nurses’ experiences with strategy components and correlations with changes in HH compliance
Correlation with changes in HH compliance in all study groups
Δ T1 to T2
Δ T1 to T3
S rho (p value)
S rho (p value)
I do know my ward’s HH performance.
My colleagues support each other in performing HH.
Our team members address each other in case of undesirable HH behaviour.
My manager pays regular attention to the adherence of HH guidelines.
HH is not a priority at our ward.
My ward manager addresses barriers to enable HH as recommended.
My ward manager holds team members accountable for HH performance.
My ward manager encourages and motivates our team members to perform HH.
Correlation with changes in HH compliance within SAS †
I know exactly when to perform HH.
My ward manager encourages and motivates our team members to perform HH.
My ward manager holds team members accountable for HH performance.
Our team members address each other in case of undesirable HH behaviour.
Within the state-of-the-art group (n = 47), we found a few correlations between nurses’ experiences with strategy components and changes in HH compliance. In short-term, experienced knowledge of HH indications showed a negative correlation with HH change scores (p < 0.05). In the long term, positive correlations with changes in HH compliance could be demonstrated for one item of social influence, namely: addressing each other on undesirable HH behaviour (p < 0.05). We also found positive correlations with changes in HH compliance for two leadership items: accountability for HH performance (p < 0.01) and encouraging and motivating team members to perform HH (p < 0.05). We found no significant correlations between scores on specific items and HH change scores within the group of the team and leaders-directed strategy (n = 20).
In this article, we examined which components of the HH improvement strategies were particularly associated with increased nurses’ HH compliance, as well as other possible factors that may have influenced nurses’ HH compliance. We therefore linked process and effectiveness evaluations in the analysis of findings from the HELPING HANDS study .
Effect evaluation: intention-to-treat versus as-received analysis
In this article, we have tried to explain the effects of two different HH improvement strategies on changes in nurses’ HH. It is important to recognize that this research goal requires a different view on the treatment effects compared to an evaluation of effectiveness. The outcome suggests that the overall conclusions about the effectiveness of the team and leaders-directed strategy arising from the original intention-to-treat analysis may have underestimated the impact and strength of this strategy. The as-received analysis showed higher effect sizes for the team and leaders-directed group than the intention-to-treat analysis on both measurements points. In the long run, we now observed a statistically significant (p = 0.002) increase in nurses’ HH compliance due to the team and leaders-based strategy. This suggests that the team and leaders-directed strategy might have had a more permanent impact on HH outcomes than shown by the intention-to-treat analysis. This corresponds with the findings of Strange, et al. . Their as-received analysis showed higher odds ratios in decreasing risky sexual behaviour than the original intention-to-treat analysis, thereby suggesting that their peer-led sex education program, if consistently implemented, probably had a greater impact on study outcomes.
Effects of strategy adherence on nurses’ HH compliance
The evaluation of strategy adherence did not provide any explanatory variables associated with changes in nurses’ HH compliance. Thus, variation in the HH outcomes across the wards could not be explained by a so-called ‘failure of implementation’ . Nevertheless, it is noteworthy that more nurses from the team and leaders-directed group completed the knowledge quiz compared to nurses from the state-of-the-art group (37% and 13%, respectively; p = 0.001). A possible explanation is that the team and leaders-directed strategy positively influenced the adherence to specific components of the state-of-the-art strategy.
Effects of contextual factors on nurses’ HH compliance
The as-received analysis showed a hospital effect that was mainly due to one hospital. Especially in the long run, HH compliance started to decrease in this particular hospital, while HH compliance in the other two hospitals remained stable or increased further. Little is known about how hospital cultural factors are associated with the implementation of HH improvement strategies. The WHO , Larson, et al.  and Pittet  emphasize the commitment of high-level administrators to create and support a culture of safety and accountability. Culture manifests itself through the values, beliefs and assumptions embedded in organizations and is reflected in ‘the way things are done around here’ . The two hospitals that showed sustainability in HH compliance designated HH as a hospital-wide priority. The third hospital was less explicit and distinct in addressing the goal of HH as an organizational priority. This raises the question of whether the observed changes in HH compliance were affected by hospital culture.
Standard care activities
Although the average HH baseline scores of the wards were comparable between wards from both groups, our analysis showed that a high baseline HH compliance was associated with a smaller effect of both HH improvement strategies. High HH compliance at baseline was particularly seen in the paediatric wards. Wagner and Kanouse  have pointed out that standard care activities may affect adherence behaviours and thus intervention outcomes. It is possible that certain components of our improvement strategies are already part of daily practice in some wards and therefore leave less room for improvement. Despite the influence of baseline scores and hospital effect, the team and leaders-directed strategy significantly contributed to an additional increase in nurses’ HH compliance, both short and long term.
Effects of experiences with the improvement strategies on nurses’ HH compliance
The exploration of the relation between determinants of success and HH compliance provided empirical evidence for performance feedback, social influence and leadership as important vehicles for changing HH behaviour. It seems likely that the mixture of these strategy components affect the teams’ abilities to focus on achieving their HH improvement goals. Our results have strengthened the theoretical underpinning of the composition of our team and leaders-directed strategy by using a team approach for changing individual behaviour. By setting clear norms and targets within the team, individual team members are invited to support each other in achieving this goal.
The findings of our study also show that it is important to promote a team culture that empowers team members to speak up when non-adherence is observed. In this finding, we recognize key elements from the social influence theory  (e.g., team members address each other in case of undesirable behaviour), and the theory on team effectiveness [28, 29] (e.g., participation safety and task orientation) (Table 2). This is of particular interest because ‘speak up’ is positively correlated with improved HH behaviour. During the team sessions, we taught the nurses to provide feedback on the HH behaviour of their colleagues in a correct way. At the same time, we guided the nurses to receive this feedback positively.
Active commitment and initiative from ward management
The results of our study show that specific components of leadership are positively correlated with an improvement in nurses’ HH compliance. Thus, ward managers should address barriers to enable HH as recommended, designate HH as a ward priority, motivate and encourage team members to perform HH, and hold team members accountable for their HH behaviour. This finding corresponds with the key elements from theory of leadership  as displayed in Table 2.
Credits of our findings are not entirely due to the delivery of the team and leaders-directed strategy. Nurses from the state-of-the-art group were not exposed to social influence and leadership as a result of improvement activities from our study. A possible explanation is that these wards, independent of our study activities, have given priority to HH and were motivated and encouraged by their managers. This explanation is supported by the results of a further analysis within the group of the state-of-the-art strategy. We found a significant relation between changes in HH compliance and differences in nurses’ experiences with social influence and leadership. Compared to the state-of-the-art group, the analysis within the group of the team and leaders-directed strategy showed less variation in changes of nurses’ HH compliance. Therefore, an association between changes in HH compliance and differences in nurses’ perceptions of strategy components within the team and leaders-directed group could not be demonstrated. We hypothesize that the lack of variation in this group is due to the consistent implementation of the team and leaders-directed strategy. As already shown by our evaluation of strategy adherence, all nurses within the group of the team and leaders-directed strategy were equally exposed to the main components of this strategy.
Strengths and limitations
The principal strength of our study was the comprehensive process evaluation within the context of a pragmatic randomised controlled trial. Questions about variations in the adherence to both HH strategies, and about factors contributing to the relationship between the HH improvement strategies and nurses’ HH outcomes, would not have been apparent as a result of only analysing the HH outcome data. Process evaluations are, in this sense, part of a more theory-based approach to evaluation, responding to the need to understand which theoretical constructs of an improvement strategy make a difference . By linking data of effectiveness to process data, a theoretical explanatory model can be derived from the process evaluation itself .
Some researchers encourage the simultaneous application of a process evaluation in control groups [5, 38]. By doing so, we discovered the impact of specific aspects of social influence and leadership in the state-of-the-art group that served as a control group. This finding has strengthened the theoretical underpinning of the composition of our team and leaders-directed strategy.
In combining process with outcome evaluations, we collected data using a wide range of methods as recommended by several authors [5, 15]. We developed a questionnaire, derived from the components of the improvement strategies. We undertook extensive pilot work to ensure that all important components of the strategies were adequately captured in questionnaire measures. We then pre-tested the questionnaire among 90 nursing students.
An important issue concerns the use of ‘as-received’ analysis as distinct from the conventional ‘intention-to-treat’ analysis used in the analysis of RCTs. These analyses differ not only in terms of the estimation procedure, but also in terms of the underlying research goal for a specific study. This study is an example of explanatory research, and the as-received analysis was therefore appropriate. Our as-received analysis was illuminating but also lost the benefits of the original random assignment, and therefore the potential for bias exists. This should be considered when interpreting our results .
A limitation of our study concerns the low questionnaire response rate of 48%. This may be a potential source of bias. We didn’t test the psychometric properties of the questionnaire. For these reasons, our findings from the nurses’ experiences analysis need to be interpreted with caution.
This is the first prospective study that has assessed the working mechanisms of two HH improvement strategies, demonstrating the added value of specific aspects of social influence and leadership. This is an important finding for hospital administrators and ward managers who want to improve nurses’ HH behaviour. Currently, most strategies focus on the individual and the organization. Including activities aimed at social influence and leadership could be a promising development. Our results point to: addressing each other in case of undesirable behaviour, support from colleagues, accountability, goal setting, and active commitment of the ward manager. The methodology of our team and leaders-directed strategy can probably be used to improve team performance on other patient safety issues as well.
Our study points to ways in which the design of process evaluations within randomised controlled trials may be conducted. Our initial results require affirmation by further process evaluations of HH improvement strategies. Further research is also needed to examine the different aspects and impact of social influence and leadership. Finally, future research should explore the influence of hospital culture.
In summary, with this study we were able to look inside the ‘black box’ of two HH improvement strategies, to generate insights into which strategy components are effective. Our results support the added value of social influence and enhanced leadership in HH improvement strategies, thus offering an interpretation of the trial effects. Our findings point to: addressing each other in case of undesirable HH behaviour, support from colleagues, accountability, goal setting, and active commitment of the ward manager. These results have strengthened the theoretical underpinning of the composition of our team and leaders-directed strategy. Our study also points to ways in which the design of process evaluations within randomised controlled trials may be conducted.
Ethical and legal aspects
The Medical Ethics Committee of district Arnhem – Nijmegen assessed the study and concluded that our study was deemed exempt from their approval, as it did not include collection of data at the level of patients.
Source of funding
This study is funded by a research grant from ZonMw, dossier number: 94517101.
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-72.View ArticlePubMed
- Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticlePubMed
- World Health Organization: WHO Guidelines on Hand Hygiene in Health Care First Global Patient Safety Challenge. 2009, Clean Care is Safer Care,http://whqlibdoc.who.int/publications/2009/9789241597906_eng.pdf,
- Glasziou P, Chalmers I, Altman DG, Bastian H, Boutron I, Brice A: Taking healthcare interventions from trial to practice. BMJ. 2010, 341: c3852-10.1136/bmj.c3852.View ArticlePubMed
- Oakley A, Strange V, Bonell C, Allen E, Stephenson J: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.PubMed CentralView ArticlePubMed
- Strange V, Allen E, Oakley A, Bonell C, Johnson A, Stephenson J: Integrating process with outcome data in a randomised controlled trial of sex education. Evaluation. 2006, 12: 330-352. 10.1177/1356389006069138.View Article
- Campbell MC, Elbourne D, Altman D: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328: 702-708. 10.1136/bmj.328.7441.702.PubMed CentralView ArticlePubMed
- Mihalic SF, Fagan AA, Argamaso S: Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity. Implement Sci. 2008, 3: 5-10.1186/1748-5908-3-5.PubMed CentralView ArticlePubMed
- Grol R, Wensing M, In Improving patient care: Effective implementation: A model. 2005, London: Elsevier: Edited by Grol R, Wensing M, Eccles M, 41-57.
- Dusenbury L, Brannigan R, Falco M, Hansen WB: A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003, 18: 237-256. 10.1093/her/18.2.237.View ArticlePubMed
- Hulscher ME, Laurant MG, Grol RP: Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003, 12: 40-46. 10.1136/qhc.12.1.40.PubMed CentralView ArticlePubMed
- Rossi P, Freeman H, Lipsey M: Evaluation. A systematic approach., seventh edition edn. 2003, Thousand Oaks, CA: Sage Publications, Inc
- Linnan L, Steckler A, In Process Evaluation in Public Health Interventions and Research: Process evaluation and public health interventions: An overview. 2002, San Francisco: Jossey-Bass Publishers: Edited by Steckler A, Linnan L, 1-23.
- Bonell C, Hargreaves J, Strange V, Pronyk P, Porter J: Should structural interventions be evaluated using RCTs? The case of HIV prevention. Soc Sci Med. 2006, 63: 1135-1142. 10.1016/j.socscimed.2006.03.026.View ArticlePubMed
- Hasson H: Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010, 5: 67-10.1186/1748-5908-5-67.PubMed CentralView ArticlePubMed
- Pittet D, Hugonnet S, Harbarth S, Mourouga P, Sauvan V, Touveneau S: Effectiveness of a hospital-wide programme to improve compliance with hand hygiene. Infection Control Programme. Lancet. 2000, 356: 1307-1312.PubMed
- Allegranzi B, Pittet D: Role of hand hygiene in healthcare-associated infection prevention. J Hosp Infect. 2009, 73: 305-315. 10.1016/j.jhin.2009.04.019.View ArticlePubMed
- Pittet D, Mourouga P, Perneger TV: Compliance with handwashing in a teaching hospital. Infection Control Program. Ann Intern Med. 1999, 130: 126-130.PubMed
- Gould DJ, Moralejo D, Drey N, Chudleigh JH: Interventions to improve hand hygiene compliance in patient care. Cochrane Database Syst Rev. 2010, CD005186:
- Naikoba S, Hayward A: The effectiveness of interventions aimed at increasing handwashing in healthcare workers - a systematic review. J Hosp Infect. 2001, 47: 173-180. 10.1053/jhin.2000.0882.View ArticlePubMed
- van Achterberg T: Schoonhoven L, Grol R: Nursing implementation science: how evidence-based nursing requires evidence-based implementation. J Nurs Scholarsh. 2008, 40: 302-310. 10.1111/j.1547-5069.2008.00243.x.View ArticlePubMed
- Jumaa PA: Hand hygiene: simple and complex. International Journal of Infectious Diseases. 2005, 9: 3-14. 10.1016/j.ijid.2004.05.005.View ArticlePubMed
- Pittet D: The Lowbury lecture: behaviour in infection control. J Hosp Infect. 2004, 58: 1-13. 10.1016/j.jhin.2004.06.002.View ArticlePubMed
- Huis A, Schoonhoven L, Grol R, Donders R, Hulscher M, Van AT: Impact of a team and leaders-directed strategy to improve nurses' adherence to hand hygiene guidelines: A cluster randomised trial. Int J Nurs Stud. 2012
- Huis A, Schoonhoven L, Grol R, Borm G, Adang E, Hulscher M: Helping hands: A cluster randomised trial to evaluate the effectiveness of two different strategies for promoting hand hygiene in hospital nurses. Implement Sci. 2011, 6: 101-10.1186/1748-5908-6-101.PubMed CentralView ArticlePubMed
- Bandura A: Social foundation and thought of action: a social cognitive theory. 1986, New York: Prentice Hall
- Mittman BS, Tonesk X, Jacobson PD: Implementing clinical practice guidelines: social influence strategies and practitioner behavior change. Qual Rev Bull. 1992, 18: 413-422.
- Shortell SM, Marsteller JA, Lin M, Pearson ML, Wu SY, Mendel P: The role of perceived team effectiveness in improving chronic illness care. Med Care. 2004, 42: 1040-1048. 10.1097/00005650-200411000-00002.View ArticlePubMed
- West MA, In Innovation and creativity at work: Psychological and Organizational Strategies: The social psychology of innovation in groups. 1990, John Wiley and Sons: Edited by West MA&FJl. Chichester, 309-333.
- OVretveit J: The Leaders' Role in Quality and Safety Improvement; a review of Re-search and Guidance; the "Improving Improvement Action Evaluation Project. 2004, Association of County Councils (Lanstingsforbundet): Stockholm
- Werkgroep Infectiepreventie: Handhygiëne medewerkers ziekenhuizen. 2007,http://www.wip.nl/free_content/Richtlijnen/Handhygiene_medewerkers_071015def.pdf,
- Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implement Sci. 2007, 2: 40-10.1186/1748-5908-2-40.PubMed CentralView ArticlePubMed
- Rychetnik L, Frommer M, Hawe P, Shiell A: Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002, 56: 119-127. 10.1136/jech.56.2.119.PubMed CentralView ArticlePubMed
- Larson EL, Bryan JL, Adler LM, Blane C: A multifaceted approach to changing handwashing behavior. Am J Infect Control. 1997, 25: 3-10. 10.1016/S0196-6553(97)90046-8.View ArticlePubMed
- McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K: Getting evidence into practice: the meaning of 'context'. J Adv Nurs. 2002, 38: 94-104. 10.1046/j.1365-2648.2002.02150.x.View ArticlePubMed
- Wagner GJ, Kanouse DE: Assessing usual care in clinical trials of adherence interventions for highly active antiretroviral therapy. J Acquir Immune Defic Syndr. 2003, 33: 276-277. 10.1097/00126334-200306010-00026.View ArticlePubMed
- Glanz K, Lewis FM, Rimer BK, In Health Behavior and Health Education: Theory, Research and Practice: Linking theory, research and practice. 1997, San Francisco: Jossey-Bass: Edited by Glanz K, Lewis FM, Rimer BK, 19-35.
- Bond GR, Evans L, Salyers MP, Williams J, Kim HW: Measurement of fidelity in psychiatric rehabilitation. Ment Health Serv Res. 2000, 2: 75-87. 10.1023/A:1010153020697.View ArticlePubMed
- Pocock SJ, Abdalla M: The hope and the hazards of using compliance data in randomized controlled trials. Stat Med. 1998, 17: 303-317. 10.1002/(SICI)1097-0258(19980215)17:3<303::AID-SIM764>3.0.CO;2-0.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.