Skip to main content

Scaling up Quality Improvement for Surgical Teams (QIST)—avoiding surgical site infection and anaemia at the time of surgery: a cluster randomised controlled trial of the effectiveness of quality improvement collaboratives to introduce change in the NHS

Abstract

Background

The aim of this trial was to assess the effectiveness of quality improvement collaboratives to implement large-scale change in the National Health Service (NHS) in the UK, specifically for improving outcomes in patients undergoing primary, elective total hip or knee replacement.

Methods

We undertook a two-arm, cluster randomised controlled trial comparing the roll-out of two preoperative pathways: methicillin-sensitive Staphylococcus aureus (MSSA) decolonisation (infection arm) and anaemia screening and treatment (anaemia arm). NHS Trusts are public sector organisations that provide healthcare within a geographical area. NHS Trusts (n = 41) in England providing primary, elective total hip and knee replacements, but that did not have a preoperative anaemia screening or MSSA decolonisation pathway in place, were randomised to one of the two parallel collaboratives. Collaboratives took place from May 2018 to November 2019. Twenty-seven Trusts completed the trial (11 anaemia, 16 infection). Outcome data were collected for procedures performed between November 2018 and November 2019.

Co-primary outcomes were perioperative blood transfusion (within 7 days of surgery) and deep surgical site infection (SSI) caused by MSSA (within 90 days post-surgery) for the anaemia and infection trial arms, respectively. Secondary outcomes were deep and superficial SSIs (any organism), length of hospital stay, critical care admissions and unplanned readmissions. Process measures included the proportion of eligible patients receiving each preoperative initiative.

Results

There were 19,254 procedures from 27 NHS Trusts included in the results (6324 from 11 Trusts in the anaemia arm, 12,930 from 16 Trusts in the infection arm). There were no improvements observed for blood transfusion (anaemia arm 183 (2.9%); infection arm 302 (2.3%) transfusions; adjusted odds ratio 1.20, 95% CI 0.52–2.75, p = 0.67) or MSSA deep SSI (anaemia arm 8 (0.13%); infection arm 18 (0.14%); adjusted odds ratio 1.01, 95% CI 0.42–2.46, p = 0.98). There were no significant improvements in any secondary outcome. This is despite process measures showing the preoperative pathways were implemented for 73.7% and 61.1% of eligible procedures in the infection and anaemia arms, respectively.

Conclusions

Quality improvement collaboratives did not result in improved patient outcomes in this trial; however, there was some evidence they may support successful implementation of new preoperative pathways in the NHS.

Trial registration

Prospectively registered on 15 February 2018, ISRCTN11085475

Peer Review reports

Introduction

There are known gaps between what evidence shows to be best practice and the care that patients receive. The reasons for this are complex and multifactorial, and efforts to improve quality show mostly inconsistent and patchy results [1,2,3]. Such evidence-to-practice gaps exist in the fields of preoperative anaemia screening and optimisation, and preoperative methicillin-sensitive Staphylococcus aureus (MSSA) (a S. aureus bacterium) decolonisation, before major surgery. These practices have been recommended by multiple national and international guidelines and consensus statements since 2015/2016 and have been the focus of previous improvement programmes in the United Kingdom (UK) [4,5,6,7,8,9,10,11]. Yet despite this, the uptake of preoperative anaemia optimisation remains low, and considerable variability exists in S. aureus decolonisation practices in the UK [4, 6, 10, 12] and other European countries [13,14,15,16]. As such, an alternative approach to the implementation of these guidelines is warranted.

The development and implementation of clinical guidelines are intended to improve the quality, outcomes and cost-effectiveness of patient care [17]. However, as these two examples highlight, the implementation of clinical guidelines is challenging. The following barriers to guideline implementation have been identified in previous systematic reviews: guidelines that are complex to implement, healthcare professionals lack awareness or understanding, organisational constraints and a lack of resources or collaboration. However, implementation strategies that (i) are multifaceted and adequately resourced; (ii) incorporate guideline dissemination, education, audit and feedback; and (iii) actively engage clinicians and improve multi-professional collaboration are more likely to succeed [17,18,19,20,21,22].

Qualitative work specifically focussing on the barriers and facilitators to the implementation of preoperative anaemia optimisation pathways has reported similar findings [14, 23,24,25,26].

Quality improvement programmes provide a framework to bridge the evidence-to-practice gap. One increasingly popular technique is the quality improvement collaborative (QIC). The Institute for Healthcare Improvement developed the Breakthrough Series Collaborative methodology to design and deliver QICs [27, 28]. Whilst the clinical process, pathway or outcome being targeted and the setting in which they are implemented can vary, the overarching aim of QICs is to introduce change at scale by encouraging collaboration between teams from within and between healthcare organisations. The QIC methodology incorporates many of the factors identified as contributing to a successful implementation strategy. For example, a QIC involves a series of educational meetings (learning events) during which details of evidence-based changes and guidelines are disseminated and training and education are provided from a panel of expert faculty. These meetings actively engage clinician- and management-led multi-professional implementation teams from participating organisations, and networking and collaborative working is encouraged. In the time between these meetings (action periods), teams work on implementing changes in their local setting, taking into consideration the particular needs and local environment in which they operate. The use of initial small-scale, pilot changes is encouraged, and a programme of data collection (audit) and feedback should be embedded to monitor and evidence change [28].

A systematic review of 24 studies, including five randomised controlled trials (RCTs), found that QICs can be effective at implementing change in healthcare, particularly for improving process of care measures [29]. However, the review authors highlighted the need for more RCTs to assess the effects of QICs on provider- and patient-level outcomes. In particular, the review identified a lack of evidence on whether the procedural improvements associated with collaboratives translate into improved patient outcomes.

A more recent systematic review of 64 studies (10 RCTs, 24 before-after studies and 30 interrupted time series studies) on the effectiveness of QICs found that 83% of published studies reported a statistically significant improvement in at least one process or patient outcome measure, suggesting QICs may be an effective approach for introducing change in healthcare [30]. However, the authors highlighted an on-going need to address significant, persistent gaps in the reporting of QIC interventions and the quality of QIC trial design, noting a lack of high-quality RCTs. In addition, they suggested there is likely publication bias whereby QICs with negative findings are less likely to be published than those with positive findings.

The existing evidence demonstrates the feasibility and potential effectiveness of QICs but highlights the need for high-quality RCTs to assess their effects on processes of care, and provider- and patient-level outcomes [29].

This trial aims to assess the effectiveness of QICs to implement large-scale change in the UK National Health Service (NHS), specifically for improving outcomes in patients undergoing elective total hip replacement (THR) and total knee replacement (TKR). To achieve this, we compared the roll-out of two different preoperative initiatives to improve postoperative outcomes: anaemia screening and treatment (QIST: Anaemia) and MSSA nasal decolonisation (QIST: Infection). Both initiatives are associated with improved postoperative outcomes and are recommended by multiple national and international guidance, including those from the World Health Organisation (WHO) and the National Institute for Health and Care Excellence [6, 7, 31,32,33,34,35,36,37]. As the initiatives target healthcare teams, a cluster RCT was used.

Methods

Trial design, participants and outcomes

Methodology for the QIST cluster trial is detailed in the prospectively published protocol [38]. In summary, 41 volunteer NHS Trusts (public healthcare organisations serving a particular geographical area) that confirmed at the time of recruitment that they had neither a preoperative anaemia screening nor MSSA decolonisation pathway already in place for adult patients undergoing primary, elective THR or TKR were randomised (1:1) as clusters to join one of two parallel QICs. Such a design deals with the ‘Hawthorne effect’ by giving both groups an intervention which should abolish any effect due simply to greater interest in the hospital by external researchers. Group allocation, performed by the trial statisticians, was via minimisation with the number of THR and TKR procedures performed in 2016/2017 (≤660, >660) and the indicators in the Learning from Mistakes (LfM) league table (outstanding, good, significant concerns or poor) as minimisation factors. Trusts randomised to the QIST: Anaemia collaborative worked on implementing preoperative anaemia screening and optimisation pathways, expected to reduce perioperative blood transfusions within 7 days pre- or post-surgery (co-primary outcome). The QIST: Infection collaborative worked on implementing preoperative MSSA nasal decolonisation pathways, expected to reduce the incidence of postoperative deep surgical site infection (SSI) caused by MSSA within 90 days post-surgery (co-primary outcome), deep SSI caused by other organisms and superficial SSIs within 30 days of surgery (secondary outcomes). Critical care admissions, length of hospital stay and unplanned readmissions were secondary outcomes for both arms.

Implementation of the preoperative pathways at each site was measured by considering the proportion of the total number of THR or TKR procedures performed each month that received preoperative anaemia screening or MSSA screening and/or decolonisation as appropriate.

The two collaborative groups were kept separate with all QIC activities being held on different dates. As the two groups were focusing on different pathways, expected to improve different postoperative outcomes, the two arms of the trial acted as each other’s control. Due to the nature of the intervention, it was not possible to blind Trusts or treating clinicians to the trial arm they had been randomised to.

It was estimated that 30,000 procedures from 40 participating Trusts would provide 80% power to detect a difference from 0.75 to 0.25% in MSSA infection rate in favour of the infection arm and over 95% power to detect a difference from 6.0 to 3.9% in blood transfusion rates in favour of the anaemia arm, assuming an intracluster correlation coefficient of 0.005 and an average of 750 procedures per Trust per year (alpha = 0.05).

Both groups collected patient-level data on preoperative screening measures, treatment(s) received, operative details and postoperative outcomes including blood transfusions and SSI. These data were combined with routinely collected electronic data from each Trust’s Patient Administration System. Consent was obtained from executives and clinicians at each participating Trust before randomisation.

Health economic and process evaluations were conducted and will be reported separately.

Intervention

Full details of how specific elements of the QIC methodology were implemented for this trial can be found in Supplementary File 1, but are summarised below with reference to terminology from the Cochrane Effective Practice and Organisation of Care taxonomy [39].

Following randomisation, participating teams from each Trust were invited to attend QIC events to learn about the initiative their Trust had been randomised to implement. Each of the two collaboratives was run and supported by a team of expert faculty with experience in the relevant clinical fields, improvement methodology and QICs (inter-professional education). Each collaborative consisted of a series of three, 1-day, face-to-face educational meetings (learning events) and a summative congress. Educational materials and games were used at learning events, where participating teams were taught about the respective clinical initiatives, and reviewed the evidence base, governance arrangements, business cases, communications strategy, data collection and reporting arrangements. A range of example materials were provided to teams. As the collaboratives progressed, teams developed and shared their own materials and presented on their own successes and challenges experienced as part of their improvement work. These were compared and discussed with others in the collaborative (monitoring of performance). Training on transferable quality improvement skills and time for teams to work on planning their improvement work were built into the learning event schedules. Cross-organisation working was encouraged at the learning events and throughout the collaboratives to develop communities of practice.

Between learning events (action periods), teams were encouraged to engage with local opinion leaders and undertake a local consensus process to implement change and the care pathways in their local setting. A continuous quality improvement approach (using the model for improvement) was encouraged and data were collected to measure the impact of changes (audit and feedback). To support this, regular feedback, support and reminders were provided to the teams by the faculty via email, webinars and regular coaching calls. Teams were required to submit a monthly written progress report. Performance data was presented within each of the collaboratives in a newsletter which included team rankings by data completion, to encourage engagement. A bespoke data collection system was created to collate manually collected data and routinely collected data held within local health information systems. This system automatically generated run charts allowing teams to track their progress over time (audit and feedback). Team progress was monitored by the faculty and support interventions were tailored to each team’s needs. Financial assistance was provided to teams to support attendance at learning events, dedicated staff time to work on the improvement initiatives and data collection. Product costs for intravenous iron (Ferrinject) and MSSA decolonising body wash and nasal gel (Octenidine) were provided when administered in line with previously published protocols, on a pay for performance basis dependant on data entry [40, 41].

The QICs ran from May 2018 to May 2019 (Table 1) including a 6-month implementation phase (May 2018–November 2018) during which it was expected that Trusts would develop and embed their preoperative pathways into usual care. A 12-month data collection period (November 2018–November 2019) followed; outcome data were collected for procedures performed during this time for trial analysis. During this period, it was expected preoperative pathways would be embedded, refinements made, and sustainability planning would take place. To minimise the risk of contamination or resentful demoralisation between the two trial arms, all Trusts were given the opportunity to join a new QIC, focussing on the pathway they had not implemented as part of the trial, after the trial data collection period was over.

Table 1 Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) figure for the Quality Improvement for Surgical Teams (QIST) trial as delivered

SSI data validation

To standardise the classification of SSI, an Independent Outcome Classification (IOC) group of orthopaedic surgeons experienced in revision arthroplasty was convened. They reviewed the case notes for all records flagged as possible SSI by the participating teams and applied Public Health England (PHE) and Centre for Disease Control (CDC) criteria for deep (up to 90 days post-surgery) and superficial (up to 30 days) SSI to all cases and a consensus reached for final trial outcomes. Deep SSI caused by MSSA as defined by the PHE definition up to 90 days post-surgery was the primary outcome for the infection arm. We had planned to include a consultant microbiologist in the IOC, but a lack of availability due to the COVID-19 pandemic meant the makeup of the IOC had to change.

Statistical analysis

Analyses were undertaken in Stata v15 (StataCorp, Texas) using two-sided statistical tests at the 5% significance level. Unless otherwise stated, Trusts were assumed to have implemented their assigned protocol only and, as such, patients and procedures were analysed in the groups to which their treating Trust was randomised; however, not all randomised Trusts, or associated procedures, could be included in the analyses and so missing data were removed from the analysis and available-case analysis was used (each outcome was analysed using only available data). It was not possible to analyse data from those 14 Trusts that were randomised but did not provide any data, and missing data within participating Trusts was not imputed. Data were received and analysed at the procedure-level, rather than the patient-level, since it was possible that patients could undergo more than one eligible procedure during the study period. We anticipated this number would be small and so treated procedures as independent. A statistical analysis plan created prior to the analysis was agreed with the trial oversight committee.

Co-primary outcomes were both analysed using mixed effects logistic regression models, adjusted for procedure type (hip or knee), age and sex of the patient, and the Trust-level factors that were used for randomisation: number of hip and knee replacements performed 2016/2017 (in continuous form), and the LfM league indicators. Trust was included as a random effect. All of the secondary outcomes related to postoperative SSI, readmissions and critical care admissions were analysed in the same way as the primary outcomes. Length of hospital stay was analysed using a Poisson regression model, and length of critical care stay was analysed using a Poisson model when just including those with a stay on critical care, and zero-inflated Poisson regression after imputing zero days on critical care when there was no admission to critical care — all were adjusted in the same way as the primary analyses.

Sensitivity analyses were planned to rerun both primary models excluding any Trusts that implemented the opposite protocol to the one they were assigned (deemed to be contaminated) and also to include ischaemic heart disease as a covariate in the analysis of the anaemia primary outcome as this is often influential in determining if a patient requires a blood transfusion. Three additional sensitivity analyses were undertaken post hoc to account for any possible underreporting of the outcomes by sites. These analyses excluded sites that:

  • Reported no transfusions, from the anaemia primary analysis;

  • Reported no infections, from the infection primary analysis; and

  • Had all reported infections confirmed by the IOC, from the infection primary analysis.

All results are presented as the relevant effect estimate (odds ratio (OR) or incident rate ratio (IRR)), 95% confidence interval (CI) and p-value.

Deviations from protocol

As the trial progressed, some changes to the planned delivery of the collaboratives were made. Additional support was made available as part of the intervention, in particular participating teams were assigned a senior faculty coach who offered a programme of regular coaching calls for the duration of the collaboratives. Information from these coaching calls, along with the monthly written reports, was used to tailor support to each team. In addition, funding was made available to support attendance at learning events for those travelling more than four hours each way, to support dedicated staff time to work on the improvement initiatives, for data collection and some product costs (Supplementary File 1). Due to the global coronavirus pandemic and national restrictions, the cross-over collaboratives consisted of only two learning events, rather than three; the final celebration event was delayed and ultimately held virtually.

Results

Recruitment

Trusts were recruited between December 2017 and March 2018. Seventy-eight Trusts indicated that they were interested in participating. Following application of the eligibility criteria, 41 Trusts were randomised, in March 2018: 19 to QIST: Anaemia (46.3%) and 22 (53.7%) to QIST: Infection (Fig. 1). Post-randomisation, Research and Development departments were asked to sign the required agreements and confirm they had the capacity and capability within their Trust to participate in this trial. Capacity and capability was confirmed and a green light to participate was issued for 27 of the 41 Trusts (65.9%): 11 Anaemia (57.9% of 19 randomised) and 16 Infection (72.7% of 22 randomised) — it was not possible to collect data for trial analysis from Trusts who did not confirm capacity and capability to participate in the trial. Due to the way the intervention was implemented, all Trusts were required to be recruited at the same time and it was not possible to recruit additional Trusts after the collaborative intervention had started.

Fig. 1
figure 1

CONSORT flow diagram

Baseline data

Of the 27 participating trusts, the average number of procedures performed in 2016/2017 was 957 (SD 670), and half (n = 13, 48.1%) were awarded a good or outstanding LfM ranking (Table 2). Characteristics were well balanced across the two arms.

Table 2 Baseline characteristics of the Trusts as randomised (n = 41) and as included in the analysis (n = 27)

Procedures

A total of 25,066 (9860 Anaemia, 15,206 Infection) THR and TKRs were undertaken at the 27 Trusts over the 1-year period (1 November 2018 and 31 October 2019). Data were provided for 19,254 procedures: 6324 (32.8% of 19,254) in the anaemia arm (average per Trust 574.9, SD 366.7, median 458) and 12,930 (67.2% of 19,254) in the infection arm (average per Trust 808.1, SD 749.3, median 630).

In the time frame, 18,449 (97.9%) patients had one eligible procedure, 401 (2.1%) had two and 1 (0.01%) had three. Amongst all procedures, there was an almost equal split of THR (48.9% anaemia arm, 48.2% infection arm) and TKR procedures (51.1% anaemia, 51.8% infection). On average, at the time of their procedure, patients were 69.2 years old (SD 10.5). There were more females (59.0%) than males (41.0%). The most common comorbidity was hypertension (50.4%), followed by obesity (23.5%) and non-insulin-dependent diabetes mellitus (13.1%). Characteristics appeared balanced between the two arms (Table 3).

Table 3 Patient and procedure details

Processes

The QIC approach used in this trial was intentionally pragmatic in terms of diagnostic criteria for anaemia (and iron deficiency) and treatment decisions for anaemia and MSSA decolonisation. This inevitably led to variation in how the two pathways were implemented at each site. A summary of key differences can be found in Table 4 with further detail provided in Supplementary Files 2 and 3.

Table 4 Summary of variation in approach to implementing anaemia screening and MSSA decolonisation pathways, rates of implementation and primary outcome reporting

Anaemia

Trusts in the anaemia arm screened patients for anaemia via preoperative blood tests, performed a median of 58 days before surgery. Preoperative haemoglobin (Hb) levels were available for 6306 (99.7%) of the 6324 procedures (males: mean 143.3 g/L, SD 12.6; females: mean 131.3, SD 11.3), and ferritin for 93.2% (n = 5894; males: 173.1, SD 170.5; females: 103.2, SD 109.4).

The WHO criteria for diagnosing anaemia are the most commonly used worldwide (Hb < 120 females, < 130 males) [42]. As seen in Table 4 and Supplementary File 3, some Trusts used lower thresholds (i.e. Hb 120 for both sexes) to define anaemia and decide treatment. This means some patients who would typically be considered anaemic (i.e. males with Hb 125) were not by some Trust’s pathways. When the WHO definitions for anaemia are applied to our data, 885 (14.0%) patients are identified as having preoperative anaemia, of which 546 (61.7%) were accompanied by iron deficiency (ferritin < 100 μg/L).

A total of 5770 procedures (91.2%) are recorded as receiving no treatment, including 48.7% (431 of 885) of those identified as being anaemic by the WHO criteria. Intravenous iron was administered in 72 (1.1%) cases (all of which were anaemic); oral iron in 297 (4.7%) cases (of which 260 were anaemic); and 185 (5.1%) (of which 122 were anaemic) were referred for further investigation prior to surgery.

Implementation of the anaemia screening pathway varied between Trusts; the proportion of procedures for which preoperative anaemia screening was performed during the 1-year measurement phase varied from 16.4 to 98.1%. Overall, 61.1% (6025 of 9860) of the total number of THR or TKR procedures performed across the 11 anaemia Trusts received preoperative anaemia screening. Figure 2 shows the proportion of the total number of THR or TKR procedures performed each month that received preoperative anaemia screening. This data spans both the implementation phase (pre-outcome data collection) and the measurement phase (1-year outcome data collection period). There was still an increasing trend in the first few months of the measurement phase (Oct–Dec 2018).

Fig. 2
figure 2

Implementation of the anaemia screening pathway over the 18-month QIST period: 6-month set up phase and 12-month data collection phase

Infection

Trusts in the infection arm chose to implement MSSA decolonisation in one of two ways: screening all patients and decolonising only those who tested positive or routinely decolonising all patients without screening. Six of the 16 Trusts adopted a screening approach, resulting in 2768 procedures being screened preoperatively (21.4%). Of these, 893 (32.3%) tested positive for MSSA (Table 4 and Supplementary File 2).

A total of 12,019 decolonisation packs were dispensed for preoperative MSSA decolonisation as part of the QIST: Infection collaborative. The most common components were Octenisan body wash (89.6%, n = 10,768) and Octenisan nasal gel (68.0%, n = 8174). A total of 11,115 patients (92.5% of those dispensed) confirmed that they used the decolonisation pack that was provided to them.

The correct implementation process for the infection arm differed depending on the approach to the pathway. For Trusts that screened patients, the correct implementation was to provide a nasal gel to patients who test positive, and not to those who test negative, whereas for the blanket approach, correct implementation was taken as confirmation that a nasal gel was issued. The implementation for the 1-year measurement phase varied by Trust; one Trust provided no data on their process, so had 0% implementation. The lowest percentage of correct implementation (for Trusts who recorded data) was 20.5%, and the highest was 94.1%. Overall, 73.7% (11,208 of 15,206) of the total number of THR or TKR procedures performed across 16 infection Trusts received correct implementation. This was slightly higher in the ten Trusts that implemented a blanket approach (75.4%, 8723 of 11,568 procedures), than the six Trusts who choose to screen (68.3%, 2485 of 3638 procedures). The rate of implementation was still increasing in the first few months of measurement (Fig. 3).

Fig. 3
figure 3

Implementation of the infection pathway over the 18-month QIST period: 6-month implementation phase and 12-month measurement phase

Outcomes

Overall, 485 (2.5%) patients required a blood transfusion within 7 days of surgery: 183 (2.9%) in the anaemia arm and 302 (2.3%) in the infection arm. The average number of units per transfusion was similar for the two groups (1.7 (SD 1.0) in the anaemia arm; 1.6 (SD 0.6) in the infection arm). There was no evidence of a difference in transfusions between the two arms (adjusted OR 0.83 (i.e. lower odds in infection arm), 95% CI 0.36 to 1.91, p = 0.67; Table 5). The trust-level intracluster correlation coefficient was estimated as 0.23 (95% CI 0.13, 0.37).

Table 5 Results of the primary and secondary outcomes and sensitivity analyses

There were 346 cases of potential SSI reported by participating Trusts. Of these, the IOC confirmed 158 as either deep or superficial SSI based on PHE and/or CDC criteria (Table 5). Seventy-one (0.37%) were confirmed as deep SSIs (PHE criteria) caused by any organism within 90 days of surgery (23 (0.36%) in the anaemia arm; 48 (0.37%) in the infection arm). Of these, 26 (0.14%) were confirmed as deep SSIs (PHE criteria) caused by MSSA within 90 days of surgery (8 (0.13%) in the anaemia arm; 18 (0.14%) in the infection arm). There was no evidence of a difference between the two arms (adjusted OR 1.01, 95% CI 0.42 to 2.46, p = 0.98). The trust-level intracluster correlation coefficient was negligible (< 0.0001, with similarly small 95% CI limits).

A breakdown of transfusion and SSI rate by type of procedure (THR or TKR) is provided in Table 6.

Table 6 Breakdown of transfusion and SSI outcomes by type of procedure, where procedure known

None of the secondary outcomes showed a statistically significant difference between the trial arms (Table 5).

Sensitivity analysis

Sensitivity analyses undertaken to exclude Trusts that were deemed to be contaminated showed that the results were robust. This result was mirrored in the analysis including ischaemic heart disease as an additional covariate.

Trusts were asked to report all potential cases of SSI for review by the trial IOC. As such, overreporting of potential SSIs, not all of which would be confirmed by the IOC, was expected. This was observed for most of the 27 participating Trusts; however, we found a large variation in the reporting of potential SSIs in the trial (Table 4 and Supplementary Files 2 and 3), with some Trusts (n = 4) reporting no suspected SSIs, and some Trusts (n = 5) having all of their suspected SSIs confirmed by the IOC, raising concerns of selective reporting. A similar degree of variation and possible underreporting was also apparent for the blood transfusion outcome (Table 4 and Supplementary Files 2 and 3). There were three Trusts that reported no patients requiring a blood transfusion. Due to this, it was decided post hoc to undertake sensitivity analyses, where the primary models were rerun excluding the sites that had reported no transfusions/infections. Results were robust (Table 5).

Costs

Participating in the QIST collaboratives incurred a mean cost of £37,164 (SD 8446) per Trust for the 11 Trusts in the anaemia arm and £37,638 (SD 9850) for the 16 Trusts in the infection arm. Total costs for running the QICs were £395,618. As almost all point estimates for postoperative outcomes were the same or slightly worse in the respective intervention arms, there were no cost savings related to the measured outcomes to be realised.

Discussion

Quality improvement collaborative methodology incorporates many facilitators for overcoming barriers to clinical guideline implementation. This large-scale trial of QICs found evidence that collaboratives may be successful in implementing change in preoperative elective orthopaedics in the NHS, though variation across Trusts was seen. However, despite implementation rates of 73.7% and 61.1% being achieved in the infection and anaemia arms respectively, improved patient outcomes were not observed. A high early dropout rate (14 of 41 randomised sites, 34.1%) and substantial variation in individual team engagement with the collaborative were also observed. These are important considerations for planning future collaboratives or trials in this area.

Collaborative methodology is typically pragmatic in how individual elements of an intervention are implemented locally. This is intended to improve local adoption and sustainability by allowing each team to consider their local circumstances, unknown to QIC organisers, when developing local pathways. This pragmatic approach was taken for QIST. For example, in the QIST: Anaemia collaborative, teams were advised on the merits of screening and the existing evidence base. However, we did not stipulate haemoglobin or ferritin thresholds for diagnosing anaemia or guiding treatment, nor did we stipulate the type, duration or timing of iron treatment. This resulted in variation in how preoperative anaemia pathways were implemented at different sites. This variation goes some way to explain why 48.7% of anaemic patients (defined by WHO criteria) received no treatment. This may have reduced the effect size of introducing anaemia pathways on postoperative outcomes. Similarly, in the QIST: Infection collaborative, teams were advised that 5 days of nasal decolonisation were required, ideally spanning the date of surgery. However, within the trial, there was no stipulation around the timing of decolonisation, or which products were used. This led to variation in how the pathways were implemented at each site, which in turn may have impacted the primary and secondary outcomes for this arm of the trial. Conversely, this pragmatic approach reflects the practical implementation of a pathway, so reports real-world effectiveness.

Previous quality improvement trials in the UK have highlighted the importance of incorporating dedicated time and resources for improvement at a local level and training to develop generic quality improvement capabilities [43, 44]. The QIST trial set out to address both of these elements. It has also been suggested that a narrower focus, for example implementing just one new initiative per improvement programme, might help local implementation and improve the chances of success [44]. It may be that our narrow focus contributed to the high adherence rates observed in some Trusts in this trial. However, this did not lead to high levels of engagement at all trial sites and substantial variation in adherence to pathways was still seen between sites, similar to a previous quality improvement study in the UK [44].

Although measures were taken to reduce the Hawthorne effect of taking part in a trial, such as including both arms as intervention arms, and providing the opportunity for teams to attend cross-over collaborative events at the end of the trial, it is possible there were uncontrollable effects of being in the QIST trial. For example, the outcome of blood transfusion can be affected by multiple factors, many of which are targeted by multimodal patient blood management programmes. It is possible that although teams in the control arm for QIST: Anaemia did not introduce preoperative anaemia screening, they may have reviewed other elements of their patient pathway as QIST had shone a light on the risks associated with blood transfusion. Examples may include Trusts reviewing their tranexamic acid policy, transfusion triggers, or increased caution in issuing transfusions as clinicians knew these were being measured. Similarly, there are many factors that influence SSIs such as practices around antibiotic prophylaxis, surgical technique and patient warming. Furthermore, we are aware that some Trusts did implement both measures during the trial measurement period, although we attempted to adjust for this in our sensitivity analyses. This is reflective of the complex systems in which patient care is delivered. In addition, as both arms received an intervention, it was not possible to compare outcomes to a no intervention control.

Our results also suggest that, on the whole, more time was required to implement these changes than we had allocated. We incorporated a 6-month implementation period into our trial design, but our data suggest a longer implementation period was needed and a 9- or 10-month period may have been more appropriate.

One of the main limitations of our study was that the trial under-recruited and the observed outcome event rates were much smaller than anticipated in the sample size calculations. Anticipated and observed control rates were 0.75% and 0.13%, respectively, for MSSA deep SSIs and 6% and 2.3%, respectively, for blood transfusions. It may be that outcomes have genuinely improved over time, in keeping with recent studies which question the effectiveness of preoperative anaemia management in contemporary practice [45, 46]. However, it is also possible that some of this was due to underreporting, as for many Trusts part of the challenge of this trial was to implement robust patient follow-up procedures, particularly around SSI surveillance. Whilst funding, support and standardised advice were provided on how to perform SSI surveillance and report possible SSIs, it is possible there was variation in how this follow-up was performed and/or reported between Trusts. The variation seen in SSI rates and the differences in the rate of reported to IOC confirmed SSIs may reflect variation in surveillance and/or reporting practices between Trusts.

Conclusions

Quality improvement collaboratives did not result in improved patient outcomes in this trial; however, there was some evidence that they can support successful implementation of new preoperative patient pathways in the NHS.

Availability of data and materials

The anonymised datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Shekelle PG, Pronovost PJ, Wachter RM, Taylor SL, Dy SM, Foy R, et al. Advancing the science of patient safety. Ann Intern Med. 2011;154(10):693 Available from: http://annals.org/article.aspx?doi=10.7326/0003-4819-154-10-201105170-00011.

    Article  Google Scholar 

  2. de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008;17(3):216–23 Available from: https://qualitysafety.bmj.com/lookup/doi/10.1136/qshc.2007.023622.

    Article  Google Scholar 

  3. Davidoff F. Heterogeneity is not always noise: lessons from improvement. JAMA. 2009;302(23):2580–6.

    CAS  Article  Google Scholar 

  4. National Institute for Health and Care Excellence. Blood transfusion (NICE guideline NG24). 2015. Available from: www.nice.org.uk/guidance/ng24. Cited 2021 May 17.

  5. Royal College of Anaesthetists. Scottish standard for the optimisation of preoperative anaemia. 2018. Available from: https://www.accs.ac.uk/sites/default/files/CSQ-Optimisation-Preop-Anaemia.pdf. Cited 2019 Feb 28.

  6. Muñoz M, Acheson AG, Auerbach M, Besser M, Habler O, Kehlet H, et al. International consensus statement on the peri-operative management of anaemia and iron deficiency. Anaesthesia. 2017;72(2):233–47.

    Article  Google Scholar 

  7. Mueller MM, Van Remoortel H, Meybohm P, Aranko K, Aubron C, Burger R, et al. Patient blood management: recommendations from the 2018 Frankfurt consensus conference. JAMA. 2019;321(10):983 Available from: http://jama.jamanetwork.com/journal.aspx.

    Article  Google Scholar 

  8. National Institute for Health and Care Excellence. Perioperative care in adults (NICE guideline NG180). 2020. Available from: https://www.nice.org.uk/guidance/ng180. Cited 2021 May 17.

  9. Allegranzi B, Bischoff P, de Jonge S, Kubilay NZ, Zayed B, Gomes SM, et al. New WHO recommendations on preoperative measures for surgical site infection prevention: an evidence-based global perspective. Lancet Infect Dis. 2016;16(12):e276–87. https://doi.org/10.1016/S1473-3099(16)30398-X.

    Article  PubMed  Google Scholar 

  10. National Institute for Health and Care Excellence. Surgical site infections - prevention and treatment (NICE guideline NG125). 2019. Available from: https://www.nice.org.uk/guidance/ng125. Cited 2021 May 17.

  11. Royal College of Anaesthetists. Perioperative quality improvement programme annual report 2018-19. 2019. Available from: https://pqip.org.uk/FilesUploaded/PQIP%20Annual%20Report%202018-19.pdf. Cited 2021 May 17.

  12. Wong J, Ho C, Scott G, Machin J, Briggs T. Getting it right first time: the national survey of surgical site infection rates in NHS trusts in England. Ann R Coll Surg Engl. 2019;101(7):463–71 Available from: https://publishing.rcseng.ac.uk/doi/10.1308/rcsann.2019.0064.

    Article  Google Scholar 

  13. Ong C, Lucet JC, Bourigault C, Birgand G, Aho S, Lepelletier D. Staphylococcus aureus nasal decolonization before cardiac and orthopaedic surgeries: first descriptive survey in France. J Hosp Infect. 2020;106(2):332–4. https://doi.org/10.1016/j.jhin.2020.08.008.

    CAS  Article  PubMed  Google Scholar 

  14. Tschelaut L, Assadian O, Strauss R, Matiasek J, Beer M, Angerler G, et al. A survey on current knowledge, practice and beliefs related to preoperative antimicrobial decolonization regimens for prevention of surgical site infections among Austrian surgeons. J Hosp Infect. 2018;100(4):386–92. https://doi.org/10.1016/j.jhin.2018.07.019.

    CAS  Article  PubMed  Google Scholar 

  15. Jung-König M, Füllenbach C, Murphy MF, Manzini P, Laspina S, Pendry K, et al. Programmes for the management of preoperative anaemia: audit in ten European hospitals within the PaBloE (Patient Blood Management in Europe) Working Group. Vox Sang. 2020;115(3):182–91.

    Article  Google Scholar 

  16. Bisbe E, Basora M. Peri-operative treatment of anaemia in major orthopaedic surgery: a practical approach from Spain. Blood Transfus. 2017;15(4):296–306 Available from: http://www.bloodtransfusion.it/articolo.aspx?idart=003066&idriv=000124.

    PubMed  PubMed Central  Google Scholar 

  17. Fischer F, Lange K, Klose K, Greiner W, Kraemer A. Barriers and strategies in guideline implementation — a scoping review. Healthcare. 2016;4(3):36.

    Article  Google Scholar 

  18. Prior M, Guerin M, Grimmer-Somers K. The effectiveness of clinical guideline implementation strategies - a synthesis of systematic review findings. J Eval Clin Pract. 2008;14(5):888–97.

    Article  Google Scholar 

  19. Colquhoun HL, Squires JE, Kolehmainen N, Fraser C, Grimshaw JM. Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review. Implement Sci. 2017;12(1):1–11.

    Article  Google Scholar 

  20. Francke AL, Smit MC, De Veer AJE, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak. 2008;8:1–11.

    Article  Google Scholar 

  21. Li SA, Jeffs L, Barwick M, Stevens B. Organizational contextual features that influence the implementation of evidence-based practices across healthcare settings: a systematic integrative review. Syst Rev. 2018;7(1):1–9.

    Article  Google Scholar 

  22. Geerligs L, Rankin NM, Shepherd HL, Butow P. Hospital-based interventions: a systematic review of staff-reported barriers and facilitators to implementation processes. Implement Sci. 2018;13(1):1–17.

    Article  Google Scholar 

  23. Muñoz M, Gómez-Ramírez S, Kozek-Langeneker S, Shander A, Richards T, Pavía J, et al. ‘Fit to fly’: overcoming barriers to preoperative haemoglobin optimization in surgical patients. Br J Anaesth. 2015;115(1):15–24 Available from: https://linkinghub.elsevier.com/retrieve/pii/S0007091217312357.

    Article  Google Scholar 

  24. NHS Blood and Transplant. National comparative audit of blood transfusion - repeat audit of patient blood management in adults undergoing elective, scheduled surgery. 2016. Available from: https://nhsbtdbe.blob.core.windows.net/umbraco-assets-corp/14914/2016-pbm-final.pdf. Cited 2021 May 20.

  25. Delaforce A, Duff J, Munday J, Hardy J. Overcoming barriers to evidence-based patient blood management: a restricted review. Implement Sci. 2020;15(1):1–13.

    Article  Google Scholar 

  26. Delaforce A, Duff J, Munday J, Hardy J. Preoperative anemia and iron deficiency screening, evaluation and management: barrier identification and implementation strategy mapping. J Multidiscip Healthc. 2020;13:1759–70 Available from: https://www.dovepress.com/preoperative-anemia-and-iron-deficiency-screening-evaluation-and-manag-peer-reviewed-article-JMDH.

    Article  Google Scholar 

  27. Hulscher M, Schouten L, Grol R. Collaboratives. Quest for quality and improved performance: The Health Foundation; 2009. Available from: https://www.health.org.uk/publications/collaboratives/. Cited 2021 May 25

  28. Institute for Healthcare Improvement. The Breakthrough Series: IHI’s collaborative model for achieving breakthrough improvement. IHI Innov Ser white Pap. 2003. Available from: http://www.ihi.org/resources/Pages/IHIWhitePapers/TheBreakthroughSeriesIHIsCollaborativeModelforAchievingBreakthroughImprovement.aspx.

  29. Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91(2):354–94 Available from: http://doi.wiley.com/10.1111/milq.12016.

    Article  Google Scholar 

  30. Wells S, Tamir O, Gray J, Naidoo D, Bekhit M, Goldmann D. Are quality improvement collaboratives effective? A systematic review. BMJ Qual Saf. 2018;27(3):226–40 Available from: http://qualitysafety.bmj.com/lookup/doi/10.1136/bmjqs-2017-006926. Cited 2018 Nov 23.

    Article  Google Scholar 

  31. Scrimshire AB, Booth A, Fairhurst C, Kotze A, Reed M, McDaid C. Preoperative iron treatment in anaemic patients undergoing elective total hip or knee arthroplasty: a systematic review and meta-analysis. BMJ Open. 2020;10(10):e036592 Available from: http://bmjopen.bmj.com/content/10/10/e036592.abstract.

    Article  Google Scholar 

  32. National Clinical Guideline Centre. Blood transfusion. NICE Guidel NG24 Methods, Evid Recomm. 2015. Available from: http://www.nice.org.uk/guidance/CG177%0Ahttp://www.ncbi.nlm.nih.gov/pubmed/26065061.

  33. Zhu X, Sun X, Zeng Y, Feng W, Li J, Zeng J, et al. Can nasal Staphylococcus aureus screening and decolonization prior to elective total joint arthroplasty reduce surgical site and prosthesis-related infections? A systematic review and meta-analysis. J Orthop Surg Res. 2020;15(1):60 Available from: https://josr-online.biomedcentral.com/articles/10.1186/s13018-020-01601-0.

    Article  Google Scholar 

  34. Chen AF, Wessel CB, Rao N. Staphylococcus aureus screening and decolonization in orthopaedic surgery and reduction of surgical site infections infection. Clin Orthop Relat Res. 2013;471(7):2383–99 Available from: http://www.ncbi.nlm.nih.gov/pubmed/23463284. Cited 2019 Jan 25.

    Article  Google Scholar 

  35. National Institute for Health and Care Excellence. Surgical site infections: prevention and treatment; 2020. p. 1–20.

    Google Scholar 

  36. World Health Organization. Global guidelines for the prevention of surgical site infection, second edition. 2018. Available from: https://apps.who.int/iris/bitstream/handle/10665/277399/9789241550475-eng.pdf?sequence=1&isAllowed=y. Cited 2021 Jun 14.

    Google Scholar 

  37. World Health Organization. Action framework to advance universal access to safe, effective and quality-assured blood products 2020–2023; 2020. p. 1–48. Available from: https://www.who.int/bloodproducts

    Google Scholar 

  38. Scrimshire AB, Booth A, Fairhurst C, Reed M, Tadd W, Laverty A, et al. Scaling up Quality Improvement for Surgical Teams (QIST) – avoiding surgical site infection and anaemia at the time of surgery: protocol for a cluster randomised controlled trial. Trials. 2020;21(1):234. https://doi.org/10.1186/s13063-020-4152-3.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Cochrane EPOC group. Effective Practice and Organisation of Care (EPOC) Taxonomy. 2015. Available from: https://epoc.cochrane.org/epoc-taxonomy. Cited 2021 May 26.

  40. Pujol-Nicolas A, Morrison R, Casson C, Khan S, Marriott A, Tiplady C, et al. Preoperative screening and intervention for mild anemia with low iron stores in elective hip and knee arthroplasty. Transfusion. 2017;57(12):3049–57 Available from: http://www.blackwellpublishing.com/journals/TRF.

    CAS  Article  Google Scholar 

  41. Jeans E, Holleyman R, Tate D, Reed M, Malviya A. Methicillin sensitive staphylococcus aureus screening and decolonisation in elective hip and knee arthroplasty. J Infect. 2018;77(5):405–9. https://doi.org/10.1016/j.jinf.2018.05.012.

    Article  PubMed  Google Scholar 

  42. McLean E, Cogswell M, Egli I, Wojdyla D, de Benoist B. Worldwide prevalence of anaemia, WHO Vitamin and Mineral Nutrition Information System, 1993–2005. Public Health Nutr. 2009;12(04):444 Available from: http://www.journals.cambridge.org/abstract_S1368980008002401.

    Article  Google Scholar 

  43. Stephens TJ, Peden CJ, Pearse RM, Shaw SE, Abbott TEF, Jones EL, et al. Improving care at scale: process evaluation of a multi-component quality improvement intervention to reduce mortality after emergency abdominal surgery (EPOCH trial). Implement Sci. 2018;13(1):142 Available from: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-018-0823-9. Cited 2018 Nov 14.

    CAS  Article  Google Scholar 

  44. Peden CJ, Stephens T, Martin G, Kahan BC, Thomson A, Rivett K, et al. Effectiveness of a national quality improvement programme to improve survival after emergency abdominal surgery (EPOCH): a stepped-wedge cluster-randomised trial. Lancet. 2019;393(10187):2213–21.

    Article  Google Scholar 

  45. Richards T, Baikady RR, Clevenger B, Butcher A, Abeysiri S, Chau M, et al. Preoperative intravenous iron to treat anaemia before major abdominal surgery (PREVENTT): a randomised, double-blind, controlled trial. Lancet. 2020;396(10259):1353–61.

    CAS  Article  Google Scholar 

  46. Roman MA, Abbasciano RG, Pathak S, Oo S, Yusoff S, Wozniak M, et al. Patient blood management interventions do not lead to important clinical benefits or cost-effectiveness for major surgery: a network meta-analysis. Br J Anaesth. 2021;126(1):149–56. https://doi.org/10.1016/j.bja.2020.04.087.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

QIST Collaborators:

Faculty members contributed to delivering the trial interventions:

Mark Burgess, Senior Information Analyst, Northumbria Healthcare NHS Foundation Trust

Gail Lowdon, Clinical Surveillance Lead, Northumbria Healthcare NHS Foundation Trust

Allan Marriott, Surgical Care Practitioner, Northumbria Healthcare NHS Foundation Trust

Sue Cadwallader, patient representative

Orthopaedic trainee collaborators contributed to data collection:

Kathryn McLoughlin, Soha Sajid, Raza Hassan

Independent Outcome Classification (IOC) Group undertook trial SSI outcome data validation:

Mr Sharad Bhatnagar, Mr Marshall Sangster, Prof Hemant Sharma, Mr Richard Holleyman, Mr Rory Morrison

In addition, we would like to acknowledge the following collaborators to this trial.

The authors would like to thank Joanne Turner and Wendy Atkinson, Staff Nurses, Northumbria Healthcare NHS Foundation Trust for their assistance with the trial.

The authors gratefully acknowledge the members of the Trial Steering Committee and Trust teams who were active participants, were trained as part of the intervention and implemented the service improvement protocol allocated.

Trial Steering committee: Dr Susy Cook, Dr Jill Mollison, Paul Wilson, Alex Acornley

QIST Infection Teams: James Fountain, Linda Messham, John Moorehead, Melanie Harrison, Sarah Stevenson, Paula Harlow, Philippa Edwards-Faulkener, and Gary Jones, of the Aintree University Hospitals NHS Foundation Trust; Sean Masterson, Russell Thomson, Heidi Chandler, Joanne Tredwell, Denise Simons, Hazera Mahdiya, Reena Peter, Rob Nimmo, and Bhargav Solanki, of the Barking, Havering and Redbridge University Hospitals NHS Trust; Peter Bobak, Jane Dennison, Emma Probitts, Diogo Silva, Richard Grogan, Bridget Tandy, Nadine Boczkowski, and Shah Muhammad, of the Bradford Teaching Hospitals NHS Foundation Trust; Alastair Hutchison, Sarah Williams, Iain Findlay, Josie Goodsell, Catherine Jeppesen, Matthew Hough, and Annette Atkinson, of the Dorset County Hospital NHS Foundation Trust; Trudi Thomson, Liz Still, Emma Tate, Tara Fisher, Kate Murray, Guy Selmon, Lisa Redmond, Neville Sharma, Toby Hartnell, and Phil Huggett, of the East Sussex Healthcare NHS Trust; Caroline Bennett, Rachel McDonald, Mark Farndon, Fiona Fairclough, Cathryn Baxter, David Earl, Lorraine Stephenson, Jenny Child, Cheryl McDermott, Jordan Lam, David Duffy, Emily Wright, Rachel McDonald, and Abby Mansbridge Beard, of the Harrogate and District NHS Foundation Trust; Christopher Martin, Gillian Urwin, Sarah Bartholomew, Chris Roberts, Ashok Ramasamy, Jan Wright, and Stephanie Gould, of the East Suffolk and North Essex NHS Foundation Trust; Hemant Pandit, Ruth Tue, Richard Dalton, Sharon Ferdinandus, Colin Higginbotham, Alison Cracknell, Debora Hardy, Debbie Mawer, Wendy Meerun, Gill Drake, Fiazia Ahmed, Anne Emmerson, John Corkett, and Gary Legge, of the Leeds Teaching Hospitals NHS Trust; Gloria Naves-Garcia, Dianne James, Gopal Rao, Sunder Chita, Alma Jackson, Muhammad Alam, Loretta Brosnan, Carol Mason, Noreen Nolan, Nobukhosi Mkhwananzi, Victoria Davis, Ajay Philip, and Manisha Mistry, of the London North West University Healthcare NHS Trust; Christopher Goulding, Chris Cook, Nikki Staines, Satish Kutty, Ervin Shpuza, James Allen, Vince Salter, Stephanie Allgrove, and Ruby Nicholls, of the Princess Alexandra Hospital NHS Trust; Turab Syed, Neil Hubbard, Ursula Knight, Chiara Mauri, and Marc Phillips, of the Royal Free London Hospital; Joanne Shaw, Andrew Gray, Michelle Myers, Susan Drysdale, Daniel Butchart, Andrea Causer, Karoline Middleton, Joe Millar, Caren Neesham, Lucksy Kottam, and Damian (Paul) Dunn, of the South Tees Hospitals NHS Foundation Trust; Philip Mitchell, Sarah Langfield, Irrum Afzal, Jo Campbell Smith, Sara Patience, Justin Bendig, Lucy Morgan, and Rhys Jones, of the South West London Elective Orthopaedic Centre; Hiren Divecha, Tim Board, Marie Darbyshire, Sarah Clegg, Sandra Latham, Mark Weir, Jayne Dormand, Nick Doree, Nithin Unnikrishnan, and Claire Long, of the Wrightington, Wigan and Leigh NHS Foundation Trust; Ajit Shetty, Jo Halliwell, Martin Dyer, Richard Carroll, Lynda Slater, Pam Ridler, Jackie Thompson, Vicki Parkin, Stuart Bond, and Amy Davies, of The Mid Yorkshire Hospitals NHS Trust; and Andrew Dunn, Catherine Durrant, Paul Oats, Kasia Bojarska, Julia Mills, Mark Evans, Mike Bamford, Maryam Jadidi, Sarah Reader, and Hayley Irwin, of the West Suffolk NHS Foundation Trust.

QIST Anaemia Teams: John Targett, Gabriel Campaner, Tessa Castillo, Ivy Marohom, Mhairi Macpherson, and Eddie Brown, of the Basildon and Thurrock University Hospital; Gautam Chakrabarty, Marcus Beadle, Fiona Kaye, Jane Taylor, Sarah Wheeler, Michelle Fallon, Asifa Ali, Michaela Nyanga, Benjamin Moore, Sue Thirkill, Jane Peacock, and Inderjit Singh, of the Calderdale and Huddersfield NHS Foundation Trust; Simon Cockshott, Rohan Smith, Archana Pillai, Sarah Duffin, Heather Clarke, Simon Pickering, and Guy Tuxford, of the University Hospitals of Derby & Burton NHS Foundation Trust; Andrew Sloan, Qaisar Choudry, Gemma Hudson, Vicky Hampson, Georgina Whiteside, Heather Robinson, and Christopher Marks, of the East Lancashire Hospitals NHS Trust; Nick Boyce Cam, Sam Pennance, Hussain Kazi, Charis Emmett, Matthew Hadfield, Paula Young, John Harris, Christine Reeves, and Karl Booth, of the Mid Cheshire Hospitals NHS Foundation Trust; Oliver Pearce, Louise Mew, Babalola Hakeem-Habeeb, Caroline Middleton, Hitesh Patel, and Ben Hawkins, of the Milton Keynes University Hospital NHS Foundation Trust; Ian Osborne, Tracey Tidbury, Debra Cotton, Neil Harrison, and Joe Gouda, of St Mary’s Hospital, Isle of Wight NHS Trust; Andrew Tunnicliffe, Tom Finnigan, David Sands Johnson, Wiesia Woodyatt, Daniel Havely, Louise Pidhoreckyj, and Catherine Baker, of the Stockport NHS Foundation Trust; Sivaraman Subramanian, Santhosh Thandayuthapani, Emma Gent, Cathryn Smith, Antonia Hardcastle, Kelly Beattie, Claire Atterbury, and Mark Demonty, of the Queen Elizabeth Hospital King’s Lynn NHS Foundation Trust; Ruth Longfellow, Claire Wright, Elizabeth Reece, Steven Golding, Christine Cowling, Paul Jermin, Jayne Edwards, Nigel Tufft, Akhmed Hussain , Wendy Mayne, Niall Graham, and Ben Rowley, of the Robert Jones and Agnes Hunt Orthopaedic Hospital NHS Foundation Trust; and Ian Lee, Maria Stephenson, Cathryn Eitel, Marian Flynn-Batham, Samantha Hook, Emily Dana, Chris Gulliver, and Debbie Jones, of the Western Sussex Hospitals NHS Foundation Trust.

Patient and public involvement

The Trial Steering Committee membership included a patient representative and they were included in the co-production of the trial intervention, contributing to both the development and the delivery.

Funding

This trial is jointly funded by NHS Improvement, Northumbria Healthcare NHS Trust ACC Vanguard, Vifor Pharma and Schülke & Mayr. The funders have had no influence on the design of the study or in writing this manuscript. They were not involved with the collection, analysis or interpretation of trial data.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. All named authors were involved in designing this trial. ABS, AL, MR and GD were involved in recruiting and consenting Trusts to this trial. ABS led on the design and delivery of the quality improvement collaboratives, the intervention in this trial, supervised by AL and MR and supported by AM, AK, CT, DT, GD and WT. ABS, AB, CF, GD, BC, DJT, CM and MR were involved with managing and oversight of this trial. ABS led on data collection and outcome validation with support from AB, CF and GD. ABS and MR directed the statistical analyses which were planned and carried out by CF and EC. All authors were involved in the discussion and interpretation of results. ABS led on writing and drafting the original manuscript and revisions. CF assisted with revisions. All authors critically revised the manuscript and approved the final version.

Corresponding author

Correspondence to Ashley Brian Scrimshire.

Ethics declarations

Ethics approval and consent to participate

The intervention is targeted at the Trust level, and NHS research ethics approval is not required. Institutional approval was sought from the Health Sciences Research Governance Committee of the University of York; the committee felt that research ethics approval was not necessary for this study (reference no: HSRGC/2018/256/D). HRA approval was sought and obtained (IRAS 238457). Consent for a Trust to participate was obtained from Trust executives as outlined in our protocol paper.

Consent for publication

Not applicable.

Competing interests

ABS is undertaking a PhD funded by the same grant as this trial.

MR receives grants for other works not related to the topic of this trial from industry (Stryker, Zimmer, Heraeus, Depuy, Smith and Nephew, Convatec, 3M Healthcare, Schulke) and charities (The Health Foundation, Orthopaedic Research UK).

AK has received consultancy and speaker fees from Vifor pharma and Pharmacosmos. He has received non-financial support from Pharmacosmos in the form of data support for local service development. All of which is outside the submitted work.

York Trials Unit has received funding from the British Orthopaedic Association to support the development of randomised controlled trials.

ABS, MR, CM, DT, AB and DJT are in receipt of grants from the National Institute for Health Research including a trial evaluating the effectiveness of treatments for MRSA

No funding body has had input, involvement or influence in this manuscript, and have not seen the manuscript prior to submission.

Full ICMJE disclosures are available for all authors on request.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Summary of how elements of the Institute for Healthcare Improvement Breakthrough Series Collaborative model were applied to the Quality Improvement for Surgical Teams (QIST) collaboratives.

Additional file 2.

Variation in approach to implementing MSSA decolonisation pathway, rates of implementation and primary outcome reporting.

Additional file 3.

Variation in approach to implementing preoperative anaemia pathway, rates of implementation and primary outcome reporting.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Scrimshire, A.B., Booth, A., Fairhurst, C. et al. Scaling up Quality Improvement for Surgical Teams (QIST)—avoiding surgical site infection and anaemia at the time of surgery: a cluster randomised controlled trial of the effectiveness of quality improvement collaboratives to introduce change in the NHS. Implementation Sci 17, 22 (2022). https://doi.org/10.1186/s13012-022-01193-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-022-01193-9

Keywords

  • Quality improvement collaborative
  • Cluster
  • Preoperative anaemia
  • MSSA
  • Decolonisation
  • Hip replacement
  • Knee replacement
  • Staphylococcus aureus