Skip to main content
Download PDF
Download ePub

Re-Purposing the Ordering of Routine Laboratory Tests in Hospitalized Medical Patients (RePORT): protocol for a multicenter stepped-wedge cluster randomised trial to evaluate the impact of a multicomponent intervention bundle to reduce laboratory test over-utilization

Implementation Science volume 19, Article number: 45 (2024) Cite this article

Abstract

Background

Laboratory test overuse in hospitals is a form of healthcare waste that also harms patients. Developing and evaluating interventions to reduce this form of healthcare waste is critical. We detail the protocol for our study which aims to implement and evaluate the impact of an evidence-based, multicomponent intervention bundle on repetitive use of routine laboratory testing in hospitalized medical patients across adult hospitals in the province of British Columbia, Canada.

Methods

We have designed a stepped-wedge cluster randomized trial to assess the impact of a multicomponent intervention bundle across 16 hospitals in the province of British Columbia in Canada. We will use the Knowledge to Action cycle to guide implementation and the RE-AIM framework to guide evaluation of the intervention bundle. The primary outcome will be the number of routine laboratory tests ordered per patient-day in the intervention versus control periods. Secondary outcome measures will assess implementation fidelity, number of all common laboratory tests used, impact on healthcare costs, and safety outcomes. The study will include patients admitted to adult medical wards (internal medicine or family medicine) and healthcare providers working in these wards within the participating hospitals. After a baseline period of 24 weeks, we will conduct a 16-week pilot at one hospital site. A new cluster (containing approximately 2–3 hospitals) will receive the intervention every 12 weeks. We will evaluate the sustainability of implementation at 24 weeks post implementation of the final cluster. Using intention to treat, we will use generalized linear mixed models for analysis to evaluate the impact of the intervention on outcomes.

Discussion

The study builds upon a multicomponent intervention bundle that has previously demonstrated effectiveness. The elements of the intervention bundle are easily adaptable to other settings, facilitating future adoption in wider contexts. The study outputs are expected to have a positive impact as they will reduce usage of repetitive laboratory tests and provide empirically supported measures and tools for accomplishing this work.

Trial Registration

This study was prospectively registered on April 8, 2024, via ClinicalTrials.gov Protocols Registration and Results System (NCT06359587). https://classic.clinicaltrials.gov/ct2/show/NCT06359587?term=NCT06359587&recrs=ab&draw=2&rank=1

Peer Review reports

Background

Laboratory tests are an indispensable tool in medicine for diagnosing and monitoring clinical conditions [1]. Yet, between 16–56% of laboratory-based testing is deemed wasteful as it does not advance patient care [1]. One form of laboratory test over-use is the use of repetitive routine blood testing in hospitalized patients [2, 3]. In addition to contributing to healthcare waste and a downstream cascade of more tests and procedures, laboratory test over-utilization in hospitals is associated with patient discomfort, disruption in sleep patterns, and hospital-acquired anemia which can increase the risk of transfusions, prolong length of stay, and increase mortality [4,5,6,7,8,9,10]. Reducing laboratory test over-utilization in hospitals thus provides an avenue towards reducing health care waste without compromising patient care [11].

Choosing Wisely Canada, a campaign to reduce unnecessary tests and treatments in healthcare has identified repetitive laboratory testing in hospitalized patients as low-value care and made several recommendations to reduce laboratory test over-use [12,13,14]. These recommendations need active and comprehensive de-implementation efforts to facilitate sustainable change [15,16,17,18,19]. Many described interventions have been shown to reduce laboratory test over-utilization, with the greatest evidence for multicomponent initiatives [20,21,22,23,24,25,26,27]. However, most studies are small and there is little systematic evaluation of downstream consequences and sustainability. A recent meta-analysis of interventions to reduce laboratory test over-utilization indicates that interventions such as education, cost display, and policy change were effective in multi-faceted intervention settings [28]. In terms of effectiveness and sustainability, changes to electronic medical record (EMR) systems were deemed as the most valuable single intervention [28].

Our group has iteratively developed a multicomponent intervention bundle (including healthcare provider and patient engagement strategies) to safely reduce repetitive use of routine laboratory testing in hospitals. Earlier versions of this intervention bundle have demonstrated safe reduction in routine laboratory test utilization in a pilot study [29], followed by expansion across eight units and four tertiary care hospitals [30]. A definitive large-scale implementation study is needed to determine the impact and outcomes of this intervention bundle. Our Canadian Institutes of Health Research (CIHR) funded project, Re-Purposing the Ordering of Routine laboratory Tests (RePORT) evaluates the impact of an enhanced and innovative intervention bundle in a wider context and adapted to local hospital context, in a multicenter clinical trial using a stepped-wedge cluster randomized design with number of routine laboratory tests per patient-day as the primary outcome. We provide below an overview of the intervention bundle tools, our implementation strategy and associated implementation science frameworks, and detail the study design and planned analysis for this implementation protocol.

Methods/Design

Study setting and population

We report this protocol using the SPIRIT guidelines [31] for reporting of intervention trials (see Additional file 1). This study will be conducted in the adult medical wards of 16 hospitals representing academic practice and community settings across the province of British Columbia (BC) in Canada (Table 1). The BC Ministry of Health works together with five regional health authorities [32] to deliver acute care in hospitals through a publicly funded system. The 16 hospitals represent all five health authorities within BC. The study population will include all healthcare providers and patients hospitalized in adult medical wards. Medical wards include patients admitted under Internal Medicine and Family Medicine (Hospitalist) groups and exclude patients admitted to Critical Care, Surgical, Pediatric, Obstetric, and specialized tertiary care medical sub-specialty units. These patients are excluded owing to their unique requirements in specialized units.

Table 1 List of participating facilities and characteristics in the province of British Columbia, Canada
Full size table

Intervention bundle evolution

We have identified six target routine tests (complete blood count, electrolytes, creatinine, urea, international normalized ratio, and partial thromboplastin time) that collectively constitute 40% of expenditure on hospital-based laboratory tests in medical units [33]. In our previously published pilot study [29], we had used local consensus to develop appropriate use criteria for these target tests and developed an online case-based module and pocket cards summarizing these recommendations. The educational module and pocket-cards were coupled with electronically distributed laboratory test utilization data for individual physicians and aggregate learner (medical students and resident physicians) teams to form the intervention bundle.

After the pilot, we developed national expert consensus-based recommendations on appropriate use of the target tests [33], and used these recommendations to create a revised interactive, online case-based educational module [34] that is accredited by the Royal College of Physicians and Surgeons of Canada for continuing professional development credits. Our intervention bundle during our subsequent expansion across eight units [30] included the case-based educational module. The electronically distributed laboratory test utilization data for physicians and learners was enhanced with the opportunity for physicians to join virtual facilitated group audit and group feedback sessions conducted according to the Calgary Audit and Feedback framework [35, 36].

Our current multimodal intervention bundle builds on the prior educational and audit and feedback tools and adds in tools to engage patients and harness Electronic Medical Record (EMR) ordering processes.

Intervention bundle components

Our multicomponent intervention bundle (please see Additional File 2 for details) includes the following components:

  1. (i)

    Education: We will use an updated online case-based module (Additional File 2) that builds on our learnings from our prior studies and continues to maintain accreditation through the Royal College of Physicians and Surgeons of Canada for continuing professional development credits. The online module will be paired with a framework for purposeful utilization of laboratory tests to create a clinical decision support tool (Appendix File 2) [37].

  2. (ii)

    Audit and feedback: We will also provide laboratory test utilization data to healthcare providers. These data reports will be at the individual, group, or ward-level based on site preference and feasibility. We have designed facilitated sessions to review the data in a group setting according to the Calgary Audit and Feedback Framework [35, 36]. During these one-hour long sessions, facilitators will lead participants through different phases of reacting to data, seeking to understand, question, justify, and contextualize, and then finally moving to reflection and planning for change. This is an evidence-informed approach for implementing learning interventions using Audit and Feedback, with demonstrated efficacy [38, 39]. These sessions incorporate specific behaviour change techniques in Audit and Feedback that target behaviour change [40].

  3. (iii)

    Electronic Medical Record (EMR) ordering process changes: Our partnerships with clinical informatics leaders in BC will enable our team to review EMR ordering processes, provide education to healthcare providers on how to effectively harness EMR systems to purposefully order routine laboratory tests, and facilitate dialogue and change around suggestions from healthcare providers on EMR ordering systems.

  4. (iv)

    Patient engagement: Our research team has collaborated with patient research partners through a Patient Advisory Council to create tools to engage patients with laboratory testing in hospitals. These tools include a patient infographic [41] (Additional file 2), an educational video [41], and a website [42] (www.hospitalbloodwork.ca) that collectively aim to educate patients about the process of laboratory testing in hospitals, and ways that they can seek engagement with the process. We operationalized the Patient Engagement Framework from Canadian Institute of Health Research’s Strategy for Patient Oriented Research [43], attending to the principles of patient engagement around inclusiveness, support, mutual respect, and co-build [44]. Using the validated Patient and Public Engagement evaluation tool [45], we have also conducted a formal evaluation of patient engagement within our council to foster ongoing engagement [46]. The evaluation indicated that patient research partners felt heard and engaged with the work of the council [46].

Patient research partners were co-applicants in the initial proposal seeking funding for this work, co-conducted with the research team a qualitative study to understand patient perceptions of hospital-based laboratory testing [47], and co-designed patient engagement tools with a human-centered design expert based on the findings from the qualitative study. Patient research partners have taken the lead in disseminating the results of their work through presentations at international (Preventing Overdiagnosis Conference, Denmark 2023 [48]) and national conferences (Northwest Strategy for Patient Oriented Research Collaborative Forum in Edmonton 2023 [49] and Putting Patients First Conference in Vancouver 2023 [50]). Patient research partners will continue to work alongside the research team with implementation and evaluation of patient engagement tools.

Study design

This multicenter, quasi-experimental stepped-wedge cluster randomized trial [51] will assess whether a multicomponent intervention bundle can reduce the number of target routine laboratory tests ordered in hospitalized medical patients. Implementation of the intervention bundle will be guided by the Knowledge to Action cycle [52], where we will understand the local context, assess local barriers and facilitators, and select and tailor our intervention tools. We will use the RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance) framework [53, 54] to evaluate the intervention bundle and the National Health Service (NHS) Sustainability model to plan for sustainment [55].

The study will first conduct a feasibility assessment of the intervention bundle tools over a 16-week pilot period at one site. The pilot period will provide an opportunity for testing the intervention tools and developing implementation strategies. After the pilot, each cluster will enter the implementation stage in 12-week steps (Fig. 1) in a random order determined by computerized random number generation. Each cluster will contain approximately 2 hospitals, loosely grouped based on geographical proximity. A cluster will be eligible to enter randomization for implementation once local data infrastructure is complete. The initial four weeks of implementation will serve as the pre-intervention period, which will be followed by an 8-week intervention period. The final four weeks of the intervention period for one cluster will overlap with the pre-intervention period of the following cluster (Fig. 1).

Fig. 1
figure 1

Stepped-wedge cluster randomized trial study design for the intervention bundle. C= Control, Pre= Preintervention period, INT= Intervention period

Full size image

During the pre-intervention period, we will finalize multidisciplinary implementation teams including nurse managers and educators, ward directors, physicians, resident physicians, and medical students at each site. Local implementation teams will provide information on local barriers and facilitators which will allow for selection and tailoring of intervention tools. They will receive virtual implementation support by the research team and the Patient Advisory Council to adapt and deliver intervention bundle tools within local context. Different intervention tools may be used at each site depending on local context and adapted to local barriers and facilitators. Each site will receive at least one tool for healthcare provider engagement and one for patient engagement. All site-specific modifications of intervention tools will be noted in our implementation process tracking tool (Fig. 2). Members of implementation teams will also complete a combined survey to assess readiness for implementation (based on the Ready, Set, Change! Decision support tool [56]) and determine overall climate of sustainability and strategies to enable sustainability of the intervention (based on NHS Sustainability survey [57]) (Additional file 3).

Fig. 2
figure 2

Implementation Process Evaluation Tool

Full size image

Following pre-intervention, clusters will enter an 8-week intervention period where intervention tools will be deployed. Implementation of intervention bundle tools will be integrated with existing hospital processes such as ongoing faculty rounds, business meetings, site and ward meetings, quality councils and existing communication forums. Local study champions (members of the implementation teams) will help disseminate educational materials including link to the online module, clinical decision support tool and patient engagement tools. Study brochures will be shared electronically, and patient infographic with QR code linking to project website will be displayed in physical hospital wards. Each healthcare provider will receive an email with links to online project educational resources. Lab utilization reports (at individual/provider group/ward level) will be sent at a frequency ranging between every 3–6 months, decided by each site. Virtual facilitated sessions will be organized to discuss the data according to the Calgary Audit and Feedback framework [35, 36].

Following implementation completion in the final cluster, we will collect 24 weeks of post-implementation data. This phase aims to re-evaluate impact of integrated implementation tools in the absence of dedicated personnel support at the end of 24 weeks post-implementation. Access to educational resources will be continued for healthcare providers and patients through embedded processes such as divisional websites, onboarding packages for new faculty and resident physicians, and physical posters with QR codes in workspaces. Laboratory test utilization data reports will be sent with links to educational resources at a frequency chosen by each site.

The stepped wedge design allows for robust evaluation of the intervention bundle while factoring in the logistical constraints common to implementation studies [58]. This study permits rigorous evaluation of the intervention bundle while enabling all willing hospital facilities to receive the intervention. Enrollment will occur at the hospital level. We do not anticipate any attrition in study sites. We have operational approval and support from regional health authority leadership and local study champions. In the event that a site does drop out for a logistical reason, we have adequate numbers of other sites with similar characteristics that could be recruited. The nature of the intervention makes it impossible to mask research team members and sites to the assignment of intervention when implementation begins.

Outcomes and data sources

We will use the RE-AIM framework to guide our evaluation of the intervention bundle (see Table 2). This framework offers a systematic approach to the collection and analysis of data required to plan, implement, evaluate, and strategize sustainability of the intervention. The primary outcome will be the number of target routine laboratory test orders per patient-day with implementation of the intervention bundle compared to the control period. Secondary outcomes will assess number of all common laboratory tests (number of tests that collectively contribute to more than 80% of test utilization in hospitals), costs associated with target routine laboratory testing, implementation fidelity and potential unintended consequences of the intervention (Table 2). We will use our implementation process tracking tool to track fidelity of implementation and implementation context (Fig. 2). We will use administrative data for quantitative outcomes and complement that with data obtained from surveys (readiness assessment and sustainability survey), observational field notes and memos collected by study coordinator through our implementation process tool, and qualitative data collected during our facilitated utilization data review sessions. An evaluation of all outcomes listed in Table 2 will be conducted after study implementation is complete and the primary outcome will be re-evaluated at 24 weeks after study completion to assess for sustainability.

Table 2 Outcomes, potential unintended consequences, and implementation fidelity
Full size table

Sample size calculation

Based on administrative data, we estimate a mean of three target laboratory test orders per patient at baseline, and an average of 100 patients per site per day on the medical wards. We believe that a 10% reduction in mean number of target test orders per patient-day is clinically important. With 16 participating sites, 8-week intervention periods, and an intra-cluster correlation of 0.1 based on our prior work or even as high as 0.2 to account for geographical clustering, we will have the ability to detect a difference of 10% in our primary outcome with greater than 90% power (2-sided alpha of 0.05) [59].

Statistical data analysis

We will use generalized linear mixed models throughout the analysis to account for multiple observations per patient and shared characteristics (correlation) between geographical clusters [60]. Models will be adjusted for patient age, sex, case-mix group [61], number of patient-days and hospital type. Using intention to treat, clusters will be analyzed according to their randomized cross over time from control to intervention period, with preintervention period data being excluded as washout. Calendar time will be included as a fixed effect for each step to account for secular trends. We anticipate using logistic regression (via a logit link) for binary outcomes (inpatient mortality, 30-day readmission, 30-day mortality), Poisson regression for count variables (e.g. number of tests) and linear regression models for continuous outcomes (e.g. length of stay). A p-value < 0.05 will be considered statistically significant. We will use complementary data from our surveys, data and field notes collected through the implementation process tracking tool, and qualitative data collected during the facilitated utilization data review sessions to help interpret site-specific results.

Costing analysis

We will compare costs of care and patient outcomes with and without implementation of the intervention bundle from the perspective of the publicly funded healthcare system. We will include costs of: (i) target laboratory tests with and without implementation of the intervention bundle using a cost per test or test group obtained from published reference median costs [62]; (ii) the index hospitalization (hospitalization where the implementation occurs) for each patient using micro-costing data [63] to provide a detailed cost per patient, including all resources consumed during the hospital stay such as direct and indirect nursing costs, surgery, ancillary services (physiotherapy, occupational therapy), and laboratory and drug costs; (iii) post-hospitalization healthcare costs over the 30-day period following discharge from hospital for the index hospitalization including: subsequent hospitalizations, emergency departments visits, ambulatory care, and urgent care costs. This will be done to estimate unintended downstream consequences of intervening on laboratory test use. We will present costs by category, and the differences in total costs will be calculated and compared to implementation costs. Our analysis will be a detailed cost consequence analysis, presented in conjunction with other outcomes.

Discussion

As healthcare costs increase globally, we need context-specific de-implementation strategies to reduce low-value healthcare practices and integrate effective, evidence-based approaches. Our study is one of few implementation science studies that combines real-world operational change with a rigorous scientific evaluation approach to comprehensively study the de-implementation of the practice of repetitive use of routine laboratory testing in hospitals. Specifically, the study builds on intervention tools that have previously demonstrated success with reduction of redundant laboratory testing in hospitals [29, 30], and capitalizes on the momentum created by the current national campaign headed by Choosing Wisely Canada to ‘Use Labs Wisely’  [64].

While numerous studies have focused on reducing repetitive laboratory testing in hospitals, most are small, single institution efforts without clear plan for sustainability or scale [28, 65]. Our study is a robust effort to build upon prior work in a systematic manner that allows for scale and plan for sustainability. A recent systematic review on interventions to reduce repetitive ordering of low-value inpatient laboratory tests identified EMR and policy changes as the most effective and sustainable [28]. However, providers found the use of strict limitations and unavoidable pop-up alerts unfavourable. Moreover, focused EMR or policy changes are easier for laboratory tests that have clearly defined appropriateness criteria or re-testing intervals.. In contrast, the tests we focus on for our study are common tests with wide applicability, it is only their redundant use that is low-value [37, 66]. As such, our multicomponent intervention bundle which combines education, audit and feedback, EMR changes and patient engagement is novel in the area of repetitive laboratory test utilization and will contribute to our understanding of how the different elements can interact and contribute to reducing repetitive laboratory test utilization, while engaging and winning the favour of practising providers. Our study will be one of the few that has developed de-novo patient engagement tools in this field and will report on the evaluation of those tools as part of a multicomponent intervention bundle. In an era of increasing patient access to laboratory test results, patient engagement tools to empower and engage patients with appropriate use is timely.

While audit and feedback is a widely used strategy to improve professional practice and has been used as a component of other multimodal quality improvement studies, there exists considerable heterogeneity in the methodologies used [67]. The effectiveness of audit and feedback depends on baseline performance and method of delivery of the feedback [67]. In our study, we use an established framework of delivering audit and feedback (Calgary Audit and Feedback Framework) which has demonstrated prior efficacy [30, 38, 39]. This study will contribute towards building evidence around a specific method of delivering audit and feedback which can be reliably replicated and adapted based on evolving evidence. Hence our study will help advance the science of delivery of audit and feedback. In addition, our use of virtual facilitation for the group audit and feedback sessions to enable province-wide implementation will contribute towards evidence in the area of virtual application of facilitated audit and group feedback based on the Calgary Audit and Feedback Framework. A recent scoping review on virtual facilitation identified significant variability on reporting of virtual facilitation and lack of details on how it was conducted [68]. Our study will contribute towards literature in the development and evaluation of effective virtual facilitation to improve uptake of interventions, both through the application of virtual facilitation for implementation support, and for the facilitated audit and feedback sessions.

Our study is also one of few studies that includes patient engagement embedded in every aspect of the research and includes co-designed intervention tools that will be implemented. This trial will contribute to the understanding of how to apply the science of Knowledge Translation to de-implementation [69], including delivery of Audit and Feedback reports, design of patient engagement strategies, and evaluation of tailored pragmatic multicomponent strategies. To the best of our knowledge, this is one of the largest planned de-implementation trials focusing on reducing redundant use of routine daily laboratory testing in hospitals. Results of the study have the potential to improve the quality of care for hospitalized patients. Lessons learned will help inform future implementation of other interventions in hospitals in general, a treatment setting that deals with high-cost and high-acuity care [70]. Given the lack of evidence on why and how implementation strategies work, our complementary data to understand local contextual determinants will advance the science of implementation.

Results of our study will be disseminated to healthcare providers and researchers through presentations at national and international conferences and open-access publications in peer-reviewed journals. Furthermore, we plan to have a cross-sectoral meeting with interested policymakers, healthcare providers and patient participants after the end of the study to disseminate experiences and findings. We will also conduct a press release after publication to share information with the public. We will include project metadata in the supplementary appendix of published articles.

Given the stepped-wedge design, a notable limitation is potential confounding due to temporal trends as more clusters are exposed to the intervention with study progress [58]. To counter this, we will use randomization to determine the sequence of cluster entry into intervention. In this study, hospital is the unit of randomization, therefore contamination with physicians and medical trainees working in multiple hospitals is possible. The study will report on the effect of this intervention in a population of hospitalized adult medical patients in a single province in Canada, as such, results may not be generalizable to other patient populations and settings.

Trial status

Pilot implementation since May 6th 2024.

Availability of data and materials

The final trial data set will be accessed by the study PI (AA), project team statisticians and data analysts. All administrative data used in this study are available from the provincial and institutional health authority data analytics sources and can be requested in accordance with institutional policies and procedures. All other data (including qualitative data) are available from the corresponding author upon reasonable request.

Abbreviations

RePORT:

Repurposing the Ordering of Routine Laboratory Tests in Hospitalized Medical Patients

EMR:

Electronic Medical Record

References

  1. Naugler C, Wyonch R. What the doctor ordered: Improving the use and value of laboratory testing. SSRN Electron J. 2019. https://doi.org/10.2139/ssrn.3338061.

    Article  Google Scholar 

  2. van Walraven C, Naylor CD. Do we know what inappropriate laboratory utilization is? JAMA. 1998;280(6):550. https://doi.org/10.1001/jama.280.6.550.

    Article  PubMed  Google Scholar 

  3. Winkens R, Dinant G-J. Evidence base of clinical diagnosis: Rational, cost effective use of investigations in clinical practice. BMJ. 2002;324(7340):783–5. https://doi.org/10.1136/bmj.324.7340.783.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Salisbury AC, Reid KJ, Alexander KP, Masoudi FA, Lai SM, Chan PS, et al. Diagnostic blood loss from phlebotomy and hospital acquired anemia during acute myocardial infarction. Arch Intern Med. 2011;171(18):1646–53. https://doi.org/10.1001/archinternmed.2011.361.

    Article  PubMed  Google Scholar 

  5. Thavendiranathan P, Bagai A, Ebidia A, Detsky AS, Choudhry NK. Do blood tests cause anemia in hospitalized patients? The effect of diagnostic phlebotomy on hemoglobin and hematocrit levels. J Gen Intern Med. 2005;20(6):520–4. https://doi.org/10.1111/j.1525-1497.2005.0094.x.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Koch CG, Li L, Sun Z, Hixson ED, Tang A, Phillips SC, et al. Hospital-acquired anemia: prevalence, outcomes, and healthcare implications. J Hosp Med. 2013;8(9):506–12. https://doi.org/10.1002/jhm.2061.

    Article  PubMed  Google Scholar 

  7. Houben PH, Winkens RA, van der Weijden T, Vossen RC, Naus AJ, Grol RP. Reasons for ordering laboratory tests and relationship with frequency of abnormal results. Scand J Prim Health Care. 2010;28(1):18–23. https://doi.org/10.3109/02813430903281758.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Bruce CR, Fetter JE, Blumenthal-Barby JS. Cascade effects in critical care medicine: a call for practice changes. Am J Respir Crit Care Med. 2013;188(12):1384–5. https://doi.org/10.1164/rccm.201309-1606ED.

    Article  PubMed  Google Scholar 

  9. Ganguli I, Lupo C, Mainor AJ, Raymond S, Wang Q, Orav EJ, et al. Prevalence and cost of care cascades after low-value preoperative electrocardiogram for cataract surgery in fee-for-service medicare beneficiaries. JAMA Intern Med. 2019;179(9):1211–9. https://doi.org/10.1001/jamainternmed.2019.1739.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Bhatia RS, Bouck Z, Ivers NM, Mecredy G, Singh J, Pendrith C, et al. Electrocardiograms in low-risk patients undergoing an annual health examination. JAMA Intern Med. 2017;177(9):1326–33. https://doi.org/10.1001/jamainternmed.2017.2649.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Berwick DM, Hackbarth AD. Eliminating waste in US health care. JAMA. 2012;307(14):1513–6. https://doi.org/10.1001/jama.2012.362. (Epub 2012 Mar 14 PMID: 22419800).

    Article  CAS  PubMed  Google Scholar 

  12. Not necessary. Policy ideas for limiting low-value care in Canada. https://choosingwiselycanada.org/not-necessary/. Accessed 12 Jan 2024.

  13. Choosing Wisely Canada Recommendations. https://choosingwiselycanada.org/recommendations. Accessed 12 Jan 2024.

  14. Using labs wisely during Global Blood Tube and other resource shortages. https://choosingwiselycanada.org/perspective/global-shortages/. Accessed 12 Jan 2024.

  15. Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, et al. Early trends among seven recommendations from the choosing wisely campaign. JAMA Intern Med. 2015;175(12):1913–20. https://doi.org/10.1001/jamainternmed.2015.5441.

    Article  PubMed  Google Scholar 

  16. van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ. Implementation and de-implementation: two sides of the same coin? BMJ Quality & Safety. 2017;26(6):495–501. https://doi.org/10.1136/bmjqs-2016-005473.

  17. Montini T, Graham ID. “Entrenched practices and other biases”: unpacking the historical, economic, professional, and social resistance to de-implementation. Implement Sci. 2015;10:24. https://doi.org/10.1186/s13012-015-0211-7.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. https://doi.org/10.1186/s12916-015-0488-z.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden N. Interventions aimed at reducing use of low-value health services: a systematic review. Med Care Res Rev MCRR. 2017;74(5):507–50. https://doi.org/10.1177/1077558716656970.

    Article  PubMed  Google Scholar 

  20. Miyakis S, Karamanof G, Liontos M, Mountokalakis TD. Factors contributing to inappropriate ordering of tests in an academic medical department and the effect of an educational feedback strategy. Postgrad Med J. 2006;82(974):823–9. https://doi.org/10.1136/pgmj.2006.049551.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Levick DL, Stern G, Meyerhoefer CD, Levick A, Pucklavage D. Reducing unnecessary testing in a CPOE system through implementation of a targeted CDS intervention. BMC Med Inform Decis Mak. 2013;13:43. https://doi.org/10.1186/1472-6947-13-43.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Meidani Z, Mousavi GA, Kheirkhah D, Benar N, Maleki MR, Sharifi M, et al. Going beyond audit and feedback: towards behaviour-based interventions to change physician laboratory test ordering behaviour. J R Coll Physicians Edinb. 2017;47(4):339–44. https://doi.org/10.4997/jrcpe.2017.407.

    Article  CAS  PubMed  Google Scholar 

  23. Foster M, Presseau J, McCleary N, Carroll K, McIntyre L, Hutton B, et al. Audit and feedback to improve laboratory test and transfusion ordering in critical care: a systematic review. Implement Sci. 2020;15(1):46. https://doi.org/10.1186/s13012-020-00981-5.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Bindraban RS, van Beneden M, Kramer MHH, van Solinge WW, van de Ven PM, Naaktgeboren CA, et al. Association of a multifaceted intervention with ordering of unnecessary laboratory tests among caregivers in Internal Medicine Departments. JAMA Netw Open. 2019;2(7):e197577. https://doi.org/10.1001/jamanetworkopen.2019.7577.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Corson AH, Fan VS, White T, Sullivan SD, Asakura K, Myint M, et al. A multifaceted hospitalist quality improvement intervention: decreased frequency of common labs. J Hosp Med. 2015;10(6):390–5. https://doi.org/10.1002/jhm.2354.

    Article  PubMed  Google Scholar 

  26. Eaton KP, Levy K, Soong C, Pahwa AK, Petrilli C, Ziemba JB, et al. Evidence-based guidelines to eliminate repetitive laboratory testing. JAMA Intern Med. 2017;177(12):1833–9. https://doi.org/10.1001/jamainternmed.2017.5152.

    Article  PubMed  Google Scholar 

  27. Rubinstein M, Hirsch R, Bandyopadhyay K, Madison B, Taylor T, Ranne A, et al. Effectiveness of practices to support appropriate laboratory test utilization: a laboratory medicine best practices systematic review and meta- analysis. Am J Clin Pathol. 2018;149(3):197–221. https://doi.org/10.1093/ajcp/aqx147.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Yeshoua B, Bowman C, Dullea J, Ditkowsky J, Shyu M, Lamet H, et al. Interventions to reduce repetitive ordering of low-value inpatient laboratory tests: a systematic review. BMJ Open Quality. 2023;12: e002128. https://doi.org/10.1136/bmjoq-2022-002128.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Ambasta A, Ma IWY, Woo S, Lonergan K, Mackay E, Williamson T. Impact of an education and multilevel social comparison-based intervention bundle on use of routine blood tests in hospitalised patients at an academic tertiary care hospital: a controlled pre-intervention post-intervention study. BMJ Qual Saf. 2020;29(10):1–2. https://doi.org/10.1136/bmjqs-2019-010118.

    Article  PubMed  Google Scholar 

  30. Ambasta A, Omodon O, Herring A, Ferrie L, Pokharel S, Mehta A, et al. Repurposing the Ordering of Routine Laboratory Tests in Hospitalised Medical Patients (RePORT): results of a cluster randomised stepped-wedge quality improvement study. BMJ Qual Saf. 2023;32(9):517–25. https://doi.org/10.1136/bmjqs-2022-015611.

    Article  PubMed  Google Scholar 

  31. Chan A-W, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, et al. Spirit 2013 explanation and elaboration: Guidance for protocols of clinical trials. BMJ. 2013;346(jan08 15). https://doi.org/10.1136/bmj.e7586.

  32. Health authorities. Government of British Columbia; 2021. https://www2.gov.bc.ca/gov/content/health/about-bc-s-health-care-system/partners/health-authorities. Accessed 16 Apr 2024.

  33. Ambasta A, Pancic S, Wong BM, Lee T, McCaughey D, Ma IWY. Expert Recommendations on Frequency of Utilization of Common Laboratory Tests in Medical Inpatients: a Canadian Consensus Study. J Gen Intern Med. 2019. https://doi.org/10.1007/s11606-019-05196-z.

    Article  PubMed  PubMed Central  Google Scholar 

  34. RePORT Cards Module. https://cards.ucalgary.ca/card/7293208. Accessed 21 Nov 2023.

  35. Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. The Calgary Audit and Feedback Framework: a practical, evidence-informed approach for the design and implementation of socially constructed learning interventions using audit and group feedback. Implement Sci. 2018;13(1):136. https://doi.org/10.1186/s13012-018-0829-3.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. How do physicians behave when they participate in audit and feedback activities in a group with their peers? Implement Sci. 2018;13(1):104. https://doi.org/10.1186/s13012-018-0796-8.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Carrigan I, Ma IWY, Ambasta A. A Framework for Purposeful Utilization of Laboratory Tests in Hospitalized Patients. Am J Med. 2022;135(3):278–80. https://doi.org/10.1016/j.amjmed.2021.08.019.

    Article  PubMed  Google Scholar 

  38. Dowling SK, Gjata I, Solbak NM, Weaver CGW, Smart K, Buna R, et al. Group-facilitated audit and feedback to improve bronchiolitis care in the emergency department. Canadian Journal of Emergency Medicine. 2020;22(5):678–86. https://doi.org/10.1017/cem.2020.374.

    Article  PubMed  Google Scholar 

  39. Barber CE, Mosher D, Dowling S, Bohm V, Solbak NM, MacMullan P, et al. Implementation and evaluation of audit and feedback for monitoring treat-to-target (T2T) strategies in rheumatoid arthritis using performance measures. Rheumatology and Therapy. 2020;7(4):909–25. https://doi.org/10.1007/s40744-020-00237-0.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Crawshaw J, Meyer C, Antonopoulou V, Antony J, Grimshaw JM, Ivers N, et al. Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals. Implement Science. 2023;18(1):63. https://doi.org/10.1186/s13012-023-01318-8.

    Article  Google Scholar 

  41. Tools by Patients for Patients. RePORT Project. https://www.hospitalbloodwork.ca/tools. Accessed 21 Nov 2023.

  42. Understanding Hospital Bloodwork [Internet]. RePORT Project. www.hospitalbloodwork.ca. Accessed 21 Nov 2023.

  43. Government of Canada CIHR. Strategy for Patient-Oriented Research. https://cihr-irsc.gc.ca/e/41204.html. Accessed 21 Nov 2023.

  44. Nielssen I, Santana M, Pokharel S, Strain K, Kiryanova V, Zelinsky S, et al. Operationalizing the principles of patient engagement through a Patient Advisory Council: Lessons and recommendations. Health Expect. 2023. https://doi.org/10.1111/hex.13909.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Abelson J, Li K, Wilson G, Shields K, Schneider C, Boesveld S. Supporting quality public and patient engagement in health system organizations: development and usability testing of the Public and Patient Engagement Evaluation Tool. Health Expectations: an International Journal of Public Participation in Health Care and Health Policy. 2016;19(4):817–27. https://doi.org/10.1111/hex.12378.

    Article  PubMed  Google Scholar 

  46. Babatunde S, Ahmed S, Santana MJ, Nielssen I, Zelinsky S, Ambasta A. Working together in health research: a mixed-methods patient engagement evaluation. Research Involvement and Engagement. 2023;9(1):62. https://doi.org/10.1186/s40900-023-00475-w.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Pokharel S, Khawaja Z, Williams J, Mithwani AA, Strain K, Khanna P, et al. Patient perceptions of in-hospital laboratory blood testing: A patient-oriented and patient co-designed qualitative study. Health Expect. 2023. https://doi.org/10.1111/hex.13880.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Preventing Overdiagnosis 2023 – Copenhagen. https://www.wiserhealthcare.org.au/event/preventing-overdiagnosis-2023-copenhagen/. Accessed 12 Dec 2023.

  49. 2023 Northwest SPOR Collaborative Forum. https://absporu.ca/training-opportunities/annual-conference/. Accessed 12 Dec 2023.

  50. Putting Patients First 2023: Changing Landscapes and Learning Together for Sustainable Patient-Oriented Research. https://healthresearchbc.ca/event/putting-patients-first-2023/. Accessed 12 Dec 2023.

  51. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54. https://doi.org/10.1186/1471-2288-6-54.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: Time for a map? J Contin Educ Heal Prof. 2006;26(1):13–24. https://doi.org/10.1002/chp.47.

    Article  Google Scholar 

  53. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health. 1999;89(9):1322–7. https://doi.org/10.2105/ajph.89.9.1322.

  54. Glasgow RE, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: What can it tell us about approaches to chronic illness management? Patient Educ Couns. 2001;44(2):119–27. https://doi.org/10.1016/s0738-3991(00)00186-5.

    Article  CAS  PubMed  Google Scholar 

  55. Maher L, Gustafson D, Evans A. NHS Sustainability Model and Guide. https://improvement.nhs.uk/resources/Sustainability-model-and-guide/. Accessed 16 Apr 2024.

  56. Ready, Set, Change! A readiness for change decision support tool. http://readiness.knowledgetranslation.ca/. Accessed 12 Dec 2023.

  57. Sustainability Model and Guide- NHS England. NHS-Institute for Innovation and Improvement. https://www.england.nhs.uk/improvement-hub/wp-content/uploads/sites/44/2017/11/ILG-1.5-Evaluating-Improvement.pdf. Accessed 13 Dec 2023.

  58. Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: Rationale, design, analysis, and reporting. BMJ. 2015;350(feb06 1). https://doi.org/10.1136/bmj.h391.

  59. The Shiny CRT Calculator: Power and Sample size for Cluster Randomised Trials. https://clusterrcts.shinyapps.io/rshinyapp/. Accessed 21 Nov 2023.

  60. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91. https://doi.org/10.1016/j.cct.2006.05.007.

    Article  PubMed  Google Scholar 

  61. Case Mix Groups+ (CMG+). https://www.cihi.ca/en/cmg. Accessed 21 Nov 2023.

  62. Ma I, Lau CK, Ramdas Z, Jackson R, Naugler C. Estimated costs of 51 commonly ordered laboratory tests in Canada. Clin Biochem. 2019;65:58–60. https://doi.org/10.1016/j.clinbiochem.2018.12.013.

    Article  PubMed  Google Scholar 

  63. Klarenbach S, Manns B, Pannu N, Clement F, Wiebe N, Tonelli M. Economic evaluation of continuous renal replacement therapy in acute renal failure. Int J Technol Assess Health Care. 2009;25(3):331–8. https://doi.org/10.1017/s0266462309990134.

    Article  PubMed  Google Scholar 

  64. Using labs wisely. https://choosingwiselycanada.org/hospitals/using-labs-wisely/. Accessed 16 Apr 2024.

  65. Moriates C. How can we finally reduce repetitive routine laboratory tests for hospitalised patients? BMJ Qual Saf. 2023;32(9):498–501. https://doi.org/10.1136/bmjqs-2023-016315.

    Article  PubMed  Google Scholar 

  66. Ten AA. Years Since the Choosing Wisely Campaign: Are We Ordering Laboratory Tests More Wisely in Our Hospitalized Patients? Jt Comm J Qual Patient Saf. 2022;48(10):500–2. https://doi.org/10.1016/j.jcjq.2022.08.001.

    Article  Google Scholar 

  67. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259. https://doi.org/10.1002/14651858.CD000259.pub3.

  68. Agulnik A, Boykin D, O’Malley DM, Price J, Yang M, McKone M, et al. Virtual facilitation best practices and research priorities: a scoping review. Implement Science Communications. 2024. 5. https://doi.org/10.1186/s43058-024-00551-6.

  69. Patey AM, Grimshaw JM, Francis JJ. Changing behaviour, ‘more or less’: Do implementation and de-implementation interventions include different behaviour change techniques? Implementation Science. 2021;16(1). https://doi.org/10.1186/s13012-021-01089-0.

  70. Rashidi B, Kobewka DM, Campbell DJ, Forster AJ, Ronksley PE. Clinical factors contributing to high cost hospitalizations in a canadian tertiary care centre. BMC Health Services Research. 2017;17(1). https://doi.org/10.1186/s12913-017-2746-6.

Download references

Acknowledgements

Not Applicable.

Funding

This study was funded by the Canadian Institutes of Health Research Project Grant (PJT- 183833) which went through peer-review. The funding body played no role in the conception of the study, collection, analysis and interpretation of data, and the decision to approve the final version of the manuscript.

Author information

Authors and Affiliations

  1. Department of Medicine, Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, Calgary, AB, T2N 4N1, Canada

    Anshula Ambasta, Jayna M. Holroyd-Leduc, Surakshya Pokharel, Irene Ma, Braden Manns, Caley Shukalek & Onyebuchi Omodon

  2. Department of Anesthesia, Pharmacology and Therapeutics, Therapeutics Initiative, University of British Columbia, Vancouver, V6T 1Z4, Canada

    Anshula Ambasta

  3. Ward of the 21st Century, University of Calgary, GD01, CWPH,Building 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada

    Surakshya Pokharel & Onyebuchi Omodon

  4. Department of Medicine, University of Alberta, 116 St & 85 Ave, Edmonton, AB, T6G 2R3, Canada

    Pamela Mathura & Narmin Kassam

  5. Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, V6T 1Z4, Canada

    Andrew Wei-Yeh Shih

  6. Faculty of Medicine and Dentistry, University of Alberta, 116 St & 85 Ave, Edmonton, AB, T6G 2R3, Canada

    Henry T. Stelfox

  7. Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, V6T 1Z4, Canada

    Mark Harrison

  8. Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, Calgary, AB, T2N 4N1, Canada

    Braden Manns, Peter Faris, Tyler Williamson, Caley Shukalek, Maria Santana & Deirdre McCaughey

  9. Department of Pediatrics, Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, Calgary, AB, T2N 4N1, Canada

    Maria Santana

  10. Department of Pathology and Laboratory Medicine, Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, Calgary, AB, T2N 4N1, Canada

    Chris Naugler

Authors
  1. Anshula Ambasta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jayna M. Holroyd-Leduc
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Surakshya Pokharel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pamela Mathura
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrew Wei-Yeh Shih
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Henry T. Stelfox
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Irene Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Mark Harrison
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Braden Manns
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Peter Faris
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Tyler Williamson
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Caley Shukalek
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Maria Santana
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Onyebuchi Omodon
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Deirdre McCaughey
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Narmin Kassam
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Chris Naugler
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AA conceived of the study protocol and wrote the first draft with significant input from JHL, PM, AWS, HTS, SP AC, NK, and DM. IM had a great role in outlining the educational plan. BM and MH outlined the costing analysis. PF, TW, and OO outlined the statistical analysis plan. MS outlined the patient engagement plan. DW outlined the audit and feedback plan. CN provided expertise on laboratory medicine and estimation of laboratory test costs. CS guided with EMR changes. All authors contributed to refinement of the study protocol and approved the final manuscript.

Corresponding author

Correspondence to Anshula Ambasta.

Ethics declarations

Ethics approval and consent to participate

This protocol has been approved by the University of British Columbia Clinical Research Ethics Board (H22-03005). Operational approval has also been obtained from all five participating health authorities in British Columbia. Since project activities are part of core operational process change, involve minimal risk to participants, and it is impracticable to obtain individual consent, we have obtained waiver of consent for healthcare provider and patient participants who will receive information about tools from the intervention bundle without any obligation to use them. We will obtain digital informed consent for healthcare provider participation in the online educational module and informed consent for participation in group audit and feedback discussions around laboratory test utilization data.

Consent for publication

Not applicable.

Competing interests

The authors have no relevant conflicts of interest to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ambasta, A., Holroyd-Leduc, J.M., Pokharel, S. et al. Re-Purposing the Ordering of Routine Laboratory Tests in Hospitalized Medical Patients (RePORT): protocol for a multicenter stepped-wedge cluster randomised trial to evaluate the impact of a multicomponent intervention bundle to reduce laboratory test over-utilization. Implementation Sci 19, 45 (2024). https://doi.org/10.1186/s13012-024-01376-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-024-01376-6

Keywords

Implementation Science

ISSN: 1748-5908