Skip to main content

Evidence-based Medication knowledge Brokers in Residential Aged CarE (EMBRACE): protocol for a helix-counterbalanced randomised controlled trial

Abstract

Introduction

Clinical practice guidelines recommend against the routine use of psychotropic medications in residential aged care facilities (RACFs). Knowledge brokers are individuals or groups who facilitate the transfer of knowledge into practice. The objective of this trial is to evaluate the effectiveness and cost-effectiveness of using knowledge brokers to translate Australia’s new Clinical Practice Guidelines for the Appropriate Use of Psychotropic Medications in People Living with Dementia and in Residential Aged Care.

Methods and analysis

The Evidence-based Medication knowledge Brokers in Residential Aged CarE (EMBRACE) trial is a helix-counterbalanced randomised controlled trial. The 12-month trial will be conducted in up to 19 RACFs operated by four Australian aged care provider organisations in Victoria, New South Wales, Western Australia and Queensland. RACFs will be randomised to receive three levels of implementation strategies (knowledge broker service, pharmacist-led quality use of medications education activities and distribution of the Guidelines and supporting materials) across three medication contexts (antipsychotics, benzodiazepines and antidepressants). Implementation strategies will be delivered by an embedded on-site aged care pharmacist working at a system level across each participating RACF. All RACFs will receive all implementation strategies simultaneously but for different medication contexts. The primary outcome will be a composite dichotomous measure of 6-month RACF-level concordance with Guideline recommendations and good practice statements among people using antipsychotics, benzodiazepines and antidepressants for changed behaviours. Secondary outcomes will include proportion of residents with Guideline concordant use of antipsychotics, benzodiazepines and antidepressants measured at the RACF-level and proportion of residents with psychotropic medication use, hospitalisation, falls, falls with injury, polypharmacy, quality of life, activities of daily living, medication incidents and behavioural incidents measured at the RACF-level.

Discussion

The EMBRACE trial investigates a novel guideline implementation strategy to improve the safe and effective use of psychotropic medications in RACFs. We anticipate that the findings will provide new information on the potential role of knowledge brokers for successful and cost-effective guideline implementation.

Trial registration

Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12623001141639. Registered 6 November 2023 — retrospectively registered, https://www.anzctr.org.au/TrialSearch.aspx.

Peer Review reports

Background

Persistent high rates of psychotropic medication use in residential aged care facilities (RACFs) remain a concern for residents, caregivers and other stakeholders. This is despite a lack of evidence supporting benefits of psychotropic medication but well-documented risks of harm. More than 60% of Australian RACF residents use regular psychotropic medications, with 41% prescribed antidepressants, 22% antipsychotics and 22% benzodiazepines on a regular basis [1]. Psychotropic medication prevalence is also highly variable, with a study across 27 RACFs in the state of Victoria reporting antipsychotic prevalence ranged from 0 to 95% (mean 32%) and antidepressant prevalence ranged from 10 to 89% (mean 48%) [2].

The American Psychiatric Association [3], European Academy of Neurology [4] and Australian Clinical Practice Guidelines and Principles of Care for People with Dementia [5] recommend avoiding antipsychotics in people living with dementia. Evidence suggests antipsychotics are associated with increased risk of cardiovascular and cerebrovascular events, falls and death [6, 7]. Benzodiazepines are associated with minimal and short-term improvements in sleep disturbances but also with an increased risk of hip fracture [8] and falls [9]. Antidepressants have uncertain benefits in people living with dementia and have been associated with adverse events including dry mouth, dizziness and falls [10].

In October 2019, Australia’s Royal Commission into Aged Care Quality and Safety identified overreliance on psychotropic medications for chemical restraint as one of three areas for immediate action [11]. The National Health and Medical Research Council (NHMRC) Dementia Centre for Research Collaboration subsequently commissioned new Australian Clinical Practice Guidelines for the Appropriate Use of Psychotropic Medications in People Living with Dementia and in Residential Aged Care (the Guidelines) [12]. The Guidelines were developed by a multidisciplinary 18-member Guideline Development Group, supported by a Stakeholder Advisory Committee comprising government agencies, professional groups, aged care provider organisations and quality improvement organisations. The Guidelines were developed using an integrated knowledge translation process in collaboration with five aged care provider organisations in Queensland, South Australia, Western Australia and New South Wales [13, 14]. Ongoing focus groups with these organisations suggested that innovative guideline implementation strategies would be needed to fully implement guideline recommendations and good practice statements.

Poor implementation of guideline recommendations is recognised as a barrier to reducing medication-related harm [15]. There is emerging interest in engaging knowledge brokers to support guideline implementation [16]. Knowledge brokers are individuals or groups that help to move knowledge from those who create the knowledge (e.g. guideline developers) to those that use the knowledge (e.g. health care professionals) [16]. Knowledge brokers act as knowledge managers, linking agents and capacity builders [16]. The role of a knowledge broker is consistent with the Australian Government’s recent announcement of AUD $345.7 million over 4 years for on-site embedded pharmacists in all Government-funded RACFs to improve medication safety [17]. Quality Use of Medicines (QUM) and Medicines Safety is also Australia’s newest National Health Priority Area [18]. In recognition that evidence-based recommendations alone are not sufficient to ensure guideline-concordant appropriate medication use, we developed a series of data-driven knowledge translation strategies for implementing the new Guidelines.

The objective of this trial is to evaluate the effectiveness and cost-effectiveness of using knowledge brokers to translate Australia’s new Clinical Practice Guidelines for the Appropriate Use of Psychotropic Medications in People Living with Dementia and in Residential Aged Care. Guideline implementation using knowledge brokers will be compared to guideline implementation through the following: (1) distribution of the Guidelines and supporting materials and (2) pharmacist-led QUM education activities.

Methods

Design

The Evidence-based Medication knowledge Brokers in Residential Aged CarE (EMBRACE) trial is a 12-month helix-counterbalanced randomised controlled trial [19]. The trial will examine three different guideline implementation strategies (Fig. 1). These strategies will be evaluated across the three psychotropic medication contexts included in the new Guidelines (antipsychotics, benzodiazepines and antidepressants) [12]. All participating RACFs will receive all implementation strategies but for different medication contexts (Table 1, Fig. 1). This trial will involve RACF-level interventions that will not involve the investigators collecting resident-level identifiable data.

Fig. 1
figure 1

Helix counterbalanced design illustrating context area-by-intervention level combinations for three groups of residential aged care facilities (square, circle and triangle). This Figure was adapted with permission from Sarkies et al. Implementation Science 2019;14:45. Abbreviations: QUM, quality use of medicine

Table 1 Intervention combinations delivered for each RACF group

In advance of the trial, the Project Management Team met with each participating aged care provider organisation’s leadership team to discuss the trial design and delivery. Design of this trial was also informed by a series of foundational activities including the following:

  • An integrated knowledge translation process involving an ongoing series of focus groups with aged care provider organisations to develop the new Clinical Practice Guidelines for the Appropriate Use of Psychotropic Medications in People Living with Dementia and in Residential Aged Care [12, 14].

  • In-depth semi-structured interviews and focus groups (n = 33) involving RACF managers, prescribers, pharmacists, nurses, aged care workers, residents, carers and other key stakeholders at participating aged care provider organisations to assess each aged care provider organisation’s existing quality improvement processes [20].

  • Fifteen semi-structured interviews with early adopters of Australia’s embedded on-site aged care pharmacist model to understand potential synergies with our knowledge broker role and to inform the development of knowledge broker training [21].

  • Systematic review of the published literature on the roles and effectiveness of knowledge brokers in implementing clinical practice guidelines [16].

Setting

The trial will be conducted in up to 19 RACFs operated by four aged care provider organisations in the states of Victoria, New South Wales, Western Australia and Queensland. The four aged care provider organisations are non-government, independent and not-for-profit organisations. Australian RACFs provide supported accommodation for people with care needs that can no longer be met in their own homes and are synonymous with long-term care facilities and nursing homes in other countries [22, 23]. Approximately, two thirds (65%) of residents in Australian RACFs are women, and 58% of residents are aged 85 years and over [24]. In Australian RACFs, medications are mostly prescribed by visiting medical practitioners, dispensed by off-site community pharmacies and administered by registered nurses or credentialled aged care workers [25]. Each aged care provider organisation’s leadership team will be responsible for identifying the specific RACFs operated by that organisation to take part in the trial. The trial protocol conforms to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines [26, 27] (Additional file 1). The trial has been registered with the Australian and New Zealand Clinical Trials Registry (ANZCTR) (registration no.: ACTRN12623001141639, date registered: 06/11/2023). The application for trial registration was submitted on the 20th of September 2023 (as shown on the ANZCTR trial registration site) prior to randomisation of RACFs, but the trial was not formally registered until 6th November 2023. There were no changes to the trial protocol between the submission date (20th of September 2023) and the registration date (6 November 2023).

Governance and consultation

The trial will be overseen by the Project Management Team comprising the lead investigators and project manager. During the trial, the Project Management Team will meet with the aged care provider organisation representatives and knowledge brokers monthly or more frequently if required to monitor the data collection and conduct of the trial and to identify any potential adverse events. Meetings will mostly be conducted via video-teleconferencing (e.g. Zoom), with face-to-face meetings organised if needed.

The trial will be supported by a stakeholder group comprising government agencies (Aged Care Quality and Safety Commission, Australian Commission on Safety and Quality in Health Care), professional groups (Royal Australian and New Zealand College of Psychiatrists, Australian and New Zealand Society of Geriatric Medicine, Australian College of Nursing, Pharmaceutical Society of Australia, Pharmacy Guild of Australia), and an advocacy body (Dementia Australia). The stakeholder group will meet annually for the duration of the trial including at implementation, evaluation and dissemination stages. A Data Safety Monitoring Board will meet as and when required during the trial. It will involve an independent group of healthcare professionals with relevant clinical expertise (e.g. general practitioner, geriatrician, nurse, pharmacist).

Randomisation and blinding

This trial will involve RACF-level interventions, and individual residents will not be recruited to participate. The unit of randomisation will be RACFs. Once potential availability of specific RACFs is determined by each aged care provider organisation, the RACF manager or an authorised representative of the aged care provider organisation will be provided with a written explanatory statement, and informed consent to participate will be obtained.

RACFs will be matched into blocks of three based on the aged care provider organisation and geographical location. One RACF within each block of three will be randomised to groups A, B, or C and receive three levels of intervention for a combination of implementation strategies and medication contexts (Table 1). Randomisation will be performed by an independent epidemiologist using a computerised random number generator within SAS (SAS Institute, Cary, NC, USA).

Following randomisation, each aged care provider organisation leadership team and their knowledge brokers will be notified of group allocations for each participating RACF within their organisation. Due to the nature of the trial, it will not be possible to blind the leadership team or knowledge brokers. Partial disclosure will be implemented for RACF nurses, aged care workers and visiting pharmacist and medical practitioners at each RACF. These clinicians and staff will be aware of the trial objectives and implementation strategies but will be blinded to the RACF group allocation. The availability of the knowledge broker service will be communicated via letters, posters and notice boards. Residents and their families will be made aware of the trial through distribution of notices and posters at each RACF. The primary outcome will be analysed by a blinded statistician or epidemiologist. The Project Management Team will not be blinded to the group allocations.

Knowledge brokers

This trial will evaluate a complex intervention involving on-site embedded pharmacists working as knowledge brokers at each aged care provider organisation. Each aged care provider organisation will recruit and employ or contract their own knowledge brokers. The Project Management Team will engage with each aged care provider organisation to help identify suitable knowledge brokers if required. Knowledge brokers will be identified through an expression of interest process via direct approaches to the aged care provider’s existing pharmacy service provider, direct approach to known professional contacts of the Project Management Team or aged care provider organisation or via local advertisements.

Pharmacists will be eligible to be a knowledge broker if they:

  • Hold general pharmacist registration with the Australian Health Practitioner Regulation Agency.

  • Are willing and available to commit to undertake the role for 12 months, including completing training and specific tasks of the trial.

  • Are willing and able to complete all relevant aged care provider organisation induction and occupation, health and safety training requirements and be contracted or employed to work with each aged care provider.

It will be desirable for the knowledge brokers to have prior aged care experience and accreditation to complete medication management reviews (MMRs), but this will not be a requirement [28]. Potential knowledge brokers will be provided with an explanatory statement, and written informed consent will be sought from the knowledge brokers. Knowledge brokers will be trained to support delivery of the implementation strategies by undergoing a training programme over a 4–5-week period prior to trial commencement. The training program consists of the following:

  • 3 × 1.5-h online workshops on knowledge translation delivered by implementation science experts. The workshops include one self-paced and two interactive modules that cover evidence implementation, stakeholder engagement, driving meaningful change and the integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework. These modules have been developed for the purpose of the trial and were informed by the foundational activities described earlier.

  • A 1.5-h online webinar on the EMBRACE trial design and the intervention and guidance on how to deliver the implementation strategies delivered by the Project Management Team.

  • A 1.5-h webinar on the Guidelines delivered by the Project Management Team [12]

  • Residential Aged Care Pharmacist Foundation Training Program developed and delivered by the Pharmaceutical Society of Australia [29]. This 9-h programme involves four residential aged care online modules, nine video lectures on aged care clinical topics, three optional modules dedicated to QUM and two optional modules on health literacy and digital literacy.

Intervention

All three levels of implementation strategies will be delivered simultaneously throughout the 12-month intervention period at the RACF-level. Each level of implementation strategy includes the activities of the previous level (Table 1). Education resources will be provided to support knowledge brokers to deliver level 1 and level 2 implementation strategies. Level 3 implementation strategies will be customised to each RACF based on ongoing local needs assessments conducted by the knowledge broker.

Level 1: Distribution of the Guidelines and supporting materials

The level 1 strategy will involve passive distribution of the Guidelines and supporting materials in both hard copy and electronically to the RACF, including on-site staff (e.g. nurses and aged care workers) and visiting healthcare professionals (e.g. medical practitioners and allied health). Materials will be distributed by the on-site aged care pharmacist at baseline as well as on request. Distributed materials will include the Guidelines, a companion guide, medication factsheets on the allocated medication context (antipsychotics, benzodiazepines or antidepressants) and a curated inventory of existing resources. All these materials will also be publicly available via MAGICapp, an online platform for publication of guidelines and evidence summaries [12]. The level 1 resources will be standardised, and no tailoring of these resources will be undertaken by the Project Management Team. The level 1 strategy is consistent with standard implementation of most clinical practice guidelines in Australian RACFs.

Level 2: Pharmacist-led QUM education activities

The level 2 strategy will involve provision of QUM services and distribution of the Guidelines and supporting materials. QUM services are Australian government-funded pharmacist-led group education activities [30]. The QUM service used in this trial will be developed to align with the Pharmaceutical Society of Australia Guidelines for QUM services and the Guidelines [30]. The QUM service will involve a face-to-face, online or pre-recorded group education activity delivered by an on-site aged care pharmacist, delivered to RACF registered nurses and enrolled nurses and aged care workers directly employed by the aged care provider organisation. Each QUM session will run for up to 70 min. The pharmacist will deliver a QUM service once per quarter, with a total of four QUM services delivered over the 12 months. The four sessions will cover the Guidelines, initiation, adverse events and monitoring and discontinuation relevant to the RACFs’ allocated medication context (Table 2).

Table 2 Overview of QUM service to RACFs

The Project Management Team will provide education resources to assist in leading the QUM service, including facilitator notes, presentation slides and a sample presentation script. The QUM service resources have been piloted with a Queensland-based regional aged care provider organisation, not otherwise participating in the trial, to test the feasibility of the resources. The level 2 resources will be standardised, and no local tailoring of materials will be undertaken by the Project Management Team. The level 2 intervention is an example of current best practice in relation to implementation of clinical practice guidelines in Australian RACFs.

Level 3: Knowledge broker service

The level 3 strategy will involve the on-site knowledge broker who will develop and lead local action plans, as well as provision of QUM services and distribution of the Guideline materials. The knowledge brokers will be employed at the aged care provider organisation level and will work across each participating RACF for that organisation. The knowledge broker will collaborate with the aged care provider organisation’s Medication Advisory Committee (MAC; a multidisciplinary group of healthcare professionals, carers and residents who implement and evaluate medication management policies and procedures [31]) to develop and implement RACF-specific local action plans underpinned by the i-PARIHS framework [32]. Local action plans will be data driven and informed by the trial indicators, iteratively reviewed and updated each quarter (Table 3). The knowledge broker will be an ‘intermediary’ to facilitate knowledge translation by acting as a knowledge manager, capacity builder and linkage agent [16, 21].

  • Knowledge manager activities may include embedding and application of Guideline knowledge into local contexts, policies and procedures, assessing barriers and enablers to Guideline implementation in the local context and preparing a local action plan.

  • Capacity builder activities may include developing staff knowledge and skills to facilitate and enable Guideline-concordant decision-making, coordinating education relevant to Guideline implementation and conducting audits and providing feedback using indicators of guideline concordance to evaluate implementation initiatives.

  • Linkage agent activities may include facilitating collaboration between medical practitioners, nurses and aged care workers, residents and their families, being a conduit between the Project Management Team and the RACF employed staff and visiting team members, and communicating with other knowledge brokers in the trial.

Table 3 Knowledge broker study activity requirements for level 3 intervention

Ongoing fidelity of the intervention delivered by the knowledge brokers will be monitored using the discussion boards, local action plans and monthly meetings with the Project Management Team. Meetings will mostly be conducted via video-teleconferencing (e.g. Zoom), with face-to-face meetings organised if needed.

Data collection

Data collection from the RACFs will occur at baseline and quarterly (3, 6, 9 and 12 months; Table 4). The data collected in this trial will include de-identified data extracted from existing routinely collected data sources within each RACF. Existing data sources will include National Aged Care Mandatory Quality Indicator Program records [33], psychotropic registers [34], prescribing and medication administration records, nursing progress notes, medical records and behaviour support plans. Data will be collected by trained aged care nurses, health or care professionals, employed or contracted by each of the participating aged care provider organisations, who will be blinded to the RACF group allocations. One or more nurses, health or care professionals per participating aged care provider organisation will attend an online training webinar on data collection led by the Project Management Team. Data will be collected and stored on a secure server by Monash University using REDCap™ (Research Electronic Data Capture), a secure web-based software platform designed to support data capture for research studies [35, 36]. Trial data will be stored for a minimum of 15 years after publication of result in accordance with Australian NHMRC and Monash University guidance for medical research involving clinical trials. The final trial dataset will only be accessible to the trial investigators and statistician or epidemiologist.

Table 4 SPIRIT diagram — schedule of enrolment, intervention, and assessment for the EMBRACE trial

RACF-level demographic information

Aggregated RACF-level demographic data will be collected from each RACF using a standard data collection form and will include the following: resident bed-days per quarter, proportion of residents who are female, median/mean resident age, proportion of residents with documented diagnosis of cognitive impairment or dementia and proportion of residents using psychotropic medications (antipsychotics, antidepressants, benzodiazepines, z-drugs, opioids and anticonvulsants).

RACF Guideline concordance

Trained nurses and health or care professionals will assess Guideline concordance using a standard data collection form completed online (preferred) or in a paper-based version. The data collection form will include questions to assess concordance with indicators for each medication context (Tables 5, 6 and 7). This will require trained nurses and health or care professionals at each participating aged care provider organisation to assign each resident a unique trial identification number. Each aged care provider organisation will securely store the spreadsheet of each resident’s trial identification number, and this will only be accessed by appropriate staff employed by the aged care provider organisation, as needed for care delivery. The Project Management Team will not have access to this information and will not be able to identify residents.

Table 5 Indicators to assess aggregate RACF-level concordance: antipsychotics
Table 6 Indicators to assess aggregate RACF-level concordance: benzodiazepines for sleep disturbance
Table 7 Indicators to assess aggregate RACF-level concordance: antidepressants

Non-identifiable data will be aggregated by Monash University and transferred to Aspect Health using a secure transfer system for the purpose of computing RACF-level Guideline concordance. These data will be fed-back to participating RACFs on a quarterly basis using an electronic dashboard system developed by Aspect Health. Aspect Health is a Queensland-based medication management provider. Aggregated non-identifiable data will be treated confidentially and stored on Aspect Health’s secure server. Each RACF will be able to view their Guideline concordance, compared against the Guideline concordance across their organisation and compared against national Guideline concordance (i.e. aggregate concordance of all participating RACFs) via a secure, password-protected login process. Aggregated data will be reported as proportions or percentages to avoid any potential for RACF re-identification. Aggregated Guideline concordance will be used by the knowledge broker to evaluate quality improvement initiatives and facilitate benchmarking across RACFs and aged care provider organisations.

RACF-level prevalence of psychotropic medication use

RACF-level prevalence of psychotropic medications (including antipsychotics, benzodiazepines, antidepressants, z-drugs, opioids and anticonvulsants) will be calculated by number of residents administered psychotropic medications in the last 7 days (regular and pro re nata (PRN)) divided by total number of residents assessed at the RACF. These data will be extracted from audit reports of the medication records of each RACF.

RACF-level proportions of hospitalisation, falls, falls with major injury, polypharmacy, quality of life and activities of daily living

Data on RACF-level proportions of hospitalisation, falls, falls with major injury, polypharmacy, quality of life and activities of daily living will be extracted from the mandatory National Aged Care Quality Indicator Program records into a standard data collection form [37]. The following definitions will be used in line with the National Aged Care Quality Indicator Program:

  • Hospitalisation: RACF-level proportion of residents with hospitalisation compared to baseline. Hospitalisation will be assessed as residents who had one or more emergency department presentations or hospital admissions within the last 3 months.

  • Falls: RACF-level proportion of residents falls compared to baseline. A fall event (one or more) will be assessed as an event that results in a person coming to rest inadvertently on the ground or other lower level within the last 3 months [37].

  • Falls with major injury: RACF-level proportion of residents falls with major injury compared to baseline. Falls with major injury will be assessed as a fall event (one or more) that resulted in a major injury or injuries within the last 3 months.

  • Polypharmacy: RACF-level proportion of residents’ polypharmacy compared to baseline. Polypharmacy will be assessed as residents who were prescribed nine or more medications at the time of data collection. Topical preparations, dietary supplements, short-term medications (e.g. short-course antibiotics) and PRN medications will be excluded.

  • Quality of life: RACF-level proportion of residents who report “good” or “excellent” quality of life as assessed using the Quality of Life Aged Care Consumers (QOL-ACC) tool compared to baseline [38]

  • Activities of daily living: RACF-level proportion of residents who experience a decline in their activities of daily living assessment total score of 1 or more points within the last 3 months. Activities of daily living will be measured using the Barthel Index of Activities of Daily Living [39].

RACF-level prevalence of medication and behavioural incidents

Data on RACF-level prevalence of medication incidents and behavioural incidents will be collected from each RACF’s electronic risk management system and Serious Incident Response Scheme (SIRS). As in previous research, medication incidents will be categorised according to the severity and type (e.g. an administration error, adverse drug reaction, resident error, pharmacy dispensing error or prescribing error) [40]. Incidents recorded in SIRS include unreasonable use of force (e.g. hitting, pushing, shoving or rough handling a resident), psychological or emotional abuse and inappropriate use of restrictive practice [41].

Knowledge broker demographics

Demographic (age, gender) and professional background (education, qualifications, accreditation status and practice experience) data will be collected from the knowledge brokers at the time of enrolment using a standard data collection form completed online (preferred) or a paper-based version.

Knowledge broker activities

Data from local action plans and knowledge broker discussion board posts will be collected throughout the trial period. Data from the local action plans will include the following:

  • Goals for improvement (informed by the Guideline indicators)

  • Type of local activities implemented

  • Resources used to develop activities

  • Timeline for implementation of activities

  • Whether or not the activity was implemented

Quarterly, semi-structured interviews and/or focus groups with knowledge brokers may also be conducted throughout the trial. Data will be de-identified and qualitatively analysed to inform on outcomes relating to local process evaluations and facilitators and barriers to change.

Outcomes

Primary outcome

The primary outcome will be the proportion of residents with Guideline concordant use of antipsychotics, benzodiazepines and antidepressants measured at the RACF-level. This outcome will be measured at the 6-month time point, informed by a similar study conducted in RACFs [42]. This overall Guideline concordance will be measured as a dichotomous outcome (i.e. concordant vs not concordant among those using the reference medication) (Additional file 2). This trial-specific composite outcome has been developed from a series of indicators for each medication contexts and developed by New South Wales Therapeutic Advisory Group.

Secondary outcomes

Secondary outcomes will include:

  • Proportion of residents with Guideline concordant use of antipsychotics, benzodiazepines and antidepressants measured at the RACF-level at 3-, 9- and 12-month time points. The 9- and 12-month time points will be used to evaluate intervention sustainability and will be useful for assessing policy and practice change that did not occur at the 6-month time point.

  • Proportion of residents concordant with each individual indicator of the Guideline concordance composite outcome for antipsychotics, benzodiazepines and antidepressants use, measured at the RACF level at 3-, 6-, 9- and 12-month time points (Tables 5, 6 and 7).

  • Proportion of residents using psychotropic medications (antipsychotics, antidepressants, benzodiazepines, z-drugs, opioids and anticonvulsants) measured at the RACF level at 3-, 6-, 9- and 12-month time points

  • Proportion of residents with hospitalisation, falls, falls with major injury, polypharmacy, quality of life and activities of daily living measured at the RACF level at 3-, 6-, 9- and 12-month time points

  • Proportion of residents with medication incidents and behavioural incidents measured at the RACF level at 3-, 6-, 9- and 12-month time points

These proportions will be calculated using the total number of residents at each RACF at each of the time points as a denominator.

Sample size and power

The sample size of 19 RACFs was deemed to have sufficient statistical power. To estimate the statistical power of the helix, counterbalanced, three-strategy, and three-context area (medication type) trial design, we performed 1000 Monte Carlo simulations using Stata/SE Statistical Software: Release 17.0 (StataCorp. 2021). The sample size analysis was conducted at the RACF level based on the primary outcome (i.e. proportion of RACF-level Guideline concordant use of antipsychotics, benzodiazepines and antidepressants). The sample size was based on conducting analysis using a linear mixed model employing fixed, categorical factors for medication type and guideline implementation strategy and RACF as a random intercept. We assumed a minimum important effect size of an absolute change in the proportion of concordant medication category takers of 5% for the level 2 strategy relative to level 1 strategy and of 15% for the level 3 strategy relative to level 1 strategy. Given these assumptions, our sample size of 19 RACFs provides > 99% power to detect the absolute change in proportion of concordant medication category takers of 15% and 81% power to detect the absolute change in proportion of 5%.

Analysis plan

Effectiveness analysis

All primary analyses will be conducted using the intention-to-treat (ITT) principle. Level 3 intervention will be compared to level 1 and level 2 at the 6-month time point as a primary outcome (Table 4).

Per protocol analysis will also be undertaken with the per protocol set including all RACFs without a major protocol deviation. Major protocol deviations may include, but are not limited to, the following:

  • Loss of knowledge broker

  • Incomplete delivery of intervention (e.g. local action plans, QUM service)

We anticipate that the primary analysis will be conducted using a linear mixed model treating the RACF as a random effect, with the strategy level and medication contexts as fixed effects. Multiple imputation will be used to impute missing covariate values where necessary. Data will be analysed using Stata/SE Statistical Software: Release 17.0 (StataCorp. 2021).

Health economic analysis

Health economic analysis will be performed from a societal perspective incorporating costs for hospital transfers, costs of intervention delivery, costs of psychotropic medication use and cost of staff time managing other adverse events (e.g. falls, behaviour-related events). Economic efficiency will be expressed in terms of incremental cost per additional resident who becomes Guideline concordant for a medication context. Costs will be calculated at 2024 value levels. Bootstrap analyses will be conducted to construct 95% confidence ellipses on a cost-effectiveness plane and to undertake acceptability curve analyses.

Process evaluation

A mixed method process evaluation will be undertaken using the eight-domain framework published by Grant et al. [43]. Process evaluation will be performed through an analysis of qualitative data (e.g. local action plans, discussion board posts) and quantitative measures of engagement with the intervention (e.g. knowledge broker participation in Project Management Team meetings, frequency of log in events on the Guideline concordance dashboard).

Dissemination

Findings will be disseminated through lay summaries, conference presentations and peer-reviewed publications. The lay summaries will be co-designed with consumer and end users. All participating aged care provider organisations and RACFs will be provided a final report summarising key findings. Research findings will also be disseminated through member organisations of the EMBRACE stakeholder group and their professional networks.

Discussion

The EMBRACE trial investigates a novel guideline implementation strategy to improve the implementation of evidence into practice in the RACF setting and directly addresses national and international priority areas: ‘Medication Without Harm’ is the World Health Organization’s (WHO) Third Global Patient Safety Challenge [15]. The EMBRACE trial also addresses dementia as an Australian National Health Priority Area, consistent with the WHO Global Action Plan on Dementia 2017–2025 [44, 45].

Complaints about medications are among the leading sources of complaints to Australia’s Aged Care Quality and Safety Commission [46]. In addressing medication appropriateness, the trial addresses a key concern of consumers and carers. Psychotropic medications contribute to 2.1% of all hospitalisations and 11.3% of all medication harm-related hospitalisations [47]. The trial directly addresses the need for new models of guideline implementation to promote safe and effective psychotropic medication use. Outcomes relating to intervention sustainability are consistent with the need for evidence to inform policy and practice change.

This trial will be the first to evaluate the novel role of system-level knowledge broker pharmacists to facilitate guideline implementation in RACFs. On-site aged care pharmacists are potentially well placed to deliver this intervention, with a recent pharmacist-led multicomponent intervention demonstrating 44% reduction in antipsychotic medication use compared to the control group at 6 months [48]. The knowledge brokers will be on-site and embedded as part of the RACF team [49] and have greater opportunity to lead system-level quality improvement initiatives [21]. The findings of this trial will address the absence of high-quality evidence regarding the effectiveness and cost-effectiveness of knowledge brokers [16] and inform RACF and government funding and resource allocation decisions for potential future roll-out or expansion of the knowledge broker pharmacist role [50].

The EMBRACE trial uses a helix-counterbalanced study design, which provides several advantages over cluster randomised or stepped-wedge designs [19]. Firstly, it is not necessary to adjust for RACF characteristics because each RACF provides data for each implementation strategy. Secondly, all participating RACFs will receive all implementation strategies. This will help to maintain engagement of those RACFs which would otherwise have been randomised to the control group. Finally, the implementation strategies can be delivered simultaneously rather than sequentially as in a stepped-wedge design.

The EMBRACE trial will generate important knowledge about guideline implementation and knowledge brokers that can be used to scale up the intervention across Australia, inform application to other therapeutic areas and contexts, and improve the delivery of healthcare to all residents living in RACFs.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analysed during the current trial.

Abbreviations

ANZCTR:

Australian New Zealand Clinical Trials Registry

EMBRACE:

Evidence-based Medication knowledge Brokers in Residential Aged CarE

i-PARIHS:

Integrated-Promoting Action on Research Implementation in Health Services

NHMRC:

National Health and Medical Research Council

QUM:

Quality use of medicines

RACF:

Residential aged care facilities

SIRS:

Serious Incident Response Scheme

References

  1. Westbury J, Gee P, Ling T, Kitsos A, Peterson G. More action needed: psychotropic prescribing in Australian residential aged care. Aust N Z J Psychiatry. 2019;53(2):136–47.

    Article  PubMed  Google Scholar 

  2. Jokanovic N, Jamsen KM, Tan ECK, Dooley MJ, Kirkpatrick CM, Bell JS. Prevalence and variability in medications contributing to polypharmacy in long-term care facilities. Drugs Real World Outcomes. 2017;4(4):235–45.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Reus VI, Fochtmann LJ, Eyler AE, Hilty DM, Horvitz-Lennon M, Jibson MD, et al. The American Psychiatric Association practice guideline on the use of antipsychotics to treat agitation or psychosis in patients with dementia. Am J Psychiatry. 2016;173(5):543–6.

    Article  PubMed  Google Scholar 

  4. Frederiksen KS, Cooper C, Frisoni GB, Frölich L, Georges J, Kramberger MG, et al. A European Academy of Neurology guideline on medical management issues in dementia. Eur J Neurol. 2020;27(10):1805–20.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Guideline Adaptation Committee. Clinical practice guidelines and principles of care for people with dementia. Sydney. Guideline Adaptation Commitee; 2016. Available from: https://cdpc.sydney.edu.au/wp-content/uploads/2019/06/CDPC-Dementia-Guidelines_WEB.pdf. Accessed 7 Dec 2023.

  6. Maher AR, Maglione M, Bagley S, Suttorp M, Hu JH, Ewing B, et al. Efficacy and comparative effectiveness of atypical antipsychotic medications for off-label uses in adults: a systematic review and meta-analysis. JAMA. 2011;306(12):1359–69.

    Article  CAS  PubMed  Google Scholar 

  7. Schneider-Thoma J, Leucht S. Second generation antipsychotic drugs and mortality: a meta-analysis of placebo-controlled randomised controlled trials. Schizophr Bull. 2018;44(Supplement 1):S115.

    Article  PubMed Central  Google Scholar 

  8. Donnelly K, Bracchi R, Hewitt J, Routledge PA, Carter B. Benzodiazepines, Z-drugs and the risk of hip fracture: a systematic review and meta-analysis. PLoS ONE. 2017;12(4): e0174730.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Seppala LJ, Wermelink AMAT, de Vries M, Ploegmakers KJ, van de Glind EMM, Daams JG, et al. Fall-risk-increasing drugs: a systematic review and meta-analysis: II. Psychotropics. J Am Med Dir Assoc. 2018;19(4):371.e11-.e17.

  10. Dudas R, Malouf R, McCleery J, Dening T. Antidepressants for treating depression in dementia. Cochrane Database Syst Rev. 2018;8(8):Cd003944.

    PubMed  Google Scholar 

  11. Tracey R, Briggs L. Royal commission into aged care quality and safety: interim report. 2019. Available from: https://www.royalcommission.gov.au/system/files/2021-03/interim-report-volume-1.pdf. Accessed 7 Dec 2023.

  12. Simon Bell RB, Sue Brennan, Malcolm Clark, Megan Corlis, Christopher Etherton-Beer, Susan Field, et al (Guideline Development Group). Clinical practice guidelines for the appropriate use of psychotropic medications in people living with dementia and in residential aged care: summary of recommendations and good practice statements. Parkville: Monash University 2022. Available from: https://app.magicapp.org/#/guideline/jMMeqj. Accessed 7 Dec 2023.

  13. Kitson A, Brook A, Harvey G, Jordan Z, Marshall R, O’Shea R, et al. Using complexity and network concepts to inform healthcare knowledge translation. Int J Health Policy Manag. 2018;7(3):231–43.

    Article  PubMed  Google Scholar 

  14. Kothari A, McCutcheon C, Graham ID. Defining integrated knowledge translation and moving forward: a response to recent commentaries. Int J Health Policy Manag. 2017;6(5):299–300.

    Article  PubMed  PubMed Central  Google Scholar 

  15. World Health Organization. Medication without harm. Available from: https://www.who.int/initiatives/medication-without-harm. Accessed 7 Dec 2023.

  16. Cross AJ, Haines TP, Ooi CE, La Caze A, Karavesovska S, Lee EJ, et al. Roles and effectiveness of knowledge brokers for translating clinical practice guidelines in health-related settings: a systematic review. BMJ Qual Saf. 2023;32(5):286–95.

    Article  PubMed  Google Scholar 

  17. Cross AJ, La Caze A, Steeper M, Bell JS. Embedding pharmacists in residential aged care: why it’s important to integrate resident- and system-level services. J Pharm Pract Res. 2022;52(4):263–5.

    Article  Google Scholar 

  18. Australian Commission on Safety and Quality in Health Care. National baseline report on quality use of medicines and medicines safety – phase 1: residential aged care. Sydney: ACSQHC; 2021. Available from: https://www.safetyandquality.gov.au/sites/default/files/2022-02/qum_and_medicines_safety-10th_national_hority_-_national_baseline_report_phase_i_residential_aged_care_-_accessible_pdf.pdf. Accessed 7 Dec 2023.

  19. Sarkies MN, Skinner EH, Bowles KA, Morris ME, Williams C, O’Brien L, et al. A novel counterbalanced implementation study design: methodological description and application to implementation research. Implement Sci. 2019;14(1):45.

    Article  PubMed  PubMed Central  Google Scholar 

  20. La Caze A, Shrestha S, Cross AJ, Steeper M, Ghrahreman-Falconer N, Buys L, et al. Ensuring appropriate use of psychotropic medicines in residential aged care: the people, processes and infrastructure (Poster). 81st FIP World Congress of Pharmacy and Pharmaceutical Sciences in Brisbane, Australia, 24–28 September 2023. Pharmacy Education. 2023;23(6)435–509. Available from: https://doi.org/10.46542/pe.2023.236.435509. Accessed 7 Dec 2023.

  21. Cross AJ, Bell JS, Steeper M, La Caze A. Embedded on-site aged care pharmacists in Australia: insights from early adopters of a new workforce model. Australas J Ageing. 2023;00:1–12.

    Google Scholar 

  22. Sanford AM, Orrell M, Tolson D, Abbatecola AM, Arai H, Bauer JM, et al. An international definition for “nursing home.” J Am Med Dir Assoc. 2015;16(3):181–4.

    Article  PubMed  Google Scholar 

  23. Australian Government Department of Health and Aged Care. About aged care. 2023. Available from: https://www.health.gov.au/topics/aged-care/about-aged-care#who-is-eligible. Accessed 7 Dec 2023.

  24. Australian Institute of Health and Welfare. People using aged care. Canberra: Australian Institute of Health and Welfare, 2022. Available from: https://www.gen-agedcaredata.gov.au/topics/people-using-aged-care. Accessed 7 Dec 2023.

  25. Sluggett JK, Ilomäki J, Seaman KL, Corlis M, Bell JS. Medication management policy, practice and research in Australian residential aged care: current and future directions. Pharmacol Res. 2017;116:20–8.

    Article  PubMed  Google Scholar 

  26. Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346: e7586.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Chen EYH, Wang KN, Sluggett JK, Ilomaki J, Hilmer SN, Corlis M, et al. Process, impact and outcomes of medication review in Australian residential aged care facilities: a systematic review. Australas J Ageing. 2019;38(Suppl 2):9–25.

    Article  PubMed  Google Scholar 

  29. Pharmaceutical Society of Australia. Residential aged care pharmacist: foundation training program. Available from: https://my.psa.org.au/s/training-plan/a110o00000C0UNMAA3/residential-aged-care-pharmacist-foundation-training-program. Accessed 7 Dec 2023.

  30. Pharmaceutical Society of Australia. Guidelines for quality use of medicines (QUM) services. 2020. Available from: https://www.ppaonline.com.au/wp-content/uploads/2020/04/PSA-Guidelines-for-Quality-Use-of-Medicines-QUM-services.pdf. Accessed 7 Dec 2023.

  31. Australian Government Department of Health and Aged Care. Glossary for the guiding principles and user guide. 2022. Available from: https://www.health.gov.au/sites/default/files/2022-11/glossary-for-the-guiding-principles-and-user-guide.pdf. Accessed 7 Dec 2023.

  32. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Australian Government Department of Health and Aged Care. National Aged Care Mandatory Quality Indicator Program (QI Program). 2023. Available from: https://www.health.gov.au/our-work/qi-program. Accessed 7 Dec 2023.

  34. Australian Government Aged Care Quality and Safety Commission. Psychotropic self-assessment tool. 2022. Available from: https://www.agedcarequality.gov.au/resources/self-assessment-tool-psychotropic-medications. Accessed 7 Dec 2023.

  35. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95: 103208.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research Electronic Data Capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.

    Article  PubMed  Google Scholar 

  37. Australian Government Department of Health and Aged Care. National Aged Care Mandatory Quality Indicator Program (QI program): Manual 3.0-Part A. 2022. Available from: https://www.health.gov.au/sites/default/files/2023-11/national-aged-care-mandatory-quality-indicator-program-manual-3-0-part-a_0.pdf. Accessed 7 Dec 2023.

  38. Ratcliffe J, Bourke S, Li J, Mulhern B, Hutchinson C, Khadka J, et al. Valuing the Quality-of-Life Aged Care Consumers (QOL-ACC) instrument for quality assessment and economic evaluation. Pharmacoeconomics. 2022;40(11):1069–79.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Collin C, Wade DT, Davies S, Horne V. The Barthel ADL Index: a reliability study. Int Disabil Stud. 1988;10(2):61–3.

    Article  CAS  PubMed  Google Scholar 

  40. Dugré N, Bell JS, Hopkins RE, Ilomäki J, Chen EYH, Corlis M, et al. Impact of medication regimen simplification on medication incidents in residential aged care: SIMPLER randomized controlled trial. J Clin Med. 2021;10(5):1104.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Australian Government Aged Care Quality and Safety Commission. Serious Incident Response Scheme: guidelines for residential aged care providers. 2022. Available from: https://www.agedcarequality.gov.au/sites/default/files/media/SIRS-guidelines-for-residential-aged-care-providers.pdf. Accessed 7 Dec 2023.

  42. Laver K, Cations M, Radisic G, de la Perrelle L, Woodman R, Fitzgerald JA, et al. Improving adherence to guideline recommendations in dementia care through establishing a quality improvement collaborative of agents of change: an interrupted time series study. Implement Sci Commun. 2020;1(1):80.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:1.

    Article  Google Scholar 

  44. Australian Institute of Health and Welfare. Dementia in Australia. Canberra: Australian Institute of Health and Welfare, 2023. Available from: https://www.aihw.gov.au/reports/dementia/dementia-in-aus. Accessed 7 Dec 2023.

  45. World Health Organization. Global action plan on the public health response to dementia 2017–2025. 2017. Available from: https://www.who.int/publications/i/item/global-action-plan-on-the-public-health-response-to-dementia-2017---2025. Accessed 7 Dec 2023.

  46. Australian Government Aged Care Quality and Safety Commission. Aged Care Quality and Safety Commission Annual Report 2018–19. 2019. Available from: https://www.agedcarequality.gov.au/sites/default/files/media/ACQSC_AR_2018-19_Full_Final.pdf. Accessed 7 Dec 2023.

  47. Wojt IR, Cairns R, Clough AJ, Tan ECK. The prevalence and characteristics of psychotropic-related hospitalizations in older people: a systematic review and meta-analysis. J Am Med Dir Assoc. 2021;22(6):1206-14.e5.

    Article  PubMed  Google Scholar 

  48. Almutairi H, Stafford A, Etherton-Beer C, Fitzgerald P, Flicker L. Impact of a multifaceted, pharmacist-led intervention on psychotropic medication use for residents of aged care facilities: a parallel cluster randomized controlled trial. J Am Med Dir Assoc. 2023;24(9):1311 e1-e8.

    Article  Google Scholar 

  49. Chew S, Armstrong N, Martin GP. Understanding knowledge brokerage and its transformative potential: a Bourdieusian perspective. Evid Policy. 2022;18(1):25–42.

    Article  Google Scholar 

  50. Cameron D, Russell DJ, Rivard L, Darrah J, Palisano R. Knowledge brokering in children’s rehabilitation organizations: perspectives from administrators. J Contin Educ Health Prof. 2011;31(1):28–33.

    Article  PubMed  Google Scholar 

Download references

Funding

This work was supported by the Australian Government Medical Research Future Fund (GA187306). AJC is supported by an NHMRC Emerging Leadership 1 grant (APP2009633).

Author information

Authors and Affiliations

Authors

Contributions

JSB, ALC, MS, TPH, SNH, LT, LQ, JW, CDP, LB, NGF, and AJC conceived the trial and obtained grant funding. JSB, ALC, MS, TPH, SNH, LT, LQ, JW, CDP, LB, NGF, MTL, SS, AM, NO, FG, CL, RW, DC, AK, MJ, AB, and AJC participated in the design of the trial protocol. JSB, ALC, MS, and AJC drafted the manuscript. JSB, ALC, MS, TPH, SNH, LT, LQ, JW, CDP, LB, NGF, MTL, SS, AM, NO, FG, CL, RW, DC, AK, MJ, AB, and AJC critically reviewed and approved the final manuscript.

Corresponding authors

Correspondence to J. Simon Bell or Amanda J. Cross.

Ethics declarations

Ethics approval and consent to participate

The trial has received Monash University Human Research Ethics Committee approval (ID 35525). The research will be conducted in accordance with the World Medical Association Declaration of Helsinki. The trial evaluates RACF-level interventions, and individual residents will not be recruited to participate. The aged care provider organisations were partners in the application for grant funding. RACF-level consent to participate was obtained from an authorised representative of the aged care provider organisation or RACF manager. If an aged care provider organisation or RACF manager decides to withdraw throughout the trial, data that have been collected prior to withdrawal will be included in the data analysis if permitted. No new data will be collected after the aged care provider organisation or RACF has withdrawn from the trial. Any planned changes in the protocol will be approved by the ethics committee, communicated to relevant stakeholders, and updated in the ANZCTR.

Consent for publication

Not applicable.

Competing interests

J. S. B. has received grant funding or consulting funds from the National Health and Medical Research Council, Medical Research Future Fund, Victorian Government Department of Health and Human Services, Dementia Australia Research Foundation, Yulgilbar Foundation, Aged Care Quality and Safety Commission, Dementia Centre for Research Collaboration, Pharmaceutical Society of Australia, Society of Hospital Pharmacists of Australia, GlaxoSmithKline Supported Studies Programme, Amgen, and several aged care provider organisations unrelated to this work. All grants and consulting funds were paid to the employing institution. J. W. was previously employed at Montefiore Homes and continues to have a professional links with them, including paid mentoring roles. A. J. C. has received grant funding or consulting funds from the Medical Research Future Fund and Pharmaceutical Society of Australia. All grants and consulting funds were paid to the employing institution. The other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

 Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) Checklist.

Additional file 2.

 Concordance with Guideline tool – antipsychotics, benzodiazepines and antidepressants.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bell, J.S., La Caze, A., Steeper, M. et al. Evidence-based Medication knowledge Brokers in Residential Aged CarE (EMBRACE): protocol for a helix-counterbalanced randomised controlled trial. Implementation Sci 19, 24 (2024). https://doi.org/10.1186/s13012-024-01353-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-024-01353-z

Keywords