Effect of core versus enhanced implementation strategies on adherence to a clinical pathway for managing anxiety and depression in cancer patients in routine care: a cluster randomised controlled trial
Implementation Science volume 18, Article number: 18 (2023)
Optimal strategies to facilitate implementation of evidence-based clinical pathways are unclear. We evaluated two implementation strategies (Core versus Enhanced) to facilitate implementation of a clinical pathway for the management of anxiety and depression in cancer patients (the ADAPT CP).
Twelve cancer services in NSW Australia were cluster randomised, stratified by service size, to the Core versus Enhanced implementation strategy. Each strategy was in place for 12 months, facilitating uptake of the ADAPT CP (the intervention being implemented). The Core strategy included a lead team with champions, staff training and awareness campaigns prior to implementation, plus access to feedback reports and telephone or online support during implementation. The Enhanced strategy included all Core supports plus monthly lead team meetings, and proactive, ongoing advice on managing barriers, staff training and awareness campaigns throughout implementation. All patients at participating sites were offered the ADAPT CP as part of routine care, and if agreeable, completed screening measures. They were allocated a severity step for anxiety/depression from one (minimal) to five (severe) and recommended management appropriate to their severity step. Multi-level mixed-effect regression analyses examined the effect of Core versus Enhanced implementation strategy on adherence to the ADAPT CP (binary primary outcome: adherent ≥ 70% of key ADAPT CP components achieved versus non-adherent < 70%), with continuous adherence as a secondary outcome. Interaction between study arm and anxiety/depression severity step was also explored.
Of 1280 registered patients, 696 (54%) completed at least one screening. As patients were encouraged to re-screen, there were in total 1323 screening events (883 in Core and 440 in Enhanced services). The main effect of implementation strategy on adherence was non-significant in both binary and continuous analyses. Anxiety/depression step was significant, with adherence being higher for step 1 than for other steps (p = 0.001, OR = 0.05, 95% CI 0.02–0.10). The interaction between study arm and anxiety/depression step was significant (p = 0.02) in the continuous adherence analysis only: adherence was significantly higher (by 7.6% points (95% CI 0.08–15.1%) for step 3 in the Enhanced arm (p = .048) and trending to significance for step 4.
These results support ongoing implementation effort for the first year of implementation to ensure successful uptake of new clinical pathways in over-burdened clinical services.
ANZCTR Registration: ACTRN12617000411347 (Trial registered 22/03/2017; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372486&isReview=true)
Clinical pathways (CPs) are standardised, evidence-based multidisciplinary management plans, which identify an appropriate sequence of clinical interventions, timeframes, milestones and expected outcomes for one or more patient groups . By their operational nature, CPs provide a level of detail over and above that provided in clinical guidelines. CPs are increasingly used in healthcare to achieve optimal, evidence-based and cost-effective outcomes, [2, 3] increase hospital efficiency [4, 5], decrease operational costs [6, 7], reduce lengths of stay , and decrease mortality rates .
However, while CPs have been shown to improve patient outcomes, this is not always the case , possibly due to poor uptake or incomplete adherence to CPs resulting from environmental, system or practitioner barriers [11, 12]. Deviations from CPs may reflect beneficial tailoring to the needs of individual patients but may also result in reduced quality of patient care, [5, 13] increased staff burden due to additional steps required to address deficiencies , and increased staff resistance to future health service change.
Due to these negative outcomes, increasing research effort has explored strategies to promote uptake and adherent use of health service interventions , culminating in sophisticated, evidence-based implementation frameworks, such as the Promoting Action Research in Health Services framework (PARiHS)  and the Consolidated Framework for Implementing Research (CFIR) . These frameworks propose that, along with evidence, context and intervention characteristics, facilitation is key to implementation success. Facilitation encompasses resources and processes offered both internally and by the research team, to support staff in implementing interventions such as CPs. While there is increasing understanding of the nature of facilitation strategies, there is very little clarity regarding the optimal dose of facilitation required. Without such data it is difficult for health systems to plan implementation efforts when introducing new interventions into health systems, including CPs, into routine care.
Our group developed a CP for screening, assessment and management of anxiety and depression in adult cancer patients (the ADAPT CP) to guide best practice in Australia . The ADAPT CP is based on evidence review, refined through stakeholder interviews  and a Delphi consensus process . The ADAPT CP follows a stepped care model incorporating iterative screening at recommended intervals, with triage to one of five steps, each with a recommended management plan (from universal care and self-management for those with minimal or mild levels of anxiety and/or depression, to specialist care for those with severe anxiety and/or depression), with review and change in step where necessary. Evidence-based recommendations on staff responsibilities, content and timing of interventions, are provided for each step and tailored to available resources . Drawing on the PARiHS and CFIR frameworks to support CP implementation, we developed an online portal (the ADAPT Portal)  to operationalise as many processes as possible, increase efficiency and reduce staff time and burden. We also developed staff education modules , patient information, and an online cognitive-behavioural intervention for mild to moderate anxiety and depression  to address concerns raised by health professionals in an earlier barrier analysis .
Our team has reported extensively on implementation preparation, processes and outcomes of the ADAPT trial , including organisational readiness for change , identification of barriers and facilitators , selection and definitions of evaluation outcomes , staff perspectives on acceptability and appropriateness  and tailoring of implementation processes according to site needs . Forthcoming publications will address implementation costs and fidelity, sustainability of the ADAPT CP and effect of the ADAPT CP on health service use.
In this cluster trial, our primary objective was to determine whether “dose” of implementation strategy (Core versus Enhanced) effects staff adherence to the ADAPT CP. Our secondary objective was to examine the effect of step allocation (overall, and by implementation support arm) on total and component adherence scores.
Our primary hypothesis was that the proportion of eligible patients screened, for whom sites achieve acceptable adherence to the ADAPT CP (defined as yes: having completed ≥ 70% of the recommended ADAPT CP components versus no.: < 70%) would be greater in the Enhanced implementation strategy arm than in the Core implementation strategy arm.
Secondary hypotheses included that:
Adherence scores for each component of the ADAPT CP would be greater in the Enhanced implementation strategy arm than in the Core implementation strategy arm.
As more actions are required of staff for higher (more severe) steps of anxiety/depression, adherence would be lower for higher than for lower steps of anxiety and depression.
There would be a significant interaction between step and implementation strategy arm, with better adherence to higher steps of anxiety and depression in the Enhanced implementation strategy arm than that in the Core implementation support arm.
Study design and setting
This study was a mixed-methods, cluster randomised controlled trial (CRCT) which was conducted from January 2017 to December 2020. Cancer services in New South Wales (NSW), Australia’s most populous state, were invited to participate in the study. Participating services were randomised to a Core versus Enhanced implementation strategy to promote uptake of and adherence to the ADAPT CP. Randomisation was stratified by size of service (large (≥ 100 new pts./year) versus small (< 100 new pts./year)) to ensure approximately equal patient volume in the two study arms.
Service inclusion criteria
Eligible cancer services could operate within the public and/or private healthcare systems, and be whole cancer services or single, independent departments within services, such as tumour streams (e.g., breast cancer or haematology) or treatment streams (such as medical or radiation oncology). Care was taken to ensure representation of services located in both major cities and regional areas.
Recruitment: cancer services, staff and patients
Researchers met with cancer service directors and multidisciplinary representatives to discuss the study in detail. Following confirmation of participation, a local ADAPT champion, who would lead implementation of the ADAPT CP at the cancer service was appointed to liaise with the research team, and facilitate engagement with the service workforce. Services also nominated a lead team to engage with the research team, optimally comprised of multi-disciplinary representatives including medical, nursing, psychosocial, administrative and IT staff, the identified ADAPT CP champion(s), and other opinion leaders as required. Cancer service staff involved in any way with implementation of the ADAPT CP were provided with participation information sheets by researchers, with consent recorded either by completion of an online survey or a consent form.
All patients at participating study sites were offered care in accordance with the ADAPT CP as part of routine care during the 12-month implementation period. Patients who agreed to complete screening within the ADAPT Portal were invited to participate in the study and give informed consent for researchers to access their medical records and health care utilisation.
Study processes have been described in detail elsewhere . The ADAPT Cluster RCT involved different stages, which included an Engagement period, with scheduled time (approximately 2 months) to prepare cancer services for implementation of the ADAPT CP; Go-Live, when the ADAPT Portal was launched; and the Implementation period, which comprised 12 months of supported implementation where the ADAPT CP was used by cancer services as part of routine care. The Engagement period (identical for all participating services) comprised 6–8 engagement meetings with the lead team, facilitated by the ADAPT research team, to tailor the ADAPT CP and Portal to local preferences, workflow and resources. Cancer service staff were invited to attend face-to-face information and education sessions about the study processes, the ADAPT CP and the ADAPT Portal, and were provided with access to online education modules on how to introduce and conduct screening for anxiety/depression, triage screening results, and make referrals if needed.
Randomisation and data collection measures
Randomisation occurred at the end of the Engagement Period, with sites randomised in blocks of 4 to the Core or Enhanced intervention group, stratified by size (large vs. small). Allocation concealment was preserved for study sites and staff throughout the study. Service staff completed baseline (T0) questionnaires prior to randomisation and at T1 (6 months into implementation) and T2 (study close, after 12 months of implementation). A subsample also participated in semi-structured interviews at these timepoints. The purpose of questionnaires and interviews was to gather information about staff and organisational readiness, staff perception of the ADAPT CP such as its usefulness, appropriateness, and potential and actual barriers to implementation (these data are reported elsewhere [24,25,26,27,28]). ADAPT staff conducting staff interviews and statistical analyses were blinded to site allocations.
Implementation strategies are outlined in Table 1. Core strategies (delivered to both study arms) were consistent with usual roll out of a CP in the Australian NSW health context. Lead team members guided tailoring of the ADAPT CP and Portal to fit the local context, to increase ownership and maximise intervention fit; awareness campaigns were run as the ADAPT CP was launched, including posters and presentations; staff received relevant training and access to education modules to increase self-efficacy and readiness; and champions were provided monthly ADAPT Portal activity audit and feedback reports and additional support from the ADAPT team at their request (a passive approach).
Services randomised to the Enhanced strategy received more prolonged, active engagement with the ADAPT team over the 12-month implementation period, including: monthly face-to-face meetings with the Lead Team, approximately 1 h in length, to discuss progress, identify training and support needs of local champions, highlight issues for attention and promotion to the wider team, and consider sustainability issues; additional awareness campaigns; and newsletters with progress updates sent to all staff with tailored strategies to address identified service-specific barriers and facilitators (an active approach).
The ADAPT CP
After study launch, all sites implemented the ADAPT CP . As per the ADAPT CP, participating patients completed anxiety and depression screening measures online and were allocated a severity step. Staff were contacted if severity was moderate or above and provided with recommended management options. Staff met with patients to confirm severity and triage them to appropriate management, checked referral uptake, reviewed progress and implemented re-screening.
Outcomes for this study have previously been described in detail .
Primary outcome: adherence
Adherence data for each cancer service was captured from the ADAPT Portal, supplemented by service medical record review. To address the ADAPT CP stepped care approach, we specified adherence as the percentage of all CP components (such as screening, triage, referral and re-screening) appropriate to the patient’s level of anxiety/depression (i.e. step allocation), undertaken at each screening episode, providing an adherence score of 0–100 (see Table 2). To address site tailoring of the ADAPT CP, delivery of CP components by any appropriate staff (individually defined at each site), was considered acceptable. Adherence to individual ADAPT CP components was also calculated.
To provide a more clinically relevant measure of adherence (our primary outcome), we further defined a categorical outcome for each screening episode: (adherent ≥ 70% of key ADAPT CP components achieved; or non-adherent: < 70% of key ADAPT CP components achieved). The medical adherence literature cites optimal cut-offs of 80–90% [29, 30], however this cut-off would have resulted in substantial unbalance in sample sizes between the adherence outcomes, and limit statistical power to detect a difference in implementation arm. This is because managing anxiety and depression is complex and not the core business of oncology services, and so adherence can be low. Considering this, we chose a cut-off of 70% for this study.
Anxiety and depression step
The severity of anxiety and depression reported at each ADAPT CP screen was determined on the basis of screening scores. Participants completed the Edmonton Symptom Assessment System (ESAS-r)  or the Distress Thermometer (DT)  (each service chose one of these to use). Patients who scored ≥ 3 on the anxiety item or ≥ 2 on the depression item of ESAS-r or ≥ 4 on the DT were prompted to complete the Hospital Anxiety and Depression Scale (HADS) . They were then allocated to an anxiety/depression severity step using published and consensus-derived cut-offs on the HADS (HADS score 0–3: step 1, HADS score 4–7: step 2, HADS score 8–10: step 3, HADS score 11–14: step 4 and HADS score ≥ 15: step 5) for minimal, mild, moderate, severe and very severe anxiety/depression respectively. Staff were alerted if patients scored at step 2 or above. Staff could adjust the step after a triage conversation with patients to determine the source and severity of their distress.
A multi-level mixed-effect logistic regression analysis was conducted using a binary outcome measure (adherent vs non-adherent) for the primary analysis and a multi-level mixed-effect multiple regression analysis for the continuous adherence outcome (0–100%) as the secondary analysis. In each analysis, implementation arm (Core vs. Enhanced) was fitted as a fixed-effect predictor. We included a fixed effect for step allocation (due to different number of components according to step allocation), and a random effect for the intercept, grouped hierarchically by persons (for repeated measures), and then site (due to the cluster randomisation). In an exploratory analysis, we tested for different effect sizes according to step allocation (by adding an interaction term between step allocation and implementation arm to the model).
Block randomisation resulted in 4 sites allocated to the Core arm, and 8 to the Enhanced (see Table 3 for site characteristics). Characteristics were evenly distributed across arms except for funding type, with all Enhanced arms being publically funded, while half the Core sites had a private or private/mixed funding model.
There were 1280 patients registered on the ADAPT Portal, 745 in the Core and 535 in the Enhanced services. Of registered patients, 696 (54%) went on to complete at least one screening, 63% in Core and 42% in Enhanced services. The most common reasons across arms for patients not screening were non-response to the screening invitation (41% of non-screeners), or patient decline (22% of non-screeners); specific reasons for non-response and decline were not recorded. As patients could complete more than one screen, a total of 1323 screening events (883 in Core and 440 in Enhanced services) were recorded (see Fig. 1).
There were slightly more females (62.6%) in the Core arm compared to the Enhanced arm (52.4%) (Table 4). Mean age of patients (63.4 years) was similar across arms. The most common cancer diagnoses were breast and genitourinary cancer. At the time of registration into the ADAPT CP, most patients had a diagnosis of stage 2/3 (regional spread) or stage 4 (distant spread) cancer. A higher (non-significant) proportion of patients completed two or more screenings in the Core (53.9%) than Enhanced (45.8%) arm.
Seventy-four percent of patients were categorised as having minimal or mild anxiety/depression after their first screen, with the remainder evenly distributed between steps 3–4 (there were no step 5 s). Following triage conversations, most step allocations were maintained or downgraded to a lesser step by staff in both Core and Enhanced arms, resulting in 63 at step 3 (9.1%) and 26 at step 4 (3.7%).
Adherence (as described above) was measured by scoring completion of individual ADAPT CP components, e.g. screening, triage, referral and re-screening. As data could be analysed only for participants who completed at least one screen, adherence for the initial screening component was by definition 100%. Adherence was high for triage (Core = 88%, Enhanced = 95%) and referrals being made (Core = 59%, Enhanced = 64%), and rescreening (Core = 75%, Enhanced = 75%), but poorer for ensuring referrals were appropriate (Core = 41%, Enhanced = 58%) and very poor for checking uptake (Core = 8%, Enhanced = 24%) and outcome of referral (Core = 6%, Enhanced = 25%) (see Table 5 and Fig. 2).
Differences in adherence between arms
There was no significant difference between arms in adherence (64% versus 66% for Core versus Enhanced arms, p = 0.35), when using the binary outcome variable of adherent versus non-adherent, controlling for persons (due to repeated screens) and site (due to cluster randomisation) (see Fig. 3 and Table 6). We conducted sensitivity analyses and results did not change from the non-significant finding using the 70% adherence cut-off. There was a significant difference in adherence according to anxiety/depression step (p < 0.001), with adherence lower for step 2 (OR = 0.05, 95% C.I. 0.03–0.09), step 3 (OR = 0.05, 95% C.I. 0.03–0.09) and Step 4 (OR = 0.05, 95% C.I. 0.02–0.10) where a greater staff response was required. The interaction term (implementation arm x step allocation) was non-significant (p = 0.11).
We repeated the analysis with adherence as a continuous variable (see Fig. 4 and Table 7). While similar results were found for main effects, here the interaction term (implementation arm x step allocation) was significant (p = 0.02), with adherence significantly higher for step 3 in the Enhanced arm (p = 0.048).
Differences in individual adherence components between arms
There were significant differences between study arms for some adherence components, with higher adherence for the Enhanced arm when compared to the Core arm for triage (OR = 2.0, 95% C.I. 1.11–7.32), referral type (OR = 2.3, 95% C.I. 1.32–3.94), and check referral uptake (OR = 4.5, 95% C.I. 2.35–8.73). For all components, there was no significant interaction between implementation arm and step allocation (p > 0.05) in terms of adherence.
Across both study arms there were significantly more referrals made for step 3 and step 4 than step 2 (p < 0.01), and more appropriate referrals made for step 3 compared to step 2 (p < 0.001). Conducting a progress review after referral and rescreening were more likely to occur for step 3 and 4 than step 2 (p < 0.01).
Our primary objective was to determine if an Enhanced, ongoing ‘active’ implementation strategy throughout the first year of implementing a clinical pathway for anxiety and depression would lead to better staff adherence to the ADAPT CP than a Core, more ‘passive’ limited implementation strategy. We found no differences between the two implementation arms in adherence when we used either a binary outcome (≥ 70% of components adhered to, versus < 70%) or a continuous outcome. Our secondary objective was to examine the effect of step allocation (overall, and by implementation support arm) on total and component adherence scores. We found that step allocation was significantly associated with adherence; adherence was lower for higher (more severe) steps of anxiety/depression. When adherence was analysed as a continuous outcome only, there was also weak evidence for a difference (p = 0.048) between step allocation and implementation support arm. Adherence was significantly higher for step 3 (moderate) anxiety/depression in the Enhanced versus Core arm.
Our finding that implementation strategy as a main effect did not impact adherence is in contrast to the findings of Almatar et al. , who found that additional monthly feedback did improve adherence to a clinical pathway for community-acquired pneumonia over education alone. Notably, champions at Core arm sites did also receive (uncurated) monthly feedback, which may have reduced our ability to detect differences between the arms.
However, our cut-off for adherence, while based on similar studies, is somewhat arbitrary. When we used a continuous outcome, providing maximum power, and included the interaction term between implementation strategy and severity step, we found a marginally significant difference between arms for adherence to the ADAPT CP for patients with higher or more severe levels of anxiety and/or depression. Controlling for other potential confounders, staff in the Enhanced arm adhered to about 7.5 percentage points more components of the CP than those in the Core arm, for patients with step 3 anxiety/depression. While statistically non-significant due to considerable variability, there was a 10 percentage-point difference in adherence between arms for patients with step 4 anxiety/depression. Thus, the Enhanced implementation effort did appear to assist services to respond to patients with more severe anxiety/depression, who arguably need help more specialist care than those with minimal to mild anxiety/depression. However, this result must be interpreted with caution, given the marginally significant result.
These results provide some of the first empirical data on the extent of implementation effort required to ensure success in implementing health service change in the form of a novel CP. Our study suggests that even when great care has been taken to design and launch a new CP, adhering to principles described in implementation science frameworks, ongoing assistance during implementation facilitates greater staff adherence. While frameworks such as the Consolidated Framework for Implementing Research (CFIR)  do emphasise ongoing processes, particularly tracking progress and refining an intervention across time to simplify and enable execution, this longitudinal aspect of implementation has received relatively little attention in the implementation science literature to date [15, 16]. Cancer services in our Enhanced arm received ongoing progress reports; scheduled monthly meetings to discuss reports, identify and overcome barriers, identify training and support needs of local champions and deliver these, and highlight issues for attention and promotion to the wider team. In addition, ongoing awareness campaigns were run and regular newsletters with progress updates and tailored strategies to address identified service-specific barriers were sent to all staff. Further research is required to identify any additional strategies that could promote uptake of health service initiatives over time.
If longitudinal implementation effort is required to achieve health service change, adequate resourcing will be needed not only for initial effort, but for sustainment. Our own health economic data (paper under review) will inform appropriate planning. Unfortunately to date, it appears that health systems often fail to dedicate sufficient resourcing to integrate and sustain implementation efforts, particularly those focused on improving mental health . Both funding and sufficient staffing are required during implementation of novel CPs. In Australia, as elsewhere, there are significant psycho-oncology workforce shortages, with few hospital positions allocated to this role.
All patients included in this data set had completed screening at least once. Subsequent adherence was highest across both arms of the study for triage (85–100% across anxiety/depression steps). Staff followed up concerning patient scores on screening measures, by having a discussion with them to clarify their concerns and needs. Adherence to re-screening, whilst lower than for triage, was also relatively high (54–78%). Screening for distress using patient-reported outcome measures has been promoted for many years [36, 37], so it is unsurprising that staff found these aspects of the ADAPT CP the easiest to adhere to, while triage is a clinical strategy with which most staff are familiar.
However, adherence to interim ADAPT CP steps (tracking whether patients took up referrals, were happy with care received and improved or required re-referral, and obtaining a treatment discharge summary) was poor. These components, laid out in the ADAPT CP, are particularly important for patients with more severe morbidity who require referral. Yet we observed a highly significant difference for the main effect of anxiety/depression step on adherence, with lower adherence overall for those with greater anxiety/depression.
While we did not directly assess reasons for this lower adherence to interim CP components in the current trial, we can speculate regarding causes. Oncology staff are likely less familiar with these components, than with initial screening. There may also be a lack of referral pathways, given psychosocial workforce limitations, and staff may therefore be referring out to community services with whom they have less established communication channels. Furthermore, these steps can require more time and be frustrating if the specialist staff to whom patients have been referred respond slowly or not at all to requests for information and discharge summaries. Integrating psychological care related to cancer diagnosis that occurs outside of the cancer centre could be complex and require careful planning and system changes. Staff may need targeted support in integrating these CP components within existing workflow processes.
It is also possible that these steps occurred but were not well documented in either the ADAPT Portal or patient records. However, without documentation, steps to address non-uptake of referral or need for new referral may not consistently occur, impacting patient outcomes [5, 13]. An advocacy effort to promote these aspects of quality care is now needed, given the success of earlier advocacy efforts to entrench screening into routine care.
Our study had significant strengths. We employed a cluster randomised controlled trial design, that allowed us to clearly compare two implementation strategies. We recruited diverse oncology services across urban and regional areas, and public and private health care systems. We collected detailed data on staff adherence to each of the CP components and controlled for potential site and patient confounders. Reporting complied with CONSORT reporting standards  (see Additional file 1).
The study also had limitations. While our study compared a Core implementation strategy with an Enhanced one that provided implementation support across one year, it is not clear what intensity of implementation support is required to achieve improved adherence. Perhaps less ongoing support may have been sufficient, or more would have achieved an even better outcome. Future studies could compare more or less intense implementation efforts, compare length of supported needed and tease out which strategies were most helpful.
We were not able to obtain accurate data on the proportion of all eligible patients who were invited by staff to participate in the ADAPT CP. The implementation strategy delivered may have effected the level of staff commitment, time and energy devoted to encouraging patients to screen for anxiety and depression, and this should be explored in future trials.
An important consideration is how much statistical power we had to detect an effect if one was present. This information is best captured in the bounds of the confidence intervals for the effect sizes. Although there was no effect of implementation arm on adherence as a binary outcome (Table 6), the reasonable range of possible effect sizes that the implementation could have had is an odd’s ratio between 0.85 and 1.59. Thus it is possible that we failed to detect an effect (within the confidence interval bounds) that was present. However, as there are very few implementation studies in Psycho-Oncology on which to base effect size estimates, it is difficult to interpret this potential effect size with confidence. This demonstrates the need for future work in this area to provide more precise estimates of effect sizes.
Our focus was on services adherence to the ADAPT CP. Due to small numbers (n = 12), it was difficult to adjust for small differences between services across study arms, such as in funding type, and this may have resulted in some bias in the results.
The ADAPT Portal was not able to integrate with the electronic medical records (EMRs) used in participating hospitals, due to diversity of systems used across services. This likely reduced staff compliance in recording their actions within the Portal in line with instructions. Thus, adherence to the ADAPT CP may have been higher than we could detect. However, we did conduct exhaustive medical record reviews to supplement the portal data and ensure our adherence data was as accurate as possible. Nevertheless, future studies would benefit from integrating data collection methods within existing hospital EMR systems.
In summary, this study suggested that an Enhanced implementation strategy that supported staff over 1 year may support staff to be more adherent to a clinical pathway for anxiety/depression, at least for patients with more severe anxiety/depression. Wensing and colleagues  noted that with the increasing pace of scientific discovery, and the number of new programs and technologies being introduced into the health care system each year, successful and efficient integration of these interventions into routine care is increasingly required. Our data suggest that commitment of sufficient staff and resources to support staff during implementation efforts will increase our success in incorporating evidence into patient care and improving outcomes.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
The Anxiety and Depression Pathway Program. A Translational Program Grant: A Sustainable and supported clinical pathway for managing anxiety and depression in cancer patients
- ADAPT CP:
Clinical Pathway for the Screening, Assessment and Management of Anxiety and Depression in Adult Cancer Patients: Australian Guidelines
Promoting Action Research in Health Services framework
Consolidated Framework for Implementing Research
- ADAPT Portal:
Web-based system to operationalise the Clinical Pathway for the Screening, Assessment and Management of Anxiety and Depression in Adult Cancer Patients: Australian Guidelines
Cluster randomised controlled trial
New South Wales
Edmonton Symptom Assessment System
Hospital Anxiety and Depression Scale
Electronic medical records
Queensland Health. Clinical Pathways. 2013; Available from: https://clinicalexcellence.qld.gov.au/resources/clinical-pathways.
Coffey RJ, Richards JS, Remmert CS, Le Roy SS, Schoville RR, Baldwin PJ. An introduction to critical paths. Qual Manage Healthcare. 2005;14(1):46.
Pearson SD, Goulart-Fisher D, Lee TH. Critical pathways as a strategy for improving care: Problems and potential. Ann Intern Med. 1995;123(12):941.
Barbieri A, Vanhaecht K, Van Herck P, Sermeus W, Faggiano F, Marchisio S, et al. Effects of clinical pathways in the joint replacement: a meta-analysis. Med BMC. 2009;7(1):32.
Marrie TJ, Lau CY, Wheeler SL, Wong CJ, Vandervoort MK, Feagan BG. A controlled trial of a critical pathway for treatment of community-acquired pneumonia. JAMA. 2000;283:749–55.
Macario A, Horne M, Goodman S, Vitez T, Dexter F, Heinen R, et al. The effect of a perioperative clinical pathway for knee replacement surgery on hospital costs. Anesth Analg. 1998;86:978–84.
Vanhaecht K, Sermeus W, Tuerlinckx G, Witters I, Vandenneucker H, Bellemans J. Development of a clinical pathway for total knee arthroplasty and the effect on length of stay and in-hospital functional outcome. Acta Orthop Belg. 2005;71(4):439.
Pearson SD, Kleefield SF, Soukop JR, Cook EF, Lee TH. Critical pathways intervention to reduce length of hospital stay* 1. Am J Med. 2001;110(3):175–80.
Panella M, Marchisio S, Di Stanislao F. Reducing clinical variations with clinical pathways: do pathways work? Int J Qual Health Care. 2003;15(6):509–21.
El Baz N, Middel B, van Dijk JP, Oosterhof A, Boonstra PW, Reijneveld SA. Are the outcomes of clinical pathways evidence based? A critical appraisal of clinical pathway evaluation. J Eval Clin Pract. 2007;13:920–9.
Nathan ER, Hochman J, Becker R, Kopecky S, Cannon CP. Critical pathways: a review. Circulation. 2000;101:461–5.
Caminiti C, Scoditti U, Diodati F, Passalacqua R. How to promote, improve, and test adherence to scientific evidence in clinical practice. BMC Health Serv Res. 2005;5:62–72.
Van de Klundert J, Gorissen P, Zeemering S. Measuring clinical pathway adherence. J Biomed Inform. 2010;43:861–72.
Eccles MP, Mittman BS: Welcome to implementation science. Implement Sci. 2006;1(1). https://doi.org/10.1186/1748-5908-1-1.
Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence-based practice: a conceptual framework. Qual Health Care. 1998;7:149–58.
Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(50). https://doi.org/10.1186/1748-5908-4-50.
Butow P, et al. Clinical pathway for the screening, assessment and management of anxiety and depression in adult cancer patients: Australian guidelines. Psycho-Oncology. 2015;24(9):987–1001. https://doi.org/10.1002/pon.3920.
Rankin N, Butow P, Thein T, Robinson T, Shaw J, Price M, Clover K, Shaw T, Grimison P. Everybody wants it done but nobody wants to do it:’ an exploration of the barrier and enablers of critical components towards creating a clinical pathway for anxiety and depression in cancer. BMC Health Serv Res. 2015;15(28):28. https://doi.org/10.1186/s12913-015-0691-9.
Shaw JM, et al. Developing a clinical pathway for the identification and management of anxiety and depression in adult cancer patients: an online Delphi consensus process. Support Care Cancer. 2015;24(1):33–41.
Masya L, Shepherd HL, Butow P, Geerligs L, Allison KC, Dolan C, Prest G, ADAPT Program Group, Shaw J. Impact of individual, organizational, and technological factors on the implementation of an online portal to support a clinical pathway addressing psycho-oncology care: mixed methods study. JMIR Hum Factors. 2021;8(2):e26390. https://doi.org/10.2196/26390.
Shaw JM, Allison K, Cuddy J, Lindsay T, Grimison P, Shepherd HL, Butow PN, Shaw T, Baychek K, and the ADAPT Program Group. Identifying and responding to anxiety and depression in adult cancer patients: Development, Acceptability and Uptake of an on-line communication skills education program targeting challenging conversations for oncology health professionals. BMC Health Serv Res. 2022;22(1):132. https://doi.org/10.1186/s12913-022-07521-5.
Murphy M, Newby JM, Butow P, Loughnan SA, Joubert AE, Kirsten L, et al. Randomised controlled trial of internet delivered cognitive behavior therapy for clinical depression and/or anxiety in cancer survivors (iCanAdapt Early). Psycho-Oncology. 2020;29:76–85.
Butow P, Shaw J, Shepherd H, et al. Comparison of implementation strategies to influence adherence to the clinical pathway for screening, assessment and management of anxiety and depression in adult cancer patients (ADAPT CP): study protocol of a cluster randomised controlled trial. BMC Cancer. 2018;18(1):1077. https://doi.org/10.1186/s12885-018-4962-9.
Geerligs L, Shepherd HL, Butow P, Shaw J, Masya L, Cuddy J, et al. What factors influence organisational readiness for change? Implementation of the Australian clinical pathway for the screening, assessment and management of anxiety and depression in adult cancer patients (ADAPT CP). Support Care Cancer. 2021;29:3235–44.
Geerligs L, Shepherd HL, Rankin NM, Masya L, Shaw JM, Price MA, et al. The value of real-world testing: a qualitative feasibility study to explore staff and organisational barriers and strategies to support implementation of a clinical pathway for the management of anxiety and depression in adult cancer patients. Pilot Feasib Stud. 2020;6:109. https://doi.org/10.1186/s40814-020-00648-4.
Shepherd H, Geerligs L, Butow P, Masya L, Shaw J, Price M et al. The elusive search for success: defining and measuring implementation outcomes in a real-world hospital trial. Front Public Health 2019;7(293): https://doi.org/10.3389/fpubh.2019.00293.
Butow PN, Shepherd HL, Cuddy J, Harris M, He S, Masya L, Faris M, Rankin NM, Beale P, Girgis A, Kelly B, Grimison P, the ADAPT Program Group, Shaw J. Acceptability and appropriateness of a clinical pathway for managing anxiety and depression in cancer patients: a mixed methods study of staff perspectives. BMC Health Services. 2021;21:1243. https://doi.org/10.1186/s12913-021-07252-z.
Butow P, Shepherd HL, Cuddy J, Harris M, He S, Masya L, Rankin NM, Grimison P, Girgis A, The ADAPT Program Group, Shaw JM. From ideal to actual practice: Tailoring a clinical pathway to address anxiety or depression in patients with cancer and planning its implementation across individual clinical services. JPORP. 2021;3(4):e061. https://doi.org/10.1097/OR9.0000000000000061.
Pérez D, Lefèvre P, Castro M, Sánchez L, Toledo ME, Vanlerberghe V, Van der Stuyft P. Process-oriented fidelity research assists in evaluation, adjustment and scaling-up of community-based interventions. Health Policy Plan. 2011;26(5):413–22. https://doi.org/10.1093/heapol/czq077.
Ament SMC, De Groot JJA, Maessen JMC, et al. Sustainability of professionals’ adherence to clinical practice guidelines in medical care: a systematic review. BMJ Open. 2015;5:e008073. https://doi.org/10.1136/bmjopen-2015-008073.
Bruera EK, Kuehn N, Miller MJ, Selmser P, Macmillan K. The Edmonton Symptom Assessment System (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care. 1991;7(2):6–9.
O’Donnell E. The distress thermometer: a rapid and effective tool for the oncology social worker. Int J Health Care Qual Assur. 2013;26(4):353–9.
Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70.
Almatar M, Peterson GM, Thompson A, Mckenzie D, Anderson T, Zaidi ST. Clinical pathway and monthly feedback improve adherence to antibiotic guideline recommendations for community-acquired pneumonia. PloS One. 2016;11(7):e0159467.
Swerissen H, Duckett S, Wright J. Chronic failure in primary medical care: Grattan Institute; 2016. Centre for mental health. https://www.centreformentalhealth.org.uk/parity-esteem. Last modified 30/03/2021–12:02.
Bultz BD, Groff SL, Fitch M, Blais MC, Howes J, Levy K, Mayer C. Implementing screening for distress, the 6th vital sign: a Canadian strategy for changing practice. Psychooncology. 2011;20(5):463–9. https://doi.org/10.1002/pon.1932. PMID: 21456060.
Fradgley E, Bultz B, Kelly B, Loscalzo M, Grassi L, Sitaram B. Progress toward integrating Distress as the Sixth Vital Sign: a global snapshot of triumphs and tribulations in precision supportive care. J Psychosoc Oncol Res Pract. 2019;1(1):e2. https://doi.org/10.1097/OR9.0000000000000002.
Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. https://www.equator-network.org/reporting-guidelines/consort/
Wensing M, Grol R. Knowledge translation in health: how implementation science could contribute more. BMC Med. 2019;17(1):88. https://doi.org/10.1186/s12916-019-1322-9. PMID:31064388;PMCID:PMC6505277.
ADAPT Program group members (alphabetically): A/Prof. Philip Beale, Prof. Phyllis Butow, A/Prof. Josephine Clayton, Jessica Cuddy, Dr. Fiona Davies, A/Prof. Haryana Dhillon, Dr Mona Faris, Dr. Liesbeth Geerligs, Prof. Afaf Girgis, Dr. Peter Grimison, Prof. Thomas Hack, Marnie Harris, Sharon He, Prof. Brian Kelly, A/Prof. Patrick Kelly, Dr. Laura Kirsten, Dr. Toni Lindsay, A/Prof. Melanie Lovell, Dr. Tim Luckett, Lindy Masya, Dr. Michael Murphy, Dr. Jill Newby, Don Piro, Dr. Melanie Price, Dr. Nicole Rankin, A/Prof. Joanne Shaw, Prof. Tim Shaw, Dr. Heather Shepherd, Prof. Rosalie Viney, Dr. Jackie Yim.
This study was funded by a Cancer Institute NSW Translational Program Grant.
Ethics approval and consent to participate
Ethics approval was obtained for the study from the Sydney Local Health District Human Research Ethics Committee, Protocol X16-0378HREC/16/RPAH/522.
Consent for publication
The authors declare they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Butow, P., Faris, M.M., Shaw, J. et al. Effect of core versus enhanced implementation strategies on adherence to a clinical pathway for managing anxiety and depression in cancer patients in routine care: a cluster randomised controlled trial. Implementation Sci 18, 18 (2023). https://doi.org/10.1186/s13012-023-01269-0
- Implementation strategies
- Cluster randomised controlled trial
- Anxiety and depression management