Skip to content


  • Meeting abstract
  • Open Access

Implementation leadership: Confirmatory factor analysis and supervisor-clinician discrepancy in ratings on the Implementation Leadership Scale (ILS)

  • 1Email author,
  • 2,
  • 1 and
  • 1
Implementation Science201510 (Suppl 1) :A70

  • Published:


  • Confirmatory Factor Analysis
  • Leadership Development
  • Order Factor
  • Clinical Supervisor
  • Leadership Training


In healthcare and allied healthcare settings, leadership that supports effective implementation of evidenced-based practices is critical. There is only one empirically validated measure to assess implementation leadership, the Implementation Leadership Scale (ILS). This study moves beyond testing the ILS with clinicians to assess the factor structure with clinical supervisors. Leader self-ratings can provide important insight into how leaders perceive their own abilities and behaviors, and assessing the discrepancies between leader self-ratings and follower ratings can be particularly useful in developing leaders' self-awareness, informing leadership development, and improving organizational functioning.


Participants included 119 clinical supervisors and 441 clinicians. All participants completed the ILS with supervisors rating themselves and clinicians reporting on their own immediate supervisor. We conducted confirmatory factor analyses utilizing supervisor data, accounting for the nested data structure (i.e., supervisors nested within agency [k = 31]) and indicating a hypothesized second order factor structure. We then conducted t-tests to examine ILS scale score discrepancies between supervisor self-ratings and clinician ratings of their supervisors.


Multilevel confirmatory factor analyses showed good fit to the hypothesized second order factor structure (CFI = 0.96, TLI, 0.95, SRMR = 0.05). First order factor loadings ranged from 0.85-0.92 for Proactive Leadership, from 0.93-0.96 for Knowledgeable Leadership, 0.88-0.94 for Supportive Leadership, and 0.83-0.96 for Perseverant Leadership, and second order factor loadings ranged from 0.74-0.95. Discrepancy analyses demonstrated that supervisors rated themselves significantly higher than clinicians on the Proactive (p < 0.05) and Supportive (p < 0.01) ILS subscales.


The factor structure of the ILS is robust indicating its utility for both supervisor and clinician report. Discrepancies between supervisor and clinician ratings suggests that leadership training based on 360 degree assessments could be utilized to create development plans to improve the implementation and sustainment leadership knowledge, skills, and behaviors of supervisors with responsibilities for supporting evidence-based practices in the workplace.

Authors’ Affiliations

University of California, San Diego, La Jolla, CA 92093, USA
San Diego State University, San Diego, CA, USA


© Aarons et al. 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.