Volume 10 Supplement 1

7th Annual Conference on the Science of Dissemination and Implementation in Health

Open Access

Assessing the extent and quality of documentation of fidelity to the implementation strategy: a proposed scoring mechanism

  • Jennifer N Hill1, 2Email author,
  • Erna Snelgrove-Clarke3 and
  • Susan E Slaughter4
Implementation Science201510(Suppl 1):A17

https://doi.org/10.1186/1748-5908-10-S1-A17

Published: 14 August 2015

Background

Implementation fidelity is critical to the internal and external validity of a study. Without it, accurate conclusions about an intervention cannot be drawn as unknown factors may have influenced the outcome(s). This scoping review assesses the extent and quality of documentation of fidelity in implementation studies.

Methods

Articles in the Cochrane Database of Systematic Reviews, Effective Practice and Organization of Care (EPOC) that included at least one of the 47 Cochrane Review implementation strategies were retrieved yielding 1158 articles in 337 journals. We selected publications from the 3 journals with the largest number of articles: British Medical Journal (BMJ), Journal of the American Medical Association (JAMA), and Medical Care. We developed an "Implementation Strategy Fidelity Score" based on definitions adapted from Dusenbury (2003) [1]. Adherence (documenting implementation strategies and extent to which they took place), dose (proportion of people receiving each strategy) and participant responsiveness (extent to which individuals were involved in the development or evaluation of strategies or their receptivity to them) were scored on a 3-point scale: 0=no detail, 1=some detail, and 2=great detail.

Results

The number of articles included for each journal and mean scores (standard deviations) across categories were: BMJ: n = 28; adherence = 0.86 (SD = 0.87); dose = 0.57 (SD = 0.86); participant responsiveness = 0.79 (SD = 0.90). JAMA: n = 26: adherence = 0.88 (SD = 0.95); dose = 0.76 (SD = 0.81); participant responsiveness = 0.92 (SD = 0.93). Medical Care: n = 19; adherence = 1.11 (SD = 0.97); dose = 0.95 (SD = 1.0); participant responsiveness = 1.21 (SD = 0.89). Although mean scores for the Medical Care journal were higher in each category, documentation of fidelity to the implementation strategy overall can be improved by adopting standard definitions, and better practices for measurement, documentation and reporting.

Conclusion

This scoring mechanism provides insight into the documentation of fidelity. It also provides a structure for defining and documenting fidelity to the implementation strategy and a benchmark from which to measure the quality of documentation.

Authors’ Affiliations

(1)
Department of Veterans Affairs, Spinal Cord Injury Quality Enhancement Research Initiative
(2)
Department of Veterans Affairs, Center of Innovation for Complex Chronic Health Care
(3)
School of Nursing & Department Obstetrics/Gynecology, Dalhousie University
(4)
Faculty of Nursing, University of Alberta

References

  1. Dusenbury L, Brannigan R, Falco M, Hansen WB: A review of research on fidelity of implementation: implications for drug abuse prevention school settings. Health Educ Res. 2003, 18 (2): 237-256. 10.1093/her/18.2.237.View ArticlePubMedGoogle Scholar

Copyright

© Hill et al. 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement