Skip to main content

A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis

Abstract

Background

Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems, yet gaps in management still exist. In response, we developed a multi-component osteoporosis knowledge translation (Op-KT) tool involving a patient-initiated risk assessment questionnaire (RAQ), which generates individualized best practice recommendations for physicians and customized education for patients at the point of care. The objective of this study was to evaluate the effectiveness of the Op-KT tool for appropriate disease management by physicians.

Methods

The Op-KT tool was evaluated using an interrupted time series design. This involved multiple assessments of the outcomes 12 months before (baseline) and 12 months after tool implementation (52 data points in total). Inclusion criteria were family physicians and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). Primary outcomes were the initiation of appropriate osteoporosis screening and treatment. Analyses included segmented linear regression modeling and analysis of variance.

Results

The Op-KT tool was implemented in three family practices in Ontario, Canada representing 5 family physicians with 2840 age eligible patients (mean age 67 years; 76% women). Time series regression models showed an overall increase from baseline in the initiation of screening (3.4%; P < 0.001), any osteoporosis medications (0.5%; P = 0.006), and calcium or vitamin D (1.2%; P = 0.001). Improvements were also observed at site level for all the three sites considered, but these results varied across the sites. Of 351 patients who completed the RAQ unprompted (mean age 64 years, 77% women), the mean time for completing the RAQ was 3.43 minutes, and 56% had any disease management addressed by their physician. Study limitations included the inherent susceptibility of our design compared with a randomized trial.

Conclusions

The multicomponent Op-KT tool significantly increased osteoporosis investigations in three family practices, and highlights its potential to facilitate patient self-management. Next steps include wider implementation and evaluation of the tool in primary care.

Peer Review reports

Background

Over 200 million people worldwide have osteoporosis, representing a considerable health care and financial burden [1]-[6]. The aging of the population will likely further compound the disease burden [2],[3],[7]. Fragility fractures are the clinical consequence of osteoporosis, with vertebral and hip fractures having the most devastating prognosis [8] and being associated with an increased risk of death [9]. Such fractures can significantly impair quality of life, physical function, and social interaction and can lead to admission to long-term care [10]-[12]. Clinical practice guidelines are available for osteoporosis management [13]-[15], but their implementation in clinical practice has been inconsistent, such that many patients are still not receiving appropriate diagnostic testing or treatment [16]-[20]. Less than 40% of patients receive appropriate therapy [17]; and the proportion of patients with fragility fractures who receive a diagnostic test or a diagnosis from a physician is not optimal (range 1.7% - 50%) [18]-[20]. Knowledge translation (KT) tools such as clinical decision support systems may be one solution to closing these practice gaps because they can provide evidence at the point of care to facilitate disease management. Clinical decision support systems generate patient-specific assessments or recommendations for clinicians by means of software algorithms that match information from a knowledge database to relevant clinical data and provide evidence-based suggestions for assessment and treatment [21]-[23].

In response to existing management gaps, we developed an osteoporosis KT (Op-KT) tool using two theoretical frameworks: the knowledge-to-action framework of Graham et al [24] and the Medical Research Council (MRC) framework for complex interventions [25]. The knowledge-to-action framework consists of knowledge creation (which allows knowledge to be filtered down from inquiry and synthesis into tools that can aid in decision making) and a series of iterative and dynamic action steps to apply this knowledge [24]. Importantly, the framework highlights the need to involve relevant end-users of the knowledge that is being implemented [24]. The MRC framework was also considered because it complements the iterative, phased approach of the knowledge-to-action framework, and it has the potential to strengthen the development and implementation of KT interventions by addressing challenges to achieving optimal study design, execution, and generalizability [25]. Our knowledge creation process involved conducting a systematic review of randomized controlled trials to determine what features of osteoporosis tools support clinical decision making [26]. We found that few osteoporosis tools exist, but interventions consisting of reminders and education targeted to both physicians and patients had potential for increasing osteoporosis investigations and treatment [26]. We combined these findings with available national osteoporosis guidelines and input from clinicians and experts in information technology and human-factors engineering to design a conceptual Op-KT tool. We then assessed the barriers and facilitators to using this knowledge in a qualitative study of focus groups with family physician [27], which enabled the development of a prototype. Finally, we tested the prototype in a mixed-methods usability study to ensure that it met the needs of target end-users including patients at risk for osteoporosis and physicians who provide care for them [28]. A description of the Op-KT tool is in the Methods below.

The objectives of the current study were to test the implementability of the multicomponent Op-KT tool and to determine its effectiveness on appropriate management of osteoporosis by family physicians (i.e., initiation of investigations such as bone mineral density testing (BMD) and treatment with medications such as bisphosphonates and nutritional supplements such as calcium and vitamin D).

Methods

The tool was implemented between May and November 2009 (phase one) and evaluated between July 2009 and November 2010 (phase two). Details of the protocol have been published previously [29]. The study was approved by the University of Toronto Health Sciences Research Ethics Board.

Phase one: implementation of the Op-KT tool

Our previous work revealed that, for complex interventions intended for delivery at the point of care, workflow must be investigated before implementation [27],[28]. As such, we developed an a priori plan involving workflow analysis to determine the feasibility of physicians and patients using the tool at the point of care and to identify factors that would minimize any disruption to usual care caused by the tool. Our goal was to tailor the tool to the practice and workflow of each setting and thereby to facilitate its adoption and uptake during phase two. Implementation involved observation of clinic staff during the patient registration process and estimations of the time patients spent waiting for their physician visit and the length of visits; an environmental scan to ensure appropriate installation of equipment; development of a customized procedures manual with input from clinic personnel; and provision of training to physicians, nurses, and other clinic staff directly involved in use of the tool. We staggered the schedule for implementing the Op-KT tool for each of the three sites (approximately two months apart) to accommodate for the time needed to complete the implementation plan described above (see Figure 1 for study design and flow). The tool was designed to be pragmatic (i.e., there was no deliberate procedure to prompt patients to initiate the RAQ) because workflow analyses indicated a need for seamless integration of the tool. As a result, there were some differences between sites in how the RAQ was initiated and the outputs delivered at the point of care. For example, the two solo practice sites had touchscreen devices in the waiting areas (as well as the examination rooms) to maximize opportunities for patients to use the tool.

Figure 1
figure 1

Study design and flow.

Description of the Op-KT tool

The functional Op-KT tool (accessible at http://knowledgetranslation.ca/osteo_final/) has 3 components:

  1. 1.

    A short (13-item) RAQ that is completed on a touch-screen device by at-risk patients in the waiting room or the examination room before their family physician visit. The RAQ was designed to assess major and minor osteoporosis risks as outlined in the Osteoporosis Clinical Practice Guidelines [30]. Screenshots of the RAQ can be viewed in Additional file 1.

  2. 2.

    A paper-based best practice recommendation prompt (BestPROMPT), generated according to patients’ RAQ responses and outlining appropriate, individualized, guideline-based [30] osteoporosis management recommendations for family physicians at the point of care. An example of this is shown in Additional file 2.

  3. 3.

    A paper-based customized osteoporosis educational sheet (COPE) given to patients at the end of the visit, outlining their individual identified risks and suggestions for managing those risks. An example of this is shown in Additional file 3.

Setting and population

Three family practices were purposively selected from the Hamilton Family Health Team, which is the largest of the 150 approved primary care Family Health Teams in Ontario, Canada, serving approximately 280 000 people [31]. It includes a comprehensive team of family physicians, nurses, registered dieticians, mental health counsellors, psychiatrists, and pharmacists. We selected 3 family practices in total, as this was sufficient to evaluate the Op-KT tool under different practice settings (one group and two solo) for a pilot study. Those who agreed to participate and met the eligibility criteria were included. Participants were family physicians in solo or group practice using the PracticeSolutions electronic medical record (EMR) system (TELUS Health, Canada) and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). A written consent was obtained from all participating physicians.

Phase two: evaluation of the Op-KT tool

Study design and sampling

We used the quasi-experimental design with interrupted time series (ITS) analysis to estimate the effect of the Op-KT tool on appropriate disease management outcomes. The study design and its execution were guided by the ITS quality criteria as outlined by Ramsey et al.[32] and the Cochrane Effective Practice and Organisation of Care group [33]. In ITS studies, sample size calculations are related to the estimation of the number of observations or time points at which data will be collected. The literature is variable on the number of data points to consider in different situations, but it is generally recommended that at least 20 pre-intervention and 20 post-intervention observations be used to ensure sufficient power to detect a change and to account for threats to validity, such as trends, seasonal or cyclical observations over time, or random fluctuations with no discernible patterns [32],[33]. We used a relatively large number of data points: 26 data points over the 12 months before starting the intervention (baseline period) and 26 data points over the 12 months after implementation (intervention period), for a total of 52 data points for each site (see Figure 1). To increase validity, data points were set closer together (i.e., each data point represented a two-week period rather than four weeks) [34].

Outcomes

The primary outcomes were initiation of appropriate osteoporosis investigations (i.e., BMD testing) and treatment (e.g., any bisphosphonate or nutritional supplements such as calcium and vitamin D) by family physicians. `Appropriate’ osteoporosis management was defined according to clinical practice guidelines available at the start of phase two [30]. Screening and treatment recommendations were used to develop a disease management algorithm [29], which was programmed into the RAQ. Secondary outcomes were the number of patients who completed the RAQ (measured by patient-initiated RAQ logs generated by the touch-screen tablets), the mean time for completion of the RAQ (minutes), and occurrence of fractures. We also assessed osteoporosis risk factors by sex. Using queries in the EMR system and an automated computer program within the touch-screen devices, we also documented any actions related to the primary outcome taken by family physicians of patients who completed the RAQ and collected site-specific demographic data (number of patients in practice, number of age-eligible patients and their mean age, and patients who had at least one visit during the intervention period).

Unit of analysis and data collection

Our unit of analysis for our primary outcomes was based on the multiple baseline assessment of individual family practice sites. These outcomes were first summarized as rates at each time point, using proportion of osteoporosis investigation and prescriptions, where the denominator represented the number of all eligible visits. We established a stable baseline of standard practice for each site using a pre-intervention chart review. The specific procedure for data collection was published in the protocol [29]. Briefly, two investigators (MK, CM) used patient charts and touch-screen tablet logs to collect visit-specific data bimonthly. Every time a patient completed the RAQ, summaries from physician and patient outputs (BestPROMPT and COPE sheets, respectively) were saved in a folder on the encrypted device hard drive. These summaries captured the date and time the RAQ was initiated and completed and the timed logs of all RAQ responses. We confirmed RAQ use and documented any outcome-related actions taken by physicians using chart review. Our unit of analysis for our secondary outcomes was at the level of patients.

Statistical analysis

We provided site level as well as overall summary measures, where data was combined across the three sites. For normally distributed continuous data, we reported means and standard deviations and performed t-tests and analysis of variance (ANOVA) to compare differences in means between groups. For non-normally distributed continuous data, we reported medians and interquartile ranges and used nonparametric tests for group comparisons. For categorical data, we reported frequencies and percentages and used Fisher exact tests and chi-square tests for comparing differences between groups.

We used segmented linear regression modeling to examine the effect of the intervention on the primary outcomes [35]. This was done at the site level and overall, where rates of osteoporosis investigations and prescriptions were compared before and after the intervention was introduced; and combined for the overall estimate by averaging across all sites. Three primary outcomes considered were: rates of BMD testing, prescription any osteoporosis medications, and any nutritional supplements. For each outcome, the initial segmented regression model used can be described as:

Y= β 0 + β 1 * time+ β 2 * Intervention+ β 3 * time*Intervention+ε,

Where, Intervention is a dichotomous variable indicating pre- and post-intervention time periods. The coefficients β0 and β1 represent the constant term (intercept) and trend over time (slope) during the baseline (pre-intervention) period, respectively; whereas, β2 and β3 represent changes in the level and trend of outcomes after the intervention (compared to baseline level and trend).

We used the Durbin-Watson's test [36] to examine presence of serial correlation in the residuals after fitting the segmented regression model. When statistically significant autocorrelation is detected, autoregressive integrated moving average (ARIMA) models was used as required (by including a lag term in the regression models model, eg. Yt - Yt-1, for first order autocorrelation) using the Cochrane-Orcutt methodology [37]. All statistical analyses were conducted using SAS version 9.3, and statistical significance was set at P < 0.05.

Results

Five family physicians among two solo practices (site one and site two) and one group practice (site three) participated in the study. Table 1 shows the patient population and the number of site visits in the study. Across the three sites, a total of 9,138 and 9,171 patients visited their physician during the pre- and post-intervention periods, respectively. Of these, 2390 patients (81% women) were deemed age eligible (i.e., women ≥50; men ≥65 years of age) during the pre-intervention period; 2,840 patients (76% women) were age-eligible during the post-intervention period (Table 1).

Table 1 Characteristics of the study population across the 3 family health team study sites during the baseline and intervention periods

Primary outcomes-results of the ITS analysis

Time series regression models showed an increase in the initiation of BMD testing from baseline of 2.79% during pre-intervention time to 6.15% in post-intervention period (difference of 3.4%, 95% confidence interval [CI 2.03-4.68; p = <0.001), indicating an increase of 34 BMD tests for every 1,000 eligible visits across the three sites. Initiation of any osteoporosis medication increased by 5 in 1,000 eligible visits (difference of 0.5%, CI 0.15-0.85; p = 0.006), and initiation of any nutritional supplement (calcium or vitamin D) by 12 in 1000 eligible visits (difference of 1.2%; CI 0.49-1.91; p = 0.001) (Table 2). Plots of average rates (averaged over the three sites) for the three outcomes are shown in Figures 2, 3 and 4, respectively.

Table 2 Results of the interrupted time series analysis for initiation of osteoporosis investigations and treatments, combined across the three sites*
Figure 2
figure 2

Percentage of patients for whom a bone mineral density test was ordered: represented for each site as well as for sites overall (July 2009 to November 2010). The 52 data points represent 26 two-week segments before and 26 two-week segments after introduction of the intervention (vertical rule).

Figure 3
figure 3

Percentage of patients for whom any osteoporosis medication was prescribed (bisphosphonates [alendronate, etidronate, risedronate, or zoledronic acid], selective estrogen receptor modulators [ e.g. , raloxifene], nasal calcitonin, parathyroid hormone, or hormone replacement therapy): represented for each site as well as for sites overall (July 2009 to November 2010). The 52 data points represent 26 two-week segments before and 26 two-week segments after the introduction of the intervention (vertical rule).

Figure 4
figure 4

Percentage of patients for whom any nutritional supplement ( i.e. , calcium or vitamin D) was prescribed: represented for each site as well as for sites overall (July 2009 to November 2010). The 52 data points represent 26 two-week segments before and 26 two-week segments after the introduction of the intervention (vertical rule).

A statistically significant autocorrelation of order 7 (correlation value of 0.51, 0.22, 0.34 for BMD testing, any osteoporosis medication and nutritional supplement with p-values of <0.001, 0.035, 0.004; respectively) was observed in the residuals; results adjusted for autocorrelation. Further investigation of the residuals (after fitting the adjusted model) showed randomly distributed residuals indicating no residual serial correlation left between the measurements across time.

Site-level analysis

Site level interrupted time series analysis indicated that the intervention led to improvements in outcomes across all sites, but not all increases were significant. For example, a statistically significant improvement was observed for BMD testing (compared to pre-intervention) in Site 1 (4.29%, CI 1.72-6.86; p = 0.001) and Site 3 (3.07%, CI 1.55-4.59; p <0.001) but not in Site 2 (3.40%, CI -0.43-7.23; p = 0.082). Increases in osteoporosis medication prescriptions in the post- *0intervention period was also significant in Site 3 (0.78%, CI 0.18-1.38; p = 0.011) but not in Site 1 (0.18%, CI -0.35-0.71; p = 0.5023) or Site 2 (0.29%, CI -0.28-0.86, p = 0.3324). Similarly, the prescription of nutritional supplements increased across all sites during the post-intervention period, but this increase was only significant in site three (1.85%, CI 0.86-2.84; p <0.001). All site level analyses were adjusted for autocorrelation, when significant autocorrelations were detected.

The breakdown of the number of eligible visits as well as the number (and rate) of osteoporosis investigations and prescriptions by site and combined sites are provided in Table 3. The results indicate that the median numbers of visits during the pre- and post-intervention times were similar for all three sites. Overall, the median and rate of BMD testing, initiation of osteoporosis medications and supplements were improved during the post-intervention period compared to the pre-intervention period, and these findings are consistent across all (Table 3). For example, the overall rate BMD testing increased during post-intervention compared to the baseline period by 2.9%, suggesting that the intervention led to about 29 more BMD tests for every 1000 eligible visits. The largest increase was observed in Site 3 (i.e., the group practice) where an increase of 31 BMD tests for every 1,000 eligible visits were observed. Relatively smaller improvements (but consistent across all the three sites) were observed for the initiation of osteoporosis medications and nutritional supplements (Table 3).

Table 3 Number of eligible visits, and number of visits leading to a primary outcome (BMD testing, initiation of osteoporosis medications and nutritional supplements) across the three sites*

Secondary outcomes-patient-level analysis

The RAQ was completed by 351 patients (mean age 64 years; range, 50-90 years; 77% women), who represented 16% of age-eligible patients with at least one physician visit during the intervention period (Table 4). The mean time to complete the RAQ was 3.43 minutes (range, 1.32-8.01 minutes). Of those who completed the RAQ, 276 patients (79%) had at least one major risk factor for osteoporosis (e.g., vertebral compression fracture, family history of maternal hip fracture) or two minor risk factors (e.g., rheumatoid arthritis, smoker, weight <57 kg); in addition, 204 patients (58%) had a previous BMD test (evenly distributed between those who had the test more than two years ago and less than two years ago), and 147 patients (42%) had never had a BMD test. More men than women indicated never having a BMD test (71% vs 33%, p <0.001). Thirty-two patients (9%) reported already taking an osteoporosis medication such as a bisphosphonate (6%), hormone replacement therapy (5%), or selective estrogen reuptake modulator (0.3%); and 233 patients (66%) reported already taking calcium (8%), vitamin D (15%), or both (43%). There was a significant difference between men and women for mean age and osteoporosis risk (p <0.001 for both), but this was expected as the age-eligibility criterion for men (i.e., age ≥ 65 years) was also considered a major risk factor for osteoporosis. A total of 195 patients (56%) had any disease management addressed by their physician in response to the tool at the point of care (N = 86) or within three months of the RAQ visit (N = 109). We did not analyze fractures because the incidence across sites was too low to calculate a clinically meaningful difference between the baseline and intervention periods (i.e., six versus three fractures, respectively).

Table 4 Characteristics of patients who completed the risk assessment questionnaire (n = 351)*

Discussion

This study showed that a multicomponent Op-KT tool incorporating all disease management components (assessment, diagnosis and treatment) is feasible for use at the point of care. Use of the tool increased the initiation of BMD testing and treatment with medications such as bisphosphonates and vitamin D for patients at risk for osteoporosis. Our findings are consistent with other studies investigating osteoporosis disease management [38]-[40]. However, they also highlight continuing gaps: specifically, 42% of at-risk patients who completed the RAQ reported never having had a BMD test, and the rate of osteoporosis investigations was significantly lower among men than women (consistent with other reports [18],[41]). Persistence of these gaps may be explained, in part, by how interventions are designed to overcome them. Few osteoporosis interventions include all components of disease management. Our previous systematic review found interventions with different combinations of disease management recommendations in the form of reminders and education (electronic, paper-based, or counseling-based), but none addressed all three aspects of disease management [26]. More recently, tools that do address disease management completely have been developed for high-risk [38] and postfracture [41] patients, but they don't address how these tools might be implemented over the long term or how they might be sustainable. Furthermore, few of the existing tools use a computer-based platform for decision support [42], most are not designed to deliver evidence-based messages at the point of care, and none consider mechanisms to avoid disruption to usual practice (which can facilitate sustainability). Most tools involve coordinator-based systems (where dedicated case managers such as nurses, orthopedic surgeons, or other allied healthcare professionals are involved in facilitating care [38],[39],[43],[44]), use telephone-based reminders [40],[45], or provide reminders or education to physicians and patients through a paper-based [46],[47] or counseling-based [48] strategy. These interventions can be resource intensive and therefore may not be sustainable.

Our study met the clinical goal of the osteoporosis tool, which was to increase osteoporosis investigations and treatment. Although the improvements in disease management were modest, they represent significant change in the right direction. Furthermore, the impact was relevant because the Op-KT tool was not tested under controlled conditions. It was designed and implemented as a pragmatic tool, so for example, the observed 3.2% increase in BMD testing represents a true measure of how the tool functioned in `real’ practice. We considered pragmatism in the tool design because our foundational work indicated that such tools might unintentionally disrupt the real reason for the visit under more controlled conditions (i.e., if a prompting mechanism was enforced for every at-risk patient) [28]. Healthcare professionals prefer the provision of guidance that does not interfere with usual care [49], as confirmed by our investigation of practice workflows across the three sites, so we deliberately designed the tool to not prompt patients to complete the risk questionnaire. This also meant that the tool was not initiated during every relevant `at-risk’ encounter, which resulted in a relatively low rate of use (16% across the three sites). However, physicians addressed the disease management of more than half of these patients, which indicates that the tool has great potential to enhance care. The challenge in designing KT tools such as this one is to find the right balance between transmitting appropriate practice knowledge at the right time and ensuring that more urgent aspects of the visit agenda (e.g., chest pain) or health status (e.g., diabetes complication) are not disrupted, particularly in practice settings where visits are short and involve multiple complaints requiring complex clinical decisions.

Our positive findings also highlight several unique features that can be considered when designing clinical decision support systems such as the Op-KT tool. First, the information that our tool delivered to physicians and patients was customized according to the risk profile of each individual patient. The tool functions by extracting and analyzing risk inputs according to a guideline-based disease management algorithm; and then deliver relevant, evidence-based prompts to aid physicians in their clinical decision making (BestPROMPT), and provide a risk profile for patients with self-management options tailored to their own risks (COPE). Very few existing tools have all of these features. FRAX, a widely known risk assessment tool, is designed to estimate individualized 10-year probability of hip and major osteoporotic fractures [50], and has been calibrated for populations in Canada [51] and the United States [52]. It estimates the 10-year fracture risk by integrating age, gender, and seven clinical risk factors independent of BMD [50], but it was not designed to consider the treatment recommendations that would be relevant to the risks identified, nor can it suggest tailored messages for patients to facilitate self-management. Additionally, evidence from many studies has shown that guidelines on their own are not sufficient to change practice [53] and decision support tools, such as the one we created, provide potential solutions to this challenge.

Second, our finding that patient involvement in disease management is feasible at the point of care highlights the untapped opportunities to improve care in primary care settings. A recent systematic review of quality improvement strategies for diabetes mellitus found that interventions targeting the disease management system along with patient-mediated strategies improved care [54]. Another recent analysis showed that clinical decision support systems that provide advice for patients in addition to practitioners are more likely to succeed [55]. Lack of time is a major barrier to implementing clinical decision support tools in family practices [56],[57], so it's prudent to shift some of the disease management tasks to patients. In our study, we showed that this is possible, as patients were able to complete the RAQ in the waiting room or in the examination room prior to their visit. Involving patients in the continuum of care can facilitate self-management, making it easier for patients to receive important information and to gain the skills and confidence (self-efficacy) to deal with their illness [58]. Moreover, patient self-management may facilitate the sustainability of an intervention by alleviating resource burdens that might be needed to maintain continuing use of the tool. Indeed, elderly patients are the fastest-growing population group [59], a demographic shift that is expected to increase the prevalence of chronic diseases [60] and the need for patient self-care to support disease management [60],[61].

This study also made several contributions to the development of complex interventions for chronic disease where the goal is to effectively translate best evidence at the point of care. The tool underwent substantial usability testing before implementation [28]. Moreover, workflow analysis preceded its roll-out in the family practice units to optimize use of the tool. These efforts were perceived to have been successful, because the patients who initiated the RAQ were able to complete it rapidly (mean 3.43 minutes). Lastly, the Op-KT tool was developed from a robust evidentiary base informed by two theoretical frameworks (the knowledge-to-action and MRC frameworks). These not only helped in mapping the process for translating osteoporosis evidence into practice, they also facilitated the selection of appropriate study designs to answer our questions, to anticipate barriers, to evaluate outcomes, and to address implementation and sustainability barriers [62].

Our study had some limitations. This was a pilot study, so our sample sizes were smaller than would be expected if we had conducted a more rigorous randomized controlled trial (RCT). As a result, findings may not be generalizable to other family practice settings or populations. However, in ITS studies, sample size calculations are related to the estimation of the number of observations or time points at which data are collected rather than the number of sites, physicians, and patients. As such, we included a higher number of data points (i.e., 26 data points before and 26 data points after the introduction of the intervention) than recommended (20 data points before/after) to ensure enough power to detect a change and to account for threats to internal validity [32],[33]. Furthermore, data points were set closer together (i.e., each data point represented a two-week period rather than four weeks) to increase validity [34]. We recognize that the ITS methodology is inherently more susceptible to validity threats than would be a more rigorous RCT design. However, for a pilot evaluation, this methodology was most appropriate, and we designed our study according to rigorous ITS criteria [32],[33] to help rule out alternative explanations of our findings. Third, the guideline used in the study was an earlier version [30], so the recommendations are not consistent with current guidelines. However, the tool is currently being updated to reflect these changes. Although we planned to integrate our tool within the PracticeSolutions system, this was not possible because of programming and EMR proprietary barriers. Such integration can facilitate more efficient delivery of patient-specific decision support at the point of care [38],[57],[63], and a more automated transfer of data while preserving the accuracy of patient-reported risks. However, we showed that a stand-alone, partially electronic system could benefit clinical practice. In addition, the majority of current practices are paper-based, so our tool is more generalizable to these settings now, but has great potential to be transformed into a fully electronic tool as physician practices become increasingly paperless.

Conclusions

Our multicomponent Op-KT tool significantly increased osteoporosis disease management in three family practices. This study highlights the potential of using decision support tools at the point of care in busy, short-visit practices to facilitate patient self-management.

Additional files

References

  1. Gullberg B, Johnell O, Kanis JA: World-wide projections for hip fracture. Osteoporosis Int. 1997, 7: 407-413. 10.1007/PL00004148.

    Article  CAS  Google Scholar 

  2. International Osteoporosis Foundation: Available at: . Accessed in March 2013., [http://www.iofbonehealth.org/facts-statistics]

  3. Goeree R, Blackhouse G, Adachi J: Cost-effectiveness of alternative treatments for women with osteoporosis in Canada. Curr Med Res Opin. 2006, 22 (7): 1425-1436. 10.1185/030079906X115568.

    Article  PubMed  Google Scholar 

  4. Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A: Incidence and economic burden of osteoporosis-related fractures in the United States, 2005-2025. J Bone Min Res. 2007, 22 (3): 465-475. 10.1359/jbmr.061113.

    Article  Google Scholar 

  5. Osteoporosis Canada. Available at: . Accessed March 2013., [http://www.osteoporosis.ca/osteoporosis-and-you/osteoporosis-facts-and-statistics/]

  6. Pike C, Brnbaum HG, Schiller M, Sharma H, Burge R, Edgell ET: Direct and indirect costs of Non-vertebral fracture patients with osteoporosis in the US. Pharmacoeconomics. 2010, 28 (5): 395-409. 10.2165/11531040-000000000-00000.

    Article  PubMed  Google Scholar 

  7. National Institutes of Health: Health information: osteoporosis (National Institute of Arthritis and Musculoskeletal and Skin Diseases). Available at: . Accessed in March, 2013., [http://health.nih.gov/topic/Osteoporosis]

  8. Reginster J, Burlet N: Osteoporosis: a still increasing prevalence. Bone. 2006, 38: S4-S9. 10.1016/j.bone.2005.11.024.

    Article  PubMed  Google Scholar 

  9. Ioannidis G, Papaioannou A, Hopman WM, Akhtar-Danesh N, Anastassiades T, Pickard L, Kennedy CC, Prior JC, Olszynski WP, Davison KS, Goltzman D, Thabane L, Gafni A, Papadimitropoulos EA, Brown JP, Josse RG, Hanley DA, Adachi JD: Relation between fractures and mortality: results from the Canadian multicentre osteoporosis study. CMAJ. 2009, 181 (5): 265-271. 10.1503/cmaj.081720.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Lips P, van Schoor NM: Quality of life in patients with osteoporosis. Osteoporosis Int. 2005, 16: 447-455. 10.1007/s00198-004-1762-7.

    Article  Google Scholar 

  11. Cummings SR, Melton LJ: Epidemiology and outcomes of osteoporotic fractures. Lancet. 2002, 359: 1761-1767. 10.1016/S0140-6736(02)08657-9.

    Article  PubMed  Google Scholar 

  12. Adachi JD, Ioannidis G, Pickard L, Berger C, Prior JC, Joseph L, Hanley DA, Olszynski WP, Murray TM, Anastassiades T, Hopman W, Brown JP, Kirkland S, Joyce C, Papaioannou A, Poliquin S, Tenenhouse A, Papadimitropoulos EA: The association between osteoporotic fractures and health-related quality of life as measured by the Health Utilities Index in the Canadian Multicentre Osteoporosis Study (CaMos). Osteoporosis Int. 2003, 14: 895-904. 10.1007/s00198-003-1483-3.

    Article  CAS  Google Scholar 

  13. Papaioannou A, Morin S, Cheung A, Atkinson S, Brown JP, Feldman S, Hanley DA, Hodsman A, Jamal SA, Kaiser SM, Kvern B, Siminoski K, Leslie WD: 2010 clinical practice guidelines for the diagnosis and management of osteoporosis in Canada: summary. CMAJ. 2010, 182 (17): 1864-1873. 10.1503/cmaj.100771.

    Article  PubMed  PubMed Central  Google Scholar 

  14. National Osteoporosis Guideline Group: Guideline for the diagnosis and management of osteoporosis in postmenopausal women and men from the age of 50 years in the UK (2010). Available at: . Accessed in March, 2013., [http://www.shef.ac.uk/NOGG/NOGG_Pocket_Guide_for_Healthcare_Professionals.pdf]

  15. Osteoporosis. Obstet Gynecol. 2012, 120 (3): 718-734. 10.1097/AOG.0b013e3182680478.

  16. Bessette L, Ste-Marie LG, Jean S, Davison KS, Beaulieu M, Baranci M, Bessant J, Brown JP: The care gap in diagnosis and treatment of women with a fragility fracture. Osteoporosis Int. 2008, 19: 79-86. 10.1007/s00198-007-0426-9.

    Article  CAS  Google Scholar 

  17. Jaglal SB, McIsaac WJ, Hawker G, Carroll J, Jaakkimainen L, Cadarette SM, Cameron C, Davis D: Information needs in the management of osteoporosis in family practice: an illustration of the failure of the current guideline implementation process. Osteoporosis Int. 2003, 14: 672-676. 10.1007/s00198-003-1421-4.

    Article  Google Scholar 

  18. Cheng N, Green ME: Osteoporosis screening for men: Are family physicians following guidelines?. Can Fam Phys. 2008, 54 (1140-1): e1-e5.

    Google Scholar 

  19. Papaioannou A, Giangregorio L, Kvern B, Boulos P, Ioannidis G, Adachi JD: The osteoporosis care gap in Canada. BMC Musculoskelet Disord. 2004, 6: 5-11.

    Google Scholar 

  20. Papaioannou A, Kennedy CC, Ioannidis G, Gao Y, Sawka AM, Goltzman D, Tenenhouse A, Pickard L, Olszynski WP, Davison KS, Kaiser S, Josse RG, Kreiger N, Hanley DA, Prior JC, Brown JP, Anastassiades T, Adachi JD: The osteoporosis care gap in men with fragility fractures: the Canadian multicentre osteoporosis study. Osteoporosis Int. 2008, 19: 581-587. 10.1007/s00198-007-0483-0.

    Article  CAS  Google Scholar 

  21. Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, Spurr C, Khorasani R, Tanasijevic M, Middleton B: Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. JAMIA. 2003, 10 (6): 523-530.

    PubMed  PubMed Central  Google Scholar 

  22. Purcell GP: What makes a good clinical decision support system: we have some answers, but implementing good decision support is still hard. BMJ. 2005, 330: 741-742. 10.1136/bmj.330.7494.740.

    Article  Google Scholar 

  23. Sullivan F, Wyatt JC: How decision support tools help define clinical problems. BMJ. 2005, 331: 831-833. 10.1136/bmj.331.7520.831.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-10.1002/chp.47. e24

    Article  PubMed  Google Scholar 

  25. Campbell M, Fitzpatric R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-10.1136/bmj.321.7262.694. e6

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Kastner M, Straus SE: Clinical decision support tools for osteoporosis disease management: a systematic review of randomized controlled trials. JGIM. 2008, 23 (12): 2095-2105. 10.1007/s11606-008-0812-9.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Kastner M, Li J, Lottridge D, Marquez C, Newton D, Straus SE: Development of a prototype clinical decision support tool for osteoporosis disease management: a qualitative study of focus groups. BMC Med Inform Dec Mak. 2010, 10: 40-10.1186/1472-6947-10-40.

    Article  Google Scholar 

  28. Kastner M, Lottridge D, Marquez C, Newton D, Straus SE: Usability evaluation of a clinical decision support tool for osteoporosis disease management. Implement Sci. 2010, 5: 96-10.1186/1748-5908-5-96.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Kastner M, Sawka A, Thorpe K, Chignel M, Marquez C, Newton D, Strause SE: Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design. Implement Sci. 2011, 6: 77-10.1186/1748-5908-6-77.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Brown JP, Josse RG: 2002 clinical practice guidelines for the diagnosis and management of osteoporosis in Canada (revised, August 26, 2004). CMAJ. 2002, 167 (10): S1-S34.

    PubMed  PubMed Central  Google Scholar 

  31. Hamilton Family Health Team: Available at: Accessed in March, 2013., [http://www.hamiltonfht.ca/About-Us]

  32. Ramsey CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE: Interrupted time series designs in health technology assessment: Lessons from two systematic reviews of behaviour change strategies. Int J Technol Assess Health Care. 2003, 19 (4): 613-623.

    Google Scholar 

  33. Cochrane Effective Practice and Organisation of Care (EPOC) group: EPOC Methods paper: Including Interrupted Time Series Designs in a EPOC Review. Available at: http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/inttime.pdf. Accessed in March, 2013.

  34. England E: How interrupted time series analysis can evaluate guideline implementation. Pharm J. 2005, 275: 344-347.

    Google Scholar 

  35. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D: Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002, 27 (4): 299-309. 10.1046/j.1365-2710.2002.00430.x.

    Article  CAS  PubMed  Google Scholar 

  36. Durbin J: Testing for serial correlation in least-squares regressions when some of the regressors are lagged dependent variables. Econometrica. 1970, 38: 410-421. 10.2307/1909547.

    Article  Google Scholar 

  37. Cochrane D, Orcutt G: Application of least squares regression to relationships containing auto-correlated error terms. J Am Stat Assoc. 1949, 44: 32-61.

    Google Scholar 

  38. Ciaschini P, Strause SE, Dolovich LR, Goeree RA, Leung KM, Woods CR, Zimmerman GM, Majumdar SR, Spadafora S, Fera LA, Lee HN: Community based intervention to optimize osteoporosis management: randomized controlled trial. BMC Geriatr. 2010, 10: 60-10.1186/1471-2318-10-60.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Majumdar SR, Johnson JA, Bellerose D, McAlister FA, Russell AS, Hanley DA, Garg S, Lier DA, Maksymowych WP, Morrish DW, Rowe BH: Nurse case-manager vs multifaceted intervention to improve quality of osteoporosis care after wrist fracture: randomized controlled pilot study. Osteoporos Int. 2011, 22: 223-230. 10.1007/s00198-010-1212-7.

    Article  CAS  PubMed  Google Scholar 

  40. Solomon DH, Iversent MD, Avorn J, Gleeson T, Brookhart MA, Patrick AR, Rekedal L, Shrank WH, Lii J, Losina E, Katz JN: Osteoporosis telephonic intervention to improve medication regimen adherence. Arch Intern Med. 2012, 172 (6): 477-483. 10.1001/archinternmed.2011.1977.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Leslie WD, LaBine L, Klassen P, Dreilich D, Caetano PA: Closing the gap in postfracture care at the population level: a randomized controlled trial. CMAJ. 2012, 184 (3): 290-296. 10.1503/cmaj.111158.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Feldstein A, Elmer PJ, Smith DH, Herson M, Orwoll E, Chen C, Aickin M, Swain MC: Electronic medical record reminder improves osteoporosis management after a fracture: a randomized controlled trial. J Am Geriatric Soc. 2006, 54: 450-457. 10.1111/j.1532-5415.2005.00618.x.

    Article  Google Scholar 

  43. Marsh D, Akersson K, Beaton DE, Bogoch ER, Boonen S, Brandi ML, McLellan AR, Mitchell PJ, Sale JE, Wahl DA: Coordinator-based systems for secondary prevention in fragility fracture patients. Osteoporos Int. 2011, 22: 2051-2065. 10.1007/s00198-011-1642-x.

    Article  CAS  PubMed  Google Scholar 

  44. Bogoch ER, Elliot-Gibson V, Beaton DE, Jamal SA, Josse RG, Murray TM: Effective initiation of osteoporosis diagnosis and treatment for patients with a fragility fracture in an orthopaedic environment. J Bone Joint Surg. 2006, 88 (1): 25-34. 10.2106/JBJS.E.00198.

    Article  PubMed  Google Scholar 

  45. Waalen J, Bruning AL, Peters MJ, Blau EM: A telephone-based intervention for increasing the use of osteoporosis medication: a randomized controlled trial. Am J Managed Care. 2009, 15 (8): e60-e70.

    Google Scholar 

  46. Yuksel N, Majumdar SR, Biggs C, Tsuyuki RT: Community pharmacist-initiated screening program for osteoporosis: randomized controlled trial. Osteo Int. 2010, 21: 391-398. 10.1007/s00198-009-0977-z.

    Article  CAS  Google Scholar 

  47. Lafata JE, Kolk D, Peterson EL, McCarthy BD, Weiss TW, Chen YT, Muma BK: Improving osteoporosis screening: results from a randomized cluster trial. J Gen Intern Med. 2007, 22: 346-351. 10.1007/s11606-006-0060-9.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Shu ADH, Steman MR, Polinski JM, Jan SA, Patel M, Truppo C, Breiner L, Chen YY, Weiss TW, Solomon DH: Adherence to osteoporosis medications after patient and physician brief education: post hoc analysis of a randomized controlled trial. Am J Managed Care. 2009, 15 (7): 417-424.

    Google Scholar 

  49. McDermott L, Yardley L, Littl P, Ashworth M, Gulliford M: Developing a computer delivered, theory based intervention for guidelin implementation in general practice. BMC Fam Pract. 2010, 11: 90-10.1186/1471-2296-11-90.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Kanis JA, Johnell O, Oden A, Johansson H, McCloskey E: FRAX and the assessment of fracture probability in men and women from the UK. Osteoporosis Int. 2008, 19: 385-397. 10.1007/s00198-007-0543-5.

    Article  CAS  Google Scholar 

  51. Fraser LA, Langsetmo L, Berger C, Ioannidis G, Goltzman D, Adachi JD, Papaioannou A, Josse R, Kovacs CS, Olszynski WP, Towheed T, Hanley DA, Kaiser SM, Prior J, Jamal S, Kreiger N, Brown JP, Johansson H, Oden A, McCloskey E, Kanis JA, Leslie WD: Fracture prediction and calibration of a Canadian FRAX tool: a population-based report from CaMos. Osteoporosis Int. 2011, 22: 829-837. 10.1007/s00198-010-1465-1.

    Article  Google Scholar 

  52. Kanis JA, Johansson H, Oden A, Dawson-Hughes B, Melton LJ, McCloskey EV: The effects of a FRAX(®) revision for the USA. Osteoporosis Int. 2010, 21: 35-40. 10.1007/s00198-009-1033-8.

    Article  CAS  Google Scholar 

  53. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72. iii-iv

    Article  Google Scholar 

  54. Tricco AC, Ivers NM, Grimshaw G, Moher D, Turner L, Galipeau J, Halperin I, Vachon B, Ramsay T, Manns B, Tonelli M, Shojania K: Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet. 2012, 379: 2252-2261. 10.1016/S0140-6736(12)60480-2.

    Article  PubMed  Google Scholar 

  55. Roshanov PS, Fernandes N, Wilcznski JM, Hemens BJ, You JJ, Handler SM, Nieuwlaat R, Souza NM, Beyene J, Van Spall HG, Garg AX, Haynes RB: Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013, 346: f657-10.1136/bmj.f657.

    Article  PubMed  Google Scholar 

  56. Garg AX, Adhikari NKJ, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293: 1223-1238. 10.1001/jama.293.10.1223.

    Article  CAS  PubMed  Google Scholar 

  57. Kawamoto K, Houlihan CA, Balas EA, Lobach DF: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330: 765-773. 10.1136/bmj.38398.500764.8F.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Lorig KR, Sobel DS, Ritter PL, Laurent D, Hobbs M: Effect of a self-management program on patients with chronic disease. Eff Clin Pract. 2001, 4: 256-262.

    CAS  PubMed  Google Scholar 

  59. Public Health Agency of Canada: The chief public health officer's report on the state of public health in Canada 2010. Chapter 3: the health and well-being of Canadian seniors. Available at: . Accessed in March, 2013., [http://www.phac-aspc.gc.ca/cphorsphc-respcacsp/2010/fr-rc/cphorsphc-respcacsp-06-eng.php]

  60. Bodenheimer T, Lorig K, Holman H, Grumbach K: Patient self-management of chronic disease in primary care. JAMA. 2002, 288 (19): 2469-2475. 10.1001/jama.288.19.2469.

    Article  PubMed  Google Scholar 

  61. Wagner EH, Bennett SM, Austin BT, Greene SM, Schaefer JK, Vonkorff M: Finding common ground: patient-centeredness and evidence-based chronic illness care. J Altern Complement Med. 2005, 11 (Suppl1): S7-S15.

    PubMed  Google Scholar 

  62. Kastner M, Straus SE: Application of the knowledge-to-action and medical research council frameworks in the development of an osteoporosis clinical decision support tool. J Clin Epidemiol. 2012, 65: 1163-1170. 10.1016/j.jclinepi.2012.04.011.

    Article  PubMed  Google Scholar 

  63. Ash JS, Berg M, Coiera E: Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. JAMIA. 2004, 11: 104-112.

    PubMed  PubMed Central  Google Scholar 

Download references

Funding

The study was funded by a Canadian Institutes of Health Research (CIHR) operating grant.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Monika Kastner.

Additional information

Competing interests

The authors have no competing interests to declare.

Authors’ contributions

All authors participated in the design of the study and the development of the osteoporosis knowledge translation tool. MK, CM, and DN executed the study. JH, JE, MC and KT conducted the statistical analysis. MK, JH and SES analyzed and interpreted the results. MK drafted the manuscript, and all authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kastner, M., Sawka, A.M., Hamid, J. et al. A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis. Implementation Sci 9, 109 (2014). https://doi.org/10.1186/s13012-014-0109-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-014-0109-9

Keywords