A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis
© Kastner et al.; licensee BioMed Central Ltd. 2014
Received: 16 November 2013
Accepted: 11 August 2014
Published: 25 September 2014
Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems, yet gaps in management still exist. In response, we developed a multi-component osteoporosis knowledge translation (Op-KT) tool involving a patient-initiated risk assessment questionnaire (RAQ), which generates individualized best practice recommendations for physicians and customized education for patients at the point of care. The objective of this study was to evaluate the effectiveness of the Op-KT tool for appropriate disease management by physicians.
The Op-KT tool was evaluated using an interrupted time series design. This involved multiple assessments of the outcomes 12 months before (baseline) and 12 months after tool implementation (52 data points in total). Inclusion criteria were family physicians and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). Primary outcomes were the initiation of appropriate osteoporosis screening and treatment. Analyses included segmented linear regression modeling and analysis of variance.
The Op-KT tool was implemented in three family practices in Ontario, Canada representing 5 family physicians with 2840 age eligible patients (mean age 67 years; 76% women). Time series regression models showed an overall increase from baseline in the initiation of screening (3.4%; P < 0.001), any osteoporosis medications (0.5%; P = 0.006), and calcium or vitamin D (1.2%; P = 0.001). Improvements were also observed at site level for all the three sites considered, but these results varied across the sites. Of 351 patients who completed the RAQ unprompted (mean age 64 years, 77% women), the mean time for completing the RAQ was 3.43 minutes, and 56% had any disease management addressed by their physician. Study limitations included the inherent susceptibility of our design compared with a randomized trial.
The multicomponent Op-KT tool significantly increased osteoporosis investigations in three family practices, and highlights its potential to facilitate patient self-management. Next steps include wider implementation and evaluation of the tool in primary care.
KeywordsKnowledge translation Clinical decision support Chronic disease management Primary care Risk assessment Osteoporosis Interrupted time series analysis
Over 200 million people worldwide have osteoporosis, representing a considerable health care and financial burden -. The aging of the population will likely further compound the disease burden ,,. Fragility fractures are the clinical consequence of osteoporosis, with vertebral and hip fractures having the most devastating prognosis  and being associated with an increased risk of death . Such fractures can significantly impair quality of life, physical function, and social interaction and can lead to admission to long-term care -. Clinical practice guidelines are available for osteoporosis management -, but their implementation in clinical practice has been inconsistent, such that many patients are still not receiving appropriate diagnostic testing or treatment -. Less than 40% of patients receive appropriate therapy ; and the proportion of patients with fragility fractures who receive a diagnostic test or a diagnosis from a physician is not optimal (range 1.7% - 50%) -. Knowledge translation (KT) tools such as clinical decision support systems may be one solution to closing these practice gaps because they can provide evidence at the point of care to facilitate disease management. Clinical decision support systems generate patient-specific assessments or recommendations for clinicians by means of software algorithms that match information from a knowledge database to relevant clinical data and provide evidence-based suggestions for assessment and treatment -.
In response to existing management gaps, we developed an osteoporosis KT (Op-KT) tool using two theoretical frameworks: the knowledge-to-action framework of Graham et al  and the Medical Research Council (MRC) framework for complex interventions . The knowledge-to-action framework consists of knowledge creation (which allows knowledge to be filtered down from inquiry and synthesis into tools that can aid in decision making) and a series of iterative and dynamic action steps to apply this knowledge . Importantly, the framework highlights the need to involve relevant end-users of the knowledge that is being implemented . The MRC framework was also considered because it complements the iterative, phased approach of the knowledge-to-action framework, and it has the potential to strengthen the development and implementation of KT interventions by addressing challenges to achieving optimal study design, execution, and generalizability . Our knowledge creation process involved conducting a systematic review of randomized controlled trials to determine what features of osteoporosis tools support clinical decision making . We found that few osteoporosis tools exist, but interventions consisting of reminders and education targeted to both physicians and patients had potential for increasing osteoporosis investigations and treatment . We combined these findings with available national osteoporosis guidelines and input from clinicians and experts in information technology and human-factors engineering to design a conceptual Op-KT tool. We then assessed the barriers and facilitators to using this knowledge in a qualitative study of focus groups with family physician , which enabled the development of a prototype. Finally, we tested the prototype in a mixed-methods usability study to ensure that it met the needs of target end-users including patients at risk for osteoporosis and physicians who provide care for them . A description of the Op-KT tool is in the Methods below.
The objectives of the current study were to test the implementability of the multicomponent Op-KT tool and to determine its effectiveness on appropriate management of osteoporosis by family physicians (i.e., initiation of investigations such as bone mineral density testing (BMD) and treatment with medications such as bisphosphonates and nutritional supplements such as calcium and vitamin D).
The tool was implemented between May and November 2009 (phase one) and evaluated between July 2009 and November 2010 (phase two). Details of the protocol have been published previously . The study was approved by the University of Toronto Health Sciences Research Ethics Board.
Phase one: implementation of the Op-KT tool
Description of the Op-KT tool
A short (13-item) RAQ that is completed on a touch-screen device by at-risk patients in the waiting room or the examination room before their family physician visit. The RAQ was designed to assess major and minor osteoporosis risks as outlined in the Osteoporosis Clinical Practice Guidelines . Screenshots of the RAQ can be viewed in Additional file 1.
A paper-based best practice recommendation prompt (BestPROMPT), generated according to patients’ RAQ responses and outlining appropriate, individualized, guideline-based  osteoporosis management recommendations for family physicians at the point of care. An example of this is shown in Additional file 2.
A paper-based customized osteoporosis educational sheet (COPE) given to patients at the end of the visit, outlining their individual identified risks and suggestions for managing those risks. An example of this is shown in Additional file 3.
Setting and population
Three family practices were purposively selected from the Hamilton Family Health Team, which is the largest of the 150 approved primary care Family Health Teams in Ontario, Canada, serving approximately 280 000 people . It includes a comprehensive team of family physicians, nurses, registered dieticians, mental health counsellors, psychiatrists, and pharmacists. We selected 3 family practices in total, as this was sufficient to evaluate the Op-KT tool under different practice settings (one group and two solo) for a pilot study. Those who agreed to participate and met the eligibility criteria were included. Participants were family physicians in solo or group practice using the PracticeSolutions electronic medical record (EMR) system (TELUS Health, Canada) and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). A written consent was obtained from all participating physicians.
Phase two: evaluation of the Op-KT tool
Study design and sampling
We used the quasi-experimental design with interrupted time series (ITS) analysis to estimate the effect of the Op-KT tool on appropriate disease management outcomes. The study design and its execution were guided by the ITS quality criteria as outlined by Ramsey et al. and the Cochrane Effective Practice and Organisation of Care group . In ITS studies, sample size calculations are related to the estimation of the number of observations or time points at which data will be collected. The literature is variable on the number of data points to consider in different situations, but it is generally recommended that at least 20 pre-intervention and 20 post-intervention observations be used to ensure sufficient power to detect a change and to account for threats to validity, such as trends, seasonal or cyclical observations over time, or random fluctuations with no discernible patterns ,. We used a relatively large number of data points: 26 data points over the 12 months before starting the intervention (baseline period) and 26 data points over the 12 months after implementation (intervention period), for a total of 52 data points for each site (see Figure 1). To increase validity, data points were set closer together (i.e., each data point represented a two-week period rather than four weeks) .
The primary outcomes were initiation of appropriate osteoporosis investigations (i.e., BMD testing) and treatment (e.g., any bisphosphonate or nutritional supplements such as calcium and vitamin D) by family physicians. `Appropriate’ osteoporosis management was defined according to clinical practice guidelines available at the start of phase two . Screening and treatment recommendations were used to develop a disease management algorithm , which was programmed into the RAQ. Secondary outcomes were the number of patients who completed the RAQ (measured by patient-initiated RAQ logs generated by the touch-screen tablets), the mean time for completion of the RAQ (minutes), and occurrence of fractures. We also assessed osteoporosis risk factors by sex. Using queries in the EMR system and an automated computer program within the touch-screen devices, we also documented any actions related to the primary outcome taken by family physicians of patients who completed the RAQ and collected site-specific demographic data (number of patients in practice, number of age-eligible patients and their mean age, and patients who had at least one visit during the intervention period).
Unit of analysis and data collection
Our unit of analysis for our primary outcomes was based on the multiple baseline assessment of individual family practice sites. These outcomes were first summarized as rates at each time point, using proportion of osteoporosis investigation and prescriptions, where the denominator represented the number of all eligible visits. We established a stable baseline of standard practice for each site using a pre-intervention chart review. The specific procedure for data collection was published in the protocol . Briefly, two investigators (MK, CM) used patient charts and touch-screen tablet logs to collect visit-specific data bimonthly. Every time a patient completed the RAQ, summaries from physician and patient outputs (BestPROMPT and COPE sheets, respectively) were saved in a folder on the encrypted device hard drive. These summaries captured the date and time the RAQ was initiated and completed and the timed logs of all RAQ responses. We confirmed RAQ use and documented any outcome-related actions taken by physicians using chart review. Our unit of analysis for our secondary outcomes was at the level of patients.
We provided site level as well as overall summary measures, where data was combined across the three sites. For normally distributed continuous data, we reported means and standard deviations and performed t-tests and analysis of variance (ANOVA) to compare differences in means between groups. For non-normally distributed continuous data, we reported medians and interquartile ranges and used nonparametric tests for group comparisons. For categorical data, we reported frequencies and percentages and used Fisher exact tests and chi-square tests for comparing differences between groups.
Where, Intervention is a dichotomous variable indicating pre- and post-intervention time periods. The coefficients β0 and β1 represent the constant term (intercept) and trend over time (slope) during the baseline (pre-intervention) period, respectively; whereas, β2 and β3 represent changes in the level and trend of outcomes after the intervention (compared to baseline level and trend).
We used the Durbin-Watson's test  to examine presence of serial correlation in the residuals after fitting the segmented regression model. When statistically significant autocorrelation is detected, autoregressive integrated moving average (ARIMA) models was used as required (by including a lag term in the regression models model, eg. Yt - Yt-1, for first order autocorrelation) using the Cochrane-Orcutt methodology . All statistical analyses were conducted using SAS version 9.3, and statistical significance was set at P < 0.05.
Characteristics of the study population across the 3 family health team study sites during the baseline and intervention periods
Total number of patients in practice
Total number of age-eligible patients* (%)
Mean age of patients
Total number of visits (%)
Total number of visits by age-eligible patients† (%)
Primary outcomes-results of the ITS analysis
Results of the interrupted time series analysis for initiation of osteoporosis investigations and treatments, combined across the three sites*
Mean of proportions across the three sites (SD)
Initiation of BMD testing
1.86 to 3.74
3.38 to 8.42
2.03 to 4.68
Initiation of any osteoporosis medication ‡
0 to 1.13
0 to 2.16
0.15 to 0.85
Initiation of calcium + vitamin D
0 to 1.80
0 to 3.44
0.39 to 1.41
Initiation of any nutritional supplement (calcium or vitamin D)
0 to 2.36
0 to 4.64
0.49 to 1.91
A statistically significant autocorrelation of order 7 (correlation value of 0.51, 0.22, 0.34 for BMD testing, any osteoporosis medication and nutritional supplement with p-values of <0.001, 0.035, 0.004; respectively) was observed in the residuals; results adjusted for autocorrelation. Further investigation of the residuals (after fitting the adjusted model) showed randomly distributed residuals indicating no residual serial correlation left between the measurements across time.
Site level interrupted time series analysis indicated that the intervention led to improvements in outcomes across all sites, but not all increases were significant. For example, a statistically significant improvement was observed for BMD testing (compared to pre-intervention) in Site 1 (4.29%, CI 1.72-6.86; p = 0.001) and Site 3 (3.07%, CI 1.55-4.59; p <0.001) but not in Site 2 (3.40%, CI -0.43-7.23; p = 0.082). Increases in osteoporosis medication prescriptions in the post- *0intervention period was also significant in Site 3 (0.78%, CI 0.18-1.38; p = 0.011) but not in Site 1 (0.18%, CI -0.35-0.71; p = 0.5023) or Site 2 (0.29%, CI -0.28-0.86, p = 0.3324). Similarly, the prescription of nutritional supplements increased across all sites during the post-intervention period, but this increase was only significant in site three (1.85%, CI 0.86-2.84; p <0.001). All site level analyses were adjusted for autocorrelation, when significant autocorrelations were detected.
Number of eligible visits, and number of visits leading to a primary outcome (BMD testing, initiation of osteoporosis medications and nutritional supplements) across the three sites*
Initiation of any osteoporosis medication
Initiation of any nutritional supplements (calcium, vitamin D)
Rate (95% CI)
Rate (95% CI)
Secondary outcomes-patient-level analysis
Characteristics of patients who completed the risk assessment questionnaire (n = 351)*
Between women and men
No. (%) of patients†
Age, mean (SD), y
Age range, y
Time to complete RAQ, mean (SD), min
Range of completion time, mean, min
Number of visits, mean (SD)
Number (%) of patients who had a BMD test
Over 2 y ago
Less than 2 y ago
Number (%) of patients at risk for osteoporosis†
Number (%) of patients already receiving therapy
Any supplement (calcium or vitamin D)
This study showed that a multicomponent Op-KT tool incorporating all disease management components (assessment, diagnosis and treatment) is feasible for use at the point of care. Use of the tool increased the initiation of BMD testing and treatment with medications such as bisphosphonates and vitamin D for patients at risk for osteoporosis. Our findings are consistent with other studies investigating osteoporosis disease management -. However, they also highlight continuing gaps: specifically, 42% of at-risk patients who completed the RAQ reported never having had a BMD test, and the rate of osteoporosis investigations was significantly lower among men than women (consistent with other reports ,). Persistence of these gaps may be explained, in part, by how interventions are designed to overcome them. Few osteoporosis interventions include all components of disease management. Our previous systematic review found interventions with different combinations of disease management recommendations in the form of reminders and education (electronic, paper-based, or counseling-based), but none addressed all three aspects of disease management . More recently, tools that do address disease management completely have been developed for high-risk  and postfracture  patients, but they don't address how these tools might be implemented over the long term or how they might be sustainable. Furthermore, few of the existing tools use a computer-based platform for decision support , most are not designed to deliver evidence-based messages at the point of care, and none consider mechanisms to avoid disruption to usual practice (which can facilitate sustainability). Most tools involve coordinator-based systems (where dedicated case managers such as nurses, orthopedic surgeons, or other allied healthcare professionals are involved in facilitating care ,,,), use telephone-based reminders ,, or provide reminders or education to physicians and patients through a paper-based , or counseling-based  strategy. These interventions can be resource intensive and therefore may not be sustainable.
Our study met the clinical goal of the osteoporosis tool, which was to increase osteoporosis investigations and treatment. Although the improvements in disease management were modest, they represent significant change in the right direction. Furthermore, the impact was relevant because the Op-KT tool was not tested under controlled conditions. It was designed and implemented as a pragmatic tool, so for example, the observed 3.2% increase in BMD testing represents a true measure of how the tool functioned in `real’ practice. We considered pragmatism in the tool design because our foundational work indicated that such tools might unintentionally disrupt the real reason for the visit under more controlled conditions (i.e., if a prompting mechanism was enforced for every at-risk patient) . Healthcare professionals prefer the provision of guidance that does not interfere with usual care , as confirmed by our investigation of practice workflows across the three sites, so we deliberately designed the tool to not prompt patients to complete the risk questionnaire. This also meant that the tool was not initiated during every relevant `at-risk’ encounter, which resulted in a relatively low rate of use (16% across the three sites). However, physicians addressed the disease management of more than half of these patients, which indicates that the tool has great potential to enhance care. The challenge in designing KT tools such as this one is to find the right balance between transmitting appropriate practice knowledge at the right time and ensuring that more urgent aspects of the visit agenda (e.g., chest pain) or health status (e.g., diabetes complication) are not disrupted, particularly in practice settings where visits are short and involve multiple complaints requiring complex clinical decisions.
Our positive findings also highlight several unique features that can be considered when designing clinical decision support systems such as the Op-KT tool. First, the information that our tool delivered to physicians and patients was customized according to the risk profile of each individual patient. The tool functions by extracting and analyzing risk inputs according to a guideline-based disease management algorithm; and then deliver relevant, evidence-based prompts to aid physicians in their clinical decision making (BestPROMPT), and provide a risk profile for patients with self-management options tailored to their own risks (COPE). Very few existing tools have all of these features. FRAX, a widely known risk assessment tool, is designed to estimate individualized 10-year probability of hip and major osteoporotic fractures , and has been calibrated for populations in Canada  and the United States . It estimates the 10-year fracture risk by integrating age, gender, and seven clinical risk factors independent of BMD , but it was not designed to consider the treatment recommendations that would be relevant to the risks identified, nor can it suggest tailored messages for patients to facilitate self-management. Additionally, evidence from many studies has shown that guidelines on their own are not sufficient to change practice  and decision support tools, such as the one we created, provide potential solutions to this challenge.
Second, our finding that patient involvement in disease management is feasible at the point of care highlights the untapped opportunities to improve care in primary care settings. A recent systematic review of quality improvement strategies for diabetes mellitus found that interventions targeting the disease management system along with patient-mediated strategies improved care . Another recent analysis showed that clinical decision support systems that provide advice for patients in addition to practitioners are more likely to succeed . Lack of time is a major barrier to implementing clinical decision support tools in family practices ,, so it's prudent to shift some of the disease management tasks to patients. In our study, we showed that this is possible, as patients were able to complete the RAQ in the waiting room or in the examination room prior to their visit. Involving patients in the continuum of care can facilitate self-management, making it easier for patients to receive important information and to gain the skills and confidence (self-efficacy) to deal with their illness . Moreover, patient self-management may facilitate the sustainability of an intervention by alleviating resource burdens that might be needed to maintain continuing use of the tool. Indeed, elderly patients are the fastest-growing population group , a demographic shift that is expected to increase the prevalence of chronic diseases  and the need for patient self-care to support disease management ,.
This study also made several contributions to the development of complex interventions for chronic disease where the goal is to effectively translate best evidence at the point of care. The tool underwent substantial usability testing before implementation . Moreover, workflow analysis preceded its roll-out in the family practice units to optimize use of the tool. These efforts were perceived to have been successful, because the patients who initiated the RAQ were able to complete it rapidly (mean 3.43 minutes). Lastly, the Op-KT tool was developed from a robust evidentiary base informed by two theoretical frameworks (the knowledge-to-action and MRC frameworks). These not only helped in mapping the process for translating osteoporosis evidence into practice, they also facilitated the selection of appropriate study designs to answer our questions, to anticipate barriers, to evaluate outcomes, and to address implementation and sustainability barriers .
Our study had some limitations. This was a pilot study, so our sample sizes were smaller than would be expected if we had conducted a more rigorous randomized controlled trial (RCT). As a result, findings may not be generalizable to other family practice settings or populations. However, in ITS studies, sample size calculations are related to the estimation of the number of observations or time points at which data are collected rather than the number of sites, physicians, and patients. As such, we included a higher number of data points (i.e., 26 data points before and 26 data points after the introduction of the intervention) than recommended (20 data points before/after) to ensure enough power to detect a change and to account for threats to internal validity ,. Furthermore, data points were set closer together (i.e., each data point represented a two-week period rather than four weeks) to increase validity . We recognize that the ITS methodology is inherently more susceptible to validity threats than would be a more rigorous RCT design. However, for a pilot evaluation, this methodology was most appropriate, and we designed our study according to rigorous ITS criteria , to help rule out alternative explanations of our findings. Third, the guideline used in the study was an earlier version , so the recommendations are not consistent with current guidelines. However, the tool is currently being updated to reflect these changes. Although we planned to integrate our tool within the PracticeSolutions system, this was not possible because of programming and EMR proprietary barriers. Such integration can facilitate more efficient delivery of patient-specific decision support at the point of care ,,, and a more automated transfer of data while preserving the accuracy of patient-reported risks. However, we showed that a stand-alone, partially electronic system could benefit clinical practice. In addition, the majority of current practices are paper-based, so our tool is more generalizable to these settings now, but has great potential to be transformed into a fully electronic tool as physician practices become increasingly paperless.
Our multicomponent Op-KT tool significantly increased osteoporosis disease management in three family practices. This study highlights the potential of using decision support tools at the point of care in busy, short-visit practices to facilitate patient self-management.
The study was funded by a Canadian Institutes of Health Research (CIHR) operating grant.
- Gullberg B, Johnell O, Kanis JA: World-wide projections for hip fracture. Osteoporosis Int. 1997, 7: 407-413. 10.1007/PL00004148.View ArticleGoogle Scholar
- International Osteoporosis Foundation: Available at: . Accessed in March 2013., [http://www.iofbonehealth.org/facts-statistics]
- Goeree R, Blackhouse G, Adachi J: Cost-effectiveness of alternative treatments for women with osteoporosis in Canada. Curr Med Res Opin. 2006, 22 (7): 1425-1436. 10.1185/030079906X115568.View ArticlePubMedGoogle Scholar
- Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A: Incidence and economic burden of osteoporosis-related fractures in the United States, 2005-2025. J Bone Min Res. 2007, 22 (3): 465-475. 10.1359/jbmr.061113.View ArticleGoogle Scholar
- Osteoporosis Canada. Available at: . Accessed March 2013., [http://www.osteoporosis.ca/osteoporosis-and-you/osteoporosis-facts-and-statistics/]
- Pike C, Brnbaum HG, Schiller M, Sharma H, Burge R, Edgell ET: Direct and indirect costs of Non-vertebral fracture patients with osteoporosis in the US. Pharmacoeconomics. 2010, 28 (5): 395-409. 10.2165/11531040-000000000-00000.View ArticlePubMedGoogle Scholar
- National Institutes of Health: Health information: osteoporosis (National Institute of Arthritis and Musculoskeletal and Skin Diseases). Available at: . Accessed in March, 2013., [http://health.nih.gov/topic/Osteoporosis]
- Reginster J, Burlet N: Osteoporosis: a still increasing prevalence. Bone. 2006, 38: S4-S9. 10.1016/j.bone.2005.11.024.View ArticlePubMedGoogle Scholar
- Ioannidis G, Papaioannou A, Hopman WM, Akhtar-Danesh N, Anastassiades T, Pickard L, Kennedy CC, Prior JC, Olszynski WP, Davison KS, Goltzman D, Thabane L, Gafni A, Papadimitropoulos EA, Brown JP, Josse RG, Hanley DA, Adachi JD: Relation between fractures and mortality: results from the Canadian multicentre osteoporosis study. CMAJ. 2009, 181 (5): 265-271. 10.1503/cmaj.081720.View ArticlePubMedPubMed CentralGoogle Scholar
- Lips P, van Schoor NM: Quality of life in patients with osteoporosis. Osteoporosis Int. 2005, 16: 447-455. 10.1007/s00198-004-1762-7.View ArticleGoogle Scholar
- Cummings SR, Melton LJ: Epidemiology and outcomes of osteoporotic fractures. Lancet. 2002, 359: 1761-1767. 10.1016/S0140-6736(02)08657-9.View ArticlePubMedGoogle Scholar
- Adachi JD, Ioannidis G, Pickard L, Berger C, Prior JC, Joseph L, Hanley DA, Olszynski WP, Murray TM, Anastassiades T, Hopman W, Brown JP, Kirkland S, Joyce C, Papaioannou A, Poliquin S, Tenenhouse A, Papadimitropoulos EA: The association between osteoporotic fractures and health-related quality of life as measured by the Health Utilities Index in the Canadian Multicentre Osteoporosis Study (CaMos). Osteoporosis Int. 2003, 14: 895-904. 10.1007/s00198-003-1483-3.View ArticleGoogle Scholar
- Papaioannou A, Morin S, Cheung A, Atkinson S, Brown JP, Feldman S, Hanley DA, Hodsman A, Jamal SA, Kaiser SM, Kvern B, Siminoski K, Leslie WD: 2010 clinical practice guidelines for the diagnosis and management of osteoporosis in Canada: summary. CMAJ. 2010, 182 (17): 1864-1873. 10.1503/cmaj.100771.View ArticlePubMedPubMed CentralGoogle Scholar
- National Osteoporosis Guideline Group: Guideline for the diagnosis and management of osteoporosis in postmenopausal women and men from the age of 50 years in the UK (2010). Available at: . Accessed in March, 2013., [http://www.shef.ac.uk/NOGG/NOGG_Pocket_Guide_for_Healthcare_Professionals.pdf]
- Osteoporosis. Obstet Gynecol. 2012, 120 (3): 718-734. 10.1097/AOG.0b013e3182680478.
- Bessette L, Ste-Marie LG, Jean S, Davison KS, Beaulieu M, Baranci M, Bessant J, Brown JP: The care gap in diagnosis and treatment of women with a fragility fracture. Osteoporosis Int. 2008, 19: 79-86. 10.1007/s00198-007-0426-9.View ArticleGoogle Scholar
- Jaglal SB, McIsaac WJ, Hawker G, Carroll J, Jaakkimainen L, Cadarette SM, Cameron C, Davis D: Information needs in the management of osteoporosis in family practice: an illustration of the failure of the current guideline implementation process. Osteoporosis Int. 2003, 14: 672-676. 10.1007/s00198-003-1421-4.View ArticleGoogle Scholar
- Cheng N, Green ME: Osteoporosis screening for men: Are family physicians following guidelines?. Can Fam Phys. 2008, 54 (1140-1): e1-e5.Google Scholar
- Papaioannou A, Giangregorio L, Kvern B, Boulos P, Ioannidis G, Adachi JD: The osteoporosis care gap in Canada. BMC Musculoskelet Disord. 2004, 6: 5-11.Google Scholar
- Papaioannou A, Kennedy CC, Ioannidis G, Gao Y, Sawka AM, Goltzman D, Tenenhouse A, Pickard L, Olszynski WP, Davison KS, Kaiser S, Josse RG, Kreiger N, Hanley DA, Prior JC, Brown JP, Anastassiades T, Adachi JD: The osteoporosis care gap in men with fragility fractures: the Canadian multicentre osteoporosis study. Osteoporosis Int. 2008, 19: 581-587. 10.1007/s00198-007-0483-0.View ArticleGoogle Scholar
- Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, Spurr C, Khorasani R, Tanasijevic M, Middleton B: Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. JAMIA. 2003, 10 (6): 523-530.PubMedPubMed CentralGoogle Scholar
- Purcell GP: What makes a good clinical decision support system: we have some answers, but implementing good decision support is still hard. BMJ. 2005, 330: 741-742. 10.1136/bmj.330.7494.740.View ArticleGoogle Scholar
- Sullivan F, Wyatt JC: How decision support tools help define clinical problems. BMJ. 2005, 331: 831-833. 10.1136/bmj.331.7520.831.View ArticlePubMedPubMed CentralGoogle Scholar
- Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-10.1002/chp.47. e24View ArticlePubMedGoogle Scholar
- Campbell M, Fitzpatric R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-10.1136/bmj.321.7262.694. e6View ArticlePubMedPubMed CentralGoogle Scholar
- Kastner M, Straus SE: Clinical decision support tools for osteoporosis disease management: a systematic review of randomized controlled trials. JGIM. 2008, 23 (12): 2095-2105. 10.1007/s11606-008-0812-9.View ArticlePubMedPubMed CentralGoogle Scholar
- Kastner M, Li J, Lottridge D, Marquez C, Newton D, Straus SE: Development of a prototype clinical decision support tool for osteoporosis disease management: a qualitative study of focus groups. BMC Med Inform Dec Mak. 2010, 10: 40-10.1186/1472-6947-10-40.View ArticleGoogle Scholar
- Kastner M, Lottridge D, Marquez C, Newton D, Straus SE: Usability evaluation of a clinical decision support tool for osteoporosis disease management. Implement Sci. 2010, 5: 96-10.1186/1748-5908-5-96.View ArticlePubMedPubMed CentralGoogle Scholar
- Kastner M, Sawka A, Thorpe K, Chignel M, Marquez C, Newton D, Strause SE: Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design. Implement Sci. 2011, 6: 77-10.1186/1748-5908-6-77.View ArticlePubMedPubMed CentralGoogle Scholar
- Brown JP, Josse RG: 2002 clinical practice guidelines for the diagnosis and management of osteoporosis in Canada (revised, August 26, 2004). CMAJ. 2002, 167 (10): S1-S34.PubMedPubMed CentralGoogle Scholar
- Hamilton Family Health Team: Available at: Accessed in March, 2013., [http://www.hamiltonfht.ca/About-Us]
- Ramsey CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE: Interrupted time series designs in health technology assessment: Lessons from two systematic reviews of behaviour change strategies. Int J Technol Assess Health Care. 2003, 19 (4): 613-623.Google Scholar
- Cochrane Effective Practice and Organisation of Care (EPOC) group: EPOC Methods paper: Including Interrupted Time Series Designs in a EPOC Review. Available at: http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/inttime.pdf. Accessed in March, 2013.
- England E: How interrupted time series analysis can evaluate guideline implementation. Pharm J. 2005, 275: 344-347.Google Scholar
- Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D: Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002, 27 (4): 299-309. 10.1046/j.1365-2710.2002.00430.x.View ArticlePubMedGoogle Scholar
- Durbin J: Testing for serial correlation in least-squares regressions when some of the regressors are lagged dependent variables. Econometrica. 1970, 38: 410-421. 10.2307/1909547.View ArticleGoogle Scholar
- Cochrane D, Orcutt G: Application of least squares regression to relationships containing auto-correlated error terms. J Am Stat Assoc. 1949, 44: 32-61.Google Scholar
- Ciaschini P, Strause SE, Dolovich LR, Goeree RA, Leung KM, Woods CR, Zimmerman GM, Majumdar SR, Spadafora S, Fera LA, Lee HN: Community based intervention to optimize osteoporosis management: randomized controlled trial. BMC Geriatr. 2010, 10: 60-10.1186/1471-2318-10-60.View ArticlePubMedPubMed CentralGoogle Scholar
- Majumdar SR, Johnson JA, Bellerose D, McAlister FA, Russell AS, Hanley DA, Garg S, Lier DA, Maksymowych WP, Morrish DW, Rowe BH: Nurse case-manager vs multifaceted intervention to improve quality of osteoporosis care after wrist fracture: randomized controlled pilot study. Osteoporos Int. 2011, 22: 223-230. 10.1007/s00198-010-1212-7.View ArticlePubMedGoogle Scholar
- Solomon DH, Iversent MD, Avorn J, Gleeson T, Brookhart MA, Patrick AR, Rekedal L, Shrank WH, Lii J, Losina E, Katz JN: Osteoporosis telephonic intervention to improve medication regimen adherence. Arch Intern Med. 2012, 172 (6): 477-483. 10.1001/archinternmed.2011.1977.View ArticlePubMedPubMed CentralGoogle Scholar
- Leslie WD, LaBine L, Klassen P, Dreilich D, Caetano PA: Closing the gap in postfracture care at the population level: a randomized controlled trial. CMAJ. 2012, 184 (3): 290-296. 10.1503/cmaj.111158.View ArticlePubMedPubMed CentralGoogle Scholar
- Feldstein A, Elmer PJ, Smith DH, Herson M, Orwoll E, Chen C, Aickin M, Swain MC: Electronic medical record reminder improves osteoporosis management after a fracture: a randomized controlled trial. J Am Geriatric Soc. 2006, 54: 450-457. 10.1111/j.1532-5415.2005.00618.x.View ArticleGoogle Scholar
- Marsh D, Akersson K, Beaton DE, Bogoch ER, Boonen S, Brandi ML, McLellan AR, Mitchell PJ, Sale JE, Wahl DA: Coordinator-based systems for secondary prevention in fragility fracture patients. Osteoporos Int. 2011, 22: 2051-2065. 10.1007/s00198-011-1642-x.View ArticlePubMedGoogle Scholar
- Bogoch ER, Elliot-Gibson V, Beaton DE, Jamal SA, Josse RG, Murray TM: Effective initiation of osteoporosis diagnosis and treatment for patients with a fragility fracture in an orthopaedic environment. J Bone Joint Surg. 2006, 88 (1): 25-34. 10.2106/JBJS.E.00198.View ArticlePubMedGoogle Scholar
- Waalen J, Bruning AL, Peters MJ, Blau EM: A telephone-based intervention for increasing the use of osteoporosis medication: a randomized controlled trial. Am J Managed Care. 2009, 15 (8): e60-e70.Google Scholar
- Yuksel N, Majumdar SR, Biggs C, Tsuyuki RT: Community pharmacist-initiated screening program for osteoporosis: randomized controlled trial. Osteo Int. 2010, 21: 391-398. 10.1007/s00198-009-0977-z.View ArticleGoogle Scholar
- Lafata JE, Kolk D, Peterson EL, McCarthy BD, Weiss TW, Chen YT, Muma BK: Improving osteoporosis screening: results from a randomized cluster trial. J Gen Intern Med. 2007, 22: 346-351. 10.1007/s11606-006-0060-9.View ArticlePubMedPubMed CentralGoogle Scholar
- Shu ADH, Steman MR, Polinski JM, Jan SA, Patel M, Truppo C, Breiner L, Chen YY, Weiss TW, Solomon DH: Adherence to osteoporosis medications after patient and physician brief education: post hoc analysis of a randomized controlled trial. Am J Managed Care. 2009, 15 (7): 417-424.Google Scholar
- McDermott L, Yardley L, Littl P, Ashworth M, Gulliford M: Developing a computer delivered, theory based intervention for guidelin implementation in general practice. BMC Fam Pract. 2010, 11: 90-10.1186/1471-2296-11-90.View ArticlePubMedPubMed CentralGoogle Scholar
- Kanis JA, Johnell O, Oden A, Johansson H, McCloskey E: FRAX and the assessment of fracture probability in men and women from the UK. Osteoporosis Int. 2008, 19: 385-397. 10.1007/s00198-007-0543-5.View ArticleGoogle Scholar
- Fraser LA, Langsetmo L, Berger C, Ioannidis G, Goltzman D, Adachi JD, Papaioannou A, Josse R, Kovacs CS, Olszynski WP, Towheed T, Hanley DA, Kaiser SM, Prior J, Jamal S, Kreiger N, Brown JP, Johansson H, Oden A, McCloskey E, Kanis JA, Leslie WD: Fracture prediction and calibration of a Canadian FRAX tool: a population-based report from CaMos. Osteoporosis Int. 2011, 22: 829-837. 10.1007/s00198-010-1465-1.View ArticleGoogle Scholar
- Kanis JA, Johansson H, Oden A, Dawson-Hughes B, Melton LJ, McCloskey EV: The effects of a FRAX(®) revision for the USA. Osteoporosis Int. 2010, 21: 35-40. 10.1007/s00198-009-1033-8.View ArticleGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72. iii-ivView ArticleGoogle Scholar
- Tricco AC, Ivers NM, Grimshaw G, Moher D, Turner L, Galipeau J, Halperin I, Vachon B, Ramsay T, Manns B, Tonelli M, Shojania K: Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet. 2012, 379: 2252-2261. 10.1016/S0140-6736(12)60480-2.View ArticlePubMedGoogle Scholar
- Roshanov PS, Fernandes N, Wilcznski JM, Hemens BJ, You JJ, Handler SM, Nieuwlaat R, Souza NM, Beyene J, Van Spall HG, Garg AX, Haynes RB: Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013, 346: f657-10.1136/bmj.f657.View ArticlePubMedGoogle Scholar
- Garg AX, Adhikari NKJ, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293: 1223-1238. 10.1001/jama.293.10.1223.View ArticlePubMedGoogle Scholar
- Kawamoto K, Houlihan CA, Balas EA, Lobach DF: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330: 765-773. 10.1136/bmj.38398.500764.8F.View ArticlePubMedPubMed CentralGoogle Scholar
- Lorig KR, Sobel DS, Ritter PL, Laurent D, Hobbs M: Effect of a self-management program on patients with chronic disease. Eff Clin Pract. 2001, 4: 256-262.PubMedGoogle Scholar
- Public Health Agency of Canada: The chief public health officer's report on the state of public health in Canada 2010. Chapter 3: the health and well-being of Canadian seniors. Available at: . Accessed in March, 2013., [http://www.phac-aspc.gc.ca/cphorsphc-respcacsp/2010/fr-rc/cphorsphc-respcacsp-06-eng.php]
- Bodenheimer T, Lorig K, Holman H, Grumbach K: Patient self-management of chronic disease in primary care. JAMA. 2002, 288 (19): 2469-2475. 10.1001/jama.288.19.2469.View ArticlePubMedGoogle Scholar
- Wagner EH, Bennett SM, Austin BT, Greene SM, Schaefer JK, Vonkorff M: Finding common ground: patient-centeredness and evidence-based chronic illness care. J Altern Complement Med. 2005, 11 (Suppl1): S7-S15.PubMedGoogle Scholar
- Kastner M, Straus SE: Application of the knowledge-to-action and medical research council frameworks in the development of an osteoporosis clinical decision support tool. J Clin Epidemiol. 2012, 65: 1163-1170. 10.1016/j.jclinepi.2012.04.011.View ArticlePubMedGoogle Scholar
- Ash JS, Berg M, Coiera E: Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. JAMIA. 2004, 11: 104-112.PubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.