- Study protocol
- Open Access
- Open Peer Review
Improving care for elderly patients living with polypharmacy: protocol for a pragmatic cluster randomized trial in community-based primary care practices in Canada
Implementation Science volume 14, Article number: 55 (2019)
Elders living with polypharmacy may be taking medications that do not benefit them. Polypharmacy can be associated with elevated risks of poor health, reduced quality of life, high care costs, and persistently complex care needs. While many medications could be problematic, this project targets medications that should be deprescribed for most elders and for which guidelines and evidence-based deprescribing tools are available. These are termed potentially inappropriate prescriptions (PIPs) and are as follows: proton pump inhibitors, benzodiazepines, antipsychotics, and sulfonylureas. Implementation strategies for deprescribing PIPs in complex older patient populations are needed.
This will be a pragmatic cluster randomized controlled trial in community-based primary care practices across Canada. Eligible practices provide comprehensive primary care and have at least one physician that consents to participate. Community-dwelling patients aged 65 years and older with ten or more unique medication prescriptions in the past year will be included. The objective is to assess whether the intervention reduces targeted PIPs for these patients compared with usual care. The intervention, Structured Process Informed by Data, Evidence and Research (SPIDER), is a collaboration between quality improvement (QI) and research programs. Primary care teams will form interprofessional Learning Collaboratives and work with QI coaches to review electronic medical record data provided by their regional Practice Based Research Networks (PBRNs), identify areas of improvement, and develop and implement changes. The study will be tested for feasibility in three PBRNs (Toronto, Montreal, and Edmonton) using prospective single-arm mixed methods. Findings will then guide a pragmatic cluster randomized controlled trial in five PBRNs (Calgary, Winnipeg, Ottawa, Montreal, and Halifax). Seven practices per PBRN will be recruited for each arm. The analysis will be by intention to treat. Ten percent of patients who have at least one PIP at baseline will be randomly selected to participate in the assessment of patient experience and self-reported outcomes. Qualitative methods will be used to explore patient and physician experience and evaluate SPIDER’s processes.
We are testing SPIDER in a primary care population with complex care needs. This could provide a widely applicable model for care improvement.
Clinicaltrials.gov NCT03689049; registered September 28, 2018
In Canada and the USA, 5% of the population incur approximately two thirds of healthcare costs and are identified as patients with complex care needs [1,2,3,4,5,6,7]. These individuals receive care in multiple settings and from different healthcare providers , making care coordination and integration challenging and resulting in less than optimal care and patient experiences [9, 10]. Strategies to improve care for complex patients are needed .
However, complex patients represent different population segments and require approaches that focus on targeted needs. Some patients have elevated care needs related to end-of-life [11, 12]. Others, such as accident victims and transplant recipients, have an acute event requiring intensive resources for a limited time . Only 15% of individuals incurring costs in the top 5% are expected to remain in that category for three or more consecutive years . Approaches to addressing care gaps in individuals with persistent complex needs could produce significant improvements in patient wellbeing and reduce healthcare costs.
Effective strategies for persistently complex patients include care by multidisciplinary teams, trusting relationships, use of technology, adaptability to local context, and assistance with navigating the healthcare system [8, 10, 13, 14]. However, these strategies have not been widely implemented, resulting in a lack of systematic improvement for complex patient populations [9, 15]. Primary health care is patient-centered, involves longitudinal care, provides system navigation, and maintains trusting ongoing relationships with patients and caregivers; it thus represents an ideal setting for improving health and care for persistently complex patients.
There is therefore a need to implement evidence-based interventions to benefit complex patients; these need to be broadly applicable to routine primary care settings in a variety of contexts and need to address individual behavioral change, organizational change, and structure change . An evaluation of the effect of implementation strategies is needed.
When planning this study, we considered  whether there was a population of patients that is persistently complex and could be identified to their primary care provider (PCP) and primary care team for action ; whether tools exist to support the implementation of care improvements for this population in routine primary care settings ; what existing change strategies could be broadly applicable in primary care settings ; whether currently available infrastructure in Canadian primary care could support the feasibility of trial recruitment and management for this issue at scale; and  what design features would promote adaptation to each context, sustainability, and spread beyond the project.
Identification of populations of persistently complex patients
Polypharmacy as an indicator of persistent complexity
A member of our team (SD) led a study that identified that the number of medications prescribed to a patient is the single most reliable index of persistent complexity, after age. Individuals 65 years or older taking ten or more medications accounted for virtually all (95.3%) patients found to have costs that were consistently in the upper quartile over the following 3 years. This degree of specificity will allow appropriate care to be directed to a primary care practice population based on overall complexity and costs rather than through targeting single health conditions.
Potentially inappropriate prescriptions as a target for improvement
Many medications are beneficial and clinically indicated while some may be unnecessary or may cause harm in some circumstances. The latter are termed potentially inappropriate prescriptions (PIPs). There are multiple consensus lists that identify which medications are potentially inappropriate, including Beers  and STOPP . The Canadian Deprescribing Network  and Choosing Wisely Canada  have recommended deprescribing PIPs in older patients. Healthcare providers and researchers have prioritized  and developed deprescribing tools for specific medication classes [22,23,24,25]. These medication classes are proton pump inhibitors (PPIs), sedative-hypnotics, sulfonylureas in older adults, and antipsychotics for indications other than psychosis in older adults.
Legacy prescribing patterns have been shown to contribute to PIPs in cases where patients no longer have the indication for a medication but may continue to receive prescriptions because of clinical inertia [26, 27]. For example, PPIs are often prescribed beyond the recommended short courses of treatment, with no defined benefit to patients and at significant cost and potential for harm (pneumonia, hip fractures, diarrhea), especially in elders . Other medications are contra-indicated; these include benzodiazepines and other sedative-hypnotics used in the treatment of insomnia, which increase the risk of falls, confusion, and hospital admissions [19, 28, 29]; sulfonylureas, which have an increased risk of hypoglycemia in older adults compared to other antihyperglycemic medication classes ; and antipsychotics, which increase the risk of stroke and mortality in older adults [30, 31].
“Deprescribing” is the planned and supervised dose reduction or stopping of medication which may be causing harm or no longer be of benefit . There is increasing awareness of the importance of deprescribing in the management of complex patients: several trials and systematic reviews have shown that structured deprescribing is a promising approach to reducing PIPs, including PPIs, benzodiazepines, and sulfonylureas [33, 34,35,36,37]. Reviews have also reported some reductions in mortality  and improvement in quality of life .
Tools and processes for deprescribing
Deprescribing is a complex process [40, 41]. Evidence-based guidelines and tools have been created to assist healthcare providers and patients in the deprescribing process [22,23,24,25, 42]. Randomized controlled trials (RCTs) have shown that an interprofessional approach, including evaluation by a pharmacist, has improved the appropriateness of medications [43, 44]. The use of benzodiazepines in elders has been reduced through direct education . Patient involvement in a shared decision-making process is essential  and is likely to enhance the impact on survival . Communication between the clinician and the patient should evolve from discussions about compliance to dialogs focusing on ensuring that risks and benefit are appropriately communicated and that the patient’s decisions are aligned with their care goals [45, 46]. Involving a pharmacist in the process improves effectiveness and increases patient empowerment and understanding [37, 47]. Appropriately informed community-dwelling seniors in Canada have expressed a preference for reducing the number of medications they take [48, 49]. Finally, effective communication with clinicians outside of primary care will be important to ensure that patients do not get confusing or contradictory messages about their medications from different providers .
Thus, a persistently complex population can be readily identified for PCPs; target medication classes and evidence-based deprescribing tools exist to improve care for that population. The next step is to devise implementation strategies focused on deprescribing PIPs for our target population.
Implementation and change strategies
Our implementation strategy, the Structured Process Informed by Data, Evidence and Research (SPIDER), has been designed to help primary care practices optimize their management of patients with complex care needs by combining several evidence-based methods and leveraging existing quality improvement (QI) capacity, partnerships in primary care, and electronic medical record (EMR) evaluation capacity.
Quality improvement methods
An important area of practice transformation is systematic improvement in the quality of patient care [50, 51]. The QI Model for Improvement emphasizes a structured approach: define goals, decide on and implement the changes needed, and measure outcomes . QI focuses on rapid-cycle tests of change in a local context while also emphasizing sustainability and spread of effective change within and across healthcare systems [53, 54]. Several Canadian provinces are training healthcare professionals in QI methods to address health quality gaps [55, 56].
The Institute for Healthcare Improvement Breakthrough Series model
There is a vast literature that explains why changes, including QI efforts, succeed or fail [57,58,59,60,61,62]. Common reasons for failure include lack of focus, negative emotions as the project rolls out, lack of influence of the QI team, uncommitted leadership, and lack of cooperation between key stakeholders .
We address these challenges with a network of QI Collaboratives that builds on the Institute for Healthcare Improvement (IHI) Breakthrough Series model . The IHI model has four steps : bringing together practices committed to QI to identify a care gap that they agree to be a priority , engaging content experts and developing a learning information package that highlights the importance of the care gap and the opportunities for change , conducting a learning session during which the practices learn about the challenges and select the change(s) best suited for their context, and  implementing the selected changes with ongoing Plan-Do-Study-Act (PDSA) cycles and regular communication. Additional file 1 provides more details about the model. The four steps are a core feature of the SPIDER intervention; they can be adapted to fit each region’s context and resources.
Audit and feedback
Audit (measuring quality of care and comparing this against agreed-upon standards of practice) and feedback (delivery of the results to healthcare professionals and/or administrators) allows practices to establish priorities for their population [65,66,67]. High-performing health systems tend to feature audit and feedback (A&F) [65, 68] as an evidence-based, scalable, and relatively inexpensive strategy to encourage uptake of best practices. We intend to use best practices in A&F as defined in the literature .
An example of practice feedback is provided in Additional file 2.
Practice coaching (which has also been called practice facilitation) is an essential element of QI efforts; without it, practice members are less likely to adopt the changes required to optimize care delivery [69,70,71,72]. A recent systematic review found that coaching was effective for QI . Coaches bring knowledge about change management and can assist practices to make the desired changes; they help practices develop skills and organize their approach to QI, provide QI tools and expertise, and help to troubleshoot challenges or barriers . Tailoring to the context and focusing on the processes and organization of care are more important than content knowledge . The greater the support provided by practice coaches, the larger the care improvements . Quebec and Ontario have recognized the importance of practice facilitators or coaches, and are supporting their implementation across their regions [73,74,75].
The enhanced Learning Collaborative
SPIDER combines the IHI Learning Collaborative with additional elements, including EMR data for audit and feedback and practice coaching. Figure 1 outlines a Plan-Do-Study-Act cycle supported by SPIDER.
Feasibility assessment: current infrastructure
Regional Practice Based Research Networks
Practice transformation through enhancement of communication and collaboration within and across practice teams requires deep knowledge about primary care in each context. Regional Practice Based Research Networks (PBRNs) designed to facilitate communication, collaboration, and support for innovations already exist in Canadian primary care [76, 77]. A key activity for these regional networks is to improve the quality of care delivered in the member practices. The PBRN movement is growing internationally [78, 79], and the networks are conducting an increasing number of projects in primary care . The College of Family Physicians of Canada, as part of its Blueprint for Family Medicine Research Success, is committed to “support[ing] the development and growth of primary care practice-based research networks” . PBRNs collaborate across Canada and the USA, enabling studies across multiple jurisdictions [81,82,83].
Collaboration between QI and research
The traditional distinctions between research and QI in academic centers have sometimes been barriers to conducting collaborative projects , but the need for their intersection is greater than ever. This study deliberately spans boundaries between the two approaches. We aim to leverage relationships that already exist at the local and regional level between practice opinion leaders, PBRNs, QI experts, and researchers to strengthen local and regional efforts. Practice coaches supporting practices will meet periodically to discuss issues encountered in implementation and solve the problems; modifications will be made as barriers and early, emerging local data and feasibility issues are encountered.
SPIDER combines QI and research in each region. It leverages EMR data in each PBRN for QI activities while building capacity for QI for family physicians and primary care teams affiliated with their Department of Family Medicine in each region.
Availability of validated EMR data
Validated, comparable data is essential to drive QI efforts. It allows practices to identify their performance gaps, compare their performance with external benchmarks such as regional or national averages, set and track care improvement goals, and inform PDSA cycles, the foundational process of QI efforts. Most Canadian PBRNs (including all PBRNs participating in this study) are members of the Canadian Primary Care Sentinel Surveillance Network (CPCSSN) . CPCSSN is a national multi-PBRN organization that works with over 1200 family physicians and nurse practitioners. De-identified patient information is extracted from the EMR systems of multiple vendors, cleaned and standardized by CPCSSN member networks, providing it for research and QI [84, 85]. Data can also be returned to providers, making it accessible to primary care teams . Data returned to practices can be re-identified at the site of care, so that lists of patients to be invited for QI or research can be generated for the practices where these patients receive care [86, 87]. CPCSSN’s database contains the de-identified medical records of nearly 1.8 million patients from primary care clinics affiliated with 12 PBRNs across Canada [77, 85], including the seven participating in SPIDER. CPCSSN has research ethics approvals from all of its sites and from Health Canada to conduct its work .
All CPCSSN PBRN members have an existing ethics approval that allows de-identified patient data to be used for research.
Adaptation, sustainability, and spread
“Reinvention” is the extent to which an intervention can be modified to fit the organization and local context as it is implemented [57, 62]. Interventions that cannot be modified or reinvented to fit context are less likely to be implemented .
There will likely be co-evolution (adaptation of the intervention as well as adaptation of the team) during implementation of changes . A study of the implementation of quality standards in business organizations found that improvements in performance were correlated with both successful reinvention of the innovation and the ability of the organization to transform itself to take advantage of the innovation .
Because of this complexity, some aspects of implementation will always be unpredictable and will depend on local context. Therefore, providing core specifications, while at the same time outlining adaptable elements and building capacity for reinvention by practices, are fundamental components of SPIDER .
Sustainability and spread
Successful changes are vulnerable to challenges of spread and sustainability. Fewer than 40% of initiatives to improve health care move from the pilot project stage to sustained implementation that spreads to more than one area of an organization, much less outside that organization . Medical Associations have called for coordinated efforts to strengthen primary care’s ability to spread QI activities responsive to local needs [93, 94].
SPIDER offers a strategy to support practices as they address regional priorities by allowing implementation to be adapted to the local context; individual practice changes can be tailored to the specific profile of practice members. Sustainability is enhanced through establishing changes that are acceptable to the practice members, have a manageable degree of disruption on every day functioning, and can be embedded in daily practice . Spread needs to be informed by experience across various regions. The intervention must have enough reproducible elements to enable replication in additional settings yet be sufficiently adaptable for each context.
The primary objective of this study is to evaluate the impact of the SPIDER model compared to usual care in the management of PIPs across the quadruple aim: health, care experience, value, and care provider work experience [96, 97]. We are not aware of large-scale projects or activities targeting the population of interest for SPIDER in the Canadian context.
The primary study outcome is to determine whether the SPIDER model reduces PIPs for patients aged 65 and older with polypharmacy, when compared to usual care. Secondary outcomes include assessing SPIDER’s effect on patient health-related quality of life, costs, and provider experience.
The study has two phases: feasibility and randomized controlled trial (RCT).
The feasibility of SPIDER will be studied in three Canadian regions (Toronto, Edmonton, and Montreal) using a single-arm, prospective, explanatory mixed methods approach. We will then adapt and apply what we learn from the first phase to a pragmatic cluster RCT  with two parallel arms (usual care control, intervention) involving five Canadian regions (Winnipeg, Halifax, Calgary, Ottawa, and Montreal). The pragmatic design (minimal patient selection criteria and tailoring of the intervention to the practice setting) enhances generalizability to other patients in diverse primary care practices. As such, the study will investigate the “real world” impact of the intervention and enhance its generalizability [99, 100]. The trial is designed to test for superiority of the SPIDER approach. Randomization will be stratified by region, with a 1:1 allocation.
We will use an open cohort design where patients identified as belonging to the target population at baseline are followed prospectively over time, regardless of the number of medications prescribed in these subsequent periods. New patients meeting the inclusion criteria identified during the follow-up periods are entered into the cohort.
Patients will be excluded from the evaluation if their EMR indicates that they are deceased or transferred out of the practice; the date entered in the EMR will be used for exclusion. If at a point in time a member of the cohort is found to have no new prescriptions issued in the EMR in the prior 12 months, that individual will be deemed to be either deceased or transferred out of the practice and will be excluded from the evaluation. At each evaluation period, new individuals meeting the target population profile may enter the cohort.
Seven Canadian Primary Care PBRNs that are members of the CPCSSN across five provinces are involved in the study.
The Canadian healthcare system includes universal coverage for all medically necessary procedures and visits provided by physicians or in hospital under the Canada Health Act . Because health care is largely managed within each province, differences in primary care organizations exist across Canada. These include availability of interprofessional care and differences in physician remuneration and public coverage of medications for individuals age 65 or over.
Practices are eligible if team members provide comprehensive family medicine in an office setting regardless of practice funding model (fee for service, capitation, or salaried) or team composition and have at least one provider consenting to participate. PCPs (family physicians or nurse practitioners) are required to offer comprehensive primary care services to community members, contribute EMR data to CPCSSN, and allow the research team to survey and/or interview selected patients from their practice. The target patient population consists of individuals ≥ 65 years of age receiving care from a participating provider, with more than one office visit during the past 2 years, and had received ≥ 10 different prescription medications in the past year as indicated in the EMR.
Practices randomized to the intervention will identify one practice champion and a team of practice administrator(s) and clinicians to participate in the 12-month Collaborative and Structured Process described earlier (see “Implementation and change strategies” section). Practices are encouraged to engage their practice pharmacist, where one is available, or a community pharmacist in the initiative.
We will generate a list of anonymized patient codes identifying patients meeting the eligibility criteria for each provider which can be re-identified at the clinical site. Medications in CPCSSN are coded using the Word Health Organization’s Anatomical-Therapeutic-Chemical (ATC) classification . ATC codes used to determine PIP classes in this study are shown in Additional file 3. Each regional PBRN will generate the list using the same algorithms and will provide the information to participants.
Practices participating in the intervention will form a Learning Collaborative for each region. The elements that can be adapted are the setting for the learning sessions (single day vs two half days for the initial session; in person vs virtual to reflect geography and availability of healthcare providers), composition of healthcare team members to reflect local context, and the extent of availability of practice coaches to reflect funding for QI in each region.
We will evaluate the feasibility of the SPIDER approach across eight dimensions: acceptability to stakeholders, demand, implementation, adaptation, integration, practicality, and efficacy of the SPIDER model [105, 109, 110], as well as evaluating participation and approaches to outcome measurement (see Table 1).
Randomized control trial phase
This phase of the study evaluates the impact of the SPIDER model across the quadruple aim. A summary of all outcome measures is shown in Table 2.
Potentially inappropriate prescriptions
A PIP is defined as at least one prescription in a class of interest during the period being measured (see Additional file 3). Each class is counted once only during each 12-month period. An individual may therefore only contribute up to 4 PIPs in any one period.
We will also ascertain the prevalence of patients 65 years or older with at least ten unique prescriptions and at least one PIP, the prevalence of each individual PIP class, and the prevalence of patients with each individual PIP class.
A 10% random sample of the patients identified at baseline as having PIPs will be invited to participate in a survey about their medication (both arms) and potentially an interview (intervention arm) to explore elements identified in previous qualitative research as pertinent [41, 106,107,108].
We will measure patient experience using the Veterans Affairs multidimensional survey capturing five dimensions related to polypharmacy and deprescribing .
We have adapted existing tools to survey providers about their experience in the Collaborative , and their experience and confidence in deprescribing PIPs [113, 115, 116]. We will conduct PCP focus groups in each region to explore the following: experience in the SPIDER Collaborative, appropriateness of guidelines provided, time required and burden, communication and shared decisions with patients and other providers, and confidence in deprescribing.
We will conduct a cost-benefit analysis. We will capture the costs delivering the enhanced QI program (materials, management costs for the program, EMR data extraction and analysis), practice facilitation for the intervention arm, and the overall healthcare costs incurred in the 24 months post-intervention using a previously validated person-centered costing methodology [117, 118].
We will also conduct focus groups with policy makers to understand their views of this approach and how policies could support integration of similar initiatives into primary care.
We will use the Consolidated Framework for Implementation Research (CFIR) to evaluate the implementation of SPIDER . The evaluation will include information about the adaptable elements in each region: types of sessions in the Learning Collaborative (in person, online), availability of interprofessional team members including pharmacists, and extent of availability of practice coaches.
An overview of the schedule of enrollment, randomization, interventions, and assessments for the RCT is provided in Fig. 2. The feasibility phase is similar; there is no allocation (single arm), and an assessment of processes and feasibility will occur during and shortly after the intervention. The intervention will begin after allocation, with a workshop, provision of feedback, and introduction of coaches. The Learning Collaborative lasts about 12 months; three additional months have been allocated to account for local context, such as booking room or conducting two separate half day workshops. Periodic Learning sessions will occur during the Learning Collaborative; communication will occur using email or webinars.
Interview focus groups and surveys will be conducted shortly after the end of the Collaborative.
EMR-based outcome data will be extracted for the year prior to the intervention and for the year after the intervention.
Sample size calculation
Preliminary analyses conducted on 86 practice sites of the University of Toronto PBRN (UTOPIAN) involving 334 PCPs found the following : an average of 24 patients per PCP had ≥ 10 unique prescriptions in the past year ; the prevalence of PIPs in this patient population was PPI 58.1%, benzodiazepine 33.0%, hypoglycemics 1.2%, and antipsychotics 6.9% ; 73.1% of patients had ≥ 1 PIP (composite prescription rate) ; the mean number of PIPs was 0.987 per patient (standard deviation 0.748); and  the intra-cluster (practice) correlation (ICC) was 0.017 using the composite prescription rate as the primary endpoint.
We will recruit about eight practices in each of the three PBRNs participating in the feasibility phase of this study, allowing us to understand various facets of implementing the approach in three geographical regions. The recruitment in the feasibility phase will inform how the approach might need to be tailored to optimize its implementation in the RCT phase.
For the RCT portion, assuming a conservative ICC of 0.05 and two participating providers per practice site (46 patients), 28 practices in each arm are required to detect a mean difference of 15% (from 0.987 to 0.837) in PIPs, allowing for α = 0.05 and β = 20%. We will recruit 14 practice sites per region (total 70) to allow for attrition. The unit of randomization will be the primary care practice, and analyses will be conducted at the patient level.
Each PCP must provide written informed consent to be included in the SPIDER trial; consent must be obtained prior to randomization for the cluster RCT.
The leads of the seven PBRNs participating in this study (each is a principal investigator on this study) will recruit the required number of practices for this study. As part of their infrastructure, PBRNs hold regular meetings and communicate with members .
We will use purposeful sampling to invite participants (family physicians, interprofessional team members, staff members) in each center to participate in focus groups. We will aim to get maximum variation across profession, sex, within each region.
Allocation and concealment
Allocation is conducted at the practice site level.
Allocation to either intervention or usual care control will be 1:1, stratified by region and using a computer-generated central randomization schedule. A senior statistician at the Department of Family and Community Medicine, University of Toronto, will oversee the generation of the allocation sequence. Concealment will be maintained by providing the randomized allocation to each region once all practice sites have been recruited for a region.
Blinding of participants is not feasible in pragmatic trials of QI interventions in primary care . The identification of PIPs and medication count (at baseline and end of study) will take place centrally by a data manager blinded to the arm attribution to avoid potential biases in cases where ambiguity about the presence of the drug requires their assessment of additional patient data. Similarly, data cleaning and imputation will be performed centrally by a staff member blinded to the arm attribution.
All physicians participating in the RCT are required to be existing members of the CPCSSN initiative and would therefore have already contributed de-identified EMR data to regional network repositories. The method of EMR data extraction and the approach to processing the data (coding and standardizing) have been previously described . CPCSSN has experience obtaining data elements required for this initiative [77, 85, 122] and generating lists of prescribed medication by time period, including attribution to the class of drug [123,124,125]. We will therefore be using EMR data routinely collected in primary care and managed by the PBRNs affiliated with CPCSSN for the primary study outcome.
A survey for patients with PIPs will be delivered to patients of study participants in both arms by a research staff member at 12 months.
A short survey will be administered at baseline to both arms asking PCPs and their staff about their practices. PCPs and staff of practices participating in each Collaborative (intervention arm) will be asked to complete an online survey about their experience with the SPIDER process and its impact on their ability to care for patients with complex needs at 12 months after baseline. Interviews of patients and focus groups with providers and policy makers will be conducted only for the intervention arm at 12 months. These will be audiotaped and transcribed verbatim.
Descriptive statistics will be used to provide information about physician and patient characteristics, participation rates, polypharmacy, and PIPs. The analysis will be on an intention to treat basis; it will therefore include physicians who have agreed to participate but discontinue their engagement at any point during the study. Outcomes are measured at the patient level; we will use hierarchical modeling with random effect variables and/or generalized estimating equations to account for clustering; intra-cluster correlation coefficients will also be reported. All patients of participating physicians who had been identified at baseline as eligible, regardless of whether they had a PIP at baseline or not will be included in the analysis. The number of PIPs prescribed per patient in the control and intervention arms over a 12-month period following the intervention in each regional network will be compared. A framework of analysis of covariance  will be used to adjust for potential confounders such as age, sex, comorbidity, and outcomes.
This study enables the identification of persistently complex patients, elders living with polypharmacy, for their family physicians and primary care teams. The QI intervention uses evidence-based tools and processes to deprescribe medications that have been identified as being potentially inappropriate by highly credible national organizations. It leverages relationships between clinicians, patients, QI experts, and researchers to implement an intervention with multiple evidence-based components, adapt it to multiple settings, and measure its effects. It uses comparable, validated EMR data for patient identification, recruitment, and outcome measurement.
A strength of the study is the identification of patients living with persistent care complexity in primary care in a way that can be actioned by physicians and their care teams. The focus is not on any single disease. As well, the design is pragmatic, reflecting usual care and patients followed in primary care practices, rather than highly selected populations, allowing greater external validity. The intervention chosen for this project uses QI principles and is led and managed by experts in QI. It reflects the principles of a Learning Healthcare System, where “science, informatics, incentives and culture are aligned for continuous improvement and innovation, with best practices seamlessly embedded in the delivery process and new knowledge captured as an integral by-product of the delivery experience.” .
There are several limitations to this approach. Data may not be captured completely in EMRs; however, we do not expect any a priori differences between practices randomized to intervention vs usual care control with respect to data entry processes. The sample represents primary care practices that contributed EMR data to CPCSSN, rather than a random sample from the population of all primary care practices. Physicians participating in CPCSSN are slightly younger and more likely to be female compared to the population of physicians who have responded to the National Physician Survey .
EMR data entry on patient status may not be timely or completely accurate; it is possible that some patients are no longer in a practice due to admission in long-term care facilities and transfer to another physician or death and that change in status has not been recorded. Physicians in the intervention arm receive data on patients with polypharmacy and may be prompted to review and clean data on patient status, leading to an imbalance between the two arms. To address this, we will ascertain eligible populations in both arms prior to intervention, carry forward all patients initially identified, and limit eligible populations to those with at least one prescription in the EMR during the 12 months following the intervention period.
EMR data for audit and feedback provided through SPIDER incurs delays related to data acquisition and processing. Typically, data reflects care that occurred between 3 and 6 months prior to feedback. The delay is not ideal for feedback, which needs to be timely . CPCSSN data is collected once every 3 months; monthly run charts are preferred for QI. To address this, teams will use their own EMR data for internal rapid-cycle testing and changes. CPCSSN data are provided at the outset and periodically for external comparisons.
We are deliberately allowing local adaptation so that the intervention is applicable to multiple settings and contexts. This improves external validity while adding challenges to intervention fidelity. We are addressing this by testing the intervention in three different regions (Toronto, Edmonton, and Montreal) as part of a feasibility phase, prior to the RCT. This will allow us to test feasibility of fidelity to “core” elements and study implementation of “adaptable” elements.
We have defined core elements for the SPIDER intervention as consisting of a Learning Collaborative, practice coaches, and audit and feedback using validated EMR data. The design does not allow us to determine which of these aspects is effective; each has prior evidence of effectiveness, and we are measuring the cumulative effect of the combined elements. We are allowing flexibility in implementing the IHI model for the Learning Collaborative as appropriate for each context, provided the IHI’s four steps are followed.
If successful, this trial will provide broadly generalizable evidence that the multi-pronged SPIDER intervention improves care for elders living with polypharmacy by reducing PIPs. Should SPIDER be successful for this population with complex care needs, the approach could be replicated to improve care for a variety of issues facing patients, their physicians, and their primary care teams and organizations. Policy makers could consider whether the elements included in SPIDER (Learning Collaboratives, EMR data for audit and feedback, practice coaching) should be supported as part of high functioning healthcare systems.
Audit and feedback
Consolidated Framework for Implementation Research
Canadian Primary Care Sentinel Surveillance Network
Data-driven Quality Improvement
Electronic medical record
Intra-cluster correlation coefficient
Institute for Healthcare Improvement
Organizational Readiness to Change Assessment
Practice Based Research Networks
Primary care provider
Potentially inappropriate prescriptions
Proton pump inhibitors
Randomized controlled trial
Structured Process Informed by Data, Evidence and Research
University of Toronto Practice-Based Research Network
Udow-Phillips M, Ehrlich E, Kofke-Egger H. Health care cost drivers: chronic disease, comorbidity, and health risk factors in the U.S. and Michigan | Center for Healthcare Research & Transformation. Ann Arbor: Center for Healthcare Research and Transformation; 2010.
Moturu S, Johnson W, Liu H. Predictive risk modelling for forecasting high-cost patients: a real-world application using Medicaid data. Int J Biomed Eng Technol. 2010;3(1–2):114–32.
Berk ML, Monheit AC, Hagan MM. How the U.S. spent its health care dollar: 1929-1980. Health Aff (Millwood). 1988;7(4):46–60.
Berk ML, Monheit AC. The concentration of health expenditures: an update. Health Aff (Millwood). 1992;11(4):145–9.
Berk ML, Monheit AC. The concentration of health care expenditures, revisited. Health Aff (Millwood). 2001;20(2):9–18.
Wodchis W, Austin P, Newman A, Carollo A, Henry D. The concentration of health care spending: little ado (yet) about much (money). https://www.cahspr.ca/en/presentation/5244423937dee8014beea024. Published 2012. Accessed September 1, 2017.
Riley GF. Long-term trends in the concentration of Medicare spending. Health affairs (Project Hope). 2007;26(3):808–16.
Tricco AC, Antony J, Ivers NM, et al. Effectiveness of quality improvement strategies for coordination of care to reduce use of health care services: a systematic review and meta-analysis. CMAJ. 2014;186(15):E568–78.
Gill A, Kuluski K, Jaakkimainen L, Naganathan G, Upshur R, Wodchis WP. “Where do we go from here?” health system frustrations expressed by patients with multimorbidity, their caregivers and family physicians. Healthc Policy. 2014;9(4):73–89.
Hong CS, Siegel AL, Ferris TG. Caring for high-need, high-cost patients: what makes for a successful care management program? Issue brief (Commonwealth Fund), vol. 19; 2014. p. 1–19.
Guilcher SJ, Bronskill SE, Guan J, Wodchis WP. Who are the high-cost users? A method for person-centred attribution of health care spending. PLoS One. 2016;11(3):e0149179.
Tanuseputro P, Wodchis WP, Fowler R, et al. The health care cost of dying: a population-based retrospective cohort study of the last year of life in Ontario, Canada. PLoS One. 2015;10(3):e0121759.
Counsell SR, Callahan CM, Buttar AB, Clark DO, Frank KI. Geriatric Resources for Assessment and Care of Elders (GRACE): a new model of primary care for low-income seniors. J Am Geriatr Soc. 2006;54(7):1136–41.
Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials. JAMA. 2009;301(6):603–18.
Blumenthal D, Chernof B, Fulmer T, Lumpkin J, Selberg J. Caring for high-need, high-cost patients - an urgent priority. N Engl J Med. 2016;375(10):909–11.
Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci. 2016;11:72.
Potentially harmful drugs in the elderly: beers list. https://pharmacist.therapeuticresearch.com/Content/Segments/PRL/2015/Dec/Potentially-Harmful-Drugs-in-the-Elderly-Beers-List-9170. Published 2015. Accessed.
O'Mahony D, O'Sullivan D, Byrne S, O'Connor MN, Ryan C, Gallagher P. STOPP/START criteria for potentially inappropriate prescribing in older people: version 2. Age Ageing. 2015;44(2):213–8.
Tannenbaum C, Farrell B, Shaw J, et al. An ecological approach to reducing potentially inappropriate medication use: Canadian deprescribing network. Can J Aging = La revue canadienne du vieillissement. 2017;36(1):97–107.
Choosing Wisely Canada Geriatrics. @ChooseWiselyCA. https://choosingwiselycanada.org/geriatrics/. Published 2017. Accessed.
Farrell B, Tsang C, Raman-Wilms L, Irving H, Conklin J, Pottie K. What are priorities for deprescribing for elderly patients? Capturing the voice of practitioners: a modified delphi process. PLoS One. 2015;10(4):e0122246.
Farrell B, Pottie K, Thompson W, et al. Deprescribing proton pump inhibitors: evidence-based clinical practice guideline. Can Fam Physician. 2017;63(5):354.
Farrell B, Black C, Thompson W, et al. Deprescribing antihyperglycemic agents in older persons: evidence-based clinical practice guideline. Can Fam Physician. 2017;63(11):832–43.
Bjerre LM, Farrell B, Hogel M, et al. Deprescribing antipsychotics for behavioural and psychological symptoms of dementia and insomnia: evidence-based clinical practice guideline. Can Fam Physician. 2018;64(1):17–27.
Pottie K, Thompson W, Davies S, et al. Deprescribing benzodiazepine receptor agonists: evidence-based clinical practice guideline. Can Fam Physician. 2018;64(5):339–51.
Pollock K, Grime J. The cost and cost-effectiveness of PPIs--GP perspectives and responses to a prescribing dilemma and their implications for the development of patient-centred healthcare. Eur J Gen Pract. 2003;9(4):126–133, 140.
Mangin D, Lawson J, Cuppage J, et al. Legacy drug-prescribing patterns in primary care. Ann Fam Med. 2018;16(6):515–20.
Hogan DB, Maxwell CJ, Fung TS, Ebly EM. Prevalence and potential consequences of benzodiazepine use in senior citizens: results from the Canadian Study of Health and Aging. Can J Clin Pharmacol. 2003;10(2):72–7.
Beers Criteria Medication List - DCRI. https://dcri.org/beers-criteria-medication-list/. Published 2019.
Wang PS, Schneeweiss S, Avorn J, et al. Risk of death in elderly users of conventional vs. atypical antipsychotic medications. N Engl J Med. 2005;353(22):2335–41.
Steinberg M, Lyketsos CG. Atypical antipsychotic use in patients with dementia: managing safety concerns. Am J Psychiatry. 2012;169(9):900–6.
Reeve E, Gnjidic D, Long J, Hilmer S. A systematic review of the emerging definition of ‘deprescribing’ with network analysis: implications for future research and clinical practice. Br J Clin Pharmacol. 2015;80(6):1254–68.
Reeve E, Ong M, Wu A, Jansen J, Petrovic M, Gnjidic D. A systematic review of interventions to deprescribe benzodiazepines and other hypnotics among older people. Eur J Clin Pharmacol. 2017;73(8):927–35.
Tannenbaum C, Martin P, Tamblyn R, Benedetti A, Ahmed S. Reduction of inappropriate benzodiazepine prescriptions among older adults through direct patient education: the EMPOWER cluster randomized trial. JAMA Intern Med. 2014;174(6):890–8.
Garfinkel D, Ilhan B, Bahat G. Routine deprescribing of chronic medications to combat polypharmacy. Therapeutic advances in drug safety. 2015;6(6):212–33.
Thompson W, Hogel M, Li Y, et al. Effect of a proton pump inhibitor deprescribing guideline on drug usage and costs in long-term care. J Am Med Dir Assoc. 2016;17(7):673.e671–4.
Martin P, Tamblyn R, Benedetti A, Ahmed S, Tannenbaum C. Effect of a pharmacist-led educational intervention on inappropriate medication prescriptions in older adults: the D-PRESCRIBE randomized clinical trial. Jama. 2018;320(18):1889–98.
Page AT, Clifford RM, Potter K, Schwartz D, Etherton-Beer CD. The feasibility and effect of deprescribing in older adults on mortality and health: a systematic review and meta-analysis. Br J Clin Pharmacol. 2016;82(3):583–623.
Iyer S, Naganathan V, McLachlan AJ, Le Couteur DG. Medication withdrawal trials in people aged 65 years and older: a systematic review. Drugs Aging. 2008;25(12):1021–31.
Reeve E, Shakib S, Hendrix I, Roberts MS, Wiese MD. Review of deprescribing processes and development of an evidence-based, patient-centred deprescribing process. Br J Clin Pharmacol. 2014;78(4):738–47.
Jansen J, Naganathan V, Carter SM, et al. Too much medicine in older people? Deprescribing through shared decision making. BMJ. 2016;353:i2893.
Reeve E, Farrell B, Thompson W, et al. Evidence-based clinical practice guideline for deprescribing cholinesterase inhibitors and memantine. Sydney: University of Sideney; 2018.
Schmader KE, Hanlon JT, Pieper CF, et al. Effects of geriatric evaluation and management on adverse drug reactions and suboptimal prescribing in the frail elderly. Am J Med. 2004;116(6):394–401.
Spinewine A, Swine C, Dhillon S, et al. Effect of a collaborative approach on the quality of prescribing for geriatric inpatients: a randomized, controlled trial. J Am Geriatr Soc. 2007;55(5):658–65.
Herxheimer A, McGettigan P. Problems of polypharmacy. BMJ. 2013;347:f7500.
Frank C, Weir E. Deprescribing for older patients. Cmaj. 2014;186(18):1369–76.
Lenander C, Elfsson B, Danielsson B, Midlov P, Hasselstrom J. Effects of a pharmacist-led structured medication review in primary care on drug-related problems and hospital admission rates: a randomized controlled trial. Scand J Prim Health Care. 2014;32(4):180–6.
Bokhof B, Junius-Walker U. Reducing polypharmacy from the perspectives of general practitioners and older patients: a synthesis of qualitative studies. Drugs Aging. 2016;33(4):249–66.
Sirois C, Ouellet N, Reeve E. Community-dwelling older people’s attitudes towards deprescribing in Canada. Res Social Adm Pharm. 2017;13(4):864–70.
The patient-centered medical home (PCMH). 2017.
Crossing the quality chasm: a new health system for the 21st century. Washington, D.C.: Institute of Medicine; 2001.
Institute for Healthcare Improvement: science of improvement. http://www.ihi.org/about/pages/scienceofimprovement.aspx. Published 2017. Accessed.
Better has no limit: partnering for a quality health sytem, a three year strategic plan 2016–2019. Toronto: Health Quality Ontario;2016.
Quality and Innovation. http://www.dfcm.utoronto.ca/landing-page/quality-innovation. Published 2017. Accessed.
IDEAS - Improving & Driving Excellence Across Sectors. https://www.ideasontario.ca/. Published 2017. Accessed.
Toward Optimized Practice (TOP) - quality improvement programs. http://www.topalbertadoctors.org/programs%2D%2Dservices/qualityimprovementprograms/. Published 2017. Accessed.
Rogers E. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.
Denis JL, Hebert Y, Langley A, Lozeau D, Trottier LH. Explaining diffusion patterns for complex health care innovations. Health Care Manag Rev. 2002;27(3):60–73.
Berwick DM. Disseminating innovations in health care. Jama. 2003;289(15):1969–75.
Casalino L, Gillies RR, Shortell SM, et al. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. Jama. 2003;289(4):434–41.
Lemieux-Charles L, Barnsley J. An innovation diffusion perspective on knowledge and evidence in health care. In: Lemieux-Charles L, Champagne F, editors. Using knowledge and evidence in health care: multidisciplinary perspectives. Toronto: University of Toronto Press; 2004.
Greenhalgh T, Glenn R, Bate P, Macfarlane F, Kyriakidou O. Diffusion of innovations in health services organizations. Malden: Blackwell publishing Ltd; 2005.
O'Neill S. How do quality improvement interventions succeed? Archetypes of success and failure. RAND Graduate School: Santa Monica; 2011.
Institute for Healthcare Improvement: The breakthrough series: IHI’s collaborative model for achieving breakthrough improvement. 2003.
Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259.
Locke EA, Latham GP. Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. Am Psychol. 2002;57(9):705–17.
Carver CS, Scheier MF. Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull. 1982;92(1):111–35.
Brehaut JC, Colquhoun HL, Eva KW, et al. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016.
Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.
Kotecha J, Han H, Green M, Russell G, Martin MI, Birtwhistle R. The role of the practice facilitators in Ontario primary healthcare quality improvement. BMC Fam Pract. 2015;16(1):93.
Baskerville NB, Hogg W, Lemelin J. Process evaluation of a tailored multifaceted approach to changing family physician practice patterns improving preventive care. J Fam Pract. 2001;50(3):W242–9.
Institute for healthcare improvement: A framework to guide practice facilitators in building capacity. http://www.ihi.org/resources/Pages/Publications/Framework-Guide-Practice-Facilitators-in-Building-Improvement-Capacity.aspx. Published 2017. Accessed.
Recommendations on the optimal configuration of the Quality Improvement and Decision Support Specialist (QIDSS) role. Association of Family Health Teams of Ontario. http://www.afhto.ca/wp-content/uploads/QIDSS-recommendations-2013-01-31.pdf. Published 2013. Accessed November 26, 2014.
What is a quality improvement decision support specialist (QIDSS)? | afhto. https://www.afhto.ca/news-events/news/what-quality-improvement-decision-support-specialist-qidss. Published 2016. Accessed.
Amelioration continue de la qualite | Reseau-1. http://reseau1quebec.ca/recherche-et-ressources/amelioration-continue-de-la-qualite/. Published 2017. Accessed.
Mold JW, Peterson KA. Primary care practice-based research networks: working at the interface between research and quality improvement. Ann Fam Med. 2005;3(Suppl 1):S12–20.
Queenan JA, Williamson T, Khan S, et al. Representativeness of patients and providers in the Canadian primary care sentinel surveillance network: a cross-sectional study. CMAJ open. 2016;4(1):E28–32.
Green LA, Hickner J. A short history of primary care practice-based research networks: from concept to essential research laboratories. J Am Board Fam Med. 2006;19(1):1–10.
Hickner J, Green LA. Practice-based research networks (PBRNs) in the United States: growing and still going after all these years. J Am Board Fam Med. 2015;28(5):541–5.
Tierney WM, Oppenheimer CC, Hudson BL, et al. A national survey of primary care practice-based research networks. Ann Fam Med. 2007;5(3):242–50.
Blueprint for Family Medicine Research success 2012–2017. Toronto, Ontario: College of Family Physicians of Canada;2012.
Pribramska I. Environmental scan and scoping review to inform a Research and Data Active Initiative for the College of Family Physicians of Canada. Toronto: College of Family Physicians of Canada; 2017.
PCORI: A cluster-randomized trial comparing team-based versus primary care clinician-focused advance care planning in practice-based research networks. https://www.pcori.org/research-results/2017/cluster-randomized-trial-comparing-team-based-versus-primary-care-clinician. Published 2017. Updated 2017-08-10. Accessed.
Primary health care intelligence. 2013 progress report of the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Kingston: Queen’s University; 2013.
Garies S, Birtwhistle R, Drummond N, Queenan J, Williamson T. Data resource profile: national electronic medical record data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Int J Epidemiol. 2017;46(4):1091–1092f.
Greiver M, Wintemute K, Aliarzadeh B, et al. Implementation of data management and effect on chronic disease coding in a primary care organisation: a parallel cohort observational study. J Innov Health Informatics. 2016;23(3):843.
Greiver M, Martin K, Aliarzadeh B, Lambert-Lanning A, Leggett J. Implementing a scalable tool for quality improvement in primary care: a report for Canada Health Infoway. Toronto: Canadian Primary Care Sentinel Surveillance Network; 2013.
Kotecha JA, Manca D, Lambert-Lanning A, et al. Ethics and privacy issues of a practice-based surveillance system: need for a national-level institutional research ethics board and consent standards. Canadian family physician Medecin de famille canadien. 2011;57(10):1165–73.
Gustafson DH, Sainfort F, Eichler M, Adams L, Bisognano M, Steudel H. Developing and testing a model to predict outcomes of organizational change. Health Serv Res. 2003;38(2):751–76.
Naveh E, Meilich O, Marcus A. The effects of administrative innovation implementation on performance: an organizational learning approach. Strateg Organ. 2006;4(3):275–302.
Aarts J, Doorewaard H, Berg M. Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center. J Am Med Inform Assoc. 2004;11(3):207–16.
Health Quality Ontario, Spread Primer. In. Toronto, Ontario: Ontario Ministry of Health and Long Term Care Queen’s printer for Ontario; 2013.
Advancing Practice Improvement in Primary Care, Final Report. Ontario College of Family Physicians Toronto, Ontario 2015.
The Practice Improvement Initiative (Pii) | Research | The College of Family Physicians Canada. College of Family Physicians of Canada. https://www.cfpc.ca/pii/. Published 2019. Accessed February 28, 2019.
Martin GP, Weaver S, Currie G, Finn R, McDonald R. Innovation sustainability in challenging health-care contexts: embedding clinically led change in routine practice. Health Serv Manag Res. 2012;25(4):190–9.
Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573–6.
Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff (Millwood). 2008;27(3):759–69.
Donner A. Some aspects of the design and analysis of cluster randomization trials. Appl Stat. 1998;47:95–113.
Thorpe KE, Zwarenstein M, Oxman AD, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ. 2009;180(10):E47–57.
Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967;20(8):637–48.
Chan AW, Tetzlaff JM, Altman DG, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Hoffmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Romanow R. Building on values: the future of health care in Canada. Ottawa; 2002.
WHO collaborating Centre for drug statistic methodology - ATC/DDD index. https://www.whocc.no/atc_ddd_index/. Published 2017. Accessed.
Bowen DJ, Kreuter M, Spring B, et al. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7.
Linsky A, Simon SR, Stolzmann K, Meterko M. Patient perceptions of deprescribing: survey development and psychometric assessment. Med Care. 2017;55(3):306–13.
Reeve E, To J, Hendrix I, Shakib S, Roberts MS, Wiese MD. Patient barriers to and enablers of deprescribing: a systematic review. Drugs Aging. 2013;30(10):793–807.
Turner JP, Edwards S, Stanners M, Shakib S, Bell JS. What factors are important for deprescribing in Australian long-term care facilities? Perspectives of residents and health professionals. BMJ Open. 2016;6(3):e009781.
Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.
Montiel-Luque A, Nunez-Montenegro AJ, Martin-Aurioles E, Canca-Sanchez JC, Toro-Toro MC, Gonzalez-Correa JA. Medication-related factors associated with health-related quality of life in patients older than 65 years with polypharmacy. PLoS One. 2017;12(2):e0171320.
Devlin NJ, Brooks R. EQ-5D and the EuroQol group: past, present and future. Appl Health Econ Health Policy. 2017;15(2):127–37.
MacCarthy D, Kallstrom L, Kadlec H, Hollander M. Improving primary care in British Columbia, Canada: evaluation of a peer-to-peer continuing education program for family physicians. BMC medical education. 2012;12:110.
Farrell B, Richardson L, Raman-Wilms L, de Launay D, Alsabbagh MW, Conklin J. Self-efficacy for deprescribing: a survey for health care professionals using evidence-based deprescribing guidelines. In: Research in social & administrative pharmacy : RSAP; 2017.
Lagasse R, Desmet M, Jamoulle M, et al. European situation of routine medical data collection and their utilization for health monitoring: Euro-Med-Data final report. Brussels: Universite Libre de Bruxelles; December 2001; 2001.
Anthierens S, Tonkin-Crine S, Cals JW, et al. Clinicians’ views and experiences of interventions to enhance the quality of antibiotic prescribing for acute respiratory tract infections. J Gen Intern Med. 2015;30(4):408–16.
Richards JC, Ryan P, McCabe MP, Groom G, Hickie IB. Barriers to the effective management of depression in general practice. Aust N Z J Psychiatry. 2004;38(10):795–803.
Rosella LC, Fitzpatrick T, Wodchis WP, Calzavara A, Manson H, Goel V. High-cost health care users in Ontario, Canada: demographic, socio-economic, and health status characteristics. BMC Health Serv Res. 2014;14:532.
Wodchis W, Bushmeneva K, Nikitović M, McKillop IH, McKillop E. Guidelines on person-level costing using administrative databases in Ontario. Working Paper Series. 2013;1.
Green LA, White LL, Barry HC, Nease DE Jr, Hudson BL. Infrastructure requirements for practice-based research networks. Ann Fam Med. 2005;3(suppl_1):S5–11.
Godwin M, Ruhland L, Casson I, et al. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003;3:28.
Birtwhistle R, Keshavjee K, Lambert-Lanning A, et al. Building a pan-Canadian primary care sentinel surveillance network: initial development and moving forward. J Am Board Fam Med. 2009;22(4):412–22.
Williamson T, Green ME, Birtwhistle R, et al. Validating the 8 CPCSSN case definitions for chronic disease surveillance in a primary care database of electronic health records. Ann Fam Med. 2014;12(4):367–72.
Coons MJ, Greiver M, Aliarzadeh B, et al. Is glycemia control in Canadians with diabetes individualized? A cross-sectional observational study. BMJ Open Diabetes Res Care. 2017;5(1):e000316.
Morkem R, Williamson T, Patten S, et al. Trends in antidepressant prescribing to children and adolescents in Canadian primary care: a time-series analysis. Pharmacoepidemiol Drug Saf. 2017;26(9):1093–9.
Greiver M, Williamson T, Barber D, et al. Prevalence and epidemiology of diabetes in Canadian primary care practices: a report from the Canadian Primary Care Sentinel Surveillance Network. Can J Diabetes. 2014;38(3):179–85.
Vickers AJ, Altman DG. Analysing controlled trials with baseline and follow up measurements. BMJ. 2001;323(7321):1123–4.
The learning healthcare project. http://www.learninghealthcareproject.org/section/background/learning-healthcare-system. Published 2018. Accessed April 16, 2018.
We are grateful to the physicians and patients who allow data sharing for networks participating in CPCSSN.
This study is supported by a peer-reviewed grant from the Canadian Institutes of Health Research (CIHR).
Matching financial support from collaborating partners including:
Quality and Innovation Program, the Department of Family and Community Medicine, University of Toronto
University of Toronto Practice Based Research Network
North York General Hospital
The College of Family Physicians of Canada
The Department of Family Medicine, Faculty of Medicine, University of Ottawa
The Department of Family Medicine, Faculty of Medicine & Dentistry, University of Alberta
The Department of Family Medicine, Faculty of Medicine, University of Calgary
Manitoba Primary Care Research Network, the Department of Family Medicine, University of Manitoba
The Department of Family Medicine, Max Rady College of Medicine, University of Manitoba
Fonds de recherche du Québec – Santé
Réseau-1 Québec, University of Montreal
Nova Scotia Health Authority
The Department of Family Medicine, Dalhousie University
Vice President Research Office, Dalhousie University
The Department of Community Health & Epidemiology, Dalhousie University
Undergraduate Medical Education, Faculty of Medicine, Dalhousie University
Dalhousie Medical Research Foundation
Doctors Nova Scotia
Dr. Greiver held an investigator award from the Department of Family and Community Medicine, University of Toronto, and was supported by a research stipend from North York General Hospital. She is currently supported through the Gordon F. Cheesbrough Research Chair at North York General Hospital. The Canadian Primary Care Sentinel Surveillance Network was a committee of the College of Family Physicians of Canada and was funded through a contribution agreement with the Public Health Agency of Canada. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada. None of the funding sources had any role in the writing of the manuscript or the decision to submit it for publication. None of the authors received payment to write this article by a pharmaceutical company or other agency.
Availability of data and materials
Data are from a nationally representative Canadian repository of primary care EMR data, the Canadian Primary Care Sentinel Surveillance Network (http://cpcssn.ca). CPCSSN data are available to researchers as outlined in the process available on the website.
Ethics approval and consent to participate
The study has obtained Research Ethics Approval through Clinical Trials Ontario (CTO Project ID: 1559); approval at each regional center will also be sought. The protocol is registered at clinicaltrials.gov (NCT03689049).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Description of the IHI breakthrough series model and SPIDER intervention (DOCX 201 kb)
An example of practice feedback (DOCX 389 kb)
ATC codes used to determine PIP classes in this study (DOCX 22 kb)
EMR data extraction (PDF 553 kb)
About this article
- Inappropriate prescribing
- Primary health care
- Quality improvement
- Electronic health records
- Social facilitation
- Clinical trials, randomized