- Study protocol
- Open Access
- Open Peer Review
A protocol for a pragmatic randomized controlled trial using the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) platform approach to promote person-focused primary healthcare for older adults
Implementation Science volume 11, Article number: 49 (2016)
Healthcare systems are not well designed to help people maintain or improve their health. They are generally not person-focused or well-coordinated. The objective of this study is to evaluate the effectiveness of the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) approach in older adults. The overarching hypothesis is that using the Health TAPESTRY approach to achieve better integration of the health and social care systems into a person’s life that centers on meeting a person’s health goals and needs will result in optimal aging.
This is a 12-month delayed intervention pragmatic randomized controlled trial. The study will be performed in Hamilton, Ontario, Canada in the two-site McMaster Family Health Team. Participants will include 316 patients who are 70 years of age or older. Participants will be randomized to the Health TAPESTRY approach or control group. The Health TAPESTRY approach includes intentional, proactive conversations about a person’s life and health goals and health risks and then initiation of congruent tailored interventions that support achievement of those goals and addressing of risks through (1) trained volunteers visiting clients in their homes to serve as a link between the primary care team and the client; (2) the use of novel technology including a personal health record from the home to link directly with the primary healthcare team; and (3) improved processes for connections, system navigation, and care delivery among interprofessional primary care teams, community service providers, and informal caregivers. The primary outcome will be the goal attainment scaling score. Secondary outcomes include self-efficacy for managing chronic disease, quality of life, the participant perspective on their own aging, social support, access to health services, comprehensiveness of care, patient empowerment, patient-centeredness, caregiver strain, satisfaction with care, healthcare resource utilization, and cost-effectiveness. Implementation processes will also be evaluated. The main comparative analysis will take place at 6 months.
Evidence of the individual elements of the Health TAPESTRY platform has been shown in isolation in the previous research. However, this study will better understand how to best integrate them to maximize the system’s transformation of person-focused, primary care for older adults.
Healthcare systems are not well designed to help people maintain or improve their health. They are generally not well-coordinated and plagued with barriers to a person-focused care system [1, 2]. In Canada, current provincial healthcare systems are confronted with working to overcome disorganized connections among primary, secondary, and community care  and the use of processes that are reactive versus proactive . Further, the current system is challenged by the burden of provider-patient interactions focused on a single disease rather than approaches that account for people who have multiple chronic conditions [4, 5]. Although the field of medicine has evolved over the years to focus on wellness versus illness, much change is still needed to take into account patient goals and preferences . Finally, the system lacks coordinated strategies that address the social determinants of health [3, 7]. Transformational healthcare system change is needed if a person is to truly realize the World Health Organization’s (WHO) definition of health, “a resource for everyday life, not the objective of living; it is a positive concept, emphasizing social and personal resources, as well as physical capacities” .
Countries with a strong emphasis on primary healthcare have realized better health outcomes and health equity [9–11]. Effective primary healthcare is community-based, promotes healthy lifestyles as a pathway to disease prevention, provides ongoing care for chronic conditions, and recognizes the importance of the broad determinants of health . Primary healthcare embraces a wide suite of services and involves a broad range of healthcare providers in a manner that is person-focused and coordinated . It has been identified that integrated care allows a person to plan their care with people who work together to understand them and their caregivers, allow them control, and bring together services to achieve outcomes of importance to them . A strong primary healthcare system also needs to be well integrated with the rest of the healthcare system. The WHO defines integrated care as the bringing together of inputs, delivery, management, and organization of services related to diagnosis, treatment, care, rehabilitation, and health promotion . High-quality integration encompasses better care delivery horizontally through improved interdisciplinary team collaboration and vertically across different levels of care such as in the home, primary, secondary, and tertiary care . Taking into account complexity theory concepts when considering effective healthcare delivery also recognizes that delivery of healthcare itself is a complex adaptive system and, as such, changes according to current demands [16, 17]. Therefore, improving primary healthcare requires the many components of the healthcare system to undergo whole-scale transformational system change and to do so in a manner that produces person-focused coordinated care.
Individuals ≥65 years are the fastest growing age group in Canada. This age segment in July 2015, for the first time ever, outnumbered people aged ≤15 years [18-21]. Worldwide, the number of people over the age of 60 is expected to double by 2050 [19, 20]. If no improvements are made to the current healthcare system, greater numbers of people will have unmet healthcare needs that will hinder healthy aging [20, 21]. Many older adults report being in excellent or very good health and are able to carry on daily activities on their own ; however, it is also well recognized that age is associated with increased numbers of chronic conditions , which can lead to functional decline and increased use of the healthcare system [19, 23, 24]. A well-functioning healthcare system will help keep people healthy and living at home and properly supported. Further, a person-focused approach has been proposed to tackle multimorbidity [25, 26].
Theory and development approaches
The chronic care model was used to identify key themes and players that should be incorporated into the intervention . Six core elements of the chronic care model were incorporated: healthcare organization and leadership, linkage to community resources, support of client self-management, coordinated delivery system design, clinical decision support, and clinical information systems  (see Table 1). A five-pronged approach has been used to develop the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) platform: (1) developmental evaluation [28, 29], (2) participatory co-development [30, 31], (3) formal investigation of sustainability , (4) iterative pilot testing  including evaluation of implementation of the intervention, and (5) a pragmatic randomized controlled trial (RCT) to evaluate the effectiveness and cost-effectiveness. The combination of approaches allows the team to explicitly record and gain progressive insight into key decisions made during development including those intended to foster sustainability and scalability, ensure the views of key players were incorporated, and allow for improvements to the intervention to be made and tested in an iterative manner before large scale evaluation.
Evidence supporting the elements of Health TAPESTRY
Health TAPESTRY seeks to bring together elements of healthcare delivery into a combined platform that capitalizes on current system strengths yet moves these forward using an integrated healthcare approach. Specifically, Health TAPESTRY centers on meeting a person’s health goals with the support of trained community volunteers, technology, an interprofessional team, system navigation, and community engagement. Healthcare volunteers have been shown to provide social support that is both physically and emotionally therapeutic to patients [33, 34]. Secondly, a multitude of benefits have been report from electronic medical records (EMRs) [35–37]. Additionally, with some mixed evidence, patient on-line access to their own health information (through personal health records (PHR)) has been shown to improve patient self-care, health outcomes, and communication and engagement with clinicians [38, 39]. Thirdly, much evidence supports the positive impact of team-based care on numerous health outcomes across several chronic diseases [40–42]. Finally, system navigation has been associated with important health outcomes [43, 44] and helps to address social determinants of health [45, 46].
We are unaware of any studies that integrate the components of Health TAPESTRY into a coordinated approach intended to improve delivery of primary healthcare. In essence, Health TAPESTRY is a health and social care approach that centers on meeting a person’s health goals and health needs explicitly gathered with the support of technology, community volunteers, an interprofessional team, and system navigation and better links between primary care and community organizations. It is a complex, multilevel approach to integration, from both system level and individual level perspectives.
The overarching aim of the Health TAPESTRY platform is to promote optimal aging. Health TAPESTRY intends to promote optimal aging through (1) intentional, proactive conversations about a person’s life and health goals and health risks and then initiation of an action plan that supports achievement of those goals and addressing of health risks; (2) improved collaborative working within the interprofessional primary care team, community service providers, and informal caregivers; (3) training volunteers to serve as a link between the person in their home and their primary care team; and (4) using technology including the PHR that allows personal health information and patient health goals to link directly to the EMR with the primary healthcare team.
Overall objective, research questions, and hypothesis
We aim to evaluate the implementation and effectiveness of the Health TAPESTRY approach in older adults. The primary research question is, what is the effectiveness of the Health TAPESTRY approach on the identification and attainment of a person’s health goals in older adult participants compared to people not receiving the Health TAPESTRY approach? Our hypothesis is that better integration of the health and social care systems into a person’s life will allow a person to better attain their health goals. Four secondary research questions will also be asked with respect to several participant outcomes, cost-effectiveness, sub-analyses, and intervention duration (see Additional file 1 for a complete list of secondary research questions). An additional set of questions will be asked related to the processes of implementation of each component of the Health TAPESTRY approach (see Additional file 1).
This is an unblinded delayed intervention pragmatic RCT. Participants in the control group will receive the intervention at 6 months, and both groups will continue to be part of the study until the 12-month mark (Fig. 1). The main analysis will be group comparisons at 6 months. Both groups will be also assessed at 12 months. Ethics approval was granted from the Hamilton Integrated Research Ethics Board (8 December 2014). The trial has been reregistered with Clinical Trials.gov NCT02283723. We used the SPIRIT guidelines to guide reporting of our trial protocol .
The study will be performed in Hamilton, Ontario, Canada, at the McMaster Family Health Team (MFHT) and surrounding communities. The MFHT consists of groups of family physicians and other healthcare professionals, providing 7-day-a-week access to care, supported by an EMR, and providing a broad collection of services based on community needs. The MFHT is paid using a blended model of funding, including capitation and fee for services, bonuses for achieving prevention targets, and special payments to expand the scope of care . The MFHT has approximately 32,000 rostered patients, 36 family physicians, 74 medical residents, 15 locums, 18 nurses, and 26 allied healthcare professionals.
As a planned pragmatic RCT, efforts will be made to limit the restrictiveness of the trial inclusion criteria. Inclusion criteria included patients rostered with MFHT, aged 70 years or older, and living in Hamilton, Ancaster, Dundas, Stoney Creek, Grimsby, Caledonia, or Rockton, Ontario. Exclusion criteria included people who reside in long-term care, will be out of the country for more than 50 % of trial duration, are palliative or receiving end-of-life care, or do not speak English or have a family member who speaks English. An initial list of potential participants will be generated through a query using the clinical EMR. Family physicians will screen lists of possible participants for exclusion criteria, and then invitation letters will be sent to all remaining participants. All volunteers and healthcare team members who are involved in the study will be invited to participate to provide their perspective as part of the implementation evaluation.
Randomization and blinding
While it is recognized that there could be potential contamination between intervention and control groups by the primary care providers who will have participants in both arms, the intervention focuses on identifying a person’s health goals which a salient component to all other actions to take place as part of the intervention. Thus, without the processes in place to receive information about a person’s goals, contamination is unlikely, and so it was felt that clustering at the level of the practice was not necessary.
The randomization process will involve an automated central (allocation concealed) computerized randomization sequence, with the patient as the unit of randomization. Randomization will be stratified by participant gender and MFHT site (McMaster Family Practice or Stonechurch Family Health Centre). Couples will be accepted into the study to encourage study participation and to ensure equitable access to the intervention. Recognizing the potential influence of one member of a couple on the other, both members will be randomized into the same group. One member of the couple will be randomly selected to contribute their data to the main analysis.
Participants, caregivers, and volunteers will not be blinded; however, there will be some masking of groups: participants will not explicitly be told that they are in the initial or delayed group. Physicians and other members of the healthcare team will be not be formally blinded to allocation; however, there will be some masking as they will only know a participant is receiving the intervention once a Health TAPESTRY report is reviewed and may not recognize whether a person has been allocated to the intervention or control group. Data analysts will be blinded to the study group.
A visual depiction of the study flow and planned timeline is provided in Additional file 2. A detailed description of the intervention is provided in Additional file 3. A screenshot of the virtual learning centre and training modules are shown in Additional File 4. A brief summary of the intervention has been described and is visually depicted in Fig. 2. A client (the research participant) will receive a visit in their home from a pair of trained volunteers. The volunteer pair will collect information electronically using a tablet computer which houses a specifically designed Health TAPESTRY software application (TAP-App). Information such as life and health goals, daily life activities, and general health will be collected using structured surveys and unstructured narratives (see Additional file 3). The information gathered will be organized in a report summarizing any alerts, key issues, observations, and goals. This report will be securely sent electronically to an intake team at the clinic. Intake teams may include any combination of healthcare professionals and were put in place to address high-health-need patients including high users of the healthcare system and Health TAPESTRY clients.
Each clinic will decide which healthcare team members should be included in the intake team and define a process that works best within their workflow. The clinic intake teams will review the reports and connect with the appropriate interprofessional healthcare team across the MFHT making sure to include the most responsible family physician. Collectively, a care plan is generated to facilitate how the team, community agencies, and the volunteers can address the client’s goals and health issues. The intervention treatment period will be 6 months.
The control group will receive the usual care. These individuals will not have volunteer visits or be discussed at an intake meeting. They may or may not have had a previous PHR account. At the conclusion of the 6-month trial, the control group will have the option of receiving the intervention.
Follow-up for the purposes of research will be according to intention to treat (ITT) and take place throughout implementation (qualitative data collection) at 6 and 12 months (quantitative data collection) in the intervention and control groups. Clinical follow-up during the intervention will be determined by clinical needs.
Tables 2 and 3 summarize the measures, timing, and data collection method used for the primary and secondary outcomes, in addition to the measures and timing of the implementation processes. The following section gives more detail for clarity and is broken down into two broad sub-sections: client outcome measures and implementation processes. A description of the tracking of adverse events and the economic analysis is also included.
Client outcome measures
Data on client demographic and other characteristics, as well as outcome measures, will be gathered using multiple data collection methods including self-report client surveys, clinic EMR, volunteer-administered TAP-App, and research program records. Outcome data measures will be repeated at 6 and 12 months. Client surveys will be programmed into the software administered by the volunteers during home visits or into software (REDCap, Version 6.9.7, Vanderbilt University ) used by researchers.
Data abstraction from clinic EMRs will be carried out using a structured, pilot-tested form. Chart audit of each patient examining the number of visits, the clinicians involved, and any referral or consultations internally or externally, as well as any physical measurements such as blood pressure, fasting blood glucose level, and lipids will take place at the end of the study. Data abstraction will occur independently in duplicate until reasonable agreement has occurred (i.e., 0.70), as calculated by Kappa statistic [50, 51]. Administrative data on health services utilization will be acquired from the EMR.
The primary outcome is the mean difference in the goal attainment scale (GAS) score at 6 months over baseline in the intervention arm, compared with the control group . Participants will identify health goals, indicators, and outcomes through structured, prompted discussion. Each participant will rate their progress towards achievement of their goal using a set of five expected outcome levels for each indicator related to that of health goal. Outcome levels identified will be as descriptive, objective, and observable as possible and phrased as relative versus absolute improvements . At 6 months, a GAS score will be calculated for each participant according to conventional methods  and used as the primary outcome. The proportion of participants’ self-reporting maintenance or improvement in their top priority goal area will be used as a secondary outcome. Further details about the process for gathering data to create the GAS are provided in Additional file 5.
A number of secondary outcomes will be collected (see Tables 2 and 3 for the description and reference of each outcome). Self-efficacy for managing chronic disease , quality of life (EQ-5D-5L) , optimal aging , social support , caregiver strain , and satisfaction with care will be measured. Also, access to healthcare services received at their clinic, comprehensiveness healthcare services received at their clinic, patient empowerment, and patient-centeredness will be measured using standardized questions developed by the Canadian Institute of Health Information through the Canadian Institutes of Health Research Community-Based Primary Healthcare initiative . Caregiver strain will be measured using the four-item Zarit screen . Hospitalizations and emergency room visits will be categorized into (1) those related to ambulatory care sensitive conditions for chronic disease [60, 61], (2) those related to adverse effects, and (3) overall for any reason.
Qualitative data will be analyzed to help understand the implementation of the intervention including the type and extent of involvement that participants, family caregivers, volunteers, and healthcare team members have in this program, volunteer confidence, and factors influencing implementation of the intervention from the perspectives of all types of participants including factors to consider when adapting the Health TAPESTRY approach to other contexts.
Specifically, the focus group and interview guides for the use with healthcare provider team, volunteers, and client participants will consist of pilot-tested open-ended questions that will address the structures and processes of care, perceived barriers and facilitators of implementing and the use of all components of the intervention, and what worked and did not work in implementing the program and in using each component. The focus group and interview guides are based on normalization process theory [62, 63]. Modifications to the interview guide will occur as themes emerged. Weekly field notes taken during primary healthcare intake team meetings will add rich detail to track the process of implementation of the intervention and any changes made over time. Data will be collected at 3 and 12 months of the intervention. In addition, to maximize Health TAPESTRY’s potential for impact, we assessed the intervention’s sustainability and scalability potential prior to implementation in this current trial using a mixed-methods approach . This work involves (1) administering a sustainability survey (a validated instrument developed by the National Health Service (NHS) institute ) to team members who were involved in the intervention development and pilot testing (n = 20) and (2) a qualitative study of one-on-one telephone interviews with a subset of NHS survey respondents (n = 25) to gain a more in-depth understanding of the factors that influence the implementation, sustainability, and scalability of the Health TAPESTRY intervention. Findings from these studies were used to optimize the intervention in preparation for the current trial .
To compliment the qualitative data collected and to further understand the implementation of the intervention and the readiness of healthcare team members for change, quantitative data will also be collected. Organizational readiness of members across MFHT will be measured using the Organizational Readiness for Change Assessment (ORCA) . Time between volunteer completion of data collection, report placement into the EMR, and discussion by intake team will also be recorded and tracked across the trial. The follow-up actions of the healthcare team will be described via chart audit of the EMR. Action type including communication method and the actions made by the healthcare team will be examined. Types of community resources recommended and utilized by participants will also be recorded. Finally, the types of life and health goals generated by participants and the proportion of recommendations made or actions taken to address these goals will be recorded. Other implementation elements complimented by a quantitative measure are volunteers’ self-efficacy to fulfill their role as a volunteer, the completeness of the initial assessments completed by the volunteers during home visits, and PHR uptake and use (see Tables 2 and 3 for descriptions).
Details of adverse events or harms from any source will be reported to the research team and recorded on a structured form. Follow-up will be completed by the appropriate person and documented. All critical incidents identified by volunteers, including potential adverse events, will be reported and followed up using a standard protocol.
Incremental costs and effects (utility) will be calculated and if the Health TAPESTRY program is both more costly and more effective, an incremental cost-utility ratio will be calculated showing how much more it costs for a QALY gained, using EQ-5D-5L  as the indicator of quality of life. If the Health TAPESTRY program is equally effective as no Health TAPESTRY program, then the economic evaluation will be based solely on incremental costs (see Additional file 6 for full details).
Tables 2 and 3 include a summary of methods of data analysis for each variable. We have provided more details related to the statistical data analysis plan for quantitative data related to client outcomes, in addition to describing the economic data analysis and data analysis for the qualitative data related to implementation processes.
We propose to test using two analysis sets: ITT set, considering all patients as randomized regardless of whether they received the intervention and a “per protocol” analysis set. A per protocol analysis will include all participants who received the intervention including both members of a couple assigned to the intervention group compared with all participants randomized to the control group including both members of a couple assigned to the control group.
Quantitative data analysis will include descriptive analyses with means and standard deviations calculated for the continuous variables and frequencies calculated for categorical variables. Data will be summarized in tabular or graphical form. The main between-group comparison will take place at 6 months. This point also serves as the control group’s baseline as they move into the intervention arm based on the delayed design. The comparison at 12 months then compares the effect of the intervention after 12 months of participation (original intervention group) versus 6 months of intervention (original control group).
The analysis will be blind to study group allocation and will follow ITT principle. Dropouts will not be replaced. Reporting will follow the CONSORT extension for pragmatic randomization trials  and non-pharmacological interventions . The baseline characteristics of the practices and patients will be reported by group as mean (standard deviation) or median (first quartile, third quartile) for continuous variables, depending on the distribution, and count (percent) for categorical variables. Multiple imputations will be used to handle missing data to enable ITT analysis. The data will be analyzed using generalized estimating equations—assuming exchangeable correlation structure adjusting for baseline scores, to analyze all outcomes . The results will be reported as estimate of the effect, corresponding 95 % confidence interval and associated p values. All p values will be reported to three decimal places with those less than 0.001 reported as p < 0.001. The criterion for statistical significance will be set a priori at alpha = 0.05 and adjusted using the Bonferroni method for multiple secondary analyses. Analyses will be performed using SAS V9.4 (Cary, NC). There will be a single final analysis at the end of the trial. Subgroup analyses will include examining differences between the following groups: men and women; age less than 80 and 80+ years; those residing alone and residing with others; or those with three or more chronic conditions.
The economic analyses will include program cost measures, health resource use and cost, and patient quality of life. The cost-effectiveness/utility analysis will be conducted from the Ontario government healthcare system perspective.
For quantitative indicators (volunteer self-efficacy, completeness of the TAP-App, PHR uptake, and the ORCA), a paired t test will be conducted to examine the mean differences between relevant time points. A descriptive method  will be used to explore implementation questions collected via qualitative methods. An inductive and deductive analysis approach will be used. Using NVivo 10 software, open coding will be used to capture participants’ perspectives of implementation and to track the process of implementation from field notes. These codes will be collapsed under pattern codes  which will be organized under normalization process theory constructs to track factors influencing implementation. An initial code book will be derived from the first two to three discussion groups and revised as needed to capture emerging themes. Two research team members will review all transcripts and notes pages and develop a codebook to capture emerging themes. Analysis will focus on implementation and understanding how each key group fits within Health TAPESTRY as well as their needs within the intervention. NVivo 10 matrix queries will be used to examine differences and similarities in perceptions based on of each group (healthcare provider, volunteer, and client). Data collection will take place concurrently with data analysis, so as to ensure that new themes are fully explored.
Power and sample size
Assuming baseline scores of 30 on the GAS score in intervention and control groups and a standard deviation of 15 with a power of 80 % and type I error probability of 0.05, we will need to enroll 286 patients overall to detect a mean difference of 5 points on the GAS score representing improvement in the level of goals attained in the intervention group compared with control [71–73]. Previous studies in older adults have demonstrated that this difference indicates a meaningful change in effect and is achievable [71–73]. This sample size will also give sufficient power to detect a difference of 1.0 (SD, 2.5) on the self-efficacy for managing chronic disease scale  and a difference of 0.10 (SD, 0.3) on the EQ-5D-5L measure, both identified as meaningful differences. The study will not be powered for planned subgroup analyses, and so these will be considered exploratory. To account for a 10 % potential loss to follow-up in the study, we will aim to enroll 316 participants.
This trial is in the study recruitment phase. We expect the final 6-month follow-up period for intervention and control participants to occur in April 2016.
The Health TAPESTRY platform has set laudable goals. It aims to remodel community-based primary healthcare to better reach people in their homes to intervene ahead of critical need. It aims to use accessible technology and a network of volunteers, to let clients self-direct and monitor their care, and make better connections to their healthcare team. It aims to break down barriers between people in their homes and community partners and healthcare teams. Any change in healthcare delivery necessitates rigorous evaluation to understand whether new processes generate the desired improvements. Multiple pilot tests have studied various components of the Health TAPESTRY platform to demonstrate feasibility and process improvements. This protocol describes the plans to rigorously evaluate the Health TAPESTRY community-based primary healthcare platform to understand whether it creates a positive difference in the achievement of their individual health goals or in how people experience the healthcare system.
The study uses the GAS score as a primary outcome. The strength of the GAS process is that it applies well to the situations of multimorbidity because it inherently allows the outcome to be individualized to the patient’s priority areas across their personal set of multimorbidities. It is also a person-focused measure because it only measures areas applicable to that particular person. The GAS process enables a patient and healthcare provider to work together to identify the patient’s priority problem areas and to systematically set realistic goals around that particular problem area. It allows for the negotiation of realistic, observable, and objective goals that could be attained with changes in health management, and it measures whether goals have been met at pre-specified follow-up times [74, 75]. The process is congruent with individualized clinical care but also provides a framework to consider as a measurement approach because it can accommodate multiple, individualized goals, and can evaluate and compare change in an individual or group over a heterogenous set of areas . The criteria for success of an intervention thus becomes the extent to which individual goals are achieved rather than the achievement of uniform criteria that are assessed for all patients receiving an intervention . This approach is similar to a disease-specific quality of life measure that allows individuals to choose the disease-specific criteria to be measured and allows individuals to describe their life in ways they consider important [78–80].
One of the main limitations of the GAS score is that if scores are too high then this could mean that the GAS scales developed were not challenging enough or if scores are too low then the scales may be too challenging. The proposed study overcomes this limitation by employing randomization to compare GAS scores between intervention and control groups and uses the same process of asking the patient to self-report changes from baseline to follow-up in both groups so as to minimize measurement bias.
The proposed study is intentional in its interest in being a pragmatic trial. Pragmatic trials ask about effectiveness in a real-world, unrestricted setting of study. They do not ask about efficacy as in explanatory trials that are carried out under selected, often ideal circumstances . Table 4 describes the Health TAPESTRY older adult RCT assessed according to the PRECIS domains . The majority of PRECIS elements are highly pragmatic. One key element following a pragmatic approach is to intentionally allow the interprofessional team to adapt and evolve over time to the participant and volunteer information coming to them compared to setting a fixed rigid process of care mapping to handle the information. This approach specifically aligns with the recognition and acceptance that in the real world the healthcare system epitomizes a complex system that is driven by features such as nonlinearity, emergence, adaptation, uncertainty, dynamical system change, and co-evolution with the need for clinic teams to continuously refine or change their approach over time based on context. It is important in pragmatic trials to also focus on factors influencing implementation of the intervention to support spread of effective interventions to other jurisdictions. Implementation evaluation will provide a rich understanding of the clinic processes so as to help interpret the comparative evaluation results with an understanding of how the implementation unfolds.
The proposed study takes place within a family health team, which may limit its generalizability to other types of primary care settings. Health TAPESTRY has considered the challenge of applicability to other settings during development and has taken steps to assess the sustainability of the integrated care delivery platform and individual components. Formal assessment of sustainability considerations based on the NHS sustainability model  has led to decisions and modifications of the intervention during pilot testing that better encourage sustainability and adaptability to other settings .
The proposed study has some notable limitations. The evaluation of the Health TAPESTRY platform is in a context with an established climate of collaboration among family healthcare team members with an open source PHR (KindredPHR) linked with an open source electronic medical chart (OSCAR) to facilitate care coordination thereby limiting the generalizability of the results to other clinical settings delivering primary care. However, the open source nature of the e-health ecosystem affords a higher level of opportunity for adoption by other communities. This study will evaluate the way in which elements of Health TAPESTRY can push those processes beyond their current state. Further, the choice to use the outcomes developed by the Canadian Institute of Health Information through the Canadian Institutes of Health Research Community-Based Primary Healthcare initiative  to assess the quality of primary care compared to other valid and reliable surveys  may limit the findings. Findings from this study may contribute to the evaluation of the psychometric properties of these untested common indicators.
Strengths of our proposed study include its design as a pragmatic RCT, the use of measures that help to understand the effects of the approach from multiple perspectives, the inclusion of a health economics component, and the use of mixed-methods to evaluate the approach. In addition, process and evaluation outcomes are incorporated. In doing so, a complete understanding of all the moving parts of Health TAPESTRY will be captured. Further, the study will engage all key players in the process of implementation, including the clients, volunteers, healthcare team, and researchers involved in the evaluation. Having each perspective will add to the richness of the data and experience throughout the study.
Canadian Institute for Health Information (CIHI). Healthcare cost drivers: the facts. 2011.
Patient-centred care. Ontario Medical Association 2010
Lewis S. A system in name only—access, variation, and reform in Canada’s provinces. N Engl J Med. 2015;372(6):497–500. doi:10.1056/NEJMp1414409.
Tinetti M, Fried T, Boydm C. Designing healthcare for the most common chronic condition—multimorbidity. JAMA. 2012;307(23):2493–4.
Pefoyo AJ, Bronskill SE, Gruneir A, Calzavara A, Thavorn K, Petrosyan Y, et al. The increasing burden and complexity of multimorbidity. BMC Public Health. 2015;15:415. doi:10.1186/s12889-015-1733-2.
Roy M, Levasseur M, Couturier Y, Lindstrom B, Genereaux M. The relevance of positive approaches to health for patient-centred care medicine. Prev Med Rep. 2015;2:10–2.
Rosenthal M. What we might accomplish by engaging in our local communites. Prev Med Rep. 2015;2:13–4.
Health Impact Assessment (HIA). In: The determinants of health http://www.who.int/hia/evidence/doh/en/.
Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy. 2002;60(3):201–18.
Macinko J, Starfield B, Shi LY. The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970–1998. Health Serv Res. 2003;38(3):831–65. doi:10.1111/1475-6773.00149.
Starfield B. Primary care: an increasingly important contributor to effectiveness, equity, and efficiency of health services. SESPAS report 2012. Gac Sanit. 2012;26 Suppl 1:20–6. doi:10.1016/j.gaceta.2011.10.009.
Primary Healthcare. Health Council of Canada2005
information CIfH. Pan-Canadian primary healthcare indicators. 2006.
A narrative for person-centered coordinated care. Gov. UK. 2015. https://www.gov.uk/guidance/enabling-integrated-care-in-the-nhs.
Gröne O, Garcia‐Barbero M. Trends in integrated care: Reflections on conceptual issues. Copenhagen: World Health Organization. 2002.
Boustani MA, Munger S, Gulati R, Vogel M, Beck RA, Callahan CM. Selecting a change and evaluating its impact on the performance of a complex adaptive healthcare delivery system. Clin Interv Aging. 2010;5:141–8.
Litaker D, Tomolo A, Liberatore V, Stange KC, Aron D. Using complexity theory to build interventions that improve healthcare delivery in primary care. J Gen Intern Med. 2006;21:S30–4. doi:10.1111/j.1525-1497.2006.00360.x.
Healthcare in Canada. A focus on aging and seniors. Canadian Institute for Health Information. 2011.
WHO. WHO. World report on aging and health. 2015.
Hoover M, Rotermann M. Seniors use of and unmet needs for home care 2009: statistics Canada. 2012.
Annual demographic estimates: Canada, provinces and territories, 2015 (Catalogue number91-215-X) 2015. http://www.statcan.gc.ca/daily-quotidien/150929/dq150929b-eng.htm.
Turcotte M, Schellenberg G. A portrait of seniors in Canada, 2006. Statistics Canada, Social and Aboriginal Statistics Division; 2007.
Adelman R, Tmanova L, Delgado D, Dion S, Lachs M. Caregiver burden: a clinical review. JAMA. 2014;311(10):1052–9. doi:10.1001/jama.2014.304.
Sundar V, Fox SW, Phillips KG. Transitions in caregiving: evaluating a person-centered approach to supporting family caregivers in the community. J Gerontol Soc Work. 2014;57(6–7):750–65. doi:10.1080/01634372.2013.847885.
Boyd C, McNabney M, Brandt N, Correa-de-Araujuo R, Daniel K, Epplin J, et al. Guiding principles for the care of older adults with multimorbidity. J Am Geriatri Soc. 2012;60:E1–25.
Hughes L, McMurdo M, Guthrie B. Guidelines for people not for diseases: the challenge of applying UK clinical guidelines to people with multimorbidity. Age Ageing. 2013;42:62–9.
Wagner EH. Chronic disease management: what will it take to improve care for chronic illness? Eff Clin Pract. 1998;1(1):2–4.
Patton M. Developmental evaluation defined and positioned. In: Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: The Guilford Press; 2011.
Gamble J. A developmental evaluation primer. Montreal Quebec: JW McConnell Family Foundation; 2008.
Richardson J, Agarwal G, Mangin D, Javadi D, Longaphy J, Gravesande J, et al. Evidence-informed development and usability testing of TAPESTRY-CM healthy lifestyle software application. Cancun: NAPCRG 2015; 2015.
Valaitis R, Longaphy J, Nair K, Agarwal G, Griffith L, Kastner M, et al. Persona-scenario exercise for codesigning primary care interventions. Can Fam Physician. 2014;60(3):294–6.
Kastner M, Sayal R, Straus S, Oliver D, Dolovich L. Sustainability and scalability of TAPESTRY. St. Johns Newfoundland: PriFor 2015; 2015.
Richardson JLL, Chan D, Stratford P, Hand C, Price D, et al. Rehabilitation in a primary care setting for persons with chronic illness: a randomized controlled trial. Prim Healthcare Res Dev. 2010;11(4):382–95.
Moore A, Moore A, Bhamani M, Peter J, Longaphy J, Oliver D, et al. Effectiveness of primary care volunteers for improving health and health service use for older adults living in the community: a systematic review. Cancun: NAPCRG 2015; 2015.
Infoway CH. Knowing is better for clinicians accessed. 2013. https://www.infoway-inforoute.ca/index.php/progress-in-canada/knowing-is-better-for-clinicians. Accessed May 6, 2013.
Infoway CH. The emerging benefits of electronic medical record use in community-based care. 2013.
Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54. doi:10.7326/M13-1531.
Giardina TD, Menon S, Parrish DE, Sittig DF, Singh H. Patient access to medical records and healthcare outcomes: a systematic review. J Am Med Inform Assoc. 2014;21(4):737–41. doi:10.1136/amiajnl-2013-002239.
Mold F, de Lusignan S, Sheikh A, Majeed A, Wyatt JC, Quinn T, et al. Patients’ online access to their electronic health records and linked online services: a systematic review in primary care. Br J Gen Pract. 2015;65(632):e141–51. doi:10.3399/bjgp15X683941.
Barrett J, Curran V, Glynn L, Godwin M. CHSRF synthesis: interprofessional collaboration and quality primary healthcare. Ottawa: Canadian Health Services Research Foundation; 2007.
Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. J Am Med Inform Assoc. 2005;12(5):505–16. doi:10.1197/jamia.M1700.
Walsh SH. The clinician’s perspective on electronic health records and how they can affect patient care. BMJ. 2004;328(7449):1184–7. doi:10.1136/bmj.328.7449.1184.
Manderson BMJ, Piraino E, Stolee P. Navigation roles support chronically ill older adults through healthcare transitions: a systematic review of the literature. Health Soc Care Community. 2012;20(2):113–27.
Wells KJBT, Dudley DJ, Garcia R, Greene A, Calhoun E, et al. Patient navigation: state of the art or is it science? Cancer. 2008;113(8):1999–2010.
Ferrante JM, Cohen DJ, Crosson JC. Translating the patient navigator approach to meet the needs of primary care. J Am Board Fam Med. 2010;23(6):736–44. doi:10.3122/jabfm.2010.06.100085.
Natale-Pereira A, Enard KR, Nevarez L, Jones LA. The role of patient navigators in eliminating health disparities. Cancer. 2011;117(15 Suppl):3543–52. doi:10.1002/cncr.26264.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. doi:10.7326/0003-4819-158-3-201302050-00583.
Rosser WW, Colwill JM, Kasperski J, Wilson L. Progress of Ontario’s family health team model: a patient-centered medical home. Ann Fam Med. 2011;9(2):165–71. doi:10.1370/afm.1228.
Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde J. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;4(2):377–81.
Cohen J. A coefficient of agreemnet for nomical scales. Educ Psychol Meas. 1960;20(1):37–46.
Banerjee M. Beyond kappa: a review of interrater agreement measures. Can J Stat. 1999;27(1):3–23. doi:10.2307/3315487.
Rushton PW, Miller WC. Goal attainment scaling in the rehabilitation of patients with lower-extremity amputations: a pilot study. Arch Phys Med Rehab. 2002;83(6):771–5. doi:10.1053/apmr.2002.32636.
Nieuwstraten C, Dolovich L, Chase H. Goal attainment scaling in the provision of pharmaceutical care to hospitalized patients with cardiovascular disease: a pilot study. Can J Hosp Pharm. 2002;55(4):262–71.
Lorig K, Chastain RL, Ung E, Shoor S, Holman HR. Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis Rheum. 1989;32(1):37–44. doi:10.1002/anr.1780320107.
Szende AWA. Measuring self-reported population health: an international perspective based on EQ-5D. 2004.
Raina PS, Wolfson C, Kirkland SA, Griffith LE, Oremus M, Patterson C, et al. The Canadian longitudinal study on aging (CLSA). Can J Aging. 2009;28(3):221–9. doi:10.1017/S0714980809990055.
Wardian J, Robbins D, Wolfersteig W, Johnson T, Dustman P. Validation of the DSSI-10 to measure social support in a general population. Res Soc Work Pract. 2013;23(1):100–6. doi:10.1177/1049731512464582.
Bedard M, Molloy DW, Squire L, Dubois S, Lever JA, O’Donnell M. The Zarit burden interview: a new short version and screening version. Gerontologist. 2001;41(5):652–7.
Canadian Institutes of Health Research (CIHR). Community-based primary health care innovation teams: common indicators. 2011.
Health Quality Ontario. The common quality agenda 2015 measuring up technical appendix. In: Ontario Health Quality. 2015.
Information CIfH. Ambulatory care sensitive conditions. 2015. http://indicatorlibrary.cihi.ca/display/HSPIL/Ambulatory+Care+Sensitive+Conditions.
May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54. doi:10.1177/0038038509103208.
May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4:29. doi:10.1186/1748-5908-4-29.
Maher L, Gustafson D, Evans A. NHS sustainability model: NHS Institute for Innovation and Improvement. 2010.
Helfrich CD, Li Y-F, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA) tool. Hamilton: McMaster University; 2009.
Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390. doi:10.1136/bmj.a2390.
Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, Group C. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295–309.
Hardin JW, Hilbe JM. Generalized estimating equations. New York: Chapman & Hall/CRC; 2002.
Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334–40.
Miles M, Huberman M, Saldaña J. Qualitative data analysis: a methods sourcebook. USA: SAGE Publications, Incorporated; 2013.
Demetrios M, Gorelik A, Louie J, Brand C, Baguley IJ, Khan F. Outcomes of ambulatory rehabilitation programmes following botulinum toxin for spasticity in adults with stroke. J Rehabil Med. 2014;46(8):730–7. doi:10.2340/16501977-1842.
Rockwood K, Howlett S, Stadnyk K, Carver D, Powell C, Stolee P. Responsiveness of goal attainment scaling in a randomized controlled trial of comprehensive geriatric assessment. J Clin Epidemiol. 2003;56(8):736–43.
Rockwood K, Stolee P, Fox RA. Use of goal attainment scaling in measuring clinically important change in the frail elderly. J Clin Epidemiol. 1993;46(10):1113–8.
Turnbull J. Evaluating health care using goal attainment scaling. Nurs Stand. 1998;12(42):35–8.
Locke EA, Saari LM, Shaw KN, Latham GP. Goal setting and task-performance—1969–1980. Psychol Bull. 1981;90(1):125–52. doi:10.1037//0033-2909.90.1.125.
Malec JF, Smigielski JS, DePompolo RW, Thompson JM. Outcome evaluation and prediction in a comprehensive-integrated post-acute outpatient brain injury rehabilitation programme. Brain Inj. 1993;7(1):15–29.
Spano RM, Kiresuk TJ, Lund SH. An operational model to achieve accountability for social work in health care. Soc Work Health Care. 1977;3(2):123–41.
Hickey AM, Bury G, O’Boyle CA, Bradley F, O’Kelly FD, Shannon W. A new short form individual quality of life measure (SEIQoL-DW): application in a cohort of individuals with HIV/AIDS. BMJ. 1996;313(7048):29–33.
Oboyle CA. The Schedule for the Evaluation of Individual Quality-of-Life (Seiqol). Int J Ment Health. 1994;23(3):3–23.
O’Boyle CA, McGee H, Hickey A, O’Malley K, Joyce CR. Individual quality of life in patients undergoing hip replacement. Lancet. 1992;339(8801):1088–91.
Chambers L, Thabane L, Kaczorowski J, Dolovich L, Mbuagbaw L, D. S. Explanatory trials versus pragmatic trials (letter). BMJ. 2014;349:1-8.
Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ. 2009;180(10):E47–57. doi:10.1503/cmaj.090523.
Haggerty JL, Burge F, Beaulieu MD, Pineault R, Beaulieu C, Levesque JF, et al. Validation of instruments to evaluate primary healthcare from the patient perspective: overview of the method. Healthc Policy. 2011;7(Spec Issue):31–46.
Rolfson D, Majumdar S, Tsuyuki R, Tahir A, Rockwood K. Validity and reliability of the Edmonton Frail Scale. 2006.
Rolfson D, Majumdar S, Tahir A, Tsuyuki R. Development and validation of a new instrument for frailty (Abs) 336. 2000.
Keller HH, Goy R, Kane SL. Validity and reliability of SCREEN II (seniors in the community: risk evaluation for eating and nutrition, version II). Eur J Clin Nutr. 2005;59(10):1149–57. doi:10.1038/sj.ejcn.1602225.
Keller HH, Hedley MR, Wong Brownlee S. The development of seniors in the community: risk evaluation for eating and nutrition (SCREEN). Can J Diet Pract Res. 2000;61(2):67–72.
Manty M, Heinonen A, Leionen R, Tormakangas T, Sakari-Rantala R, Hirvensalo M, von Bonsdorff MB, Rantanen T. Construct and predictive validity of a self-reported measure of preclinical mobility limitation. Arch Phys Med Rehabil. 2007;88(September):1108–13.
Topolski TD, LoGerfo J, Patrick DL, Williams B, Walwick J, Patrick MB. The rapid assessment of physical activity (RAPA) among older adults. Prev Chronic Dis. 2006;3(4):A118.
Barclay DA. Family functioning, psychosocial stress, and goal attainment in brain injury rehabilitation. J Soc Work Disabil Rehabil. 2013;12(3):159–75. doi:10.1080/1536710X.2013.810093.
The authors would like to acknowledge Ernie Avilla, Kalpana Nair, Mehreen Bhamani, Marianne Hannon, Katharine May, Lynda Nash, Jessica Peter, Anubha Sant, Raied Siddqui, and Linda Xie for their contributions to the development of Health TAPESTRY. We would also like to acknowledge the clinic staff and healthcare providers and volunteers for their incredible work to realize the Health TAPESTRY program.
This study was funded by Health Canada, with additional support from the Government of Ontario (MOHLTC), Labarge Optimal Aging Initiative, McMaster Family Health Organization, and the Department of Family Medicine at McMaster University.
The authors declare that they have no competing interests.
All authors contributed to the conception of the idea of Health TAPESTRY and the preparation of this protocol. LD and DO directed all aspects of the study design, implementation, and evaluation. DP, LD, DO, and TC held joint responsibility for administrative and management oversight for the study. DP and LD wrote the initial submission to fund the Health TAPESTRY program. Prospectus LD, DO, DP, GA, LG, DM, AP, JP, CR, JR, PLS, SS, RV, and PR provided expertise surrounding aspects of primary healthcare and healthy aging of older adults and chronic disease management or multimorbidities. DP, TC, and DC were instrumental in the development of the technology piece and integration of different technologies. MK and SS provided expertise centered on sustainability and knowledge translation. RV, JP, LC, DM, DO, GA, LD and CR developed methods for the evaluation of the interprofessional team piece. DO, GA, and CR fostered the clinic participation. LT. PR, LG, and DM provided the support for the development of the statistical analyses plan and methodological design. LL, LC, DJ, and JL helped develop the scientific and operational aspects of the study. All authors read and approved the final manuscript.
Secondary research questions and questions related to the process of implementation of each component of the Health TAPESTRY approach. (DOCX 13 kb)
Study flow and planned timeline. (DOC 69 kb)
Screenshot of virtual learning center login page and training modules. (DOC 439 kb)
Cost-effectiveness plan. (DOCX 12 kb)
About this article
- Primary healthcare
- Older adults
- Randomized controlled trial
- Integrated care
- Healthcare volunteers
- Interdisciplinary healthcare teams
- Health services research
- Personal health record