- Study protocol
- Open Access
- Open Peer Review
A protocol for a pragmatic randomized controlled trial using the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) platform approach to promote person-focused primary healthcare for older adults
- Lisa Dolovich1Email author,
- Doug Oliver1, 2,
- Larkin Lamarche1,
- Gina Agarwal1, 2,
- Tracey Carr1,
- David Chan1,
- Laura Cleghorn1, 3,
- Lauren Griffith4,
- Dena Javadi1,
- Monika Kastner5,
- Jennifer Longaphy1,
- Dee Mangin1,
- Alexandra Papaioannou6,
- Jenny Ploeg3,
- Parminder Raina4,
- Julie Richardson7,
- Cathy Risdon1, 2,
- P. Lina Santaguida4,
- Sharon Straus8,
- Lehana Thabane4,
- Ruta Valaitis3 and
- David Price1, 2
© Dolovich et al. 2016
- Received: 26 January 2016
- Accepted: 12 March 2016
- Published: 5 April 2016
Healthcare systems are not well designed to help people maintain or improve their health. They are generally not person-focused or well-coordinated. The objective of this study is to evaluate the effectiveness of the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) approach in older adults. The overarching hypothesis is that using the Health TAPESTRY approach to achieve better integration of the health and social care systems into a person’s life that centers on meeting a person’s health goals and needs will result in optimal aging.
This is a 12-month delayed intervention pragmatic randomized controlled trial. The study will be performed in Hamilton, Ontario, Canada in the two-site McMaster Family Health Team. Participants will include 316 patients who are 70 years of age or older. Participants will be randomized to the Health TAPESTRY approach or control group. The Health TAPESTRY approach includes intentional, proactive conversations about a person’s life and health goals and health risks and then initiation of congruent tailored interventions that support achievement of those goals and addressing of risks through (1) trained volunteers visiting clients in their homes to serve as a link between the primary care team and the client; (2) the use of novel technology including a personal health record from the home to link directly with the primary healthcare team; and (3) improved processes for connections, system navigation, and care delivery among interprofessional primary care teams, community service providers, and informal caregivers. The primary outcome will be the goal attainment scaling score. Secondary outcomes include self-efficacy for managing chronic disease, quality of life, the participant perspective on their own aging, social support, access to health services, comprehensiveness of care, patient empowerment, patient-centeredness, caregiver strain, satisfaction with care, healthcare resource utilization, and cost-effectiveness. Implementation processes will also be evaluated. The main comparative analysis will take place at 6 months.
Evidence of the individual elements of the Health TAPESTRY platform has been shown in isolation in the previous research. However, this study will better understand how to best integrate them to maximize the system’s transformation of person-focused, primary care for older adults.
- Primary healthcare
- Older adults
- Randomized controlled trial
- Integrated care
- Healthcare volunteers
- Interdisciplinary healthcare teams
- Health services research
- Personal health record
Healthcare systems are not well designed to help people maintain or improve their health. They are generally not well-coordinated and plagued with barriers to a person-focused care system [1, 2]. In Canada, current provincial healthcare systems are confronted with working to overcome disorganized connections among primary, secondary, and community care  and the use of processes that are reactive versus proactive . Further, the current system is challenged by the burden of provider-patient interactions focused on a single disease rather than approaches that account for people who have multiple chronic conditions [4, 5]. Although the field of medicine has evolved over the years to focus on wellness versus illness, much change is still needed to take into account patient goals and preferences . Finally, the system lacks coordinated strategies that address the social determinants of health [3, 7]. Transformational healthcare system change is needed if a person is to truly realize the World Health Organization’s (WHO) definition of health, “a resource for everyday life, not the objective of living; it is a positive concept, emphasizing social and personal resources, as well as physical capacities” .
Countries with a strong emphasis on primary healthcare have realized better health outcomes and health equity [9–11]. Effective primary healthcare is community-based, promotes healthy lifestyles as a pathway to disease prevention, provides ongoing care for chronic conditions, and recognizes the importance of the broad determinants of health . Primary healthcare embraces a wide suite of services and involves a broad range of healthcare providers in a manner that is person-focused and coordinated . It has been identified that integrated care allows a person to plan their care with people who work together to understand them and their caregivers, allow them control, and bring together services to achieve outcomes of importance to them . A strong primary healthcare system also needs to be well integrated with the rest of the healthcare system. The WHO defines integrated care as the bringing together of inputs, delivery, management, and organization of services related to diagnosis, treatment, care, rehabilitation, and health promotion . High-quality integration encompasses better care delivery horizontally through improved interdisciplinary team collaboration and vertically across different levels of care such as in the home, primary, secondary, and tertiary care . Taking into account complexity theory concepts when considering effective healthcare delivery also recognizes that delivery of healthcare itself is a complex adaptive system and, as such, changes according to current demands [16, 17]. Therefore, improving primary healthcare requires the many components of the healthcare system to undergo whole-scale transformational system change and to do so in a manner that produces person-focused coordinated care.
Individuals ≥65 years are the fastest growing age group in Canada. This age segment in July 2015, for the first time ever, outnumbered people aged ≤15 years [18-21]. Worldwide, the number of people over the age of 60 is expected to double by 2050 [19, 20]. If no improvements are made to the current healthcare system, greater numbers of people will have unmet healthcare needs that will hinder healthy aging [20, 21]. Many older adults report being in excellent or very good health and are able to carry on daily activities on their own ; however, it is also well recognized that age is associated with increased numbers of chronic conditions , which can lead to functional decline and increased use of the healthcare system [19, 23, 24]. A well-functioning healthcare system will help keep people healthy and living at home and properly supported. Further, a person-focused approach has been proposed to tackle multimorbidity [25, 26].
Theory and development approaches
Chronic care model and health TAPESTRY
Healthcare organization and leadership
Strong leadership, readiness for change, and effective incentives to systematically promote successful quality improvement interventions.
Health TAPESTRY creates time and space for clinic huddles to take place to discuss clients individually in an organically defined, interprofessional process through support from clinic leadership.
Clinic leadership supports integration of volunteers into the team and the adoption and use of e-health technologies
Linkage to community resources
Efficient use of community resources such as peer-support groups, community programs, and counselling to improve the quality of care and support offered to patients and improve cost-effectiveness in the system.
Health TAPESTRY offers linkages to community organizations through support of volunteers and directed healthcare provider referral or connection based on goals and needs oriented action plans.
Support of patient self-management
Patient empowerment, activation, and support of self-management skills to effectively sustain management of chronic conditions.
Health TAPESTRY volunteers serve as advocates for clients and encourage self-management through follow-up and discussion of client-identified health goals. Healthcare providers encourage self-management activities through education and actions based on goals and needs oriented action plans.
Coordinated delivery system design
Disconnected care across multiple providers and caregivers is a point of inefficiency in the health system; therefore, addressing lack of coordination to significantly improve patient experience.
The KindredPHR seeks to allow clients to better connect to all their providers in a more coordinated way. The Health TAPESTRY specific applications generate information in the home that is shared electronically with the clinic.
Clinical decision support
Facilitating the use of evidence-based guidelines and patient assessment tools to enhance effectiveness.
The Health TAPESTRY App contains modules (surveys, risk algorithms) that have been supported by evidence and expert opinion.
Clinical information systems
Improving patient-provider and provider-provider communication, using reminder systems, documenting treatment plans and sending secure messages to enhance the delivery of proactive care.
The KindredPHR offers secure messaging between clients and providers and allows for establishment of reminders, tracking of health information and treatment plans, and recording data. Communication is also be facilitated by the clinic EMR.
Evidence supporting the elements of Health TAPESTRY
Health TAPESTRY seeks to bring together elements of healthcare delivery into a combined platform that capitalizes on current system strengths yet moves these forward using an integrated healthcare approach. Specifically, Health TAPESTRY centers on meeting a person’s health goals with the support of trained community volunteers, technology, an interprofessional team, system navigation, and community engagement. Healthcare volunteers have been shown to provide social support that is both physically and emotionally therapeutic to patients [33, 34]. Secondly, a multitude of benefits have been report from electronic medical records (EMRs) [35–37]. Additionally, with some mixed evidence, patient on-line access to their own health information (through personal health records (PHR)) has been shown to improve patient self-care, health outcomes, and communication and engagement with clinicians [38, 39]. Thirdly, much evidence supports the positive impact of team-based care on numerous health outcomes across several chronic diseases [40–42]. Finally, system navigation has been associated with important health outcomes [43, 44] and helps to address social determinants of health [45, 46].
We are unaware of any studies that integrate the components of Health TAPESTRY into a coordinated approach intended to improve delivery of primary healthcare. In essence, Health TAPESTRY is a health and social care approach that centers on meeting a person’s health goals and health needs explicitly gathered with the support of technology, community volunteers, an interprofessional team, and system navigation and better links between primary care and community organizations. It is a complex, multilevel approach to integration, from both system level and individual level perspectives.
The overarching aim of the Health TAPESTRY platform is to promote optimal aging. Health TAPESTRY intends to promote optimal aging through (1) intentional, proactive conversations about a person’s life and health goals and health risks and then initiation of an action plan that supports achievement of those goals and addressing of health risks; (2) improved collaborative working within the interprofessional primary care team, community service providers, and informal caregivers; (3) training volunteers to serve as a link between the person in their home and their primary care team; and (4) using technology including the PHR that allows personal health information and patient health goals to link directly to the EMR with the primary healthcare team.
Overall objective, research questions, and hypothesis
We aim to evaluate the implementation and effectiveness of the Health TAPESTRY approach in older adults. The primary research question is, what is the effectiveness of the Health TAPESTRY approach on the identification and attainment of a person’s health goals in older adult participants compared to people not receiving the Health TAPESTRY approach? Our hypothesis is that better integration of the health and social care systems into a person’s life will allow a person to better attain their health goals. Four secondary research questions will also be asked with respect to several participant outcomes, cost-effectiveness, sub-analyses, and intervention duration (see Additional file 1 for a complete list of secondary research questions). An additional set of questions will be asked related to the processes of implementation of each component of the Health TAPESTRY approach (see Additional file 1).
The study will be performed in Hamilton, Ontario, Canada, at the McMaster Family Health Team (MFHT) and surrounding communities. The MFHT consists of groups of family physicians and other healthcare professionals, providing 7-day-a-week access to care, supported by an EMR, and providing a broad collection of services based on community needs. The MFHT is paid using a blended model of funding, including capitation and fee for services, bonuses for achieving prevention targets, and special payments to expand the scope of care . The MFHT has approximately 32,000 rostered patients, 36 family physicians, 74 medical residents, 15 locums, 18 nurses, and 26 allied healthcare professionals.
As a planned pragmatic RCT, efforts will be made to limit the restrictiveness of the trial inclusion criteria. Inclusion criteria included patients rostered with MFHT, aged 70 years or older, and living in Hamilton, Ancaster, Dundas, Stoney Creek, Grimsby, Caledonia, or Rockton, Ontario. Exclusion criteria included people who reside in long-term care, will be out of the country for more than 50 % of trial duration, are palliative or receiving end-of-life care, or do not speak English or have a family member who speaks English. An initial list of potential participants will be generated through a query using the clinical EMR. Family physicians will screen lists of possible participants for exclusion criteria, and then invitation letters will be sent to all remaining participants. All volunteers and healthcare team members who are involved in the study will be invited to participate to provide their perspective as part of the implementation evaluation.
Randomization and blinding
While it is recognized that there could be potential contamination between intervention and control groups by the primary care providers who will have participants in both arms, the intervention focuses on identifying a person’s health goals which a salient component to all other actions to take place as part of the intervention. Thus, without the processes in place to receive information about a person’s goals, contamination is unlikely, and so it was felt that clustering at the level of the practice was not necessary.
The randomization process will involve an automated central (allocation concealed) computerized randomization sequence, with the patient as the unit of randomization. Randomization will be stratified by participant gender and MFHT site (McMaster Family Practice or Stonechurch Family Health Centre). Couples will be accepted into the study to encourage study participation and to ensure equitable access to the intervention. Recognizing the potential influence of one member of a couple on the other, both members will be randomized into the same group. One member of the couple will be randomly selected to contribute their data to the main analysis.
Participants, caregivers, and volunteers will not be blinded; however, there will be some masking of groups: participants will not explicitly be told that they are in the initial or delayed group. Physicians and other members of the healthcare team will be not be formally blinded to allocation; however, there will be some masking as they will only know a participant is receiving the intervention once a Health TAPESTRY report is reviewed and may not recognize whether a person has been allocated to the intervention or control group. Data analysts will be blinded to the study group.
Each clinic will decide which healthcare team members should be included in the intake team and define a process that works best within their workflow. The clinic intake teams will review the reports and connect with the appropriate interprofessional healthcare team across the MFHT making sure to include the most responsible family physician. Collectively, a care plan is generated to facilitate how the team, community agencies, and the volunteers can address the client’s goals and health issues. The intervention treatment period will be 6 months.
The control group will receive the usual care. These individuals will not have volunteer visits or be discussed at an intake meeting. They may or may not have had a previous PHR account. At the conclusion of the 6-month trial, the control group will have the option of receiving the intervention.
Follow-up for the purposes of research will be according to intention to treat (ITT) and take place throughout implementation (qualitative data collection) at 6 and 12 months (quantitative data collection) in the intervention and control groups. Clinical follow-up during the intervention will be determined by clinical needs.
Summary of trial client outcomes and implementation processes
Methods of analysisa
GAS score will be higher in the intervention arm compared to the control arm at 6-months; proportion of participants who report maintaining or improving in the top priority goal area will be higher in the intervention arm than the control arm at 6-months
Goal attainment scaling score  obtained from a structured interview; proportion of participants who report maintaining or improving in their top priority goal area
Linear regression for continuous variables; logistical regression for categorical variables
Higher self-efficacy, quality of life, optimal aging, social support, access, comprehensiveness, patient empowerment, patient-centeredness, and satisfaction of care and lower caregiver strain, hospital admissions, and emergency room visits will be reported in the intervention arm compared to the control arm at 6-months
Self-efficacy for managing chronic disease ; self-report
T0, T6, T12
Quality of life
EQ5D-5L ; self-report
T0, T6, T12
Single-item optimal aging question from the Canadian Longitudinal Study on Aging ; self-report
T0, T6, T12
DUKE social support index ; self-report
T0, T6, T12
CIHI common indicators; self-report 
T0, T6, T12
Comprehensiveness of care
T0, T6, T12
T0, T6, T12
T0, T6, T12
4-item Zarit screen ; self-report
T0, T6, T12
Satisfaction with care
Single item, satisfaction rated from 1 to 10; self-report
T0, T6, T12
Hospitalizations and emergency room visits
T0, T6, T12
Summary of trial client outcomes and implementation processes
Methods of analysis
3-item self-efficacy rating of communication with client, performance of tasks necessary for home visit (i.e., navigate TAP-App) and handling unexpected issues (0–100 % scale)
Prior to each home visit
Mean differences for the first 3 months of visits compared to the second 3 months of visits
Completeness of TAP-App used by volunteers
Time to complete each module; number of items missed
Mean differences where applicable
Client satisfaction with volunteers
Description of experience with volunteer home visits
Qualitative descriptive method
Uptake of personal health record by clients
PHR metrics including number of times logged in, features used, number of secure messages sent, issues encountered, and described experience with the personal health record
T0, T6, T12
Mean differences where applicable; content analysis with frequency counts of each category where applicable
Type and extent of healthcare team involvement with client
Chart audit to track actions of healthcare team (type of follow-up, team members involved)
Content analysis with frequency counts of each category of resource
Quality and extent of healthcare team functioning and organizational readiness for change by health team members
Described in qualitative interviews
Qualitative descriptive method
Mean difference between T3 and T12
How often and what types of community resources are utilized by clients?
Chart audit to track connections to community resources and programs
Content analysis with frequency counts of each category of resource
Type and extent of involvement of clients in program
Described in qualitative interviews
Qualitative descriptive method
Type and extent of involvement of family caregivers in the program
Research session notes; described in qualitative interviews
Content analysis with frequency counts of each category of resource
What life and health goals are generated by clients?
Structured open-ended questions in research session
Thematic analysis of goals based on goal areas
Process of implementation and factors influencing implementation
Described in qualitative interviews
Qualitative descriptive method
Client outcome measures
Data on client demographic and other characteristics, as well as outcome measures, will be gathered using multiple data collection methods including self-report client surveys, clinic EMR, volunteer-administered TAP-App, and research program records. Outcome data measures will be repeated at 6 and 12 months. Client surveys will be programmed into the software administered by the volunteers during home visits or into software (REDCap, Version 6.9.7, Vanderbilt University ) used by researchers.
Data abstraction from clinic EMRs will be carried out using a structured, pilot-tested form. Chart audit of each patient examining the number of visits, the clinicians involved, and any referral or consultations internally or externally, as well as any physical measurements such as blood pressure, fasting blood glucose level, and lipids will take place at the end of the study. Data abstraction will occur independently in duplicate until reasonable agreement has occurred (i.e., 0.70), as calculated by Kappa statistic [50, 51]. Administrative data on health services utilization will be acquired from the EMR.
The primary outcome is the mean difference in the goal attainment scale (GAS) score at 6 months over baseline in the intervention arm, compared with the control group . Participants will identify health goals, indicators, and outcomes through structured, prompted discussion. Each participant will rate their progress towards achievement of their goal using a set of five expected outcome levels for each indicator related to that of health goal. Outcome levels identified will be as descriptive, objective, and observable as possible and phrased as relative versus absolute improvements . At 6 months, a GAS score will be calculated for each participant according to conventional methods  and used as the primary outcome. The proportion of participants’ self-reporting maintenance or improvement in their top priority goal area will be used as a secondary outcome. Further details about the process for gathering data to create the GAS are provided in Additional file 5.
A number of secondary outcomes will be collected (see Tables 2 and 3 for the description and reference of each outcome). Self-efficacy for managing chronic disease , quality of life (EQ-5D-5L) , optimal aging , social support , caregiver strain , and satisfaction with care will be measured. Also, access to healthcare services received at their clinic, comprehensiveness healthcare services received at their clinic, patient empowerment, and patient-centeredness will be measured using standardized questions developed by the Canadian Institute of Health Information through the Canadian Institutes of Health Research Community-Based Primary Healthcare initiative . Caregiver strain will be measured using the four-item Zarit screen . Hospitalizations and emergency room visits will be categorized into (1) those related to ambulatory care sensitive conditions for chronic disease [60, 61], (2) those related to adverse effects, and (3) overall for any reason.
Qualitative data will be analyzed to help understand the implementation of the intervention including the type and extent of involvement that participants, family caregivers, volunteers, and healthcare team members have in this program, volunteer confidence, and factors influencing implementation of the intervention from the perspectives of all types of participants including factors to consider when adapting the Health TAPESTRY approach to other contexts.
Specifically, the focus group and interview guides for the use with healthcare provider team, volunteers, and client participants will consist of pilot-tested open-ended questions that will address the structures and processes of care, perceived barriers and facilitators of implementing and the use of all components of the intervention, and what worked and did not work in implementing the program and in using each component. The focus group and interview guides are based on normalization process theory [62, 63]. Modifications to the interview guide will occur as themes emerged. Weekly field notes taken during primary healthcare intake team meetings will add rich detail to track the process of implementation of the intervention and any changes made over time. Data will be collected at 3 and 12 months of the intervention. In addition, to maximize Health TAPESTRY’s potential for impact, we assessed the intervention’s sustainability and scalability potential prior to implementation in this current trial using a mixed-methods approach . This work involves (1) administering a sustainability survey (a validated instrument developed by the National Health Service (NHS) institute ) to team members who were involved in the intervention development and pilot testing (n = 20) and (2) a qualitative study of one-on-one telephone interviews with a subset of NHS survey respondents (n = 25) to gain a more in-depth understanding of the factors that influence the implementation, sustainability, and scalability of the Health TAPESTRY intervention. Findings from these studies were used to optimize the intervention in preparation for the current trial .
To compliment the qualitative data collected and to further understand the implementation of the intervention and the readiness of healthcare team members for change, quantitative data will also be collected. Organizational readiness of members across MFHT will be measured using the Organizational Readiness for Change Assessment (ORCA) . Time between volunteer completion of data collection, report placement into the EMR, and discussion by intake team will also be recorded and tracked across the trial. The follow-up actions of the healthcare team will be described via chart audit of the EMR. Action type including communication method and the actions made by the healthcare team will be examined. Types of community resources recommended and utilized by participants will also be recorded. Finally, the types of life and health goals generated by participants and the proportion of recommendations made or actions taken to address these goals will be recorded. Other implementation elements complimented by a quantitative measure are volunteers’ self-efficacy to fulfill their role as a volunteer, the completeness of the initial assessments completed by the volunteers during home visits, and PHR uptake and use (see Tables 2 and 3 for descriptions).
Details of adverse events or harms from any source will be reported to the research team and recorded on a structured form. Follow-up will be completed by the appropriate person and documented. All critical incidents identified by volunteers, including potential adverse events, will be reported and followed up using a standard protocol.
Incremental costs and effects (utility) will be calculated and if the Health TAPESTRY program is both more costly and more effective, an incremental cost-utility ratio will be calculated showing how much more it costs for a QALY gained, using EQ-5D-5L  as the indicator of quality of life. If the Health TAPESTRY program is equally effective as no Health TAPESTRY program, then the economic evaluation will be based solely on incremental costs (see Additional file 6 for full details).
Tables 2 and 3 include a summary of methods of data analysis for each variable. We have provided more details related to the statistical data analysis plan for quantitative data related to client outcomes, in addition to describing the economic data analysis and data analysis for the qualitative data related to implementation processes.
We propose to test using two analysis sets: ITT set, considering all patients as randomized regardless of whether they received the intervention and a “per protocol” analysis set. A per protocol analysis will include all participants who received the intervention including both members of a couple assigned to the intervention group compared with all participants randomized to the control group including both members of a couple assigned to the control group.
Quantitative data analysis will include descriptive analyses with means and standard deviations calculated for the continuous variables and frequencies calculated for categorical variables. Data will be summarized in tabular or graphical form. The main between-group comparison will take place at 6 months. This point also serves as the control group’s baseline as they move into the intervention arm based on the delayed design. The comparison at 12 months then compares the effect of the intervention after 12 months of participation (original intervention group) versus 6 months of intervention (original control group).
The analysis will be blind to study group allocation and will follow ITT principle. Dropouts will not be replaced. Reporting will follow the CONSORT extension for pragmatic randomization trials  and non-pharmacological interventions . The baseline characteristics of the practices and patients will be reported by group as mean (standard deviation) or median (first quartile, third quartile) for continuous variables, depending on the distribution, and count (percent) for categorical variables. Multiple imputations will be used to handle missing data to enable ITT analysis. The data will be analyzed using generalized estimating equations—assuming exchangeable correlation structure adjusting for baseline scores, to analyze all outcomes . The results will be reported as estimate of the effect, corresponding 95 % confidence interval and associated p values. All p values will be reported to three decimal places with those less than 0.001 reported as p < 0.001. The criterion for statistical significance will be set a priori at alpha = 0.05 and adjusted using the Bonferroni method for multiple secondary analyses. Analyses will be performed using SAS V9.4 (Cary, NC). There will be a single final analysis at the end of the trial. Subgroup analyses will include examining differences between the following groups: men and women; age less than 80 and 80+ years; those residing alone and residing with others; or those with three or more chronic conditions.
The economic analyses will include program cost measures, health resource use and cost, and patient quality of life. The cost-effectiveness/utility analysis will be conducted from the Ontario government healthcare system perspective.
For quantitative indicators (volunteer self-efficacy, completeness of the TAP-App, PHR uptake, and the ORCA), a paired t test will be conducted to examine the mean differences between relevant time points. A descriptive method  will be used to explore implementation questions collected via qualitative methods. An inductive and deductive analysis approach will be used. Using NVivo 10 software, open coding will be used to capture participants’ perspectives of implementation and to track the process of implementation from field notes. These codes will be collapsed under pattern codes  which will be organized under normalization process theory constructs to track factors influencing implementation. An initial code book will be derived from the first two to three discussion groups and revised as needed to capture emerging themes. Two research team members will review all transcripts and notes pages and develop a codebook to capture emerging themes. Analysis will focus on implementation and understanding how each key group fits within Health TAPESTRY as well as their needs within the intervention. NVivo 10 matrix queries will be used to examine differences and similarities in perceptions based on of each group (healthcare provider, volunteer, and client). Data collection will take place concurrently with data analysis, so as to ensure that new themes are fully explored.
Power and sample size
Assuming baseline scores of 30 on the GAS score in intervention and control groups and a standard deviation of 15 with a power of 80 % and type I error probability of 0.05, we will need to enroll 286 patients overall to detect a mean difference of 5 points on the GAS score representing improvement in the level of goals attained in the intervention group compared with control [71–73]. Previous studies in older adults have demonstrated that this difference indicates a meaningful change in effect and is achievable [71–73]. This sample size will also give sufficient power to detect a difference of 1.0 (SD, 2.5) on the self-efficacy for managing chronic disease scale  and a difference of 0.10 (SD, 0.3) on the EQ-5D-5L measure, both identified as meaningful differences. The study will not be powered for planned subgroup analyses, and so these will be considered exploratory. To account for a 10 % potential loss to follow-up in the study, we will aim to enroll 316 participants.
This trial is in the study recruitment phase. We expect the final 6-month follow-up period for intervention and control participants to occur in April 2016.
The Health TAPESTRY platform has set laudable goals. It aims to remodel community-based primary healthcare to better reach people in their homes to intervene ahead of critical need. It aims to use accessible technology and a network of volunteers, to let clients self-direct and monitor their care, and make better connections to their healthcare team. It aims to break down barriers between people in their homes and community partners and healthcare teams. Any change in healthcare delivery necessitates rigorous evaluation to understand whether new processes generate the desired improvements. Multiple pilot tests have studied various components of the Health TAPESTRY platform to demonstrate feasibility and process improvements. This protocol describes the plans to rigorously evaluate the Health TAPESTRY community-based primary healthcare platform to understand whether it creates a positive difference in the achievement of their individual health goals or in how people experience the healthcare system.
The study uses the GAS score as a primary outcome. The strength of the GAS process is that it applies well to the situations of multimorbidity because it inherently allows the outcome to be individualized to the patient’s priority areas across their personal set of multimorbidities. It is also a person-focused measure because it only measures areas applicable to that particular person. The GAS process enables a patient and healthcare provider to work together to identify the patient’s priority problem areas and to systematically set realistic goals around that particular problem area. It allows for the negotiation of realistic, observable, and objective goals that could be attained with changes in health management, and it measures whether goals have been met at pre-specified follow-up times [74, 75]. The process is congruent with individualized clinical care but also provides a framework to consider as a measurement approach because it can accommodate multiple, individualized goals, and can evaluate and compare change in an individual or group over a heterogenous set of areas . The criteria for success of an intervention thus becomes the extent to which individual goals are achieved rather than the achievement of uniform criteria that are assessed for all patients receiving an intervention . This approach is similar to a disease-specific quality of life measure that allows individuals to choose the disease-specific criteria to be measured and allows individuals to describe their life in ways they consider important [78–80].
One of the main limitations of the GAS score is that if scores are too high then this could mean that the GAS scales developed were not challenging enough or if scores are too low then the scales may be too challenging. The proposed study overcomes this limitation by employing randomization to compare GAS scores between intervention and control groups and uses the same process of asking the patient to self-report changes from baseline to follow-up in both groups so as to minimize measurement bias.
Evaluation of the Health TAPESTRY in older adult RCT assessed according to the PRECIS domains
Assessment of the Health TAPESTRY older adult RCT
Research team rating on scale 1 to 5 (1 = least pragmatic to 5 = most pragmatic)
Participant eligibility criteria
Sample is quite healthy—intentionally left it open and not too targeted at people who are frail; included individuals along bus routes had to screen-out those people who volunteers could not physically access (i.e., long-term care facilities, hospices, along rural routes); had to screen-out individuals who could not speak English or did not have a caregiver who spoke English and willing to facilitate volunteer visits—this was outside the volunteer program’s capacity
Interventions and expertise
TAP-reports reviewed and action plan is developed for that particular person based on their individual self-report information so action plans are all different. There is not a “one size fits all” approach to reports. No specific instructionsgiven to intake teams on process, allowed teams to develop own process and workflow for TAPESTRY; practice was allowed to be different between the two clinics. Never forced clients to use PHR to facilitate connection to healthcare team. At least one home visit by the volunteer was initiated, but no minimum or maximum follow-up visits were enforced in the trial
Experimental intervention-practitioner expertise
MFHT and intake teams made up of different people, intake teams changed throughout the trial, elements of care plan carried out by various MFHT members, regardless of level of expertise
Control individuals allowed to receive any type of care from any healthcare professional at the clinic. Individuals in the control group do not receive volunteer visits, the TAP-App and are not discussed at the intake team meetings
Comparison intervention-practitioner expertise
Same MFHT members are involved in the care of individuals in the intervention and control groups
Follow-up and outcomes
Formal follow-up to collect research outcomes (baseline, 6 and 12 months). No formal volunteer home visit follow-up schedule of clients, no instruction for MFHT of clinic follow-up
Primary trial outcome
Primary out is GAS score, which is subjective, person-centered care outcome and clinically meaningful to client
Participant compliance with “prescribed” intervention
No formal strategy to encourage compliance; methods to encourage use of PHR, improve volunteer confidence in role
Practitioner adherence to study protocol
Only subtle strategies to encourage intervention to move forward have left for organic process, but no formal strategy to monitor adherence or encourage adherence; researchers sat in intake team meetings early on to track development of processes, however, have withdrawn researchers have intake teams to lessen influence of initiative
Analysis of primary outcome
Using intention to treat principle, intention to include all experiences in evaluation (good and bad), statistical analysis plan will work under “noise”
The proposed study takes place within a family health team, which may limit its generalizability to other types of primary care settings. Health TAPESTRY has considered the challenge of applicability to other settings during development and has taken steps to assess the sustainability of the integrated care delivery platform and individual components. Formal assessment of sustainability considerations based on the NHS sustainability model  has led to decisions and modifications of the intervention during pilot testing that better encourage sustainability and adaptability to other settings .
The proposed study has some notable limitations. The evaluation of the Health TAPESTRY platform is in a context with an established climate of collaboration among family healthcare team members with an open source PHR (KindredPHR) linked with an open source electronic medical chart (OSCAR) to facilitate care coordination thereby limiting the generalizability of the results to other clinical settings delivering primary care. However, the open source nature of the e-health ecosystem affords a higher level of opportunity for adoption by other communities. This study will evaluate the way in which elements of Health TAPESTRY can push those processes beyond their current state. Further, the choice to use the outcomes developed by the Canadian Institute of Health Information through the Canadian Institutes of Health Research Community-Based Primary Healthcare initiative  to assess the quality of primary care compared to other valid and reliable surveys  may limit the findings. Findings from this study may contribute to the evaluation of the psychometric properties of these untested common indicators.
Strengths of our proposed study include its design as a pragmatic RCT, the use of measures that help to understand the effects of the approach from multiple perspectives, the inclusion of a health economics component, and the use of mixed-methods to evaluate the approach. In addition, process and evaluation outcomes are incorporated. In doing so, a complete understanding of all the moving parts of Health TAPESTRY will be captured. Further, the study will engage all key players in the process of implementation, including the clients, volunteers, healthcare team, and researchers involved in the evaluation. Having each perspective will add to the richness of the data and experience throughout the study.
The authors would like to acknowledge Ernie Avilla, Kalpana Nair, Mehreen Bhamani, Marianne Hannon, Katharine May, Lynda Nash, Jessica Peter, Anubha Sant, Raied Siddqui, and Linda Xie for their contributions to the development of Health TAPESTRY. We would also like to acknowledge the clinic staff and healthcare providers and volunteers for their incredible work to realize the Health TAPESTRY program.
This study was funded by Health Canada, with additional support from the Government of Ontario (MOHLTC), Labarge Optimal Aging Initiative, McMaster Family Health Organization, and the Department of Family Medicine at McMaster University.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Canadian Institute for Health Information (CIHI). Healthcare cost drivers: the facts. 2011.Google Scholar
- Patient-centred care. Ontario Medical Association 2010Google Scholar
- Lewis S. A system in name only—access, variation, and reform in Canada’s provinces. N Engl J Med. 2015;372(6):497–500. doi:10.1056/NEJMp1414409.View ArticlePubMedGoogle Scholar
- Tinetti M, Fried T, Boydm C. Designing healthcare for the most common chronic condition—multimorbidity. JAMA. 2012;307(23):2493–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Pefoyo AJ, Bronskill SE, Gruneir A, Calzavara A, Thavorn K, Petrosyan Y, et al. The increasing burden and complexity of multimorbidity. BMC Public Health. 2015;15:415. doi:10.1186/s12889-015-1733-2.View ArticlePubMedGoogle Scholar
- Roy M, Levasseur M, Couturier Y, Lindstrom B, Genereaux M. The relevance of positive approaches to health for patient-centred care medicine. Prev Med Rep. 2015;2:10–2.View ArticlePubMedGoogle Scholar
- Rosenthal M. What we might accomplish by engaging in our local communites. Prev Med Rep. 2015;2:13–4.View ArticlePubMedGoogle Scholar
- Health Impact Assessment (HIA). In: The determinants of health http://www.who.int/hia/evidence/doh/en/.
- Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy. 2002;60(3):201–18.View ArticlePubMedGoogle Scholar
- Macinko J, Starfield B, Shi LY. The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970–1998. Health Serv Res. 2003;38(3):831–65. doi:10.1111/1475-6773.00149.View ArticlePubMedPubMed CentralGoogle Scholar
- Starfield B. Primary care: an increasingly important contributor to effectiveness, equity, and efficiency of health services. SESPAS report 2012. Gac Sanit. 2012;26 Suppl 1:20–6. doi:10.1016/j.gaceta.2011.10.009.View ArticlePubMedGoogle Scholar
- Primary Healthcare. Health Council of Canada2005Google Scholar
- information CIfH. Pan-Canadian primary healthcare indicators. 2006.Google Scholar
- A narrative for person-centered coordinated care. Gov. UK. 2015. https://www.gov.uk/guidance/enabling-integrated-care-in-the-nhs.
- Gröne O, Garcia‐Barbero M. Trends in integrated care: Reflections on conceptual issues. Copenhagen: World Health Organization. 2002.Google Scholar
- Boustani MA, Munger S, Gulati R, Vogel M, Beck RA, Callahan CM. Selecting a change and evaluating its impact on the performance of a complex adaptive healthcare delivery system. Clin Interv Aging. 2010;5:141–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Litaker D, Tomolo A, Liberatore V, Stange KC, Aron D. Using complexity theory to build interventions that improve healthcare delivery in primary care. J Gen Intern Med. 2006;21:S30–4. doi:10.1111/j.1525-1497.2006.00360.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Healthcare in Canada. A focus on aging and seniors. Canadian Institute for Health Information. 2011.Google Scholar
- WHO. WHO. World report on aging and health. 2015.Google Scholar
- Hoover M, Rotermann M. Seniors use of and unmet needs for home care 2009: statistics Canada. 2012.Google Scholar
- Annual demographic estimates: Canada, provinces and territories, 2015 (Catalogue number91-215-X) 2015. http://www.statcan.gc.ca/daily-quotidien/150929/dq150929b-eng.htm.
- Turcotte M, Schellenberg G. A portrait of seniors in Canada, 2006. Statistics Canada, Social and Aboriginal Statistics Division; 2007.Google Scholar
- Adelman R, Tmanova L, Delgado D, Dion S, Lachs M. Caregiver burden: a clinical review. JAMA. 2014;311(10):1052–9. doi:10.1001/jama.2014.304.View ArticlePubMedGoogle Scholar
- Sundar V, Fox SW, Phillips KG. Transitions in caregiving: evaluating a person-centered approach to supporting family caregivers in the community. J Gerontol Soc Work. 2014;57(6–7):750–65. doi:10.1080/01634372.2013.847885.View ArticlePubMedGoogle Scholar
- Boyd C, McNabney M, Brandt N, Correa-de-Araujuo R, Daniel K, Epplin J, et al. Guiding principles for the care of older adults with multimorbidity. J Am Geriatri Soc. 2012;60:E1–25.View ArticleGoogle Scholar
- Hughes L, McMurdo M, Guthrie B. Guidelines for people not for diseases: the challenge of applying UK clinical guidelines to people with multimorbidity. Age Ageing. 2013;42:62–9.View ArticlePubMedGoogle Scholar
- Wagner EH. Chronic disease management: what will it take to improve care for chronic illness? Eff Clin Pract. 1998;1(1):2–4.PubMedGoogle Scholar
- Patton M. Developmental evaluation defined and positioned. In: Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: The Guilford Press; 2011.Google Scholar
- Gamble J. A developmental evaluation primer. Montreal Quebec: JW McConnell Family Foundation; 2008.Google Scholar
- Richardson J, Agarwal G, Mangin D, Javadi D, Longaphy J, Gravesande J, et al. Evidence-informed development and usability testing of TAPESTRY-CM healthy lifestyle software application. Cancun: NAPCRG 2015; 2015.Google Scholar
- Valaitis R, Longaphy J, Nair K, Agarwal G, Griffith L, Kastner M, et al. Persona-scenario exercise for codesigning primary care interventions. Can Fam Physician. 2014;60(3):294–6.PubMedPubMed CentralGoogle Scholar
- Kastner M, Sayal R, Straus S, Oliver D, Dolovich L. Sustainability and scalability of TAPESTRY. St. Johns Newfoundland: PriFor 2015; 2015.Google Scholar
- Richardson JLL, Chan D, Stratford P, Hand C, Price D, et al. Rehabilitation in a primary care setting for persons with chronic illness: a randomized controlled trial. Prim Healthcare Res Dev. 2010;11(4):382–95.View ArticleGoogle Scholar
- Moore A, Moore A, Bhamani M, Peter J, Longaphy J, Oliver D, et al. Effectiveness of primary care volunteers for improving health and health service use for older adults living in the community: a systematic review. Cancun: NAPCRG 2015; 2015.Google Scholar
- Infoway CH. Knowing is better for clinicians accessed. 2013. https://www.infoway-inforoute.ca/index.php/progress-in-canada/knowing-is-better-for-clinicians. Accessed May 6, 2013.Google Scholar
- Infoway CH. The emerging benefits of electronic medical record use in community-based care. 2013.Google Scholar
- Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54. doi:10.7326/M13-1531.View ArticlePubMedGoogle Scholar
- Giardina TD, Menon S, Parrish DE, Sittig DF, Singh H. Patient access to medical records and healthcare outcomes: a systematic review. J Am Med Inform Assoc. 2014;21(4):737–41. doi:10.1136/amiajnl-2013-002239.View ArticleGoogle Scholar
- Mold F, de Lusignan S, Sheikh A, Majeed A, Wyatt JC, Quinn T, et al. Patients’ online access to their electronic health records and linked online services: a systematic review in primary care. Br J Gen Pract. 2015;65(632):e141–51. doi:10.3399/bjgp15X683941.View ArticlePubMedPubMed CentralGoogle Scholar
- Barrett J, Curran V, Glynn L, Godwin M. CHSRF synthesis: interprofessional collaboration and quality primary healthcare. Ottawa: Canadian Health Services Research Foundation; 2007.Google Scholar
- Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. J Am Med Inform Assoc. 2005;12(5):505–16. doi:10.1197/jamia.M1700.View ArticlePubMedPubMed CentralGoogle Scholar
- Walsh SH. The clinician’s perspective on electronic health records and how they can affect patient care. BMJ. 2004;328(7449):1184–7. doi:10.1136/bmj.328.7449.1184.View ArticlePubMedPubMed CentralGoogle Scholar
- Manderson BMJ, Piraino E, Stolee P. Navigation roles support chronically ill older adults through healthcare transitions: a systematic review of the literature. Health Soc Care Community. 2012;20(2):113–27.View ArticlePubMedGoogle Scholar
- Wells KJBT, Dudley DJ, Garcia R, Greene A, Calhoun E, et al. Patient navigation: state of the art or is it science? Cancer. 2008;113(8):1999–2010.View ArticlePubMedPubMed CentralGoogle Scholar
- Ferrante JM, Cohen DJ, Crosson JC. Translating the patient navigator approach to meet the needs of primary care. J Am Board Fam Med. 2010;23(6):736–44. doi:10.3122/jabfm.2010.06.100085.View ArticlePubMedGoogle Scholar
- Natale-Pereira A, Enard KR, Nevarez L, Jones LA. The role of patient navigators in eliminating health disparities. Cancer. 2011;117(15 Suppl):3543–52. doi:10.1002/cncr.26264.PubMedPubMed CentralGoogle Scholar
- Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. doi:10.7326/0003-4819-158-3-201302050-00583.View ArticlePubMedPubMed CentralGoogle Scholar
- Rosser WW, Colwill JM, Kasperski J, Wilson L. Progress of Ontario’s family health team model: a patient-centered medical home. Ann Fam Med. 2011;9(2):165–71. doi:10.1370/afm.1228.View ArticlePubMedPubMed CentralGoogle Scholar
- Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde J. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;4(2):377–81.View ArticleGoogle Scholar
- Cohen J. A coefficient of agreemnet for nomical scales. Educ Psychol Meas. 1960;20(1):37–46.View ArticleGoogle Scholar
- Banerjee M. Beyond kappa: a review of interrater agreement measures. Can J Stat. 1999;27(1):3–23. doi:10.2307/3315487.View ArticleGoogle Scholar
- Rushton PW, Miller WC. Goal attainment scaling in the rehabilitation of patients with lower-extremity amputations: a pilot study. Arch Phys Med Rehab. 2002;83(6):771–5. doi:10.1053/apmr.2002.32636.View ArticleGoogle Scholar
- Nieuwstraten C, Dolovich L, Chase H. Goal attainment scaling in the provision of pharmaceutical care to hospitalized patients with cardiovascular disease: a pilot study. Can J Hosp Pharm. 2002;55(4):262–71.Google Scholar
- Lorig K, Chastain RL, Ung E, Shoor S, Holman HR. Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis Rheum. 1989;32(1):37–44. doi:10.1002/anr.1780320107.View ArticlePubMedGoogle Scholar
- Szende AWA. Measuring self-reported population health: an international perspective based on EQ-5D. 2004.Google Scholar
- Raina PS, Wolfson C, Kirkland SA, Griffith LE, Oremus M, Patterson C, et al. The Canadian longitudinal study on aging (CLSA). Can J Aging. 2009;28(3):221–9. doi:10.1017/S0714980809990055.View ArticlePubMedGoogle Scholar
- Wardian J, Robbins D, Wolfersteig W, Johnson T, Dustman P. Validation of the DSSI-10 to measure social support in a general population. Res Soc Work Pract. 2013;23(1):100–6. doi:10.1177/1049731512464582.View ArticleGoogle Scholar
- Bedard M, Molloy DW, Squire L, Dubois S, Lever JA, O’Donnell M. The Zarit burden interview: a new short version and screening version. Gerontologist. 2001;41(5):652–7.View ArticlePubMedGoogle Scholar
- Canadian Institutes of Health Research (CIHR). Community-based primary health care innovation teams: common indicators. 2011.Google Scholar
- Health Quality Ontario. The common quality agenda 2015 measuring up technical appendix. In: Ontario Health Quality. 2015.Google Scholar
- Information CIfH. Ambulatory care sensitive conditions. 2015. http://indicatorlibrary.cihi.ca/display/HSPIL/Ambulatory+Care+Sensitive+Conditions.Google Scholar
- May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54. doi:10.1177/0038038509103208.View ArticleGoogle Scholar
- May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4:29. doi:10.1186/1748-5908-4-29.View ArticlePubMedPubMed CentralGoogle Scholar
- Maher L, Gustafson D, Evans A. NHS sustainability model: NHS Institute for Innovation and Improvement. 2010.Google Scholar
- Helfrich CD, Li Y-F, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA) tool. Hamilton: McMaster University; 2009.Google Scholar
- Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390. doi:10.1136/bmj.a2390.View ArticlePubMedPubMed CentralGoogle Scholar
- Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, Group C. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295–309.View ArticlePubMedGoogle Scholar
- Hardin JW, Hilbe JM. Generalized estimating equations. New York: Chapman & Hall/CRC; 2002.View ArticleGoogle Scholar
- Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334–40.View ArticlePubMedGoogle Scholar
- Miles M, Huberman M, Saldaña J. Qualitative data analysis: a methods sourcebook. USA: SAGE Publications, Incorporated; 2013.Google Scholar
- Demetrios M, Gorelik A, Louie J, Brand C, Baguley IJ, Khan F. Outcomes of ambulatory rehabilitation programmes following botulinum toxin for spasticity in adults with stroke. J Rehabil Med. 2014;46(8):730–7. doi:10.2340/16501977-1842.View ArticlePubMedGoogle Scholar
- Rockwood K, Howlett S, Stadnyk K, Carver D, Powell C, Stolee P. Responsiveness of goal attainment scaling in a randomized controlled trial of comprehensive geriatric assessment. J Clin Epidemiol. 2003;56(8):736–43.View ArticlePubMedGoogle Scholar
- Rockwood K, Stolee P, Fox RA. Use of goal attainment scaling in measuring clinically important change in the frail elderly. J Clin Epidemiol. 1993;46(10):1113–8.View ArticlePubMedGoogle Scholar
- Turnbull J. Evaluating health care using goal attainment scaling. Nurs Stand. 1998;12(42):35–8.View ArticlePubMedGoogle Scholar
- Locke EA, Saari LM, Shaw KN, Latham GP. Goal setting and task-performance—1969–1980. Psychol Bull. 1981;90(1):125–52. doi:10.1037//0033-2909.90.1.125.View ArticleGoogle Scholar
- Malec JF, Smigielski JS, DePompolo RW, Thompson JM. Outcome evaluation and prediction in a comprehensive-integrated post-acute outpatient brain injury rehabilitation programme. Brain Inj. 1993;7(1):15–29.View ArticlePubMedGoogle Scholar
- Spano RM, Kiresuk TJ, Lund SH. An operational model to achieve accountability for social work in health care. Soc Work Health Care. 1977;3(2):123–41.View ArticlePubMedGoogle Scholar
- Hickey AM, Bury G, O’Boyle CA, Bradley F, O’Kelly FD, Shannon W. A new short form individual quality of life measure (SEIQoL-DW): application in a cohort of individuals with HIV/AIDS. BMJ. 1996;313(7048):29–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Oboyle CA. The Schedule for the Evaluation of Individual Quality-of-Life (Seiqol). Int J Ment Health. 1994;23(3):3–23.View ArticleGoogle Scholar
- O’Boyle CA, McGee H, Hickey A, O’Malley K, Joyce CR. Individual quality of life in patients undergoing hip replacement. Lancet. 1992;339(8801):1088–91.View ArticlePubMedGoogle Scholar
- Chambers L, Thabane L, Kaczorowski J, Dolovich L, Mbuagbaw L, D. S. Explanatory trials versus pragmatic trials (letter). BMJ. 2014;349:1-8.Google Scholar
- Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ. 2009;180(10):E47–57. doi:10.1503/cmaj.090523.View ArticlePubMedPubMed CentralGoogle Scholar
- Haggerty JL, Burge F, Beaulieu MD, Pineault R, Beaulieu C, Levesque JF, et al. Validation of instruments to evaluate primary healthcare from the patient perspective: overview of the method. Healthc Policy. 2011;7(Spec Issue):31–46.PubMedPubMed CentralGoogle Scholar
- Rolfson D, Majumdar S, Tsuyuki R, Tahir A, Rockwood K. Validity and reliability of the Edmonton Frail Scale. 2006.Google Scholar
- Rolfson D, Majumdar S, Tahir A, Tsuyuki R. Development and validation of a new instrument for frailty (Abs) 336. 2000.Google Scholar
- Keller HH, Goy R, Kane SL. Validity and reliability of SCREEN II (seniors in the community: risk evaluation for eating and nutrition, version II). Eur J Clin Nutr. 2005;59(10):1149–57. doi:10.1038/sj.ejcn.1602225.View ArticlePubMedGoogle Scholar
- Keller HH, Hedley MR, Wong Brownlee S. The development of seniors in the community: risk evaluation for eating and nutrition (SCREEN). Can J Diet Pract Res. 2000;61(2):67–72.PubMedGoogle Scholar
- Manty M, Heinonen A, Leionen R, Tormakangas T, Sakari-Rantala R, Hirvensalo M, von Bonsdorff MB, Rantanen T. Construct and predictive validity of a self-reported measure of preclinical mobility limitation. Arch Phys Med Rehabil. 2007;88(September):1108–13.View ArticlePubMedGoogle Scholar
- Topolski TD, LoGerfo J, Patrick DL, Williams B, Walwick J, Patrick MB. The rapid assessment of physical activity (RAPA) among older adults. Prev Chronic Dis. 2006;3(4):A118.PubMedPubMed CentralGoogle Scholar
- Barclay DA. Family functioning, psychosocial stress, and goal attainment in brain injury rehabilitation. J Soc Work Disabil Rehabil. 2013;12(3):159–75. doi:10.1080/1536710X.2013.810093.View ArticlePubMedGoogle Scholar