This article has Open Peer Review reports available.
Study protocol for the translating research in elder care (TREC): building context – an organizational monitoring program in long-term care project (project one)
© Estabrooks et al; licensee BioMed Central Ltd. 2009
Received: 24 April 2009
Accepted: 11 August 2009
Published: 11 August 2009
While there is a growing awareness of the importance of organizational context (or the work environment/setting) to successful knowledge translation, and successful knowledge translation to better patient, provider (staff), and system outcomes, little empirical evidence supports these assumptions. Further, little is known about the factors that enhance knowledge translation and better outcomes in residential long-term care facilities, where care has been shown to be suboptimal. The project described in this protocol is one of the two main projects of the larger five-year Translating Research in Elder Care (TREC) program.
The purpose of this project is to establish the magnitude of the effect of organizational context on knowledge translation, and subsequently on resident, staff (unregulated, regulated, and managerial) and system outcomes in long-term care facilities in the three Canadian Prairie Provinces (Alberta, Saskatchewan, Manitoba).
This study protocol describes the details of a multi-level – including provinces, regions, facilities, units within facilities, and individuals who receive care (residents) or work (staff) in facilities – and longitudinal (five-year) research project. A stratified random sample of 36 residential long-term care facilities (30 urban and 6 rural) from the Canadian Prairie Provinces will comprise the sample. Caregivers and care managers within these facilities will be asked to complete the TREC survey – a suite of survey instruments designed to assess organizational context and related factors hypothesized to be important to successful knowledge translation and to achieving better resident, staff, and system outcomes. Facility and unit level data will be collected using standardized data collection forms, and resident outcomes using the Resident Assessment Instrument-Minimum Data Set version 2.0 instrument. A variety of analytic techniques will be employed including descriptive analyses, psychometric analyses, multi-level modeling, and mixed-method analyses.
Three key challenging areas associated with conducting this project are discussed: sampling, participant recruitment, and sample retention; survey administration (with unregulated caregivers); and the provision of a stable set of study definitions to guide the project.
In this issue of Implementation Science we present a series of three study protocols: an overview of the Translating Research in Elder Care (TREC) program ; TREC project one (Study Protocol for Translating Research in Elder Care: Building Context – an Organizational Monitoring Program in Long-Term Care Project – this paper); and TREC project two (Study Protocol for Translating Research in Elder Care – Building Context through Case Studies in Long-Term Care Project) . The purpose of this paper is to report the study protocol for project one.
Increasingly investigators recognize that theory is required to guide the design of knowledge translation studies [3–5]. Currently, there is no one accepted theory of knowledge translation. Numerous theories are used in the field, many arising from the fields of organizational behaviour and social sciences, suggesting that knowledge translation is concerned not only with the behaviour of individual clinicians but also with the organizations or contexts in which they work. Most of these theories are neither highly developed nor rigorously tested, indicating a need for further work in this area.
Knowledge translation theory
Knowledge translation models
Research Utilization Models
Ottawa Model of Research use 
Conduct and Utilization of Research in Nursing (CURN) 
Nursing Child Assessment Satellite Training (NCAST) 
Stetler Model 
Iowa Model of Research in Nursing Practice 
Promoting Action on Research Implementation in Health Services (PARiHS) 
Weiss' (Social Sciences) Research Utilization Models
Knowledge-Driven Model 
Problem-Solving Model 
Interactive Model 
Political Model 
Tactical Model 
Enlightenment Model 
Organizational Innovation Models
Model of Territorial Rights and Boundaries 
Dual Core Model of Innovation 
Ambidextrous Model 
Bandwagon Models 
Desperation-Reaction Model of Medical Diffusion 
Organizational Models and Theories
(Less focused on knowledge translation but relevant to knowledge translation)
Episodic or Punctuated Equilibrium Model of Change 
Situated Change Theory 
Agency Theory 
Institutional Theory 
Predictors of knowledge translation
Rogers  argued that the adoption of an innovation (or research) is influenced by the interaction among three key components: the innovation, the adopter, and the environment. Investigators studying nursing services delivery have used this theory widely to frame studies of research use [12–20]. Little work has been done on characteristics of the innovation in healthcare . Until recently, research has focused largely on changing individual (the adopter) behaviour. For example, in studying physician behaviour, investigators have focused on interventions, such as academic detailing , educational influentials [23–25], reminder systems [22, 26], and audit and feedback [27, 28]. While these interventions result in modest to moderate improvements in patient care, generalizability remains uncertain because of a limited understanding of the contextual, individual, and organizational factors that may influence the effectiveness of the different interventions [25, 29].
In the study of nurse (adopter) behaviour, the focus has largely been on examining individual determinants of research use, such as attitude [30–32], age [31, 33], education [17, 33–36], experience [31, 33], clinical area [17, 30], journals read [19, 37, 38], employment status , and most recently, critical thinking behaviour . Less attention has been given to interventions, such as opinion leaders  or multidisciplinary teams . In a systematic review by Estabrooks et al. , the most frequently studied individual determinant, and the only one with a consistently positive effect, was attitude towards research. Findings for other individual determinants were highly equivocal and most studies were characterized by serious design and methodological flaws. Further, investigators have not selected individual factors for study with the important requirement that the factor be potentially modifiable.
Numerous organizational (environmental) factors thought to influence innovation adoption in industry and health services have also been studied. Those shown to have an influence include organizational complexity [42–46], centralization , size (e.g., number of beds) [20, 42, 44, 48, 49] presence of a research champion [50–52], traditionalism [53, 54], organizational slack [42, 55], access to and amount of resources , constraints on time [12, 57–67], professional autonomy [58, 68, 69] and organizational support [30, 31, 56, 68, 70, 71]. Again, investigators have generally not selected factors for study with a requirement for potential modifiability.
While there is generally a growing awareness and acceptance among researchers of the importance of organizational context (the local environment) to successful knowledge translation, and successful knowledge translation to improved patient, provider (staff), and system outcomes, astonishingly little empirical evidence supports these assumptions. Further, we know little about knowledge translation in the long-term care environment – an environment where: the quality of care is suboptimal  and the model of care is a nursing services delivery model where the majority of caregivers provide some level of nursing services.
In this project, we aim to investigate the impact of organizational context (giving specific attention to those factors which may be potentially modifiable) on knowledge translation and the effect of both organizational context and knowledge translation on resident, provider (staff), and system outcomes using long-term care as a naturally occurring laboratory.
We are using an extension of the PARiHS framework to frame this research project. In the PARiHS framework, the continuous interaction between context, evidence, and facilitation is hypothesized to lead to increased research implementation. This project is particularly focused on increasing understanding of the role of one of these elements, context, on promoting knowledge translation and improving outcomes. We define context as "...the environment or setting in which people receive healthcare services, or in the context of getting research evidence into practice, the environment or setting in which the proposed change is to be implemented." [, p. 176]. Context according to PARiHS consists of three core dimensions: culture, leadership, and evaluation. In this project, however, we take an expanded view of context to include additional modifiable elements of the work setting, such as interactions (formal and informal), social capital, resources, and organizational slack.
Study purpose and objectives
To develop and validate theory relating to knowledge translation and its relationship to outcomes.
To develop and run an organizational monitoring system to assess organizational context in long-term care facilities longitudinally.
To measure the influence of organizational context on knowledge translation, and on resident, provider (staff), and system outcomes.
To undertake and complete multi-level modeling and mixed-method analyses.
To refine the TREC survey (a survey suite) to ensure it enables valid longitudinal measurement of organizational context in long-term care settings.
Design and methods
This project is a multi-level, longitudinal descriptive study of a stratified random sample of long-term care facilities across the three Canadian Prairie Provinces: Alberta, Saskatchewan, and Manitoba. Data are collected at three levels: facility, unit, and individual (provider [staff] and resident). Facility-level data are collected annually from facility administrators and unit level data, quarterly from care managers. Provider (staff)-level data are collected annually from unregulated staff (i.e., healthcare aides), regulated staff (i.e., licensed practical nurses/registered nurses, physicians, allied healthcare providers, practice specialists [e.g., educators, advanced practice nurses]), and managerial staff (i.e., unit care managers) using the TREC survey. Resident-level data are accessed quarterly from the Resident Assessment Instrument-Minimum Data Set version 2.0 (RAI-MDS 2.0) databases that are maintained by provincial, regional, and/or facility custodians (depending on the province).
Facility- and unit-level measures
Standardized data collection forms, developed by the research team in consultation with TREC senior decision makers, are used to collect unit- and facility-level data. Examples of data collected using these forms include: facility operation model (e.g., public, private, voluntary), facility structure (e.g., number and type of units), services/programs offered (at unit and facility level), major events, and staffing patterns.
Provider (staff)-level measures
The TREC survey is used to collect provider (staff)-level data. The survey is composed of a suite of survey instruments designed to measure: organizational context, knowledge translation, individual factors believed to impact knowledge translation, and staff outcomes believed to be sensitive to both organizational context and knowledge translation. The core of the TREC survey is the Alberta Context Tool (ACT), a survey designed to measure organizational context in complex healthcare settings. The index version of the ACT was developed for use in acute care settings  and has been adapted for and piloted in the long- term care setting as part of our feasibility work for this project. There are variations of the tool for each of the following groups: healthcare aides, nurses (licensed practical nurses/registered nurses), physicians, allied healthcare providers, practice specialists, and care managers. In addition to the ACT, several additional scales are included in the TREC survey. They include: self-reported knowledge translation (operationalized as the use of research or best practice); individual factors – attitude towards research use, belief suspension, and problem solving ability; and measures of staff outcomes – burnout, aggression from residents, job and career satisfaction, and health status.
Psychometric properties of the TREC survey
The ACT is a 51-item measure of organizational context. The tool includes eight dimensions: leadership, culture, evaluation, formal interactions, informal interactions, social capital, structural and electronic resources, and organizational slack. The first three dimensions assess organizational context as conceptualized in the PARiHS framework , while dimensions four through eight represent our expanded view of organizational context. Taken together, these eight dimensions, using principal components analysis, have revealed a fourteen-factor structure explaining 70% of the variance in organizational context in acute care (hospital) settings. Further, in the acute care sector each dimension has shown acceptable internal reliability (Cronbach α, range = 0.65 to 0.92) . While initial psychometric analyses from our long-term care feasibility work were limited by sample size, we have been able to verify a stable three-factor structure representing 74% of the variance in organizational context for the first three dimensions of the ACT (leadership, culture, and evaluation) in long-term care. Reliability coefficients (Cronbach α) for the eight dimensions were acceptable.
Knowledge translation, in the TREC Survey, refers to the use of research or new knowledge in practice. Four types of research utilization (instrumental, conceptual, persuasive, and overall) are assessed. The items used to measure research use have produced consistent findings in past studies [75, 76] indicating reliability. Construct validity of the measures with structural equation modeling has also been reported .
Attitude, in the TREC survey, refers to the opinion expressed, along a continuum of negative to positive, by healthcare workers towards research knowledge. A six-item abbreviated scale is used based on Lacey's  modification of a questionnaire developed by Champion and Leach . The abbreviated scale has demonstrated good reliability (Cronbach α = 0.74) and construct validity (one factor accounting for 48% of the variance in 'attitude towards research') .
Belief suspension refers to the degree to which an individual is able to suspend previously held beliefs in order to implement a research-based change. It measures personal beliefs of the healthcare worker (i.e., those beliefs that originate in the family of origin [the home], in school/training, or within the work context). A six-item scale (three items measuring willingness to suspend belief, and three items measuring actual suspension of belief) developed by Estabrooks  is used in the TREC survey. The scale has shown good reliability (Cronbach α = 0.87) and construct validity (two factors accounting for 78% of the variance in 'belief') in previous research .
Problem-solving ability refers to the ability of an individual to implement behaviors that reflect a goal directed sequence of cognitive operations utilized to cope with challenges or demands . An abbreviated form (10 items) of Heppner's 32-item Problem Solving Inventory (PSI) is used in the TREC survey. The abbreviated form has shown good reliability (Cronbach α = 0.74) and construct validity (three factors corresponding to the original three factors of the 32-item PSI, accounting for 61% of the variance in 'problem solving ability') . In this project, we have permission to append the abbreviated version to the TREC survey.
Burnout is assessed using the Maslach Burnout Inventory General Survey (MBI-GS) [82, 83]. In this instrument, respondents are asked to indicate the frequency with which they have experienced specific feelings. The original MBI-GS contained 16 items, and is reliable with Cronbach α coefficients ranging from 0.88 to 0.90 for its subscales [83, 84]. Factorial validity using structural equation modeling and construct validity based on convergence and divergence have also been reported . In this project, we have permission to append the MBI-GS (short-form), which consists of nine items, to the TREC survey.
Health status is measured using the SF- 8™ Health Survey, a multi-purpose short- form health survey with eight questions. It yields an eight- scale profile of functional health and well- being scores, as well as psychometrically-based physical and mental health summary measures and a preference- based health utility index. The eight questions included in the SF- 8™ Health Survey were selected from pools of empirically tested items, and are scored on the same norm-based metric as the original larger SF-36 scale . Items in the SF- 8™ Health Survey ask respondents to consider a specific period of time, or recall period, when responding. The instrument has shown good reliability (Cronbach α coefficients of >0.76 for all eight subscales, and a test- retest reliability coefficient of >0.80) . Construct validity using factor analysis has also been established . We have permission to append the standard form (four-week recall) of the SF- 8™ Health Survey to the TREC survey.
Aggression in the workplace
Aggression in the workplace is measured in the TREC survey with a modification of the Workplace Violence Instrument (WVI). The WVI consists of a subset of questions developed by Estabrooks and colleagues  based on a critical review of the literature and is designed to assess six types of aggressive (violent) behavior: inappropriate yelling or screaming; verbal threats; hurtful remarks or behaviors; spit on, bitten, hit, pushed or pinched; repeated and unwanted questions or remarks of a sexual nature; and sexual touching. The scale has shown variation in a large international study (indicating reliability) [87, 88].
Resident demographic and outcome data are collected (retrospectively) at the unit and facility level (that is, de-identified at the individual resident level) using routinely collected RAI-MDS 2.0 data. The RAI- MDS 2.0 is an international system for capturing essential information about the health, physical, mental, and functional status of continuing and long-term care facility residents [89–97]. It consists of seven assessment modules and tracking forms, including an initial or admission assessment, annual assessment, quarterly assessments, assessments for major health-related events, as well demographic change, discharge, and facility profile tracking forms. The instrument is used in long-term care facilities across the Prairie Provinces where this project is taking place. Numerous reports describe the reliability, validity, and sensitivity of change of the indicators of resident outcomes captured with the instrument [96, 98–104]. In this project we are initially focusing on the following four indicators as outcome variables in our analysis: pain management, falls and fractures, problem behavior management, and the health status index – a composite measure of health-related quality of life. During the five years of the project other resident outcomes captured with the RAI-MDS 2.0 data may also be used.
Procedures (year one)
Feasibility testing and piloting of the TREC survey
Investigation of knowledge uptake in the long-term care sector is nascent. Therefore, our first year's work was to undertake feasibility testing in the sector and pilot the TREC survey in long- term care facilities with frontline workers. The purpose of this feasibility work has been to: tailor the TREC survey for use by frontline (primarily healthcare aide) workers in the long-term care environment; assess the feasibility of our data collection procedures and modify them accordingly for the main project; and confirm/establish reliability and validity of the survey in the long-term care context.
We conducted feasibility and pilot testing of the TREC survey with unregulated, regulated, and managerial staff in all three Prairie Provinces. Our pilot work demonstrated that online surveys were not a viable option for the healthcare aide group at this time, and that the survey could be administered more effectively and in a shorter time interval with these workers by using a structured interview format (mean time using personal interview of 19 minutes compared to a mean time using pen and paper of 35 minutes). Therefore, we are using a computer-assisted personal interview (CAPI) format of survey administration with healthcare aide staff in the main project. Based on acceptable response rates with online versions of the ACT in acute care settings with regulated and managerial workers [74, 105] we are offering the TREC survey in online format only to these groups.
Our sample consists of two facility (i.e., nursing home) samples. Our primary sample consists of urban facilities drawn proportionately from the three provinces. We require a minimum of 25 facilities for multi- level modeling . We have therefore over- sampled (to 30 urban facilities) to account for facility attrition over the five-year period and to strengthen our models. A second sample is composed of rural facilities. We realize that care in rural settings may present different challenges and opportunities from those in urban settings. Therefore, we are studying six rural facilities in our sample. All rural facilities are located within the province of Saskatchewan as they deliver more care in rural settings than the other Prairie Provinces. Thus, our combined facility sample size is 36 facilities.
Facility Inclusion and Exclusion Criteria
Facility Inclusion Criteria
1. Registered by the provincial government
2. 90% of residents over 65
3. Conduct RAI-MDS 2.0 assessment since September 2007
4. Facility operation conducted in the English language
5. Rural sites greater than 100 km (but less than 200 km) radius of Regina or Saskatoon, and with populations of 10,000 people or less
6. Urban facilities must be within designated health regions (i.e., Alberta – Edmonton, Calgary, or East Central; Manitoba – Winnipeg; Saskatchewan – Regina-Qu'Appelle or Saskatoon)
7. Stable or minimal level of organizational flux
Facility Exclusion Criteria
1. Facilities integrated with acute care
2. Facilities with a sub-acute service
3. Rural facilities within the Capital Health Region (Edmonton, AB), Calgary Health Region (Calgary, AB), and Winnipeg Regional Health Authority (Winnipeg, MB) that reside in places with populations of 10,000 people or less
4. Rural facilities less than 100 km or greater than 200 km of Regina or Saskatoon (SK)
5. Facilities with less than 35 long-term care beds
6. Dementia special needs facilities
7. Facilities undergoing (or expected to undergo) a degree of organizational flux within the proposed five-year lifespan of the TREC program
Provider (staff) sample
Provider (Staff) Inclusion and Exclusion Criteria
1. Identify a unit within a facility where they have worked for at least three months and are working now
2. Work a minimum of six shifts per month on this unit
1. Healthcare Aide Student
(Registered Nurses [RNs] and Licensed Practical Nurses [LPNs])
1. Identify a unit within a facility where they have worked for at least three months and are now working
2. Work a minimum of six shifts per month on this unit
1. Licensed Practical Nurse/Registered Nurse Student
2. Nursing instructors whose primary role is supervising students
Allied Healthcare Providers
1. Identify a facility in which they provide at least one third (i. e., at least 6 days a month) of their long-term care services
1. Allied Healthcare Student
2. Allied instructors whose primary role is supervising students
1. Physicians who see ten or more residents in a facility
2. The Medical Director of the facility
1. Physicians not currently seeing residents
2. Residents or medical students
3. Academic staff
1. Identify a facility in which they provide at least one third (i. e., at least six days a month) of their long-term care services
1. Academic staff
2. Clinical instructors whose primary role is supervising students
1. Identify one facility in which they work more than 50% of the time.
2. Facility administrators when there is no care manager who is responsible for resident care (e. g. only one unit in the facility)
1. Managers not responsible for resident care (e. g., dietary managers, materials management managers)
We will aggregate the healthcare aides' scores on the TREC survey to compute unit and facility scores; healthcare aides are the primary care providers for residents and provide the majority of direct nursing and related services to residents in long-term care facilities. Based on our previous work with the ACT (and using a two-sample mean sample size calculation), we estimate needing a minimum of ten healthcare aides per unit to complete the TREC survey in order to get stable estimates for aggregated unit scores on the survey's constructs. This is consistent with previous work that we have completed [107, 108].
Procedures (years two to five)
Each province has established a local team responsible for recruitment and data collection. This team is led by a site investigator(s) and includes a research manager, research associate, research assistant(s), and in some cases graduate students and post-doctoral fellows.
Facility and unit level data
We are collecting facility-level data (e.g., funding, resident census, staffing, services and programs, and staff absence) using standardized data collection forms which are administered in short structured interviews with facility administrators (directors of care). Stable items (e.g., postal code, age of facility) are being collected only at the start of the project. Other items (e.g., major events, staff turnover) are collected for each year of TREC survey data collection. We are also collecting unit-level data (e.g., type of unit, average length of resident stay, number of occupied beds, staffing patterns) using standardized unit data collection forms. These are also administered for each year of TREC survey data collection in short structured interviews with unit care managers.
Provider (staff)-level data
Members of each provincial research team, in consultation with the site administrator (or designate), arrange for recruitment of study participants. Potential participants are informed about the study through a variety of communication strategies, including informal information sessions in each facility by a member(s) of the local research team. Potential participants are provided with a study information sheet at this time.
Staff in the 36 facilities are asked to complete the TREC survey. The survey contains 141 to 167 items, depending on the target staff group. A vendor  has been contracted to develop and administer the electronic/online version of the survey (for the regulated and managerial staff) and to develop the CAPI version of the survey (for the healthcare aides). In both administration methods the vendor is responsible for secure, accurate, and reliable data capture with appropriate linkages, and secure transfer of the data to the central study server.
Interviewers (trained TREC research staff and contracted interviewers) administer the CAPI survey to healthcare aides. The interviews are completed during the healthcare aide's work time, or if they prefer, an alternative time and place is arranged. Interviewers are trained in both technical aspects of the CAPI process as well as interview technique and trouble shooting. Quality control practices specific to the CAPI interviewing are in place and will be monitored and maintained through the duration of the project.
For the online surveys, a survey package containing an information letter/invitation to participate is distributed by a member of the research team to all regulated and managerial workers in the selected facilities that meet our inclusion criteria and can be contacted. This survey package contains a business card with the URL and a password to enable access to the survey. In addition, the package contains a coffee card as a token of our appreciation and information sheets. There is no opportunity for the participant to identify themselves to the research team. Completed web surveys will not contain names or identifying information. Further, the computer data will be password protected and only accessible to the research team working on this study. Two weeks and four weeks following the distribution of initial survey packages, a printed reminder (in the form of a poster) is posted on the units of the participating facilities.
RAI-MDS 2.0 data are collected, in electronic format, on a quarterly basis as part of routine clinical care at all of the long-term care facilities in the health regions involved in this project. Staff in the central data processing unit for TREC (located at the University of Alberta) are responsible for receiving and managing the RAI- MDS 2.0 data (in electronic format) from the appropriate provincial/facility custodians on a quarterly basis for the duration of the project. The data are supplied de-identified at the level of the individual resident but contains (or they can be created) unit- and facility-level identifiers (needed to conduct our multi-level modeling).
Interviewer training for individuals conducting CAPI with healthcare aides has been undertaken to ensure standardized interviewer technique and the collection of high-quality data. Interviewer and quality control manuals have been created to facilitate data quality processes for these interviews. The interviewer manual describes the step-by-step process of conducting a CAPI interview, and the process by which the data are handled. The quality control manual outlines the characteristics of a successful interviewer and the training and process that must be undertaken before someone is deemed to be prepared to begin interviewing. Quarterly and yearly quality control and improvement processes are in place.
Data analysis is an ongoing iterative process. Data are cleaned and processed for analyses at the close of each quarter. Real-time descriptive analyses are completed more frequently to assess response rates and to ensure that interviewer variation is within expected limits. As the data set is assembled, we are performing ongoing descriptive analyses to: check for outliers and systematic biases, monitor response rates, and inform variable selection for modeling. These analyses are also being used to inform TREC project two data collection . In addition, we are computing response rates and distributions (means, medians, standard deviations) for the knowledge translation measures and all of the constructs assessed in the TREC survey by provider group, unit, facility, region, and province.
Psychometric analysis (ACT)
Psychometric analyses on the ACT component of the TREC survey will be carried out to determine the tool's robustness in the long-term care setting (pilot testing in the LTC setting yielded satisfactory results). In brief, we will conduct reliability (internal consistency) and validity (factor analysis, item analysis, and modeling) analyses. We will examine corrected item-total correlations and coefficient alpha. Exploratory factor analytic methods will be used to: indicate the underlying domains (factors) within the item pool of the ACT, which will provide an explanation of variance amongst items; to operationalize the meaning of the underlying factors; and to determine if our derived variables (e.g., organizational slack) behave as expected. Construct validity assessments with confirmatory factor analysis (using structural equation modeling) will also be performed.
After reviewing the descriptive analyses for the total data set we will undertake analysis of variance (ANOVA) and multiple comparison tests as sample size permits in order to investigate differences in knowledge translation behaviours among staff groups (i.e., healthcare aides, nurses, physicians, allied health, practice specialists, care managers) and between units, facilities, regions, and provinces. We will use similar methods to describe and assess differences in resident (e.g., falls) and provider (e.g., health status, burnout) outcomes. Additionally, differences among staff groups, units, facilities, regions, and provinces on all independent variables (e.g., ACT dimensions) will be examined with similar descriptive and ANOVA methods.
The majority of our analytical work will consist of a series of regression models, then multi-level and structural equation models, and finally, if our data permits, hierarchical structural equation models. We will estimate the knowledge translation dependent variables at the individual provider (staff) level. Staff characteristics, individual, and context variables will be the primary explanatory variables in these equations. We will then use the predictions of knowledge translation variables as independent variables in additional equations to estimate staff and resident outcomes, with the individual staff member/resident as the unit of analysis. Resident characteristics, staff characteristics, and predictions of knowledge translation variables aggregated to the unit or facility level will be the primary explanatory variables in these equations. We will perform multi-level analysis using organizational data (aggregated) at the unit level with subjects nested within each unit. We have three levels of organizational data in the survey- facility (level three), unit (level two), and individual (level one). In further analyses, we will use these data in structural equation models to explore the relationships among different outcomes and context variables, including latent variables. This may be of particular importance in analyzing the knowledge translation variables, which have qualities that are difficult to observe directly.
As a value-added function for the participating long-term care facilities we will provide them with annual facility reports approximately six weeks after we have the second wave of data collection (so that we can provide wave 1 and wave 2 comparisons). Our decision makers have informed us that because many of the long-term care facilities within their regions have limited internal data analysis capability, periodic private reports on their own data would be of value. These reports will be at the facility level and may include some de-identified unit-level feedback, but will not allow for identification of specific residents, staff and/or units. The format of the report will be the same in all facilities and have been determined in a consultative process with the facilities in the first year of the main study. In addition to the agreed upon data elements requested by the facilities, a section of the report will also emphasize variances of note for the individual facility.
Feedback to Health Care Aides
Our original intention was to disseminate survey results at the end of the 5-year program. However, during year one HCA's voiced a strong desire to receive feedback as the study progressed. Consistent with the integrated KT approach we are using and in response to this request, a decision was made to provide feedback to HCA's following each wave of TREC survey data collection. To this end, we developed feedback reports and established a process to evaluate their effectiveness. The report development phase involved selection of single items from the survey, analysis of the data for the purposes of presenting comparative data, and preparation of sample feedback reports. We consulted with key stakeholders to elicit feedback on the sample reports; this informed a number of revisions to the reports. This feedback occurs shortly after the current wave of data collection is completed in a facility.
Ethical approval for this project was obtained from the appropriate university ethics boards: Universities of Alberta, Calgary, Manitoba, Saskatchewan, and Regina. We have also received relevant operational approvals from the 36 selected long-term care facilities, as well as RAI-MDS 2.0 custodian approvals. Data collection has proceeded in quarters, occurring during all 12 months. All data in this study are held confidentially. Master files that can be linked to units and facilities are locked with restricted access. Other team members and staff will have access as required (i.e., for analysis) to data files with scrambled identification codes. All data are held centrally at the University of Alberta on secure dedicated servers according to Tri Council and generally accepted standards for similar data collections.
We anticipate that the proposed project, as one component of the larger TREC program, will contribute to the development of new knowledge translation theory about the role of organizational context in influencing knowledge use in long-term care settings (and particularly among unregulated caregivers), as well as the role of context on provider and resident outcomes.
There are a number of areas of challenge associated with this project. The first area of challenge relates to sampling, recruitment, and retention over the five-year period of the project. Our sampling approach was guided by the need to balance the selection of facilities by operation model, facility size, and province to the extent feasible. However, each province has differing numbers of facilities, as well as differing distributions of small and large facilities, and operation models. This has lead to some provinces being over- or under- represented in specific matrix cells.
Recruitment of staff participants has been challenging in our previous research. We are undertaking a comprehensive recruitment and retention process that began as we formulated the team and included senior decision-makers in each jurisdiction. Members of each provincial team visit the recruited facilities prior to commencing data collection and meet with all levels of staff to inform them of the study and its potential benefits. The project managers in each province maintain regular contact with each site and project co-lead investigators visit each province on a regular schedule. While we hope to maintain a stable number of respondents in each year of the project, we are not following a cohort of caregivers throughout the five years. While limiting some of our analytical possibilities, a cohort of staff is not necessary to examine the effect of context on knowledge translation, or staff and resident outcomes in the residential long-term care environment.
A second area of challenge for this project is survey administration, and in particular, administration to the healthcare aides. We had originally intended to use online surveys for all staff, including healthcare aides, although we knew we might need to use paper-based surveys for the healthcare aide group. Our early feasibility and pilot work demonstrated that online surveys were not a viable option for the healthcare aide group, at least at this time. We also discovered that traditional paper and pencil administration resulted in poor data quality. Therefore, we elected to administer the survey to this group using CAPI in the main project. Costs for this approach are higher than for the original, planned online survey administration. Therefore, analyses are planned to assess costs compared to benefits of using the CAPI approach. In these analyses, we will pay particular attention to the balance between data completeness, data quality and cost.
A third area of challenge relates to the provision of definitions to guide the project – as expected, we require standard definitions of terms to ensure consistency in data collection and analysis procedures between the three provinces. We have found, however, that a number of our definitions have required ongoing revisions. For example, we have found considerable variation between how a 'unit' is defined both between facilities in a province and between provinces. A standard definition of 'unit' that can be applied across settings is important to understanding the structure of different long-term care facilities, and also goes to aggregation of staff scores to create unit-level scores for the TREC survey constructs. With respect to creating standard definitions, another challenge we face is that different terms often are used to refer to the same concept between the three provinces. For example, in Alberta there are a several terms used to refer to unregulated workers (e.g., personal care attendant, healthcare aide, resident companion) that are different again from the term used in Saskatchewan (e.g., special care attendant). To address this definitional challenge, we are creating a universal TREC glossary that identifies all possible terms associated with the research program.
The project described in this protocol will make an important contribution to the advancement of knowledge translation theory as far as it considers the effect of organizational context on knowledge translation, and the subsequent impact of organizational context and knowledge translation on resident and staff outcomes in residential long-term care settings. The theoretical insights will then be used to design interventions to modify elements of organizational context that improve knowledge translation and outcomes for residents and staff in future studies.
The authors acknowledge the TREC team for its contributions to this study. Funding was provided by the Canadian Institutes of Health Research (CIHR) (MOP #53107). Dr Estabrooks is supported by a CIHR Canada Research Chair in Knowledge Translation. Ms Squires is supported by CIHR, AHFMR, and Killam Fellowships and Faculty of Nursing (University of Alberta). Dr Cummings is supported by career scientist awards from CIHR and AHFMR.
- Estabrooks CA, Hutchinson AM, Squires JE, Birdsell JM, Degner L, Sales AE, Norton PG: Translating Research in Elder Care: An introduction to a study protocol series. Implement Sci. 2009, 4 (1): 51-10.1186/1748-5908-4-51.PubMedPubMed CentralGoogle Scholar
- Rycroft-Malone J, Dopson S, Degner L, Hutchinson AM, Estabrooks CA: Study protocol for the Translating Research in Elder Care (TREC): Building Context Through Case Studies in Long-Term Care Project (Project 2). Implement Sci. 2009, 4 (1): 53-10.1186/1748-5908-4-53.PubMedPubMed CentralGoogle Scholar
- Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: The use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.PubMedGoogle Scholar
- Estabrooks CA, Thompson DS, Lovely JJ, Hofmeyer A: A guide to knowledge translation theory. J Contin Educ Health Prof. 2006, 26: 25-36. 10.1002/chp.48.PubMedGoogle Scholar
- Sales A, Smith J, Curran G, Kochevar L: Models, strategies, and tools: Theory in implementing evidence-based findings into health care practice. J Gen Intern Med. 2006, 21 Suppl 2: S43-S49.PubMedGoogle Scholar
- Rogers EM: Diffusion of Innovations. 2003, New York: Free Press, 5Google Scholar
- Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: Time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.PubMedGoogle Scholar
- Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence based practice: A conceptual framework. Qual Saf Health Care. 1998, 7: 149-158. 10.1136/qshc.7.3.149.Google Scholar
- Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B: What counts as evidence in evidence-based practice?. J Adv Nurs. 2004, 47: 81-90. 10.1111/j.1365-2648.2004.03068.x.PubMedGoogle Scholar
- McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K: Getting evidence into practice: The meaning of 'context'. J Adv Nurs. 2002, 38: 94-104. 10.1046/j.1365-2648.2002.02150.x.PubMedGoogle Scholar
- Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, Seers K: Getting evidence into practice: The role and function of facilitation. J Adv Nurs. 2002, 37: 577-588. 10.1046/j.1365-2648.2002.02126.x.PubMedGoogle Scholar
- Rodgers SE: The extent of nursing research utilization in general medical and surgical wards. J Adv Nurs. 2000, 32: 182-193. 10.1046/j.1365-2648.2000.01416.x.PubMedGoogle Scholar
- Berggren AC: Swedish midwives' awareness of, attitudes to and use of selected research findings. J Adv Nurs. 1996, 23: 462-470. 10.1111/j.1365-2648.1996.tb00007.x.PubMedGoogle Scholar
- Dobbins M, Cockerill R, Barnsley J: Factors affecting the utilization of systematic reviews: A study of public health decision makers. Int J Technol Assess Health Care. 2001, 17: 203-214. 10.1017/S0266462300105069.PubMedGoogle Scholar
- Dooks P: Diffusion of pain management research into nursing practice. Cancer Nurs. 2001, 24: 99-103. 10.1097/00002820-200104000-00004.PubMedGoogle Scholar
- Lia-Hoagberg B, Schaffer M, Strohschein S: Public health nursing practice guidelines: An evaluation of dissemination and use. Public Health Nurs. 1999, 16: 397-404. 10.1046/j.1525-1446.1999.00397.x.PubMedGoogle Scholar
- Michel Y, Sneed NV: Dissemination and use of research findings in nursing practice. J Prof Nurs. 1995, 11: 306-311. 10.1016/S8755-7223(05)80012-2.PubMedGoogle Scholar
- Milner MF, Estabrooks CA, Humphrey C: Clinical nurse educators as agents for change: Increasing research utilization. Int J Nurs Stud. 2005, 42: 899-914. 10.1016/j.ijnurstu.2004.11.006.PubMedGoogle Scholar
- Rutledge DN, Greene P, Mooney K, Nail LM, Ropka M: Use of research-based practices by oncology staff nurses. Oncol Nurs Forum. 1996, 23: 1235-1244.PubMedGoogle Scholar
- Varcoe C, Hilton A: Factors affecting acute-care nurses' use of research findings. Can J Nurs Res. 1995, 27: 51-71.PubMedGoogle Scholar
- Lomas J: Retailing research: Increasing the role of evidence in clinical services for childbirth. Milbank Q. 1993, 71: 439-475. 10.2307/3350410.PubMedGoogle Scholar
- Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: An overview of systematic reviews of interventions. Med Care. 2001, 39: II-2-II-45. 10.1097/00005650-200108002-00002.Google Scholar
- Grimshaw JM, Eccles MP, Greener J, Maclennan G, Ibbotson T, Kahan JP, Sullivan F: Is the involvement of opinion leaders in the implementation of research findings a feasible strategy?. Implement Sci. 2006, 1: 3-10.1186/1748-5908-1-3.PubMedPubMed CentralGoogle Scholar
- Thomson O'Brien MA, Oxman AD, Haynes RB, Davis DA, Freemantle N, Harvey EL: Local opinion leaders: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2004, CD000125-Google Scholar
- Grimshaw JM, Thomas RE, MacIennan G, Fraser CR, Vale L, Whity P, Eccles MP, Matowe L, Shirran L, Wensing M, Dikstra R, Donaldson C, Hutchison A: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 1-72.Google Scholar
- Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA, Cochrane Effective Practice and Organisation of Care Review Group: Getting research findings into practice: Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998, 317: 465-468.PubMedPubMed CentralGoogle Scholar
- Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, CD000259-Google Scholar
- Sapyta J, Riemer M, Bickman L: Feedback to clinicians: Theory, research, and practice. J Clin Psychol. 2005, 61: 145-153. 10.1002/jclp.20107.PubMedGoogle Scholar
- Grimshaw JM, Eccles MP, Walker AE, Thomas RE: Changing physicians' behavior: What works and thoughts on getting more things to work. J Contin Educ Health Prof. 2002, 22: 237-243. 10.1002/chp.1340220408.PubMedGoogle Scholar
- Bostrom J, Suter WN: Research utilization: Making the link to practice. J Nurs Staff Dev. 1993, 9: 28-34.PubMedGoogle Scholar
- Champion VL, Leach A: Variables related to research utilization in nursing: An empirical investigation. J Adv Nurs. 1989, 14: 705-710. 10.1111/j.1365-2648.1989.tb01634.x.PubMedGoogle Scholar
- Coyle LA, Sokop AG: Innovation adoption behavior among nurses. Nurs Res. 1990, 39: 176-180. 10.1097/00006199-199005000-00016.PubMedGoogle Scholar
- Butler L: Valuing research in clinical practice: A basis for developing a strategic plan for nursing research. Can J Nurs Res. 1995, 27: 33-39.PubMedGoogle Scholar
- Hong SW, Ching TY, Fung JP, Seto WL: The employment of ward opinion leaders for continuing education in the hospital. Med Teach. 1990, 12: 209-217. 10.3109/01421599009006698.PubMedGoogle Scholar
- Tranmer JE, Lochhaus-Gerlach J, Lam M: The effect of staff nurse participation in a clinical nursing research project on attitude towards, access to, support of and use of research in the acute care setting. Can J Nurs Leadersh. 2002, 15: 18-26.PubMedGoogle Scholar
- Tsai S-L: Nurses' participation and utilization of research in the Republic of China. Int J Nurs Stud. 2000, 37: 435-444. 10.1016/S0020-7489(00)00023-7.PubMedGoogle Scholar
- Rodgers SE: A study of the utilization of research in practice and the influence of education. Nurse Educ Today. 2000, 20: 279-287. 10.1054/nedt.1999.0395.PubMedGoogle Scholar
- Kirchhoff KT: A diffusion survey of coronary precautions. Nurs Res. 1982, 31: 196-201. 10.1097/00006199-198207000-00002.PubMedGoogle Scholar
- Profetto-McGrath J, Hesketh KL, Lang S, Estabrooks CA: A study of critical thinking and research utilization among nurses. West J Nurs Res. 2003, 25: 322-337. 10.1177/0193945902250421.PubMedGoogle Scholar
- Dufault MA, Bielecki C, Collins E, Willey C: Changing nurses' pain assessment practice: A collaborative research utilization approach. J Adv Nurs. 1995, 21: 634-645. 10.1046/j.1365-2648.1995.21040634.x.PubMedGoogle Scholar
- Estabrooks CA, Floyd JA, Scott-Findlay S, O'Leary KA, Gushta M: Individual determinants of research utilization: A systematic review. J Adv Nurs. 2003, 43: 506-520. 10.1046/j.1365-2648.2003.02748.x.PubMedGoogle Scholar
- Damanpour F: The adoption of technological, administrative, and ancillary innovations: Impact of organizational factors. J Manag. 1987, 13: 675-688. 10.1177/014920638701300408.Google Scholar
- Damanpour F: Organizational complexity and innovation: Developing and testing multiple contingency models. Manage Sci. 1996, 42: 693-716. 10.1287/mnsc.42.5.693.Google Scholar
- Meyer A, Goes J: Organizational assimilation of innovations: A multilevel contextual analysis. Acad Manage Rev. 1988, 31: 897-923. 10.2307/256344.Google Scholar
- Mohr L: Determinants of innovation in organizations. Am Polit Sci Rev. 1969, 63: 111-126. 10.2307/1954288.Google Scholar
- Orlandi M: The diffusion and adoption of worksite health promotion innovations: An analysis of barriers. Prev Med. 1986, 15: 522-536. 10.1016/0091-7435(86)90028-9.PubMedGoogle Scholar
- Kimberly J, Evanisko M: Organizational innovation: The influence of individual, organizational, and contextual factors on hospital adoption of technological and administrative innovations. Acad Manage J. 1981, 24: 689-713. 10.2307/256170.PubMedGoogle Scholar
- Germain R: The role of context and structure in radical and incremental logistics innovation adoption. Bus Res. 1996, 35: 117-127. 10.1016/0148-2963(95)00053-4.Google Scholar
- Brett JLL: Organizational integrative mechanisms and adoption of innovations by nurses. Nurs Res. 1989, 38: 105-110.PubMedGoogle Scholar
- Howell J, Higgins C: Champions of change: Identifying understanding, and supporting champions of technological innovations. Organ Dyn. 1990, 19: 40-55. 10.1016/0090-2616(90)90047-S.Google Scholar
- Markham S, Green S, Basu R: Champions and antagonists: Relationships with R&D project characteristics and management. J Eng Tech Manag. 1991, 8: 217-242. 10.1016/0923-4748(91)90012-G.Google Scholar
- Schon D: Champions for radical new inventions. Harv Bus Rev. 1963, 41: 77-86.Google Scholar
- Downs G, Mohr L: Conceptual issues in the study of innovation. Adm Sci Q. 1976, 21: 700-714. 10.2307/2391725.Google Scholar
- Scott S, Bruce R: Determinants of innovative behaviour: A path model of individual innovation in the workplace. Acad Manage J. 1994, 37: 580-607. 10.2307/256701.Google Scholar
- Damanpour F: Organizational innovation: A meta-analysis of effects of determinants and moderators. Acad Manage J. 1991, 34: 555-590. 10.2307/256406.Google Scholar
- Pettengill MM, Gillies DA, Clark CC: Factors encouraging and discouraging the use of nursing research findings. Image J Nurs Sch. 1994, 26: 143-147. 10.1111/j.1547-5069.1994.tb00934.x.PubMedGoogle Scholar
- Richens Y: Are midwives using research evidence in practice?. Br J Midwifery. 2001, 9: 237-242.Google Scholar
- Rodgers S: An exploratory study of research utilization by nurses in general medical and surgical wards. J Adv Nurs. 1994, 20: 904-911. 10.1046/j.1365-2648.1994.20050904.x.PubMedGoogle Scholar
- Tyden T: The contribution of longitudinal studies for understanding science communication and research utilization. Sci Commun. 1996, 18: 29-48. 10.1177/1075547096018001002.Google Scholar
- Dunn V, Crichton N, Roe B, Seers K, Williams K: Using research for practice: A UK experience of the BARRIERS Scale. J Adv Nurs. 1997, 26: 1203-1210. 10.1111/j.1365-2648.1997.tb00814.x.PubMedGoogle Scholar
- Griffiths JM, Bryar RM, Closs SJ, Cooke J, Hostick T, Kelly S, Marshall K: Barriers to research implementation by community nurses. Br J Community Nurs. 2001, 6: 501-510.PubMedGoogle Scholar
- Mayhew PA: Overcoming barriers to research utilization with researched-based practice guidelines. Medsurg Nurs. 1993, 2: 336-337.PubMedGoogle Scholar
- Retsas A: Barriers to using research evidence in nursing practice. J Adv Nurs. 2000, 31: 599-606. 10.1046/j.1365-2648.2000.01315.x.PubMedGoogle Scholar
- Clifford C, Murray S: Pre- and post-test evaluation of a project to facilitate research development in practice in a hospital setting. J Adv Nurs. 2001, 36: 685-695. 10.1046/j.1365-2648.2001.02033.x.PubMedGoogle Scholar
- Humphris D, Littlejohns P, Victor C, O'Halloran P, Peacock J: Implementing evidence-based practice: Factors that influence the use of research evidence by occupational therapists. Br J Occup Ther. 2000, 63: 516-522.Google Scholar
- Royle JA, Blythe J, DiCenso A, Boblin-Cummings S, Deber R, Hayward R: Evaluation of a system for providing information resources to nurses. Health Informatics J. 2000, 5: 100-109. 10.1177/146045820000600208.Google Scholar
- Hefferin EA, Horsley JA, Ventura MR: Promoting research-based nursing: The nurse administrator's role. J Nurs Adm. 1982, 12: 34-41.PubMedGoogle Scholar
- Funk SG, Champagne MT, Wiese RA, Tornquist EM: Barriers to using research findings in practice: The clinician's perspective. Appl Nurs Res. 1991, 4: 90-95.PubMedGoogle Scholar
- Walczak JR, McGuire DB, Haisfield ME, Beezley A: A survey of research-related activities and perceived barriers to research utilization among professional oncology nurses. Oncol Nurs Forum. 1994, 21: 710-715.PubMedGoogle Scholar
- Rizzuto C, Bostrom J, Newton Suter W, Chenitz WC: Predictors of nurses' involvement in research activities. West J Nurs Res. 1994, 16: 193-204. 10.1177/019394599401600206.PubMedGoogle Scholar
- Hatcher S, Tranmer J: A survey of variables related to research utilization in nursing practice in the acute care setting. Can J Nurs Adm. 1997, 10: 31-53.PubMedGoogle Scholar
- Research on Aging: Providing Evidence for Rescuing the Canadian Health Care System. [http://www.cihr-irsc.gc.ca/e/10519.html]
- Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C: Ingredients for change: Revisiting a conceptual framework. Qual Saf Health Care. 2002, 11: 174-180. 10.1136/qhc.11.2.174.PubMedPubMed CentralGoogle Scholar
- Estabrooks CA, Squires JE, Adachi AM, Kong L, Norton PG: Utilization of Health Research in Acute Care Settings in Alberta Technical Report. 2008, Edmonton: Faculty of Nursing, University of Alberta, Report No. 08-01-TRGoogle Scholar
- Estabrooks CA, Kenny DJ, Cummings GG, Adewale AJ, Mallidou AA: A comparison of research utilization among nurses working in Canadian civilian and United States Army healthcare settings. Res Nurs Health. 2007, 30: 282-296. 10.1002/nur.20218.PubMedGoogle Scholar
- Estabrooks CA, Scott S, Squires JE, Stevens B, O'Brien-Pallas L, Watt-Watson J, Profetto-McGrath J, McGilton K, Golden-Biddle K, Lander J, Donner G, Boschma G, Humphrey CK, Williams J: Patterns of research utilization on patient care units. Implement Sci. 2008, 3: 31-10.1186/1748-5908-3-31.PubMedPubMed CentralGoogle Scholar
- Estabrooks CA: The conceptual structure of research utilization. Res Nurs Health. 1999, 22 (3): 203-216. 10.1002/(SICI)1098-240X(199906)22:3<203::AID-NUR3>3.0.CO;2-9. [http://www3.interscience.wiley.com/journal/61004138/abstract]PubMedGoogle Scholar
- Lacey EA: Research utilization in nursing practice – a pilot study. J Adv Nurs. 1994, 19: 987-995. 10.1111/j.1365-2648.1994.tb01178.x.PubMedGoogle Scholar
- Estabrooks CA: Research utilization in nursing: An examination of formal structure and influencing factors. Dissertation. 1997, Edmonton, AB: University of Alberta, Faculty of NursingGoogle Scholar
- Estabrooks CA: Modeling the individual determinants of research utilization. West J Nurs Res. 1999, 21: 758-772. 10.1177/01939459922044171.PubMedGoogle Scholar
- Heppner PP: The Problem Solving Inventory (PSI): Research Manual. 1988, Palo Alto, CA: Consulting Psychologists PressGoogle Scholar
- Maslach C, Jackson SE: The measurement of experienced burnout. J Occup Behav. 1981, 2: 99-10.1002/job.4030020205.Google Scholar
- Maslach C, Jackson SE, Leiter MP: Maslach Burnout Inventory. 1996, Palo Alto, CA: Consulting Psychologists Press, Inc, 3Google Scholar
- Beckstead JW: Confirmatory factor analysis of the Maslach Burnout Inventory among Florida nurses. Int J Nurs Stud. 2002, 39: 785-792. 10.1016/S0020-7489(02)00012-3.PubMedGoogle Scholar
- Carr A: Adult measures of quality of life. Arthritis Rheum. 2003, 49: S113-S133. 10.1002/art.11414.Google Scholar
- Giovannetti P, Estabrooks CA, Hesketh KL: Alberta Nurse Survey Final Report. 2002, Edmonton, AB: University of Alberta, Faculty of Nursing, Report No. 02-01-TRGoogle Scholar
- Duncan SM, Hyndman K, Estabrooks CA, Hesketh K, Humphrey CK, Wong JS, Acorn S, Giovannetti P: Nurses' experience of violence in Alberta and British Columbia hospitals. Can J Nurs Res. 2001, 32: 57-78.PubMedGoogle Scholar
- Hesketh KL, Duncan SM, Estabrooks CA, Reimer MA, Giovannetti P, Hyndman K, Acorn S: Workplace violence in Alberta and British Columbia hospitals. Health Policy. 2003, 63: 311-321. 10.1016/S0168-8510(02)00142-2.PubMedGoogle Scholar
- Carpenter GI, Hirdes JP, Ribbe MW, Ikegami N, Challis D, Steel K, Bernabei R, Fries B: Targeting and quality of nursing home care. A five-nation study. Aging (Milano). 1999, 11: 83-89.Google Scholar
- Hirdes JP: Quality control in nursing homes. Can Med Assoc J. 1999, 161: 127-Google Scholar
- Hirdes JP, Fries BE, Morris JN, Steel K, Mor V, Frijters D, LaBine S, Schalm C, Stones MJ, Teare G, Smith T, Marhaba M, Perez E, Jonsson P: Integrated health information systems based on the RAI/MDS series of instruments. Healthc Manage Forum. 1999, 12: 30-40.PubMedGoogle Scholar
- Morris JN, Hawes C, Fries BE, Phillips CD, Mor V, Katz S, Murphy K, Drugovich ML, Friedlob AS: Designing the national resident assessment instrument for nursing homes. Gerontologist. 1990, 30: 293-307.PubMedGoogle Scholar
- Fries BE, Hawes C, Morris JN, Phillips CD, Mor V, Park PS: Effect of the National Resident Assessment Instrument on selected health conditions and problems. J Am Geriatr Soc. 1997, 45: 994-1001.PubMedGoogle Scholar
- Fries BE, Schroll M, Hawes C, Gilgen R, Jonsson PV, Park P: Approaching cross-national comparisons of nursing home residents. Age Ageing. 1997, 26: 13-18.PubMedGoogle Scholar
- Morris JN, Nonemaker S, Murphy K, Hawes C, Fries BE, Mor V, Phillips C: A commitment to change: revision of HCFA's RAI. J Am Geriatr Soc. 1997, 45: 1011-1016.PubMedGoogle Scholar
- Hawes C, Morris JN, Phillips CD, Mor V, Fries BE, Nonemaker S: Reliability estimates for the Minimum Data Set for nursing home resident assessment and care screening (MDS). Gerontologist. 1995, 35: 172-178.PubMedGoogle Scholar
- Hirdes JP: Addressing the health needs of frail elderly people: Ontario's experience with an integrated health information system. Age Ageing. 2006, 35: 329-331. 10.1093/ageing/afl036.PubMedGoogle Scholar
- Fries BE, Simon SE, Morris JN, Flodstrom C, Bookstein FL: Pain in U.S. nursing homes: validating a pain scale for the minimum data set. Gerontologist. 2001, 41: 173-179.PubMedGoogle Scholar
- Bernabei R, Gambassi G, Lapane K, Landi F, Gatsonis C, Dunlop R, Lipsitz L, Steel K, Mor V: Management of pain in elderly patients with cancer: SAGE Study Group: Systematic Assessment of Geriatric Drug Use via Epidemiology. JAMA. 1998, 279: 1877-1882. 10.1001/jama.279.23.1877.PubMedGoogle Scholar
- Gruber-Baldini AS, Zimmerman E, Mortimore E, Magaziner J: The validity of the Minimum Data Set in measuring the cognitive impairment of persons admitted to nursing homes. J Am Geriatr Soc. 2000, 48: 1601-1606.PubMedGoogle Scholar
- Hartmaier SL, Sloane PD, Guess HA, Koch GG, Mitchell CM, Phillips CD: Validation of the minimum data set cognitive performance scale: Agreement with the mini-mental state examination. J Gerontol A Biol Sci Med Sci. 1995, 50: M128-133.PubMedGoogle Scholar
- Lawton MP, Casten R, Parmelee PA, Van Haitsma K, Corn J, Kleban MH: Psychometric characteristics of the minimum data set II: Validity. J Am Geriatr Soc. 1998, 46: 736-744.PubMedGoogle Scholar
- Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J: Inter-rater reliability of nursing home quality indicators in the U.S. BMC Health Serv Res. 2003, 3: 20-10.1186/1472-6963-3-20.PubMedPubMed CentralGoogle Scholar
- Wodchis WP, Hirdes JP, Feeny DH: Health-related quality of life measure based on the minimum data set. Int J Technol Assess Health Care. 2003, 19: 490-506. 10.1017/S0266462303000424.PubMedGoogle Scholar
- Hutchinson AM, Adachi A-M, Kong L, Estabrooks CA, Stevens B: Context and Research Use in the Care of Children: A Pilot Study. 2008, Edmonton, AB: Faculty of Nursing, University of Alberta, Report No. 08-03-TRGoogle Scholar
- Snijders TAB: Power and sample size in multilevel linear models. Encyclopedia of Statistics in Behavioral Science. Edited by: Everitt BS, Howell DC. 2005, Chicester: Wiley, 3: 1570-1573.Google Scholar
- Estabrooks CA, Midodzi WK, Cummings GG, Wallin L: Predicting research use in nursing organizations: A multilevel analysis. Nurs Res. 2007, 56: S7-23. 10.1097/01.NNR.0000280647.18806.98.PubMedGoogle Scholar
- Estabrooks CA, Midodzi WK, Cummings GG, Ricker KL, Giovannetti P: The impact of hospital nursing characteristics on 30-day mortality. Nurs Res. 2005, 54: 74-84. 10.1097/00006199-200503000-00002.PubMedGoogle Scholar
- Nooro Online Research. [http://www.nooro.com/]
- Logan J, Graham ID: Toward a comprehensive interdisciplinary model of health care research use. Sci Commun. 1998, 20: 227-246. 10.1177/1075547098020002004.Google Scholar
- Horsley JA, Crane J, Crabtree MK, Wood DJ: Using Research to Improve Nursing Practice: A Guide. 1983, San Francisco: Grune & StrattonGoogle Scholar
- Krueger JC: Utilization of nursing research: The planning process. J Nurs Adm. 1978, 8: 6-9.PubMedGoogle Scholar
- Stetler CB: Updating the Stetler Model of research utilization to facilitate evidence-based practice. Nurs Outlook. 2001, 49: 272-279. 10.1067/mno.2001.120517.PubMedGoogle Scholar
- Titler MG, Kleiber C, Steelman VJ, Rakel BA, Budreau G, Everett LQ, Buckwalter KC, Tripp-Reimer T, Goode CJ: The Iowa Model of evidence-based practice to promote quality care. Crit Care Nurs Clin North Am. 2001, 13: 497-509.PubMedGoogle Scholar
- Weiss C: The many meanings of research utilization. Public Adm Rev. 1979, 39: 426-431. 10.2307/3109916.Google Scholar
- Daft R, Becker S: Organizational innovation. Innovation in Organizations. 1978, New York: Elsevier, 3-213.Google Scholar
- Daft R: A dual-core model of organizational innovation. Acad Manage J. 1978, 21: 193-210. 10.2307/255754.Google Scholar
- Abrahamson E, Rosenkopf L: Institutional and competitive bandwagons: Using mathematical-modeling as a tool to explore innovation diffusion. Acad Manage Rev. 1993, 18: 487-517. 10.2307/258906.Google Scholar
- Warner K: A "desperation-reaction" model of medical diffusion. Health Serv Res. 1975, 10: 369-383.PubMedPubMed CentralGoogle Scholar
- Romanelli E, Tushman M: Organizational transformation as punctuated equilibrium: An empirical test. Acad Manage J. 1994, 37: 1141-1166. 10.2307/256669.Google Scholar
- Orlikowski WJ: Improvising organizational transformation over time: A situated change perspective. Inform Syst Res. 1996, 7: 63-92. 10.1287/isre.7.1.63.Google Scholar
- Eisenhardt K: Agency theory: An assessment and review. Acad Manage Rev. 1989, 14: 57-75. 10.2307/258191.Google Scholar
- Reay T, Golden-Biddle K, GermAnn K: Legitimizing a new role: Small wins and micro-processes of change. Acad Manage J. 2006, 49: 977-998.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.