- Study protocol
- Open Access
- Open Peer Review
Improving quality of care through routine, successful implementation of evidence-based practice at the bedside: an organizational case study protocol using the Pettigrew and Whipp model of strategic change
Implementation Sciencevolume 2, Article number: 3 (2007)
Evidence-based practice (EBP) is an expected approach to improving the quality of patient care and service delivery in health care systems internationally that is yet to be realized. Given the current evidence-practice gap, numerous authors describe barriers to achieving EBP. One recurrently identified barrier is the setting or context of practice, which is likewise cited as a potential part of the solution to the gap. The purpose of this study is to identify key contextual elements and related strategic processes in organizations that find and use evidence at multiple levels, in an ongoing, integrated fashion, in contrast to those that do not.
The core theoretical framework for this multi-method explanatory case study is Pettigrew and Whipp's Content, Context, and Process model of strategic change. This framework focuses data collection on three entities: the Why of strategic change, the What of strategic change, and the How of strategic change, in this case related to implementation and normalization of EBP. The data collection plan, designed to capture relevant organizational context and related outcomes, focuses on eight interrelated factors said to characterize a receptive context. Selective, purposive sampling will provide contrasting results between two cases (departments of nursing) and three embedded units in each. Data collection methods will include quantitative tools (e.g., regarding culture) and qualitative approaches including focus groups, interviews, and documents review (e.g., regarding integration and “success”) relevant to the EBP initiative.
This study should provide information regarding contextual elements and related strategic processes key to successful implementation and sustainability of EBP, specifically in terms of a pervasive pattern in an acute care hospital-based health care setting. Additionally, this study will identify key contextual elements that differentiate successful implementation and sustainability of EBP efforts, both within varying levels of a hospital-based clinical setting and across similar hospital settings interested in EBP.
Evidence-based practice (EBP) is currently an expected approach to improving the quality of patient care and service delivery in health care systems internationally. It has been a widespread expectation for a number of years, but is yet to be realized. Numerous authors note the gap between current practice and available evidence and/or describe multiple barriers to achieving EBP [1–8]. One barrier that is recurrently identified is the setting or context of practice. Context is likewise cited by some as a potential part of the solution to the evidence-practice gap [6, 9–12].
The Committee on Quality of Health Care in America, in Crossing the Quality Chasm, noted the need to recognize quality as a system property, that is, as a contextual property. This need includes systems that "facilitate the application of scientific knowledge to practice, and provide clinicians with the tools and supports necessary to deliver evidence-based care consistently and safely [p. 7–8, ]." Such a focus inherently implies the necessity of a broad, strategic view of the practice environment relative to EBP, or, as evolving research suggests, a need to consider methods and strategies for integrating use of evidence into the fabric of the clinical organization [9, 10, 13, 14]. Such an EBP normalization or institutionalization approach is not evident in most organizations, nor is it the primary focus of implementation research. Instead, there appears to be a narrow project-, practice-, standard-, guideline-, or procedure-oriented approach to introducing evidence for the purpose of improving the way care is delivered in clinical settings. The same narrow approach appears to exist for studying the related implementation process. This fragmented focus has not sufficiently enhanced our knowledge of sustainable implementation. Neither has it appeared to consistently spread related improvements, if they are initially achieved, and thus the research-practice gap continues to be a challenge.
Evolving science in the area of EBP supports the critical role of context, that is the critical role of the health care environment in which practice and EBP efforts take place. Despite this evolving knowledge, it is unclear exactly what key contextual elements are involved, how executives and other organizational leaders can achieve this contextual quality, and what organizational interventions might be tested by researchers to provide guidance to organizational leadership. This project will study the role and evolution of context in the routine or ongoing translation of evidence into practice within targeted services. The "targeted service" in this study will be departments of nursing – a critical player in quality in any health care organization.
Research objectives and overview
The purpose of this project is to understand both key contextual elements and related strategic processes in organizations that find and use evidence at multiple levels – in an ongoing, integrated fashion – in contrast to those that do not. More specifically, it seeks to:
∘ Identify key contextual elements and related strategic processes relevant to successful implementation and sustainability of EBP as the norm within an acute care hospital setting; and
∘ Identify key contextual elements that differentiate successful implementation and sustainability of EBP efforts, both within varying levels of a hospital-based clinical setting and across similar hospital settings interested in EBP.
Table 1 provides definitions both underlying this purpose and relevant to other study components.
The current state of knowledge in this field suggests that it is premature to propose hypotheses or to use a research design to test hypotheses. Given the need to better understand specific organizational factors that are key to normalizing EBP, and the inherent complexity of such phenomena, this study will use an explanatory case study approach . Case study research, built on study questions, will provide a rich description of relevant organizational phenomena. Following this descriptive and theoretical work, propositions can be developed for future testing.
The primary research questions for this case study are as follows:
What key contextual elements support and facilitate: a) Implementation of EBP at the project level, and b) Normalization of EBP within a health care system at multiple institutional levels?
What implementation interventions or strategic processes are used to: a) Facilitate implementation at the project level, and b) Create normalization of EBP within a health care system at multiple institutional levels?
In this study, the term context is defined as the local health care environment in which practice takes place, including related organizational elements (see Table 1) . Additionally, within our conceptual framework the term context is one of Pettigrew and Whipp's three "essential dimensions" of strategic change (i.e., "content, context and process") . Related definitions are explained more fully below.
Our theoretically-based data collection will also afford a post hoc opportunity for exploration of three EBP models relevant to nursing as well as health care in general: the Ottawa Model of Research Use , PARIHS framework , and Stetler organizational model . Each of these models is designed to provide guidance on how to achieve successful implementation. Each has a contextual element, and study data will be used to scrutinize those contextual elements.
Significance and rationale
Implementation of available evidence into practice is a critical issue, as a great deal of research has little or no impact on practice [2–5]. Simply 'pushing out' evidence to caregivers through written documents or education has only limited success; and rather than a simple linear and logical process, studies are demonstrating that implementation efforts are messy and challenging [11, 19]. Furthermore, relevant research has recognized that the process of implementation most often takes place within an organizational context that can have either a facilitative or hindering impact upon the adoption of research findings [10, 11, 16].
Another critical implementation issue is the frequent and often negative or narrow focus of research regarding organizational factors, such as the focus on barriers to use of individual targeted evidence in time-limited projects. Little research has been conducted on what contextual factors might be essential to enable the repeated, ongoing, routine uptake of evidence, or on the strategic management processes that could facilitate a change to support "normalized" EBP [10, 11]. Within the hospital setting, the department/directorate of nursing offers a structured series of levels in which to study the concept of organizational/normalized EBP. Given its typical role in management of patient care units and related resource allocation, nursing is increasingly recognized as pivotal both to the quality of care in general and to the implementation of interdisciplinary-based quality care . Importantly, the nursing profession also has a long history with "research utilization" (RU) [21–23].
In the service setting, RU, and now the broader but related concept of EBP, has long been stated as a goal for nursing departments. Over the years a number of nursing departments have described such efforts at implementation [24–27]. Several have achieved that goal to such an extent that they have become recognized internationally [28, 29]. However, it is unlikely that the self-reported information available in the literature about such "best practice" departments adequately explicates the complex contextual factors and strategic processes needed to replicate successful implementation. Therefore, this study focuses on examining how organizations "make it happen." More specifically, it focuses on the explicit and replicable HOW, WHY and WHAT of the context that helps an organization to successfully implement and sustain EBP as a pervasive pattern (see Table 1). Because little, if any research has been conducted to understand the relationship among organizational context, related strategic management decisions, and the reported success of such EBP efforts in nursing, this study will contribute to our transferable and pragmatic understanding of such an important issue.
Overview of literature
Early lessons about translating findings into practice are being called into question based on more recent reviews and evolving research [19, 30, 31]. There are now calls both for better theoretical underpinnings for implementation interventions at the individual provider level and for better information about the critical influence of organizational context [11, 19, 32]. Relevant to this study, Greenhalgh et al.'s extensive review of literature on diffusion of innovations in service organizations specifically calls for more research on "how organisations might create and sustain an absorptive capacity for new knowledge and ...achieve ... key components of a receptive context for change ." Fixsen et al., in a more recent review of implementation research across multiple disciplines, further notes the importance of organizational context and the fact that "facilitative administration is often discussed and rarely evaluated with respect to implementation outcomes ."
In most implementation research in health care, where change efforts have primarily focused on physician-provider behavior, there is growing evidence that the organization plays a key role in implementation results. For example, Bradley et al. studied hospital efforts to improve use of β-blockers . They found that the presence of shared goals for quality improvement (QI), use and availability of credible feedback data for monitoring improvements, and the degree of support from hospital administration and clinical leadership – per related advocacy for the EBP – were key factors in differentiating high versus low performance.
Scientific studies about the influence of organizational context on the routine implementation of EBP are limited in general and in nursing specifically . Much of the prior research in nursing has consisted of surveys on the perception of barriers to RU. Related findings have consistently indicated that nurses often view characteristics of the organization, akin to our definition of context, as a barrier [34, 35]. However, the BARRIERS to Research Utilization Scale, which is most frequently used in such surveys, provides only a limited view of context through its eight related items . A more recent descriptive study involving nurses assessed the degree of perceived organizational support for RU. They found that more RU was reported on units that also reported more "people support, positive attitude towards research utilization among the management, and organizational support ."
Ferlie and Shortell , after assessing initiatives on the quality of health care in the United Kingdom and the United States – which assumedly includes EBP, suggested that organizations need to recognize the key role of context, specifically in terms of a set of "core" elements: 1) organizational culture that supports learning throughout the care process, 2) leadership at all levels, 3) emphasis on the development of effective teams, and 4) greater use of information technologies for continuous improvement and external accountability. The elements of culture, leadership, and teamwork/collaboration also have been identified in the EBP literature. For example, in a concept analysis by McCormack, et al. , as well as in individual studies and various reviews of the literature, the potential importance of culture on adoption behavior is cited [11, 12, 31, 37, 39]. A case in point is a set of case studies regarding use of evidence in four types of multi-system clinical programs, which found that "the speed of adoption is influenced by the degree to which the innovation requires changes in organizational culture ." In terms of leadership, Greenhalgh et al. and Estabrooks et al., among others, found leadership to be important to adoption/RU/EBP [11, 37]. Greenhalgh et al.'s synthesis, for example, suggested that leadership was one of five "broad determinants" of organizational innovativeness – again strongly linked to the determinant of a receptive culture . Other studies have identified the potential importance of teamwork and collaboration [11, 40].
Unfortunately, the precise aspects of culture that are important to EBP are yet to be substantiated, and there is no consistency in "leadership" definitions. Research on leadership has often focused more on the characteristics of a leader than the types of behaviors that make a difference in successful implementation, or more importantly for this study, in institutionalization . The above studies suggest the importance of various factors, but without the level of detail needed for EBP-related organizational interventions.
Two other contextual factors of potential significance are organizational infrastructure and unit variability. Infrastructure is defined broadly as organizational structures, systems, roles, processes, relations, alignments and capabilities. A few examples of the specific aspects of infrastructure that have been suggested as important to implementation, either in the innovation literature or within specific EBP studies, include: effective monitoring and feedback systems and, as with Ferlie and Shortell's core elements , related information technologies [11, 30]; external communication networks and boundary-spanning roles [11, 41]; and a defined organizational approach to "change" projects, a project lead, a facilitator, and coordinative mechanisms across departments or disciplines [2, 31, 42–44]. In terms of general variability at the level of organizational units, it is unlikely that all units within a given service will reflect the same "context" or degree of specific contextual factors . In terms of EBP specifically, there is some evidence to suggest that unit level factors such as access to computers, organizational slack, autonomy, leadership style, or the quality of relationships and interactions – such as the degree of harmony between leaders and staff, may influence nurses' use of research evidence [46–49]. These factors, along with other unit-relevant contextual influences, require further study.
In conclusion, when a general innovation or a new EBP is introduced into an organization, a change process is assumedly involved. If an organization is to make EBP the routine approach to practice, it appears unlikely to occur without strategic change and the related management of key contextual elements. An understanding of both organizational change and elements of context specifically related to EBP are thus critical to success in normalization. As Greenhalgh et al. indicate, however, "the evidence on implementation and sustainability ... [which is] difficult to disentangle from that on change management and organizational development in general," is an under-researched area . As a result, little guidance exists for nurse executives or others in health care administration regarding either which specific contextual elements are important or the strategic change/management processes needed to move an organization toward EBP as the norm. Further, discussion regarding organizational factors in EBP studies, often done retrospectively, has frequently related to the use of individual targeted evidence in time-limited projects, regarding individual clinicians, and involving isolated policies/procedures. Additional research needs to focus on contextual factors within a broader frame of reference relevant to the routine uptake of evidence across various organizational levels (Table 1). Such research also is needed to better understand how facilitative or receptive contexts emerge or are developed, in order to better inform and guide executives interested in this critical area of health care.
Given the current state of science, a key assumption underlying this case study is that organizational change is integral to the achievement of, ongoing success with, and sustainability of routine EBP [38, 50]. Where such routine EBP does exist, it is assumed that at some point in time certain "receptive" conditions were created – that is, change took place to enable EBP to become the norm [11, 50, 51]. It may be that some of these conditions were put in place in the past for other reasons, while additional conditions had to be introduced more recently and deliberately for EBP. It is further assumed, based on research literature on organizational change, that such change has to be led and strategically managed [52–54]. A final assumption is that such change is highly complex, and its study must account for significant dynamics within the change process relative to multiple levels within an institution [11, 13, 17].
The theoretical framework for this explanatory case approach is Pettigrew and Whipp's Content, Context, and Process model of strategic change , or more specifically the strategic management of change . This model has been "widely used in analyzing and learning retrospectively from change programmes in organizations" and was based on empirical case-based organizational research [p. 33 ]. Although originally developed to understand competitive private sector organizations, it was later applied to a study of health care .
Users of the Pettigrew and Whipp model's three "essential dimensions" of strategic change (i.e., "content, context, and process") may interpret each term in slightly different ways . However, overall the model focuses researchers and managers on the WHY of strategic change with relevance to context; the WHAT of strategic change in terms of its content; and the HOW of strategic change processes. When applied to health care by Pettigrew et al., the overall framework helped to identify several factors related to more successful strategic change . These factors or "signs and symptoms of receptivity" include the following: quality and coherence of policy; key people leading change; supportive organizational culture, including the managerial subculture; environmental pressure; good managerial and clinical relations; co-operative inter-organizational networks; a fit between the change agenda and its locale; and the simplicity and clarity of organizational goals and priorities [12, 44]. These factors are dynamically linked and form a pattern receptive to the desired change or innovation. However, there is no apparent common, exact path or recipe by which these common factors come together to create success [17, 51].
Given the differential views available regarding the meaning of each of the three overarching dimensions of the framework (context, content and process) and their related operational counterparts (the why, what and how of change, respectively), it became imperative to clearly articulate definitions underlying the study. This was important in terms of both relating the individual dimensions to the signs and symptoms (S&S) of receptivity, and identifying and creating detailed data collection tools. Table 1 articulates our definition of each of the framework's dimensions. Table 2 illustrates how those dimensions in turn are perceived to relate to individual S&S of an overall receptive context – in terms of our broader meaning of context – and to our overall approach to data collection. Table 2 reflects the fact that S&S may emerge at different times (playing different functions/multiple dimensions) over the dynamic life of an organization and its related change. This reinforces the fluid nature of the dimensions, the signs, and their inter-relationship – the pattern of which may vary from organization to organization and within organizations.
Once the above conceptual perspectives were articulated, more detailed definitions of the S&S were needed in order to direct specific data collection efforts. As with the essential dimensions, the essence of various signs and symptoms was not always transparent in light of the study's focus on institutionalization of EBP. Therefore, building on existing descriptions of organizationally-related elements relevant to each receptivity factor [11, 12, 44], the following supplemental sources were used to facilitate development of each factor's operational definition:
These supplemental resources were useful in clarifying operational definitions of the potential HOWs and WHATs of strategic change and its management, particularly for the Change Agenda and Quality & Coherence factors. See Table 4, as well as the additional files, which illustrate use of these supplemental sources. [See Additional file 1] [See Additional file 2]
This is a multi-method explanatory case study. A case study approach is the method of choice, given our descriptive purpose, research questions, the complexity of organizational phenomena, and current state of knowledge in this field . Our conceptual framework focuses data elements and collection approaches on a series of sub-questions. Our sampling method is designed to provide: a) an exemplar of the WHY, WHAT and HOW in a case known to have normalized EBP to a greater degree than others, and b) for contrast, a case just beginning the journey to institutionalization. Within each case, embedded levels will provide additional, comparative data. Each of these study elements is described below, along with other procedural details and our approach to analysis.
Operational study questions
Sub-questions are built on our two primary study questions, the three entities of the Why/What/How of strategic change, and our conceptual sources regarding S&S of receptivity. The first primary question is a macro, analytical question (Table 3) focusing on theoretical explanation building and is being addressed through triangulation of all study data, e.g., from surveys and interviews. It is broken down into conceptual sub-questions (Table 3).
The second primary question is the operational question (Table 4), also broken down into sub-questions. The full set of operational questions is provided in a supplemental file. [See Additional file 1]. This document includes the foci of questions for individual interviews, focus groups, and group observation meetings. Actual interview questions will be based on this document and adapted to the targeted group and interview time. The bulleted examples, within the final level of sub-questions in Table 4 and the supplemental file [See Additional file 1], are for clarifying purposes and serve as the source of items for a set of stimulated recall checklists noted below.
In some cases key contextual elements may already exist prior to efforts to initiate EBP. These may be uncovered through questions relative to enabling conditions, reference to organizational history, and, for the beginning case, our survey data. Questions regarding enabling and hindering forces are also used to capture unanticipated factors or elements. Finally, operational questions reflect the study's focus on multiple levels within the institution.
Sample and Recruitment
The study is being conducted in the United States. A case is defined as a department of nursing within a hospital. Such departments have an ordered series of levels that can be studied, as described in Table 1. Within each case, three embedded units will be selected.
In order to illuminate the research aims and assist in explanation building, purposive case sampling will be used. One case will be selected after a nomination process involving the American Organization of Nurse Executives (AONE), whereby a list of institutions perceived as exhibiting a high, sustained, normalized level of EBP are identified. The potential set of beginning cases will be recruited from members of AONE who self-report being "early in the journey to institutionalization." Final selections will be made by the team per top ranking (role model), self-rating of institutionalization (with rationale), interest in EBP and the study, feasibility for data collection, and the degree of matching hospital characteristics.
This selective, purposive sampling approach will provide contrasting results for predicable reasons . This will allow testing of a preliminary proposition developed from the literature review and conceptual framework by the study team: Successful EBP nursing departments have key contextual elements in place and/or experience a strategic organizational change relative to key contextual/organizational elements to achieve EBP outcomes.
Embedded units sample
Three embedded units per case will be included given the criteria of feasibility, institutional burden, grant funding, and diversity of patient populations. As noted earlier, a degree of variability is expected to exist within any organization and thus within units across a department of nursing – although there may be less variability within a role model case . However, because of feasibility issues, rather than attempt to search for a set of varied units across a spectrum of diversity within both sites, the decision was made to focus on instances of best achievement or positive beginning effort across units with different types and intensity of patient populations. The units will be selected, to the extent possible, at random from those identified by nursing leadership in each case site as being highly evidence-based or interested in such activity. We will attempt to sample a medical, surgical and ICU unit in each hospital, and stratify the available sample as needed. These embedded units should provide a reasonable cross section of clinical services within the institution.
Individual level sample
Individuals invited to participate include the following: all staff on selected embedded units; "leadership" in the form of all managers within the nursing department as well as clinical resource and/or specialty nurses, members of the quality management structure (within and outside of nursing), institutional senior level managers responsible for EBP, and other site-identified individuals said to be key to EBP; and, finally, participating members of three or four group meetings relevant to EBP. Stratified random selection will be used according to relevant categories, if needed, per availability of large numbers. However, selected individual leadership participants (for interviews) and groups (for observations) will be purposively sampled (e.g., the CNO, EBP project groups and their leads, and the procedure committee). Both nursing and interdisciplinary groups will be recruited. In terms of the interviews, approximately 20 individual interviews per case will be conducted, while approximately 400 subjects in total are expected to participate in various data collection activities. The number will vary depending on availability of potential participants, size of the organization and degree to which the data obtained becomes repetitive, with little new information emerging.
Data collection methods will include quantitative tools and qualitative approaches.
Four instruments with acceptable levels of reliability and validity will be used. First is the Research Utilization Questionnaire, adapted from Estabrooks' original tool to assess the extent of direct, indirect, and persuasive use of research in practice  [Personal communication, C. Estabrooks, University of Alberta, 10/30/2006; current version unpublished.] The three other study tools assess the nature of organizational elements identified as potentially critical, both within the Pettigrew framework and current implementation science (see Table 2) [6, 11, 12, 17, 51]. This includes Goh and Richard's Organizational Learning Survey (OLS) , judged by the team as assessing culture in a focused manner relevant to EBP ; the Multi-dimensional Leader Questionnaire for leadership assessment ; and the Nursing Work Index [60, 61], which provides valuable information on collaboration/teamwork. The latter information also provides a baseline comparison of cases relative to their work environment for nursing practice . These survey data will be collected about individual embedded units from nursing staff and about the nursing department as a whole from members of the hospital-wide nursing leadership team in each hospital. Following the Dillman approach, participants will receive a survey, then a reminder, and then a second survey.
Selected materials will be assessed for information regarding the degree to which use of evidence is integrated into the routine fabric of the organization, primarily per the Pettigrew et al. essential dimensions and S&S of a receptive context . Sample documents include mission, philosophy and practice models, EBP project information, job descriptions and performance evaluation/appraisal forms or processes, and strategic approaches focused on EBP, such as communication vehicles, education/orientation content, and the like.
Documents also will be reviewed for indicators of success and maintenance of specific efforts. Internal, locally developed evidence and EBP outcomes will be explored, including report cards, QI summaries and project reports. Document reviews will provide primarily nominal, ordinal and qualitative data. A general description of the institution and its activities, per a public annual report, will be reviewed for background.
We will observe the meeting of three to four groups identified by site leadership as relevant to the EBP initiative and naturally occurring at the time of the site visit. Potential groups will include the procedure/standards/guideline committees and special EBP project committees. Such observations will provide investigators with a "live" example of EBP activity, thus adding supplementary insights about the organization. Immediately after the meeting, the investigator will record field notes regarding relevant processes that emerged, which will provide additional background as other structured data are analyzed. During the last 15 minutes of the meeting, the group will be asked brief questions to clarify and/or expand on issues and available documentation. Meeting questions are included in a supplemental file. [See Additional file 1]
This data collection method will not only provide information regarding stakeholders' perspectives but also information unavailable from other sources. Interviews will be recorded and transcribed. Two types of interviews will be held, i.e., individual and group:
∘ Staff nurses, within a group interview – We will hold two to three, 45–60 minute focus groups of three to eight nurses on each of the three embedded units per site; and
∘ Individual interviews with leaders – Key stakeholders, as identified in the sample section above, will be interviewed for 60–90 minutes.
Within each type of interview, open-ended questions will be guided by the operational sub-question list [See Additional file 1]. In addition, participants will be asked, through a process of stimulated recall, about specific institutional and operational components based on the Pettigrew et al. framework and supplemental research [10, 12, 17, 51, 55]. [See Additional file 2] Through this process, we may unearth targeted conceptual-based data not previously identified; however, stimulated recall will be used only after participants have had an opportunity to provide spontaneous thoughts about the evolution of EBP.
Success in achieving EBP at multiple levels will be operationally defined in diverse ways, including the following:
The degree of EBP activity (at all levels) over time.
Number of active EBP projects and number of units and related services engaged and making progress.
Percent of polices that are current and substantiated with evidence.
Percent of relevant procedures, protocols, practice assessment tools, etc. (the "Ps") that are evidence-based.
Evidence of adherence to the "Ps" per audit and self-report.
The degree to which there is evidence (direct and perceptual) that individual targeted EBP projects' goals/objectives and outcomes were met.
Evidence regarding, and tracking of change in key nursing-sensitive outcomes, i.e., fall rate or patient self-care behavior. Such outcome data will be recorded in terms of comparative not raw terms in degree of improvement and at/above available benchmarks.
The degree to which there is evidence that needed strategic departmental changes per EBP-related goals/objectives were met.
Evidence of the status of the organization in relation to EBP.
Self-ratings of staff on the research utilization tool .
Concrete patient examples of nursing behaviors from caregiver/manager self-report that show episodic and/or "routine" use of evidence.
Self-rating on "where their organization is on EBP." For example, are they just starting to think about it, beginning to develop plans, making some progress, making good progress, or making very good progress?
Concrete managerial/leadership examples of behaviors from participant reports that show episodic or "routine" use and/or expectations of use of evidence in practice, i.e., use of EBP rounds .
Maintenance or the degree to which success has been sustained will be operationally defined as follows:
The degree to which there is evidence that identified EBP projects' targeted changes and related outcomes have been maintained over time, i.e., one-year post-implementation.
The degree to which there is evidence (both direct and perceptual) that identified strategic changes have been maintained over time, i.e., one-year post-implementation.
Applicable outcomes that have been achieved over the past three years will be sought including, as noted, ongoing use of evidence and sustainability of documented changes. Our various data collection methods will provide multiple views of potential outcomes, including self-reported "use," the perceived degree of success achieved in specific endeavors and overall normalization, and data-based results for targeted projects and indicators. Cumulatively, these data will be used to draw conclusions about project success/outcomes.
The PI will conduct onsite visits of approximately eight days, and another investigator will assist her during a two-day visit at each site. A local facilitator with human subjects' protection training and familiarity with the organization, but not in a management position, will assist the work of the investigators.
It is highly likely that members of the role-model hospital, particularly leadership, will know of their widely recognized status. Initially, it may not however be clear how members of the beginning hospital view themselves. A number of hospital members may belong to AONE, and thus may have read the full study abstract. In any case, to mitigate the potential issue of socially desirable answers, to the extent possible, targeted recruitment and consent documents will indicate only that the two cases were chosen because both are highly interested in EBP and in making it part of the norm of practice. Specific recruitment and consent documents will not focus on the difference between the hospitals or emphasize the actual status of an individual site.
Data from this multi-method study will be summarized and compared to answer the study's analytical and operational questions (Table 3 and 4). Triangulation of the multi-method/multi-source data will be an essential element of the analysis. Overall, the process will be both deductive and inductive: i.e., deductive in that key terms and themes relative to the Pettigrew et al. model will be used as coding categories; and inductive to the extent that the investigators will be open to and will add unanticipated contextual themes identified relative to the evolution of EBP normalization and implementation .
Quantitative data will be analyzed according to the questionnaires' manuals using parametric and non-parametric techniques as appropriate within and across cases. Qualitative data will be subject to thematic content analysis following the procedure outlined by Miles and Huberman . All qualitative data will be managed through NVivo. The ultimate description of each case will be based on the patterns that emerge from the quantitative data in surveys, mixed data from document reviews, and the primarily qualitative data from interviews, focus groups, and group meeting interviews/observations. As such, a pattern-matching logic, based on explanation building, will be used as a data analysis framework 
To enhance the study's trustworthiness, i.e., its credibility, transferability, dependability and the confirmability of our qualitative data and related interpretations, approaches identified by Lincoln and Guba  as well as Rycroft-Malone  for naturalistic inquiry will be used. This will include peer-debriefing at the site among the team's site visitors; checks with stakeholders regarding selected aspects of interpretation after preliminary analyses; an inquiry 'audit' by one of the investigators (MC) of the primary data collectors' documentation of methods, data, and decisions made during the collection and analysis process; and a "reflexive, methodologically self-critical account of how the research was conducted ." Also, to enhance reliability of the analysis of interviews, the first three interviews from each site will be coded by two investigators, compared for consistency, and discrepancies resolved through discussion and/or additional coding rule changes. A similar process will be conducted for the analysis of complex documents.
Consistent with case study methodology, each case is regarded as a 'whole study' in which convergent evidence is sought and then analyzed within data sets, within sites, across units and between staff and leadership, and, ultimately, across the two cases relative to the pre-identified key contextual factors [12, 17, 51]. Yin calls this cross-case analysis . In this way, differences and similarities will be highlighted and comparisons made in order to assist theoretical explanation-building regarding the influence of context on the use and sustainability of EBP. In this way a more complete picture about the influence of context will be developed.
The study was submitted to the Institutional Review Board at the Boston University Medical Campus (Boston, Massachusetts, USA). It was approved as Expedited. The protocol was subsequently approved by all other co-investigator sites and will be approved at each case study site. Neither the identity of individual participants nor the two cases will be revealed.
There are two, interconnected and potentially limiting factors, i.e., our sample size and the study's external validity. Financial and practical constraints dictated that only two sites be included. These two sites will be matched and thus involve only one size of hospital. While more sites would improve the credibility and statistical generalizability of various findings, the strength in use of a case study lies in the opportunity to collect multiple types of data enabling development of a comprehensive, in-depth picture of the influences of context on the routine use of evidence in practice. Thus, while findings of the study will have limited generalizability, they will be theoretically transferable and will lead to a number of propositions or hypotheses that can be tested in future research .
Data from this comparative, explanatory case study will be analyzed across data sources, across collection methods, across individual units within a case, and across case hospitals. This cross-case analysis and triangulation of all data results will enable us to highlight differences and similarities in order to assist explanation-building regarding the concept of a receptive context and related strategic change – specifically, in relation to the use and normalization of EBP. Overall, findings will provide a rich description. Following such descriptive and theoretical work, propositions can be developed that could be explored in further studies regarding the institutionalization of EBP. This could include action research for nurse executives and their implementation research partners interested in institutionalizing EBP. Other researchers could use results to formulate and test hypotheses using various methodologies. Finally, the summarized findings will be used to assess each of the three RU/EBP models as to their degree of inclusiveness of key contextual elements identified by the case study. These results will then be communicated to leadership audiences, along with our preliminary findings regarding the What, Why and How of strategically integrating EBP into the day-to-day fabric of care.
Institute of Medicine (U.S.). Committee on Quality of Health Care in America: Crossing the quality chasm: a new health system for the 21st century. 2001, Washington, DC: National Academy Press
Harvey G: Quality Improvement and Evidence-Based Practice: As One or at Odds in the Effort to Promote Better Health Care?. Worldviews on Evidence-based Nursing. 2005, 2 (2): 52-54. 10.1111/j.1741-6787.2005.05001.x.
Herr K, Titler MG, Schilling ML, Marsh JL, Xie X, Ardery G, Clarke WR, Everett LQ: Evidence-based assessment of acute pain in older adults: current nursing practices and perceived barriers. Clinical Journal of Pain. 2004, 20 (5): 331-340. 10.1097/00002508-200409000-00008.
Lenfant C: Shattuck lecture – clinical research to clinical practice – lost in translation?. N Engl J Med. 2003, 349 (9): 868-874. 10.1056/NEJMsa035507.
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.
Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network, 1-125.
Grol R, Wensing M, Eccles M, (eds): Improving Patient Care: The Implementation of Change in Clinical Practice. 2005, Edinburgh; New York: Elsevier Butterworth Heinemann
Karkos B, Peters K: A Magnet community hospital: Fewer barriers to nursing research utilization. J Nurs Adm. 2006, 36 (7–8): 377-382.
Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C: Ingredients for change: revisiting a conceptual framework. Qual Saf Health Care. 2002, 11 (2): 174-180. 10.1136/qhc.11.2.174.
Stetler CB: Role of the organization in translating research into evidence-based practice. Outcomes Manag. 2003, 7 (3): 97-103. quiz 104–105.
Greenhalgh T, Robert G, Bate P, Kyriakidou O, Macfarlane F, Peacock R: How to Spread Good Ideas: A systematic review of the literature on diffusion, dissemination and sustainability of innovations in health service delivery and organisation. 2004, London: National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO), 1-424.
Pettigrew A, Ferlie E, McKee L: Shaping Strategic Change – The Case of the NHS in the 1980s. Public Money & Management. 1992, 12 (3): 27-31.
Pettigrew AM: The Character and Significance of Strategy Process Research. Strategic Management Journal. 1992, 13 (8): 5-16.
Amey A, Corkum S, Lavis J, DesMeules M: Expanding Knowledge Development and Exchange in Chronic Disease in the Public Health Agency of Canada: Results of an Environmental Scan. Knowledge Utilization Conference: Knowledge Utilization and Implementation in Health Services: Theory, Strategies, and Education: July 24 – 26, 2006; Minneapolis, MN. 2006
Yin RK: Case Study Research: Design and Methods. 1994, Thousand Oaks: Sage Publications, 5: 2
McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K: Getting evidence into practice: the meaning of 'context'. J Adv Nurs. 2002, 38 (1): 94-104. 10.1046/j.1365-2648.2002.02150.x.
Pettigrew A, Whipp R: Managing change and corporate performance. European industrial restructuring in the 1990s. Edited by: Cool K, Neven DJ, Walter I. 1992, Houndmills, Basingstoke, Hampshire: Macmillan Academic and Professional
Graham ID, Logan J: Innovations in knowledge transfer and continuity of care. Canadian Journal of Nursing Research. 2004, 36 (2): 89-103.
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment. 2004, 8 (6): iii-iv. 1–72.
Lewis C, Hoffmann ML, Gard A, Coons J, Bichinich P, Euclid J: Development and implementation of an interdisciplinary plan of care. J Healthc Qual. 2005, 27 (1): 15-23.
Horsley JA, Crane J, Crabtree MK, Wood DJ: Using research to improve practice: A guide. 1983, New York: Grune & Stratton
Goode CJ, Lovett MK, Hayes JE, Butcher LA: Use of research based knowledge in clinical practice. Journal of Nursing Administration. 1987, 17 (12): 11-18.
Stetler CB, Marram G: Evaluating research findings for applicability in practice. Nurs Outlook. 1976, 24 (9): 559-563.
Goode CJ, Blegen MA: Development and evaluation of a research-based management intervention. A recognition protocol. Journal of Nursing Administration. 1993, 23 (4): 61-66. 10.1097/00005110-199304000-00015.
Titler MG, Kleiber C, Steelman V, Goode C, Rakel B, Barry-Walker J, Small S, Buckwalter K: Infusing research into practice to promote quality care. Nurs Res. 1994, 43 (5): 307-313. 10.1097/00006199-199409000-00009.
Stetler CB, Corrigan B, Sander-Buscemi K, Burns M: Integration of evidence into practice and the change process: fall prevention program as a model. Outcomes Manag Nurs Pract. 1999, 3 (3): 102-111.
Stetler CB, Brunell M, Giuliano KK, Morsi D, Prince L, Newell-Stokes V: Evidence-based practice and the role of nursing leadership. J Nurs Adm. 1998, 28 (7–8): 45-53.
Goode CJ, Piedalue F: Evidence-based clinical practice. Journal of Nursing Administration. 1999, 29 (6): 15-21. 10.1097/00005110-199906000-00005.
Titler MG, Kleiber C, Steelman VJ, Rakel BA, Budreau G, Everett LQ, Buckwalter KC, Tripp-Reimer T, Goode CJ: The Iowa Model of Evidence-Based Practice to Promote Quality Care. Crit Care Nurs Clin North Am. 2001, 13 (4): 497-509.
Bradley EH, Holmboe ES, Mattera JA, Roumanis SA, Radford MJ, Krumholz HM: A qualitative study of increasing beta-blocker use after myocardial infarction: Why do some hospitals succeed?. Jama. 2001, 285 (20): 2604-2611. 10.1001/jama.285.20.2604.
Bradley EH, Webster TR, Baker D, Schlesinger M, Inouye SK, Barth MC, Lapane KL, Lipson D, Stone R, Koren MJ: Translating research into practice: speeding the adoption of innovative health care programs. Issue Brief (Commonw Fund). 2004, 724: 1-12.
Rubenstein LV, Pugh J: Strategies for promoting organizational and practice change by advancing implementation research. J Gen Intern Med. 2006, 21 (Suppl 2): S58-64. 10.1111/j.1525-1497.2006.00364.x.
Foxcroft DR, Cole N: Organisational infrastructures to promote evidence based nursing practice. Cochrane Database Syst Rev. 2003, 4:
Funk SG, Champagne MT, Wiese RA, Tornquist EM: BARRIERS: the barriers to research utilization scale. Appl Nurs Res. 1991, 4 (1): 39-45.
Bryar RM, Closs SJ, Baum G, Cooke J, Griffiths J, Hostick T, Kelly S, Knight S, Marshall K, Thompson DR: The Yorkshire BARRIERS project: diagnostic analysis of barriers to research utilisation. Int J Nurs Stud. 2003, 40 (1): 73-84. 10.1016/S0020-7489(02)00039-1.
Funk S: The BARRIERS to Research Utilization Scale. [http://www.unc.edu/depts/rsc/funk/barriers.html]
Estabrooks C, Scott-Findlay S, Rutakumwa W, Duan Q, Rozanova J: The Determinants of Research Utilization in Acute Care: Pain Management in Adult and Paediatric Settings: Technical Report. 2004, Edmonton, Alberta: Knowledge Utilization Studies Program, University of Alberta
Ferlie EB, Shortell SM: Improving the quality of health care in the United Kingdom and the United States: a framework for change. Milbank Quarterly. 2001, 79 (2): 281-315. 10.1111/1468-0009.00206.
Dopson S, FitzGerald L, Ferlie E, Gabbay J, Locock L: No magic targets! Changing clinical practice to become more evidence based. Health Care Manage Rev. 2002, 27 (3): 35-47.
Stone EG, Morton SC, Hulscher ME, Maglione MA, Roth EA, Grimshaw JM, Mittman BS, Rubenstein LV, Rubenstein LZ, Shekelle PG: Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med. 2002, 136 (9): 641-651.
Iles V, Sutherland K: Managing Change in the NHS: Organisational Change: A Review for Health Care Managers, Professionals and Researchers. 2001, London: National Co-ordinating Centre for NHS Service Delivery and Organisation R & D, 1-101.
Dopson S, Locock L, Chambers D, Gabbay J: Implementation of evidence-based medicine: evaluation of the Promoting Action on Clinical Effectiveness programme. J Health Serv Res Policy. 2001, 6 (1): 23-31. 10.1258/1355819011927161.
Solberg LI, Brekke ML, Fazio CJ, Fowles J, Jacobsen DN, Kottke TE, Mosser G, O'Connor PJ, Ohnsorg KA, Rolnick SJ: Lessons from experienced guideline implementers: attend to many factors and use multiple strategies. Jt Comm J Qual Improv. 2000, 26 (4): 171-188.
Mares P: How health authorities learn: a review of literature. [http://www.innovate.org.uk/frameset.asp?Link=Library]
Charns MP, Schaefer MJ: Health care organizations: a model for management. 1983, Englewood Cliffs, NJ: Prentice-Hall
Cummings G: Investing relational energy: the hallmark of resonant leadership. Can J Nurs Leadersh. 2004, 17 (4): 76-87.
Cummings G, Hayduk L, Estabrooks C: Mitigating the impact of hospital restructuring on nurses: the responsibility of emotionally intelligent leadership. Nurs Res. 2005, 54 (1): 2-12. 10.1097/00006199-200501000-00002.
Wallin L, Estabrooks CA, Midodzi WK, Cummings GG: Development and validation of a derived measure of research utilization by nurses. Nurs Res. 2006, 55 (3): 149-160. 10.1097/00006199-200605000-00001.
Pepler CJ, Edgar L, Frisch S, Rennick J, Swidzinski M, White C, Brown TG, Gross J: Unit culture and research-based nursing practice in acute care. Can J Nurs Res. 2005, 37 (3): 66-85.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Quarterly. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.
Pettigrew A, Ferlie E, McKee L: Shaping Strategic Change: Making Change in Large Organizations: The Case of the National Health Service. 1992, London: Sage Publications
Buchanan D, Ketley D, Gollop R, Jones JL, Saint Lamont S, Sharpe A, Whitby E: No going back: a review of the literature on sustaining strategic change. [http://www.wise.nhs.uk/sites/crosscutting/sustain/Document%20Library2/1/Full%20Reports/Full_Report_No_Going_Back.pdf]
Redfern S, Christian S: Achieving change in health care practice. J Eval Clin Pract. 2003, 9 (2): 225-238. 10.1046/j.1365-2753.2003.00373.x.
Charns MP, Smith Tewksbury L: Collaborative Management in Health Care: Implementing the Integrative Organization. 1993, San Francisco: Jossey-Bass Publishing
Stetler C, Charns MP, (eds): Collaboration in health care: Hartford Hospital's experience in changing management and practice. 1995, Chicago: American Hospital Association Publishing
Rogers EM: Diffusion of innovations. 1995, New York: Free Press, 4
Estabrooks CA: The conceptual structure of research utilization. Res Nurs Health. 1999, 22 (3): 203-216. 10.1002/(SICI)1098-240X(199906)22:3<203::AID-NUR3>3.0.CO;2-9.
Goh S, Richards G: Benchmarking the learning capability of organizations. European Management Journal. 1997, 15 (5): 575-10.1016/S0263-2373(97)00036-4.
Avolio JB, Bass BM, Jung DI: Re-examining the components of transformational and transactional leadership using the multifactor leadership questionnaire. Journal of Occupational and Organizational Psychology. 1999, 72: 441-462. 10.1348/096317999166789.
Aiken LH, Patrician PA: Measuring organizational traits of hospitals: the Revised Nursing Work Index. Nurs Res. 2000, 49 (3): 146-153. 10.1097/00006199-200005000-00006.
Lake ET, Friese CR: Variations in nursing practice environments: relation to staffing and hospital characteristics. Nurs Res. 2006, 55 (1): 1-9. 10.1097/00006199-200601000-00001.
Leiter MP, Spence Laschinger HK: Relationships of work and practice environment to professional burnout: testing a causal model. Nurs Res. 2006, 55 (2): 137-146. 10.1097/00006199-200603000-00009.
Thomas EJ, Sexton JB, Neilands TB, Frankel A, Helmreich RL: The effect of executive walk rounds on nurse safety climate attitudes: a randomized trial of clinical units [corrected]. BMC Health Serv Res. 2005, 5 (1): 28-10.1186/1472-6963-5-28.
Miles MB, Huberman AM: Qualitative data analysis: a sourcebook of new methods. 1984, Beverly Hills, CA: Sage Publications
Lincoln YS, Guba EG: Naturalistic Inquiry. 1985, Newbury Park, CA: Sage Publications, Inc
Rycroft-Malone J: Patient participation in nurse-patient interactions about medication. unpublished PhD thesis. 2002, Southampton, United Kingdom: University of Southampton
Rycroft-Malone J, Stetler CB: Commentary on Evidence, Research, Knowledge: A Call for Conceptual Clarity: Shannon Scott-Findlay & Carolee Pollock. Worldviews on Evidence-Based Nursing. 2004, 1 (2): 98-101. 10.1111/j.1741-6787.2004.04031.x.
Canadian Health Services Research Foundation: The foundation's definition of evidence. [http://www.fcrss.ca/other_documents/evidence_e.php]
Stetler CB: Updating the Stetler Model of research utilization to facilitate evidence-based practice. Nurs Outlook. 2001, 49 (6): 272-279. 10.1067/mno.2001.120517.
• This study is funded through a research grant from the Robert Wood Johnson Foundation to the Boston University School of Public Health.
• It has been endorsed by the American Organization of Nurse Executives (AONE) and the AONE Institute for Patient Care Research and Education.
• The protocol evolved out of a Development/Planning Grant from the Canadian Institutes of Health Research International Opportunity Program and networking provided by the international Knowledge Utilization Colloquium
• Colleen Goode, PhD, RN, FAAN, University of Colorado Hospital, is gratefully acknowledged for her critical support of the development of this protocol; and Caroline Marchionni, RN, MSc(A), McGill University Health Centre research assistant also is gratefully acknowledged for her support and assistance with this proposal.
The author(s) declare that they have no competing interests.
CBS, JR, JR-M, and AS collectively developed the study plan with the support of a Canadian Institutes of Health Research International Opportunity Development/Planning grant. JR led the application for those CIHR funds. CBS conceived of the study, and lead the application for current grant funding, with key support from MC; she has drafted the initial form and final revision of this manuscript. All other authors (JR, JR-M, AS, and MC) have read drafted components of the manuscript, provided input into initial and final refinements of the total manuscript, and agreed to the final manuscript.