- Research
- Open access
- Published:
Multi-level factors influence the implementation and use of complex innovations in cancer care: a multiple case study of synoptic reporting
Implementation Science volume 9, Article number: 121 (2014)
Abstract
Background
The implementation of innovations (i.e., new tools and practices) in healthcare organizations remains a significant challenge. The objective of this study was to examine the key interpersonal, organizational, and system level factors that influenced the implementation and use of synoptic reporting tools in three specific areas of cancer care.
Methods
Using case study methodology, we studied three cases in Nova Scotia, Canada, wherein synoptic reporting tools were implemented within clinical departments/programs. Synoptic reporting tools capture and present information about a medical or surgical procedure in a structured, checklist-like format and typically report only items critical for understanding the disease and subsequent impacts on patient care. Data were collected through semi-structured interviews with key informants, document analysis, nonparticipant observation, and tool use/examination. Analysis involved production of case histories, in-depth analysis of each case, and a cross-case analysis. Numerous techniques were used during the research design, data collection, and data analysis stages to increase the rigour of this study.
Results
The analysis revealed five common factors that were particularly influential to implementation and use of synoptic reporting tools across the three cases: stakeholder involvement, managing the change process (e.g., building demand, communication, training and support), champions and respected colleagues, administrative and managerial support, and innovation attributes (e.g., complexity, compatibility with interests and values). The direction of influence (facilitating or impeding) of each of these factors differed across and within cases.
Conclusions
The findings demonstrate the importance of a multi-level contextual analysis to gaining both breadth and depth to our understanding of innovation implementation and use in health care. They also provide new insights into several important issues under-reported in the literature on moving innovations into healthcare practice, including the role of middle managers in implementation efforts and the importance of attending to the interpersonal aspects of implementation.
Background
In cancer care, therapeutic decisions are often based on input from a multidisciplinary team of specialist physicians [1]. For patients with suspected or confirmed cancer, clear recordings of diagnostic and surgical procedures and findings support accurate diagnosis and staging, and facilitate treatment planning. The dominant method of reporting such findings is the narrative report, which is a free text, descriptive account of the procedure, findings, and proposed treatment. Research has demonstrated, across settings and diseases, these types of reports inconsistently and incompletely provide the information required to understand the disease and make informed care decisions [2]-[7].
Another method of reporting, the synoptic report, captures and presents information in a structured, checklist-like manner and typically reports only items critical for understanding the disease and subsequent impacts on patient care. Research has consistently demonstrated that synoptic reports greatly improve the quality of pathology [1],[2],[8]-[19] and surgical [5],[20]-[24] reporting. When electronic, synoptic reporting tools (SRTs) result in health system efficiencies [24]-[26] and provide an effective mechanism to generate real-time data [20],[25],[27],[28]. They have been widely endorsed as a means of standardizing cancer reporting, and improving the availability and quality of clinical information for persons diagnosed with cancer [29]-[33]. However, SRTs represent complex innovations (i.e., new knowledge, tools, or practices), with their implementation and use requiring changes in clinical practice [34] and support from the organization and larger healthcare system.
Much of healthcare delivery occurs as part of a team within a complex organizational structure that is situated in a historical, cultural, economic, and political context. Thus, the setting in which an innovation is implemented, the timing of implementation and the cultural, economic, and socio-political climate during that particular period of time, and the individuals involved may all affect whether, and the extent to which, new ideas and tools are implemented in clinical practice. Researchers increasingly acknowledge the important role these contextual factors play in innovation implementation and use in health care [35]-[39]. The objective of this study was to examine the key interpersonal, organizational, and system level factors (hereafter referred to as `multi-level’ factors) that influenced the implementation and use of SRTs in three cases of cancer care. Each case represented a SRT initiative in a particular clinical area.
Methods
The methods are described in detail elsewhere [40] and presented briefly here. Case study methodology [41],[42], employing an explanatory multiple-case design, was used to explore which factors were important to SRT implementation and use, examine relationships amongst factors, and uncover which factors appear to be similar (and distinct) across cases. Four units of analysis were attended to within each case: the implementation team, the clinician user(s), the organization (hospital), and the broader health system (sociopolitical, historical, and regulatory context). The study was approved by the Research Ethics Boards at all applicable institutions.
Theoretical perspectives
Three theoretical perspectives largely informed the design of this study:
-
1.
Promoting Action on Research Implementation in Health Services (PARiHS) framework [43],[44]
-
2.
Organizational framework of innovation implementation [45]
-
3.
`Systems’ thinking / change [46]
Table 1 provides a brief description of each theoretical perspective. When taken together, these perspectives presented a range of interpersonal, organizational, and system influences on practice change and therefore identified potentially important factors to study. During study design, they informed case selection by helping identify cases that appeared to vary in terms of potentially important factors. During data collection, they informed which potential key informants were approached, which documents were sampled, and the questions posed to key informants during the in-depth interviews.
Sampling
Using the sampling guidance of Yin [42] and Stake [41], three cases in Nova Scotia, Canada, were selected for study. Nova Scotia is a small Canadian province, with a population of approximately 940,000. Health care is delivered through nine health regions and the province’s consolidated women’s and children’s hospital. Information with respect to potential cases was obtained prior to case selection, via publicly available documents and discussions with implementation leaders, to guide sampling decisions. The three cases selected were:
-
1.
Synoptic reporting in the Nova Scotia Breast Screening Program (hereafter referred to as the `mammography case’);
-
2.
Synoptic reporting in the Colon Cancer Prevention Program (hereafter referred to as the `endoscopy case’); and
-
3.
Synoptic reporting in the Surgical Synoptic Reporting Tools Project (hereafter referred to as the `cancer surgery case’).
Though differences existed, two cases overlapped with respect to settings, timing, and individuals involved (endoscopy case, cancer surgery case), while one case differentiated considerably in terms of these contextual conditions (mammography case). Based on existing, pre-study knowledge, these cases were also perceived to converge and diverge with respect to many factors that, based on the theoretical perspectives and broader literature, were likely to influence the implementation and use of an innovation in clinical practice.
Data collection procedures
Multiple data collection procedures were used to gain rich, detailed information about each case and to increase the likelihood of achieving data triangulation across informants, units of analysis, and data collection methods [49],[50]:
-
1.
One-on-one semi-structured interviews [51] were conducted with key informants at the different units of analysis. Key informants were identified through purposive and snowball sampling. Interview questions were adapted based on each case’s unique context as well as the person being interviewed and his/her role in the implementation. One researcher (RU) conducted all interviews. Each interview was audio-recorded, transcribed verbatim, and checked for accuracy. Following each interview, the questions and responses were reviewed to determine whether the issues were answered in sufficient depth and whether the questions or probes needed revisions [52]. Any revisions to the script were completed prior to the next interview.
-
2.
Documents were analyzed for each case. They were acquired from the implementation teams, other key informants, and Internet searches. Documents included project plans/charters, team/organizational reports, formal/informal evaluations, and communications materials, and records related to the structure, infrastructure, and governance of Nova Scotia’s health system. All documents were reviewed to gain an historical and contextual perspective on the initiative and to corroborate and augment evidence from other sources [42].
-
3.
Non-participant observation [51] was conducted to observe training sessions related to use of the surgical tool and initial surgeon reactions to viewing/using the SRT. These sessions were conducted for one case only (cancer surgery) since the implementation of this SRT was occurring during data collection.
-
4.
Each SRT was examined to gain insight into the technical operations related to using the system. Final synoptic reports, with patient identifying information concealed, were reviewed to examine content and format.
Field notes were also taken during and following interviews, observation sessions, and examination of the SRTs. One researcher (RU) attempted to resolve any inconsistencies and contradictions across sources and methods through re-reviewing transcripts/documents and further inquiry (e.g., follow-up with informants).
Analysis
Analysis commenced with the first data collected. One researcher (RU) constructed detailed case descriptions for each case to describe the history, context, and organization of the initiative, and the SRT that was implemented.
The three cases were treated as separate studies and analysed independently. A thematic analysis was conducted for each case [53], involving coding, collating codes, and generating, reviewing, and refining themes. A coding framework was developed during a pilot study [54], with subsequent minor refinements until no new concepts emerged. All interview transcripts and field notes were coded line-by-line in their entirety. Coding was performed manually by labeling the code in the margin of a hard copy of the transcript. Documents were read (and re-read) to identify contextual/historical data, record concepts/codes and link them to specific document excerpts, and triangulate findings from other data sources.
The collapsing of codes into categories and the identification and refinement of themes involved iterative processes between the case-specific data and the theoretical perspectives as well as other literature sources [55]-[58]. These processes included constructing tables that identified emerging categories and themes in relation to the three theoretical perspectives in order to understand how, and the extent to which, the case-specific data aligned (or not) with the constructs of the theoretical perspectives. While the theoretical perspectives helped guide the study, the researcher made concerted efforts to seek out conflicting evidence and to examine whether other factors were key facilitators or enablers of SRT implementation and use, such as those described in psychological and behavioral theories [59]-[61]. Emergent findings were discussed on multiple occasions with the research team to assist the analytic process and questioning of the data.
The final stage of analysis was a cross-case analysis to compare and contrast themes across cases. Each similar theme was examined in regards to the `direction of influence’ the theme took in the context of each case. For instance, one overarching theme-or key factor-may have been a facilitator in one case due to its presence, but a barrier in another case due to its absence. Divergent themes were examined in regards to their specific importance to the particular case/context.
Numerous techniques were used during research design, data collection, and analysis to increase the rigour of this study. These are presented in Table 2.
Results
Table 3 presents key informant participation for this study by case and unit of analysis. Six individuals invited to partake in the mammography case did not respond; one individual invited in the endoscopy case did not respond; and no individuals invited in the cancer surgery case did not respond. However, one surgeon in the cancer surgery case refused to be observed during training. All individuals who did not respond were clinician users. Two informants participated in two interviews (e.g., initial and follow-up interviews). Table 4 presents the documents reviewed for each case.
Case descriptions
Table 5 provides brief descriptions of each of the cases. A detailed description of the broader healthcare system is presented in an online appendix.
Additional file 1.
Factors influencing implementation and use
Table 6 presents both the common and distinct factors influencing the implementation and use of each SRT and specifies the direction of influence (facilitating or impeding) for each case. One factor related to characteristics of the SRT itself and was conceptualized as existing at the level of the innovation. Five common factors were particularly influential to SRT implementation and use across the three cases: stakeholder involvement, managing the change process, administrative and managerial support, champions and respected colleagues, and innovation attributes.
Stakeholder involvement
The breadth, depth, and timing of stakeholder involvement were critical to SRT implementation and use. This was found across cases (and across settings within cases) wherein the early, collaborative involvement of a broad range of stakeholders, including clinician users, managers and staff of relevant departments, and hospital/health region administrators, allowed implementation team members to develop and maintain relationships necessary to implement the SRTs within the various governance/regulatory structures and IT infrastructure, and to promote a sense of ownership amongst local stakeholders. Conversely, where stakeholder involvement was low, interview and documentary data revealed that this was a barrier to effective implementation and use.
In the endoscopy case, for instance, while the implementation team included key stakeholders as members of working groups and worked with local implementation teams, most key informants perceived a low level of involvement and many endoscopists stated their input was not requested at any point throughout SRT implementation. Limited stakeholder involvement and perceptions that their concerns were not always acknowledged led some key informants to describe unsatisfactory relationships with the implementation team, which some believed contributed considerably to some of the challenges the implementation team encountered during implementation, including the inability to integrate the SRT with existing IT systems in most hospitals: `[w]e probably would be all integrated right now had [the implementation team] actually heard the need’ (Organizational member #3). Data from the mammography case demonstrated high stakeholder involvement during SRT development and early implementation, but much less involvement during expansion, which has proven challenging for that case. As one clinician user stated, `[the implementation team] get[s] out there and realize[s] that no one else likes it because no one was involved in the development’ (Physician #2).
In contrast, key informant and document data from the cancer surgery case indicated that stakeholders viewed themselves as partners in the project, with their input sought and incorporated into the project planning as much as possible. Nearly all system and organizational members expressed high satisfaction with their depth of involvement and the implementation team’s responsiveness to their feedback and recommendations:
`I thought that from a coding perspective, they were receptive to anything that we had to say and we certainly had lots of one-on-ones with [Dr. X] and said, `this is the challenge, this is what we think is missing, this is what we need to be clear on in terms of breast conservation versus mastectomy’ … [They were] more than receptive to take our concerns, our input, and then offer solutions or feedback’ (Organizational member #2).
Consequently, local implementations of this SRT were viewed as collaborative processes, the significance of which was emphasized by one implementation team member:
`It was about … listening to [our partners] and respecting what they are saying. [Their] language and voice is reflected in the work. Without doubt, that is the number one thing that has made this successful …’ (Team member #2).
Managing the change process
Across all cases, managing the people and processes involved in the change process was fundamental to SRT implementation and use. This involved building a case for SRTs, communicating about the change process (including articulating the value of the tools and how they fit into the `bigger picture’ of cancer care), equipping people to use the SRTs, and managing barriers and providing incentives to change.
In two of the cases (mammography case, endoscopy case), the data suggested that SRT implementation and use were negatively impacted by sub-optimal change management practices. Key informants perceived that communication about the SRTs and their implementation was inadequate. In the mammography case, several key informants stated they received no communication whatsoever about the tools prior to their implementation and many felt that implementation processes were hampered because users (and other organizational members) had a limited understanding of how the SRTs aligned with breast health/care in Nova Scotia:
`I think that part of the problem was that people didn’t really understand how it fit into the grand scheme of things and, uhm, perhaps if [the implementation team] had been able to get that concept across better, [radiologists] would have been more accepting’ (Physician #1).
Similarly, in the endoscopy case, key informant interviews with organizational managers suggested that they did not perceive the value of the SRT. In the cancer surgery case, all key informants perceived value in the tool and understood the desired endpoint, suggesting that the implementation team was successful in communicating the reasons for SRT implementation: `My experience has been they know what they are doing, they know where they need to go and want to go, uhm, and continuing to make those strides with their colleagues’ (System member #2). Moreover, data from all cases suggest that much of the effective communication-i.e., communicating the reasons for the change, how individuals’ work will be impacted, and what is expected of them during and after implementation-occurred through personal contact rather than formal communication channels.
Implementation teams from all cases provided initial, onsite training for clinician users and some level of ongoing technical support during and following implementation. The training environments and experiences differed across cases, with some users describing the training and support processes as challenging while others were pleased with the quality of training. Following initial training, the availability of ongoing support was critical to realizing committed, sustained SRT use. For instance, many endoscopists in the endoscopy case expressed frustration with ongoing support mechanisms and the timeliness of support processes whereas most surgeons in the cancer surgery case were particularly pleased with the high level of support provided early in implementation, specifically the 24/7 telephone access to a technical support person, as well as the ongoing support process.
The importance of an early positive implementation experience, especially with training and support, was highlighted across cases and sources of evidence. In the mammography case, when reflecting upon early training and support experiences, one informant stated that `the initial frustration was such that it was a deal breaker’ (Physician #4). In the cancer surgery case, interview, observation, and documentary evidence suggested that `… training should not be underestimated. In fact, the more training provided the better the implementation experience was’ (Excerpt, Canadian Partnership Against Cancer: Synoptic Reporting Tools Project Evaluation).
Finally, implementation teams were required to mitigate barriers to SRT implementation and use, which ranged from general resistance to change to technological barriers (e.g., computer availability). In both the mammography and endoscopy cases, many key informants felt that many of the perceived barriers could have been addressed by improved change management practices. In the cancer surgery case, key informants discussed the concerted efforts the implementation team made to remove obstacles to use and how these efforts facilitated SRT use: `[I was reluctant] the first couple of days because I said `I am not a computer person,’ but they made it easy’ (Physician #3).
Champions and respected colleagues
Across all cases, the existence of respected, trusted clinical colleagues championing the initiative was critical to implementation and to clinicians’ acceptance and use of the tools. These champions played key roles in achieving buy-in for implementation (at all levels) and facilitating a credible implementation process. In the mammography case, key informants perceived the existence of local champions to be the biggest factor for radiologist buy-in and use, with the lack of a local champion perceived to impede implementation and use: `[We] need champions at the districts, especially [radiologists] … the biggest factor for radiologists, if local leaders wanted the system and supported it, it went well’ (Team member #2). In both the endoscopy and cancer surgery cases, the well-respected clinical colleagues who were leading and championing the initiatives were instrumental to facilitating use of the tools, despite many challenges with SRT use (either due to the tool itself or the way in which it was implemented). In fact, nearly all surgeons in the cancer surgery case indicated it was their respect for and trust in a clinical colleague that influenced their decision to use the SRT: `I trust [Dr. Z]’ (Physician #6).
These individuals’ influence extended beyond their clinical colleagues, facilitating the acquisition and leveraging of organizational resources and development of policy. In both the mammography and endoscopy cases, the influence of highly-respected clinicians who were leading and championing the initiatives was integral to developing and enacting policy with respect to using the SRTs for screening purposes.
Administrative and managerial support
Key informant and document data indicated that all cases had strong support from senior administrators and executives at the organizational and health system levels (e.g., health regions, government). These individuals perceived value from a quality improvement perspective, with SRTs aligning with higher-level strategic priorities and directions. Support and buy-in from senior administrators was fundamental to the teams’ abilities to implement these tools across different hospitals and their various organizational policies and infrastructure. For instance, in the endoscopy case, high-level support helped ensure the team acquired the necessary resources to achieve implementation: `[We] would put forward the budget request and the [Department of Health and Wellness] would honour that budget request and we were resourced in what we needed to do’ (Team member #2). In the mammography and endoscopy cases, support from system-level administrators ultimately led to the enactment of policy requiring clinicians to use the SRTs for all screening investigations.
The level of support from middle managers and department/unit heads varied across the cases though had a considerable impact on the implementation experience-both for the implementation teams as well as clinician users. In the mammography and endoscopy cases, support from middle managers was low in some hospitals. Lack of managerial support was largely related to their low involvement and input during implementation, the introduction of new roles/tasks with no additional resources to carry out this new work, lack of IT integration (which added to the workload in many departments), and their limited understanding of the tool’s value. This low support was expressed by one participant in the endoscopy case, who said, `Everyone says these systems will be cost-savings and time-savings, but I don’t believe [this tool] is either’ (Organizational member #2). Conversely, managers were highly supportive of the cancer surgery case, helping the team leverage resources (e.g., time, expertise) and navigate the organizational and socio-political landscape. Key informants stated they felt the team accomplished such a high level of support via widespread stakeholder engagement and personal contact with stakeholders throughout the system.
Innovation attributes
Characteristics of the SRTs undoubtedly influenced their implementation and use. Specifically, the complexity/simplicity of the input system and resulting end report, the relative advantage the tool had over existing practices, and the extent to which the tool aligned with individual, departmental, and organizational values, interests, and prior experiences (i.e., compatibility) all contributed to individuals’ perceptions of the SRTs and their willingness to implement and use them.
The ease of use of the tools (including the end report) varied across cases, with clinician users in the endoscopy and cancer surgery cases more apt to describe the SRT as user-friendly than users in the mammography case. Nearly all endoscopists in the endoscopy case, for instance, stated that the SRT was easy to learn and use, and that it saved time when compared to dictating: `As far as using the computer program, it’s basically very intuitive. There are one or steps that aren’t but they are simple once you get the trick of it’ (Physician #4). Similarly, most surgeons in the cancer surgery case indicated the tool was relatively easy to use, though took more time to complete than traditional narrative (dictated) reporting. Despite this, most users expressed some dissatisfaction with certain features of the tools (e.g., quantity of data elements) and/or the end report (e.g., length) though these views were not universal. Technical and accessibility issues (e.g., login difficulty) were also a large source of frustration for users, especially when they were unable to access technical support in a timely manner to resolve them.
Many radiologists in the mammography case did not find the SRTs user-friendly and those who refrained from using the tool expressed that it was not advantageous compared to current reporting practices. One particular issue that nearly every key informant, outside of the implementation team, discussed was the end report that was generated. This report was perceived as inadequate and confusing to review, with key informants from multiple levels of the system stating they did not view it as a true synoptic report. These issues are exemplified in the following remarks:
`Whatever system is out there, it can’t make our job more difficult, the report that comes out has to be the same or better, not worse, uh and the people that are reading those reports have to understand what we are saying and in this case none of those are true’ (Physician #3).
Across cases, clinicians emphasized that, in an already-overburdened environment, using a SRT (or any new tool in practice) must be as easy as what they currently do, at least after the initial learning curve.
Data across multiple sources strongly indicated that synoptic reporting aligned with organizational and system values, directions, and priorities. Perceived value related to clinical utility, organizational efficiencies, and the potential for performance monitoring and quality improvement. Endoscopists and surgeons perceived that the SRTs were compatible with their individual and professional values, despite any specific issues with the tools themselves. Most identified clinical benefits to using SRTs, including standardization and timeliness of information, improved communication with other care providers, and enabling best practices. These views are illustrated by one clinician user in the cancer surgery case, who stated:
`I think that we probably all agreed that in the traditional system of just dictating operative notes, there is great variability of information that is provided, uhm, it created problems for communication for what was found, oncologists trying to figure what we did or didn’t do and, uhm, also from a quality assurance perspective. You know, there are certain things that should be in there and [the synoptic report] can help achieve addressing those issues. It is just a good thing’ (Physician #1).
Use of SRTs across cases
The extent of SRT use was revealed via key informant interviews and document analysis (mammography case, endoscopy case) and a brief review of one SRT database (cancer surgery case). Table 7 describes use across the cases.
Discussion
This study examined the key multi-level factors that influenced the implementation and use of SRTs in three cases of cancer care in one Canadian province. Cross-case analysis revealed five common factors that were particularly influential across the cases studied. That these factors transcended the different contexts (settings, timing, and individuals) demonstrates their importance to gaining buy-in and support for implementation, promoting a sense of ownership for implementation, acquiring and leveraging resources (human and fiscal) to make the implementation a reality, and providing people with reasons to change and the tools to help them succeed.
The theoretical perspectives that guided this study emphasize various multi-level influences on innovation implementation. The five factors that were common across cases were represented across the three perspectives, either explicitly as a construct or by encompassing some of the same concepts as the constructs embody (see Table 8). As presented in Table 8, many of the constructs of the organizational framework of innovation implementation [45] were salient to SRT implementation and use across all cases. Similarly, the propositions put forward by Kitson [46] (see Table 1) were all germane to the cases studied.
One of the constructs of the PARiHS framework-context-influenced SRT implementation in the mammography case, but less so in the other cases. Interestingly, neither the construct of evidence (even defined broadly through PARiHS) nor facilitation (as conceptualized by PARiHS) was an influential factor in SRT implementation and use. Most key informants did not discuss the evidence for synoptic reporting as being a factor in their decisions to adopt and/or use the tools. When evidence was discussed, the source of evidence was most often data from other jurisdictions (e.g., local evaluations, verbal experiences with use) than the scientific literature. Related to facilitation, the implementation teams in each case were responsible for supporting affected individuals before and during SRT implementation. However, key informant and documentary data did not indicate a need for facilitation as described by PARiHS, specifically for a dedicated, trained individual to work with the team `to construct a programme of change that meets the individual and team’s learning needs’ [44] (pg. 10). Rather, the data emphasized particular facets of implementation processes that dedicated teams must attend to and engage in. Thus, aspects of facilitation were clearly encompassed in the findings related to stakeholder involvement and managing the change process. Broadening our understanding of facilitation as a team or organizational construct wherein many individuals can adopt strategies and activities that facilitate implementation-versus a position filled by a trained individual-may provide a more nuanced understanding of facilitation in innovation implementation.
The key factors influencing implementation and use in the endoscopy and cancer surgery cases were quite similar. This is perhaps not surprising given the initiatives took place at approximately the same time in the same province and involved some of the same stakeholders at the system and user levels. However, the specific influence of those factors (i.e., facilitating or impeding) often differed between cases, with the implementation approached quite differently with respect to many of the factors. The cases also had many differences (e.g., resource characteristics and availability) with entirely different implementation teams. That commonalities existed in spite of the differences, and that many of the same overarching factors were also common to the mammography case, strengthens our findings and helps to extend and refine theory in the area of innovation implementation in health care. Specifically, the findings add novel insights into several important issues that are under-developed in the existing literature in this area. First, they revealed the important role that individuals at the middle-level of organizations (e.g., middle managers, department/unit heads) play in implementation efforts. Indeed, the data demonstrated that these individuals can facilitate innovation implementation by demonstrating their moral support for implementation (e.g., involving staff in pre-implementation planning); exerting their authority over existing departmental policies, priorities, and resources (e.g., providing on-the-ground resources, such as staff time, to facilitate implementation); and influencing the development of policy related to the innovation and its implementation (e.g., championing the innovation with senior administrators who can develop and enact organizational policy). Their influence, however, can be positive or negative-that is, these individuals can allocate resources to support implementation or ensure that implementation is something that is carried out `off the side of one’s desk.’
Second, the findings revealed that the interpersonal aspects of change have a considerable influence on innovation implementation and use. For instance, the findings clearly showed the facilitating influence of involving stakeholders early in implementation planning and from multiple levels of the healthcare system, not simply clinician users. Quite simply, stakeholders who felt they were highly involved in the implementation were more willing to help the team navigate the implementation at their respective organizations, and to provide organizational and departmental resources (e.g., staff time and expertise). Those with low involvement were, by and large, resistant to SRT implementation-despite speaking highly of SRTs in general-and cited numerous reasons for opposing the SRT or its implementation. This finding has important practical implications because individuals can make choices and frame issues in ways that influence others and thus have consequences for implementation. Moreover, the data suggest that stakeholders should include not only clinician users and senior administrators, but also other organizational members who can affect, and are affected by, the implementation. Indeed, many of the `micro-processes’ of implementation have to be negotiated with local stakeholders [65]; these individuals have the knowledge and expertise, and oftentimes access to local resources, to provide solutions that are workable and sensitive to local conditions and capacities.
This study has a number of strengths. First, the multiple strategies employed to increase rigor enhance confidence in our findings. Second, there was a high level of participation across units of analysis for all cases. Six individuals did fail to respond in the mammography case; though the reason(s) for this is speculative, it may have involved clinician time/interest or a perception that he/she had nothing of value to share. Indeed, these six individuals were radiologists at institutions wherein the SRTs had been in use for more than a decade. It is plausible that the SRTs were in place when they commenced their practice and therefore they felt they had little insight into their implementation and opted not to respond to the invitation.
This study does have limitations. First, this study was undertaken in one jurisdiction only. Given that the structure and socio-political context of healthcare systems vary, this may limit the applicability of findings to other jurisdictions. Nonetheless, healthcare systems generally have a number of defining features, including a wide range and diversity of stakeholders, complex governance and resourcing arrangements, and high degrees of professional autonomy of many of its staff [66], which should increase the applicability of these findings in other health systems. Moreover, the sampling strategy ensured that the cases varied on key constructs believed to influence innovation implementation, and the healthcare delivery system in the province differed considerably across the implementation timeframes. These differences across cases also facilitate the applicability of findings to other contexts. A second limitation pertains to the mammography case, wherein a number of key informants stated it was difficult to remember what happened during the implementation period. Therefore, the data are subject to issues of recall. Of the key informants who were involved during the initial implementation efforts, however, their recollections of people and events during that time did not differ considerably from one another.
Conclusions
Key factors at multiple levels of the health system affected SRT implementation and use. The five factors common across cases were: stakeholder involvement, managing the change process, administrative and managerial support, champions and respected colleagues, and innovation attributes. The key role of interpersonal level factors across cases, despite differing characteristics and contexts, and their relationships to gaining and maintaining both moral and material support for innovation implementation have significant implications for individuals and teams who are responsible for implementing changes in healthcare settings. Indeed, the findings revealed that positive relationships can counterbalance many negative contextual factors-thus, the early engagement of key stakeholders across multiple levels of healthcare organizations and systems may be fundamental to implementation efforts and to supporting the consistent and committed use of an innovation. The findings also demonstrate the importance of a multi-level contextual analysis to gaining both breadth and depth to our understanding of innovation implementation and use in health care. Recent conceptual work on implementation in health care [67] and evidence-based practice [68] supports the need for this type of analysis.
Authors’ contributions
RU conceived the idea for this study, led the intellectual development, and was primarily responsible for its conduct. GAP, LJ, JS, and EG all contributed to the development of the study, and its analysis and interpretation. All authors reviewed and agreed on the final manuscript.
Additional file
Abbreviations
- PARiHS:
-
Promoting Action on Research Implementation in Health Services framework
- SRT:
-
Synoptic reporting tool
References
Srigley JR, McGowan T, Maclean A, Raby M, Ross J, Kramer S, Sawka C: Standardized synoptic cancer pathology reporting: a population-based approach. J Surg Oncol. 2009, 99 (8): 517-524. 10.1002/jso.21282.
Beattie GC, McAdam TK, Elliott S, Sloan JM, Irwin ST: Improvement in quality of colorectal cancer pathology reporting with a standardized proforma - a comparative study. Colorectal Dis. 2003, 5 (6): 558-562. 10.1046/j.1463-1318.2003.00466.x.
Bull AD, Biffin AH, Mella J, Radcliffe AG, Stamatakis JD, Steele RJ, Williams GT: Colorectal cancer pathology reporting: a regional audit. J Clin Pathol. 1997, 50 (2): 138-142. 10.1136/jcp.50.2.138.
Donahoe L, Bennett S, Temple W, Hilchie-Pye A, Dabbs K, Macintosh E, Porter G: Completeness of dictated operative reports in breast cancer-the case for synoptic reporting. J Surg Oncol. 2012, 106 (1): 79-83. 10.1002/jso.23031.
Edhemovic I, Temple WJ, de Gara CJ, Stuart GC: The computer synoptic operative report - a leap forward in the science of surgery. Ann Surg Oncol. 2004, 11 (10): 941-947. 10.1245/ASO.2004.12.045.
Lefter LP, Walker SR, Dewhurst F, Turner RW: An audit of operative notes: facts and ways to improve. ANZ J Surg. 2008, 78 (9): 800-802. 10.1111/j.1445-2197.2008.04654.x.
Verleye L, Ottevanger PB, Kristensen GB, Ehlen T, Johnson N, van der Burg ME, Reed NS, Verheijen RH, Gaarenstroom KN, Mosgaard B, Seoane JM, van der Velden J, Lotocki R, van der Graaf W, Penninckx B, Coens C, Stuart G, Vergote I: Quality of pathology reports for advanced ovarian cancer: are we missing essential information? An audit of 479 pathology reports from the EORTC-GCG 55971/NCIC-CTG OV13 neoadjuvant trial. Eur J Cancer. 2011, 47 (1): 57-64. 10.1016/j.ejca.2010.08.008.
Branston LK, Greening S, Newcombe RG, Daoud R, Abraham JM, Wood F, Dallimore NS, Steward J, Rogers C, Williams GT: The implementation of guidelines and computerised forms improves the completeness of cancer pathology reporting. The CROPS project: a randomised controlled trial in pathology. Eur J Cancer. 2002, 38 (6): 764-772. 10.1016/S0959-8049(01)00258-1.
Cross SS, Feeley KM, Angel CA: The effect of four interventions on the informational content of histopathology reports of resected colorectal carcinomas. J Clin Pathol. 1998, 51 (6): 481-482. 10.1136/jcp.51.6.481.
Rigby K, Brown SR, Lakin G, Balsitis M, Hosie KB: The use of a proforma improves colorectal cancer pathology reporting. Ann R Coll Surg Engl. 1999, 81 (6): 401-403.
Chapuis PH, Chan C, Lin BP, Armstrong K, Armstrong B, Spigelman AD, O’Connell D, Leong D, Dent OF: Pathology reporting of resected colorectal cancers in New South Wales in 2000. ANZ J Surg. 2007, 77 (11): 963-969. 10.1111/j.1445-2197.2007.04291.x.
Messenger DE, McLeod RS, Kirsch R: What impact has the introduction of a synoptic report for rectal cancer had on reporting outcomes for specialist gastrointestinal and nongastrointestinal pathologists?. Arch Pathol Lab Med. 2011, 135 (11): 1471-1475. 10.5858/arpa.2010-0558-OA.
Wilkinson NW, Shahryarinejad A, Winston JS, Watroba N, Edge SB: Concordance with breast cancer pathology reporting practice guidelines. J Am Coll Surg. 2003, 196 (1): 38-43. 10.1016/S1072-7515(02)01627-7.
Hammond EH, Flinner RL: Clinically relevant breast cancer reporting: using process measures to improve anatomic pathology reporting. Arch Pathol Lab Med. 1997, 121 (11): 1171-1175.
Austin R, Thompson B, Coory M, Walpole E, Francis G, Fritschi L: Histopathology reporting of breast cancer in Queensland: the impact on the quality of reporting as a result of the introduction of recommendations. Pathology. 2009, 41 (4): 361-365. 10.1080/00313020902884469.
Chamberlain DW, Wenckebach GF, Alexander F, Fraser RS, Kolin A, Newman T: Pathological examination and the reporting of lung cancer specimens. Clin Lung Cancer. 2000, 1 (4): 261-268. 10.3816/CLC.2000.n.008.
Gill AJ, Johns AL, Eckstein R, Samra JS, Kaufman A, Chang DK, Merrett ND, Cosman PH, Smith RC, Biankin AV, Kench JG: Synoptic reporting improves histopathological assessment of pancreatic resection specimens. Pathology. 2009, 41 (2): 161-167. 10.1080/00313020802337329.
Karim RZ, van den Berg KS, Colman MH, McCarthy SW, Thompson JF, Scolyer RA: The advantage of using a synoptic pathology report format for cutaneous melanoma. Histopathology. 2008, 52 (2): 130-138. 10.1111/j.1365-2559.2007.02921.x.
Mohanty SK, Piccoli AL, Devine LJ, Patel AA, William GC, Winters SB, Becich MJ, Parwani AV: Synoptic tool for reporting of hematological and lymphoid neoplasms based on World Health Organization classification and College of American Pathologists checklist. BMC Cancer. 2007, 7: 144-10.1186/1471-2407-7-144.
Temple WJ, Francis WP, Tamano E, Dabbs K, Mack LA, Fields A: Synoptic surgical reporting for breast cancer surgery: an innovation in knowledge translation. Am J Surg. 2010, 199 (6): 770-775. 10.1016/j.amjsurg.2009.07.037.
Chambers AJ, Pasieka JL, Temple WJ: Improvement in the accuracy of reporting key prognostic and anatomic findings during thyroidectomy by using a novel Web-based synoptic operative reporting system. Surgery. 2009, 146 (6): 1090-1098. 10.1016/j.surg.2009.09.032.
Park J, Pillarisetty VG, Brennan MF, Jarnagin WR, D’Angelica MI, Dematteo RP, CoitD G, Janakos M, Allen PJ: Electronic synoptic operative reporting: assessing the reliability and completeness of synoptic reports for pancreatic resection. J Am Coll Surg. 2010, 211 (3): 308-315. 10.1016/j.jamcollsurg.2010.05.008.
Harvey A, Zhang H, Nixon J, Brown CJ: Comparison of data extraction from standardized versus traditional narrative operative reports for database-related research and quality control. Surgery. 2007, 141 (6): 708-714. 10.1016/j.surg.2007.01.022.
Laflamme MR, Dexter PR, Graham MF, Hui SL, McDonald CJ: Efficiency, comprehensiveness and cost-effectiveness when comparing dictation and electronic templates for operative reports. AMIA Annu Symp Proc. 2005, 2005: 425-429.
Mack LA, Dabbs K, Temple WJ: Synoptic operative record for point of care outcomes: a leap forward in knowledge translation. Eur J Surg Oncol. 2010, 36 (Suppl 1): S44-S49. 10.1016/j.ejso.2010.06.005.
Cowan DA, Sands MB, Rabizadeh SM, Amos CS, Ford C, Nussbaum R, Stein D, Liegeois NJ: Electronic templates versus dictation for the completion of Mohs micrographic surgery operative notes. Dermatol Surg. 2007, 33 (5): 588-595.
Caines JS, Schaller GH, Iles SE, Woods ER, Barnes PJ, Johnson AJ, Jones GR, Borgaonkar JN, Rowe JA, Topp TJ, Porter GA: Ten years of breast screening in the Nova Scotia Breast Screening Program, 1991-2001. experience: use of an adaptable stereotactic device in the diagnosis of screening-detected abnormalities. Can Assoc Radiol J. 2005, 56 (2): 82-93.
Rayson D, Payne JI, Abdolell M, Barnes PJ, Macintosh RF, Foley T, Younis T, Burns A, Caines J: Comparison of clinical-pathologic characteristics and outcomes of true interval and screen-detected invasive breast cancer among participants of a canadian breast screening program: a nested case-control study. Clin Breast Cancer. 2011, 11 (1): 27-32. 10.3816/CBC.2011.n.005.
Cancer Australia, Australian Government: Structured pathology reporting. [], [http://canceraustralia.gov.au/research-data/data/data-set-development/structured-pathology-reporting]
Canadian Partnership Against Cancer: Synoptic Reporting (surgery). [], [http://www.partnershipagainstcancer.ca/priorities/2007-2012-initiatives/cancer-guidelines-2007-2012-strategic-initiatives/synoptic-surgical-reporting-2/]
Cancer Care Ontario: Pathology Reporting Project. [], [https://www.cancercare.on.ca/common/pages/UserFile.aspx?fileId=310243]
Cancer Program Standards 2009. 2009, American College of Surgeons, Chicago, IL
Canadian Partnership against Cancer: International Collaboration on Cancer Reporting: communique. [], [http://www.partnershipagainstcancer.ca/wp-content/uploads/International-Collaboration-on-Cancer-Reporting-Communique.pdf]
Urquhart R, Grunfeld E, Porter GA: Synoptic reporting and the quality of cancer care: a review of evidence and Canadian initiatives. Oncology Exchange. 2009, 8 (1): 28-31.
Battista RN: Innovation and diffusion of health-related technologies. A conceptual framework. Int J Technol Assess Health Care. 1989, 5 (2): 227-248. 10.1017/S0266462300006450.
Denis JL, Hebert Y, Langley A, Lozeau D, Trottier LH: Explaining diffusion patterns for complex health care innovations. Health Care Manage Rev. 2002, 27 (3): 60-73. 10.1097/00004010-200207000-00007.
Fraser I: Translation research: where do we go from here?. Worldviews Evid Based Nurs. 2004, 1 (Suppl 1): S78-S83. 10.1111/j.1524-475X.2004.04046.x.
Litaker D, Tomolo A, Liberatore V, Stange KC, Aron D: Using complexity theory to build interventions that improve health care delivery in primary care. J Gen Intern Med. 2006, 21 (Suppl 2): S30-S34. 10.1007/s11606-006-0272-z.
Titler MG: The Evidence for Evidence-Based Practice Implementation. Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Edited by: Hughes RG. 2008, Agency for Healthcare Research and Quality, Rockville, MD
Urquhart R, Porter GA, Grunfeld E, Sargeant J: Exploring the interpersonal-, organization-, and system-level factors that influence the implementation and use of an innovation-synoptic reporting-in cancer care. Implement Sci. 2012, 7: 12-10.1186/1748-5908-7-12.
Stake R: Multiple Case Study Analysis. 2006, Guilford Press, New York, NY
Yin RK: Case Study Research: Design and Methods. 2009, Sage, Thousand Oaks, CA
Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998, 7 (3): 149-158. 10.1136/qshc.7.3.149.
Kitson AL, Rycroft-Malone J, Harvey G, Mccormack B, Seers K, Titchen A: Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008, 3 (1): 1-10.1186/1748-5908-3-1.
Helfrich CD, Weiner BJ, Mckinney MM, Minasian L: Determinants of implementation effectiveness: adapting a framework for complex innovations. Med Care Res Rev. 2007, 64 (3): 279-303. 10.1177/1077558707299887.
Kitson AL: The need for systems change: reflections on knowledge translation and organizational change. J Adv Nurs. 2009, 65 (1): 217-228. 10.1111/j.1365-2648.2008.04864.x.
Klein KJ, Conn AB, Sorra JS: Implementing computerized technology: An organizational analysis. J Appl Psychol. 2001, 86 (5): 811-824. 10.1037/0021-9010.86.5.811.
Klein KJ, Sorra JS: The challenge of innovation implementation. Acad Manage Rev. 1996, 21 (4): 1055-1080.
Denzin NK: The Research Act: A Theoretical Introduction to Sociological Methods. 1978, McGraw-Hill, New York, NY
Denzin N: Sociological Methods: A Sourcebook. 2006, Transaction Publishers, Piscataway, NJ
Patton MQ: Qualitative Research & Evaluation Methods. 2002, SAGE Publications, Thousand Oaks, CA
Rubin H, Rubin I: Qualitative Interviewing: The Art of Hearing Data. 1995, Sage Publications, Thousand Oaks, CA
Braun V, Clarke V: Using thematic analysis in psychology. Qual Res Psychol. 2006, 3: 77-101. 10.1191/1478088706qp063oa.
Urquhart R, Sargeant J, Porter GA: Factors related to the implementation and use of an innovation in cancer surgery. Curr Oncol. 2011, 18 (6): 271-279. 10.3747/co.v18i6.961.
Van de Ven AH, Polley DE, Garud R, Venkataraman S: The Innovation Journey. 1999, Oxford University Press, Oxford
Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.
Rogers EM: Diffusion of Innovations. 2003, Free Press, New York, NY
Patton MQ: Utilization Focused Evaluation. 2008, SAGE, Saint Paul, MN
Godin G, Belanger-Gravel A, Eccles M, Grimshaw J: Healthcare professionals’ intentions and behaviours: A systematic review of studies based on social cognitive theories. Implement Sci. 2008, 3: 36-10.1186/1748-5908-3-36.
Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14 (1): 26-33. 10.1136/qshc.2004.011155.
Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57: 660-680. 10.1111/j.1464-0597.2008.00341.x.
Thurmond VA: The point of triangulation. J Nurs Scholarsh. 2001, 33 (3): 253-258. 10.1111/j.1547-5069.2001.00253.x.
Flyvbjerg B: Five misunderstandings about case-study research. Qual Inq. 2006, 12 (2): 219-245. 10.1177/1077800405284363.
Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, Mccormack B, Seers K: Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002, 37 (6): 577-588. 10.1046/j.1365-2648.2002.02126.x.
Fitzgerald L, Ferlie E, Wood M, Hawkins C: Interlocking interactions, the diffusion of innovations in health care. Human Relations. 2002, 55 (12): 1429-1449. 10.1177/001872602128782213.
Iles V, Sutherland K: Organizational Change: A Review for Health Care Managers, Professionals and Researchers. 2001
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50.
Satterfield JM, Spring B, Brownson RC, Mullen EJ, Newhouse RP, Walker BB, Whitlock EP: Toward a transdisciplinary model of evidence-based practice. Milbank Q. 2009, 87 (2): 368-390. 10.1111/j.1468-0009.2009.00561.x.
Acknowledgements
We gratefully acknowledge Margaret Jorgensen (coordinator) for her assistance with this study and Cynthia Kendell for her helpful review of and suggestions on this manuscript. This study was funded by the CIHR/CCNS Team in Access to Colorectal Cancer Services in Nova Scotia (funders: Canadian Institutes of Health Research, Cancer Care Nova Scotia, Nova Scotia Department of Health and Wellness, Capital District Health Authority; Dalhousie University Faculty of Medicine; Dalhousie Medical Research Foundation). Robin Urquhart also received funding from the Nova Scotia Health Research Foundation to carry out this work. The funding bodies had no role in the design, collection, analysis, and interpretation of data; in the writing of the manuscript; and in the decision to submit this manuscript for publication.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
GAP was the Project Lead in Nova Scotia for the Surgical Synoptic Reporting Tools Project. He received no financial compensation for this work. The remaining authors declare that they have no competing interests.
Electronic supplementary material
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Urquhart, R., Porter, G.A., Sargeant, J. et al. Multi-level factors influence the implementation and use of complex innovations in cancer care: a multiple case study of synoptic reporting. Implementation Sci 9, 121 (2014). https://doi.org/10.1186/s13012-014-0121-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13012-014-0121-0