Skip to main content

Safety analysis over time: seven major changes to adverse event investigation

Abstract

Background

Every safety-critical industry devotes considerable time and resource to investigating and analysing accidents, incidents and near misses. The systematic analysis of incidents has greatly expanded our understanding of both the causes and prevention of harm. These methods have been widely employed in healthcare over the last 20 years but are now subject to critique and reassessment. In this paper, we reconsider the purpose and value of incident analysis and methods appropriate to the healthcare of today.

Main text

The primary need for a revised vision of incident analysis is that healthcare itself is changing dramatically. People are living longer, often with multiple co-morbidities which are managed over very long timescales. Our vision of safety analysis needs to expand concomitantly to embrace much longer timescales. Rather than think only in terms of the prevention of specific incidents, we need to consider the balance of benefit, harm and risks over long time periods encompassing the social and psychological impact of healthcare as well as physical effects.

We argued for major changes in our approach to the analysis of safety events: assume that patients and families will be partners in investigation and where possible engage them fully from the beginning, examine much longer time periods and assess contributory factors at different time points in the patient journey, be more proportionate and strategic in analysing safety issues, seek to understand success and recovery as well as failure, consider the workability of clinical processes as well as deviations from them and develop a much more structured and wide-ranging approach to recommendations.

Conclusions

Previous methods of incident analysis were simply adopted and disseminated with little research into the concepts, methods, reliability and outcomes of such analyses. There is a need for significant research and investment in the development of new methods. These changes are profound and will require major adjustments in both practical and cultural terms and research to explore and evaluate the most effective approaches.

Peer Review reports

Background

Every safety-critical industry devotes considerable time and resource to investigating and analysing accidents, incidents and near misses. Such industries employ many methods for assessing safety. Incident reporting and investigation, often called ‘lagging indicators’ are complemented by what are termed ‘leading indicators’, such as human reliability analysis, safety audits and horizon-scanning for future migrations from safety procedures. While lagging indicators focus on learning from failure and non-compliance, leading indicators support organisations to anticipate future safety risks. There is a rich literature outlining the benefits and limitations of specific types of lagging and leading indicators, and it is generally accepted that how well an organisation combines learning from the two types of indicators optimises safety performance [1,2,3]. Analyses of safety issues in any industry therefore requires review of a range of information [4, 5]; nevertheless, the identification and analysis of serious incidents and adverse events continues to be a critical stimulus and guide for safety improvement.

Implementation science has primarily focussed on improving the uptake of existing research evidence, interventions and policy but may also address the development of interventions. The findings of incident analysis can be valuable here in identifying vulnerabilities in systems and suggesting interventions that may improve safety and reliability. This may occur through the analysis of single incidents within an organisation or through aggregated analyses of incidents at a national level. For instance, Rees et al. [6] recently reviewed 2191 paediatric safety incidents, including 12 deaths and 41 cases of severe harm. In their examination review of potential solutions to the problems identified, they prioritised medication provision in community pharmacies; triage processes to enable effective and timely assessment, diagnosis and referral of acutely sick children attending out-of-hours services; and enhanced communication for robust safety netting between professionals and parents [6]. The analysis of incidents can therefore act as a powerful stimulus and guide to the development and implementation of interventions to improve healthcare.

A critical challenge for patient safety in earlier years was to develop a more thoughtful approach to both error and harm to patients [7, 8]. While a particular action or omission may be the immediate cause of an incident, closer analysis usually reveals a series of events and departures from safe practice, each influenced by the working environment and the wider organizational context [9, 10]. We previously extended Reason’s organisational accident model and adapted it for use in healthcare, classifying the error producing conditions and organizational factors in a single broad framework of factors affecting clinical practice [7]. This gave rise to a method of incident analysis often referred to as ALARM [11] and a later revision and extension in 2004 [12] (the ‘London Protocol’) which has been translated into several languages and can be applied to all areas of healthcare including the acute sector, mental health, and primary care. Similar methods, usually referred to as ‘root cause analysis’, have been developed and implemented by a number of organisations [8, 13]. In this paper, we have chosen not to use the term root cause analysis as, like other commentators, we believe that the ideal of a single root cause is thoroughly misleading [14, 15].

The systematic analysis of incidents has greatly expanded our understanding of both the causes and prevention of harm. These analyses have been conducted in multiple clinical settings and have revealed both the range of vulnerabilities in health systems but also the many factors that may contribute to error [6, 16,17,18,19]. For instance, in a review of medication-related incidents [20], Dean and colleagues identified a wide variety of specific errors and contributory factors which in turn suggested methods of intervention and error reduction. These approaches have been widely employed in healthcare over the last 20 years but are now subject to critique and reassessment [5, 15, 21, 22]. We need to reconsider the purpose and value of incident analysis and develop methods appropriate to the healthcare of today.

The need for reassessment

The primary need for a revised vision of incident analysis is that healthcare itself is changing dramatically [4]. People are living longer, often with multiple co-morbidities which are managed over very long timescales. Care is increasingly being delivered in the home and in community settings; patients and families are increasingly and necessarily in charge of their own care. The emphasis and indeed purpose of healthcare is changing from one of healing and restoration to health to the longer term aim of supporting well-being in the face of chronic disease and increasing frailty [23]. The focus of care is moving from the hospital to the home and community which means that we need to pay much more attention to safety issues that arise outside at home, in the community and in primary care settings.

We have recently argued [4] that our vision of safety analysis needs to expand concomitantly to embrace much longer timescales. The analysis of specific incidents remains important but there is increasing evidence that the harm and failures of care that patients may suffer are often due to an accumulation of problems over a long time period across multiple contexts [24, 25]. For instance, many hospital admissions for older people are due to adverse drug events, particularly those due to the interaction of multiple medications over a long period of time. Analyses of incidents generally limited to a single hospital admission or to a specific event in primary care but many adverse drug events can only be understood by examining decisions and events along the patient journey. In the case of an admission to hospital with a complex drug reaction, a full understanding of the event might only be achieved by tracking the history of the patient’s care over several months leading up to the admission. Patients’ and carers’ perspectives are rarely sought and yet they may be the only people who can provide a picture of the care delivered over long time periods [4].

The second major reason for a reassessment is that many of the analyses that are conducted do not lead to effective actions or improvements. Reviews conducted by healthcare organisations suggest that the implementation and quality of incident analysis can be highly variable and is often poor [5, 8, 15, 26]. Organisations are often under pressure to deliver a large number of mandated investigation reports which means that the analyses can degenerate into a bureaucratic process in which the only outcome is the production of a report identifying ‘root causes’ and making formulaic and largely unachievable recommendations. For instance, in a recent analysis of 302 incident analyses, Kellog and colleagues [27] found that the most common recommendations were for more training and the reinforcement of existing policies neither of which, even if implemented, were likely to have any substantial impact on the problems uncovered. They found that multiple event types were repeated in the study period in the same organisation, despite repeated analyses. This suggests that we have perhaps been too optimistic in assuming that a thoughtful analysis would lead naturally to reasonable and effective recommendations; rather, we need to give much more thought to how recommendations and interventions should be derived from incident analysis data and to draw on a richer set of recommendations and responses [4, 6].

Main text

Understanding the whole patient journey: an illustrative case

To assist our reflections on the future of safety analysis, it is helpful to reflect on an illustrative story of the death of a person with mental health problems from a cardiac arrest while being treated as an inpatient and after having been prescribed a new generation of anti-psychotic drugs (Table 1). The story demonstrates the valuable insights we can get from seeing events through the eyes of the patient and how the time frame for analysis needs to cover the patient’s journey from the point of them presenting with symptoms across multiple healthcare providers.

Table 1 A mental health service user dies of a cardiac arrest

Supporting and treating patients with co-existing mental ill health and physical health symptoms can be very challenging, and it is perhaps easy with hindsight to say that this person’s own account of her cardiac symptoms should have been taken more seriously. It is clear however that the healthcare professionals involved became fixated on persuading patient B to take a medication she was reluctant to use. Over time, her feelings of anxiety about taking clozapine increased and she exhibited increasing paranoia, believing the healthcare team were encouraging her to take a medication that was harmful to her cardiac health. She was in fact entirely correct in her assessment.

The scope of the hospital investigation into patient B’s death focused on the period from the time of her acute inpatient admission to her death on the ward. The fact that she had been seen as a ‘non-complaint’ patient and the events leading up to her admission were hardly considered at all. The care given by the hospital in the last days of the patient’s life was in fact of good quality and shed little light on the reasons for her decline and untimely death. Had the time frame for analysis been extended to capture the last months and years of the patient’s healthcare journey and investigated how the drift away from treatment recommended in guidelines occurred, the findings from the analysis may have been very different. They would, for instance, have focused more on how using persuasion as a strategy to convince a mental health service user who is raising concerns about their prescribed medications leads to a breakdown in the therapeutic relationship between care provider and patient and prolonged psychological harm.

This illustrative story serves to introduce some of the changes needed in our approach to analysing the risks of healthcare. We clearly need to examine much longer time periods, but the changes needed are much more than an extension of the current methodology, even though many of the underlying concepts and methods can still provide a relevant foundation. In particular, we need to look at fewer incidents in much greater depth, to be led much more by patients, to seek to understand success and recovery as well as failure and finally to consider an expanded repertoire of responses and recommendations.

Seven major changes to adverse event analysis

Widen the time frame of analysis: review the patient journey

In many cases, the time period encompassed by safety analysis will need to be extended to examine a significant portion of the patient’s journey through the healthcare system, exploring the safety of the patient journey through time. This is different to simply examining the causal history of factors that led to the occurrence of one particular event. Many patients suffer significant harm because of multiple small failures that accumulate throughout their care, rather than a single dramatic failure at one point in time [24, 28,29,30]. We already understand that after an incident we need to look back to the series of factors that combined to create a single harmful event—for instance, a young doctor is unsupervised at night with inadequate equipment, a difficult team and a very sick patient. More often though, in the care of a patient over time, we see a progressive degradation in care due to a combination of errors and system vulnerabilities that accumulate over a long period.

Amalberti and colleagues [31, 32] have previously argued that we should extend the time frame of analysis to consider an ‘event journey’. However, to examine safety over longer time periods, particularly in community settings, we now believe that we should speak simply of the patient journey. This will require looking back through the medical history of the patient in search for all events that have defined the patient’s journey and contributed to the final outcome, whether or not these events have been perceived as serious at the time they occurred or whether the problem was detected and resolved. In this scenario, we will need to try to understand, without the benefit of hindsight, both the benefits and risks of certain courses of action and how sometimes risks will be knowingly and acceptably taken because of the benefits incurred. A simple but important example is the frail person who elects to stay at home rather than be cared for in a residential setting; this course is medically more risky, but the risks are outweighed by the wider social and psychological benefits.

The suggestion that we might extend our analysis to longer time periods raises a number of questions about the definition and identification of events that would be suitable and productive for analysis. The word ‘incident’ does not seem entirely appropriate when considering a series of events that might gradually unfold over several months and some new terminology might be required. We might instead speak of a ‘safety analysis of the patient journey’ over a particular time period. We would also need to identify the trigger events which might lead to such analyses. In the first instance, these might be familiar adverse events which on initial inspection suggest a long genesis. In time, we might be able to identify unsafe periods of patient care, although this is not easy with current information systems.

Work with patients and families to identify, define and prioritise safety issues

Identifying periods of time when care has been unsafe is difficult with current systems firstly because they are not oriented to detecting problems of this kind and secondly because most healthcare staff will only be aware of particular episodes within the patient journey. One potential solution is to analyse some incidents that are selected by patients rather than by professionals to gain a wider coverage of the landscape of potential problems. Incidents currently selected for analysis by professionals tend to be those that have the most immediate and most visible impact in a particular clinical context. The longer term problems that patients can experience as they receive care across different clinical settings over long periods of time are invisible to most professionals not because they are unwilling to see them but simply because the information is not readily available [33, 34].

We already know that patients and families are able to reliably identify adverse events that have not been detected by professionals. Patients have been shown in a number of studies to report errors and adverse events accurately and to provide additional information not available to healthcare professionals [34,35,36,37]. We suggest that events considered for analysis should be selected from the patient’s point of view as well as by professionals. We do not yet know what other kind of events might be identified as worthy of investigation by patients and families but they may be quite different from those identified by professionals. Developing methods to identify significant events identified by patients will be challenging and will likely require collaboration between families and professionals to select events and thematic issues that provide the most fruitful insights [38].

The inclusion of patients and families in both selection and analysis is likely to profoundly affect both the focus and findings of safety analyses. We might anticipate for instance that much more attention will be given to psychological and social issues, that communication and the coordination of care between providers [34] will be a dominant theme and that the cognitive and emotional demands of caring will emerge as a safety issue in its own right.

Conduct fewer, deeper and more proportionate analyses

Healthcare organisations have finite resources for safety investigation and analysis, and these resources are frequently consumed by the demands of outside agencies. Staff can become understandably frustrated and burdened by requirements for time-consuming incident investigation carried out without adequate time or sufficient training. Much greater investment in training in safety analysis is certainly needed [15]. But more fundamentally, much more care and attention needs to be paid in selecting which incidents would be suitable for extensive analysis, particularly in terms of the likely improvements to patient safety. The depth and extent of the analysis conducted should ideally be proportionate to the value of the potential learning and improvements that are likely to result.

Some tragic events must be investigated because the patient and family need an explanation and support; this is right and necessary, and healthcare organisations have a moral responsibility to respond to families who have suffered [39,40,41]. However, these are not necessarily the events which provide the greatest insights into the strengths and vulnerabilities of the healthcare system. For the purposes of safety improvement, a fairly drastic ‘triage’ process should be carried out. Some issues can be reviewed fairly rapidly by a clinical team in a team meeting, while others with wider implications may require longer and more extensive analysis possibly coordinated  across multiple organisations [42]. At present, the main criteria for choosing incidents within organisations is the severity of outcome, although at national level, investigations may be prioritised because they are addressing issues that have widespread implications for the whole system of care [43, 44]. Severity of outcome could remain a criterion for longer term analyses, but we might also want to prioritise events that were likely to reveal problems not highlighted in current systems; these would certainly include problems that arose within the patient’s home, breakdowns in coordination of care across providers and difficulties in transitions between providers of care.

Such long-term analyses would be resource intensive. We suggest however that an extensive analysis of 10 incidents a year across clinical settings would provide just as rich an understanding of the landscape, richer than 100 rushed and formulaic analyses. A deep investigation of 10 incidents in a given clinical area over a year would reveal enough insight for several years’ worth of further exploration and improvement. Findings from such analyses must then be considered in the context of other safety relevant information [45] and the longer term organisational strategy for improving the quality and safety of care.

Applying a more proportionate approach to prioritising analytic resources also requires a flexible portfolio of analytic strategies. For example, productive analyses of minor issues can be carried out rapidly in a few minutes in a team meeting [39] or perhaps used as the basis for reflection in a larger clinical or organisational meeting. Where more detailed analysis may be required, escalating approaches such as concise analysis tools [42], a rapid SWARM analysis [46] through to system level reviews [47]. These all represent different approaches to reflection and investigation of safety issues at different levels across an organisation, which is foundational practice in other safety critical industries [43]. The critical point is to triage incidents and events and customise an appropriate degree of inquiry.

Understand success and failure in detection and recovery

Analyses and reports should identify, and indeed celebrate, good treatment as well as pointing out failures in the care process [48, 49]. More subtly, we also need to pay more attention to both successes and failures of detection, anticipation and recovery [4]. There is much to learn from the ability of the system to detect and recover from failures and close calls [38, 50]. For example, in addition to identifying failures and contributory factors, we could instead ask ‘what successes and failures of response and recovery occurred in the care of this patient?’ and ‘how we can we improve detection and recovery in settings such as these?’ These questions are fundamental to understanding how safety functions and risk controls work effectively—and how they break down [9]. They are also central to many prospective risk analysis methods, such as Bow Tie analysis [51] and Failure Mode and Effects Analysis [52]. Bow Tie analysis, for instance, has been extensively used in the aviation sector to identify and communicate risk information effectively. Carrying out a prospective analysis of a safety risk using the Bow Tie method involves asking a structured set of questions prospectively addressing the nature of a hazard, the circumstances that lead to danger, the impact of loss of control and the means of recovery and mitigation of any harms. Bow Tie diagrams illustrate a hazard, the undesirable event, trigger events (threats) and potential outcomes; they also show the risk controls put in place to minimise the risk. Failure Modes and Effects Analysis, occasionally used in healthcare, [53,54,55] is another analytical method that provides a systematic and structured approach to identifying potential sources and consequences of failure. A key stage of this method involves identifying how potential failures might be detected and responded to if they actually occur.

We should also give serious consideration to examining events and episodes where a successful recovery occurred which would be supportive of staff morale and also instructive in revealing successful adaptive strategies, such as ‘good catch’ programmes in healthcare that seek to analyse and understand events where staff effectively detected and recovered from potentially harmful events [56]. This would have implications both for our understanding of events and, more importantly, for the recommendations which follow such analyses which might expand to include a much stronger focus on developing detection and recovery strategies.

Examine safety issues and contributory factors at different time points

The original ALARM/LONDON protocol proposed that, after the initial care delivery problems were identified, each should be analysed separately to consider the contributory factors [11]. In a sequence of problems, different sets of contributory factors may be associated with each specific problem. For instance, a nurse might fail to ask for advice about a deteriorating patient due to inexperience, poor supervision and deficiencies in teamwork; in contrast, the same patient might later fail to receive the correct medication, but this might be due to inadequate staffing and poor organisation of care. With an analysis over a relatively short timescale, this more complex analysis may not be carried out and all the contributory factors may be considered together; in fact, techniques such as the fish bone causal diagram actively promote the aggregation of all contributory factors into a single amalgam. Much of the value of mapping out the complex patterns of factors and conditions that underlie safety issues is therefore lost, as fine-grained explanations of how events evolve and interlink can instead give way to simplistic lists [57]. However, this more subtle perspective becomes much more important with a longer timescale as a series of problems may be identified which are clearly separated in time and context. Each of these can be separately analysed using the ALARM grid to build up a much more detailed picture of system vulnerabilities.

Reflect on the workability of the underlying care process

Any safety analysis begins by comparing what actually happened with what ideally should have happened. Indeed, it is typically a dramatic mismatch between what was expected and what actually happened that alerts organisations to a serious safety problem in the first place [58]. Analysing incidents in terms of the gap between the way work is expected to be done and what actually occurs is a central strategy in detecting the early signs of emerging safety problems [59,60,61]. Comparing how work is actually done and how it is imagined is one of the primary learning opportunities offered by incident analysis in other industries [43]. For example, in airline incident reporting and investigation systems, safety investigators assume that knowledge of organisational practice is always partial and imperfect and so focus considerable attention on identifying any discrepancies between the practices that are described in incident reports and those that are specified in formal manuals and standard procedures. Even minor discrepancies, such as the order in which bolts are routinely replaced in a maintenance task, can cause serious concern. These discrepancies will typically prompt a detailed investigation of the nature of the ‘real-world’ practical work involved, along with careful examination of the formal procedures that are intended to guide this work, to ensure that both are aligned, reliable and mutually supportive [43, 62].

Analysing this mismatch allows broader reflection on the nature of the problems identified and wider system vulnerabilities. However, typically, the accepted standard of care is taken as a given and the analysis examines reasons for departure from that standard. The conclusion of the investigation may simply be that staff did not comply with standard procedures without any consideration of the workability of those procedures [63] or the context and circumstances in which the care was delivered. Adherence to processes and standards is rightly ingrained in the professional training of nurses and other professions which may make such reflections appear non-professional. Investigations therefore need to look more closely not only at the reasons for departures from standard procedures but at the standards and procedures themselves [64]. This is a subtle but important change of analytic stance. When analytical efforts are directed at identifying and understanding the mismatch between expected organisational work and the real situated practices of professionals, it simultaneously allows both to be updated, improved and revised. There is potential for using this perspective more actively in longer term reviews of safety issues to highlight the workability or unworkability of the intended care processes and so to develop smarter ways of working that are more aligned to human capacities.

Broaden our repertoire of responses and recommendations

Investigations have to be completed in a timely manner and the immediate priority is often to provide assurance to hospital patient safety committees, commissioners and regulators that action plans have been generated and recommendations have been implemented. In their turn, committees and regulators seek assurance that the plan has been actioned in a timely manner, an approach which is guaranteed to encourage simple recommendations that avoid thorny system problems. Reviews of recommendations generated by incident analysis have found that most recommendations are weak and few address fundamental system issues [5, 21, 44]. There is little understanding that people-focused solutions [65, 66] like adding in another double-check, re-writing the safety procedure, creating a new safety procedure or sending out an email reminder to staff are weak and will not in themselves lead to sustained improvements. Studies of successful improvement and behaviour change suggest that even when basic procedures are very well understood considerable work is needed both to understand reasons for non-compliance and to bring about change. Such changes, in the case of hand hygiene for instance, often require long term multi-faceted interventions which embrace cognitive, social and emotional determinants of behaviour all set within a wider organisational strategy with highly visible leadership commitment [67,68,69,70].

Analysts use frameworks of contributory factors to guide the investigation of incidents and we may need to also use frameworks of solutions and interventions to ensure that all potentially relevant interventions are considered [71]. We have previously distinguished five broad strategies each associated with a family of interventions [4]. The first two strategies aim to optimise care, improving both safety and efficiency; the first strategy is to target specific harms or specific clinical processes and the second aims at the improvement of the underlying work systems and processes. These two broad strategies are complemented by strategies that are more concerned with detecting and responding to risk and which assume, particularly in a time of rising demand and financial austerity, that care will often be delivered in difficult working conditions. These three additional strategies are risk control; monitoring, adaptation and response; and mitigation. Each of these is associated with a family of specific interventions. Reports after incident analyses typically consider only a very few of the dozens of potential strategies and interventions available. The development of frameworks of contributory factors 20 years ago [7] helped us structure investigation and ensure a comprehensive exploration of relevant issues; we now need to draw on a menu of safety interventions which we can review when considering what actions might be required following analyses of patient journeys.

Conclusions

Healthcare is changing rapidly with more care being provided in the home and community to an ageing population suffering chronic diseases over long time periods. Our previous concepts of quality and safety have to evolve to reflect these changes. Rather than thinking primarily in terms of specific incidents, we need to consider the balance of benefit and harm over long time periods and encompass the social and psychological impact of healthcare as well as physical effects. We have argued that we need to look at the evolution of patient journeys in much greater depth, be more proportionate and strategic in analysing safety issues, assume that patients and families will be partners in investigation, seek to understand success and recovery as well as failure and develop a much broader and more thoughtful approach to recommendations (Table 2). The longer term perspective has important implications for the subsequent safety strategies that we implement. These changes are profound and will require major adjustments in both practical and cultural terms and research to explore and evaluate the most effective approaches.

Table 2 Seven major changes in adverse event analysis

First and foremost, the involvement of patients and families will need to become the default option in an investigation. This has already been mandated by the Dutch Safety Inspectorate, with the important proviso that healthcare organisations do not have to involve patients and families where there is good reason not to do so [38]. The routine inclusion of patients and families in inquiries should increase the attention given to emotional and social aspects of care and give more emphasis to communication and coordination of care over time and across organisations. We will need to develop new approaches to analyses which allow the inclusion of patient perspectives without burdening families unduly.

Second, everyone involved in investigation needs to reflect on what proportion of the current investigative activity is really meaningful and how information gained from incident analysis should be linked to system improvement. The effectiveness of investigations needs to be evaluated in terms of the quality of the analysis and the depth and seriousness of the ultimate recommendations rather than simply in terms of meeting deadlines and the signing off action plans. Both regulators and healthcare organisations also need to realise that generating recommendations on the basis of a single incident may not be optimal. Aggregate analyses of safety investigations over a year, integrated with other related safety and quality data, will allow examination of major system issues and the production of more meaningful action plans [6, 8, 72, 73]. For instance, poorly organised handover may be a factor in multiple safety incidents but be regarded as too difficult to tackle in a single incident action plan. A hospital reviewing a year’s worth of events however can see a pattern emerging and prepare a serious plan for improving handover across the whole organisation.

Third, safety analyses are commonly limited by the boundaries of the organisations in which the ultimate harm occurred. Analysing the patient journey, and seeing safety through the eyes of the patient, will necessitate the development of more sophisticated ways of conducting safety analyses across organisations including the home and community environment. Such activities will likely require the building of new investigative infrastructures, along with the development of norms and social agreements that support data sharing, collaborative analysis and coordinated improvement across organisational boundaries. This broader approach will require a new type of forum, supported by technical tools such as video conferencing, covering longer periods in the patient’s medical history and involving the participation of both hospital and community practitioners jointly with relatives and the patient. It would also require the development of new indicators and electronic traces, such as tools to monitor individual patients’ laboratory results, to record the nature and duration of all breakdowns in the continuum of care.

Fourth, implementing some of the changes we propose also requires us to improve the evidence available to those who lead safety analyses. Compared with other industries, healthcare investigations use a limited evidence base mainly consisting of the medical record and unstructured interviews [43, 74, 75]. The limited scope of information and evidence is a major contributor to the limited nature of many investigations and the lack of attention to system issues. All too often, current investigations are superficial because the quality of the evidence available to those leading the analysis is fragmented across different IT systems used by multiple providers or is of poor quality; for example, the scenario in which a medication error occurs and the infusion device memory has a 4-h capacity and an automatic over-ride built in, so the actual dose administered to a patient is never known because the device’s memory has been over-written by the time the investigation commences. With the introduction of new technologies and information systems, there are considerable opportunities to support the capture, retention and analysis of safety-relevant data [76, 77].

We recognise that the challenges of analysing even a small proportion of safety issues over longer time periods are considerable. Even with active patient and family involvement, it will be hard to track all relevant clinical information and to get an accurate sequence of events and contributory factors. In the British NHS and other national systems, the patient is at least notionally receiving care from a single provider although in practice the care is often provided by a mixture of publicly funded healthcare, social services and private providers. The challenges will be greater still in more fragmented systems such as the USA where the patient may receive care from a number of disparate and often unconnected healthcare providers. Even within those integrated systems in the USA, such as the Department of Veterans Affairs (VA) healthcare system, patients can receive care delivered or managed by the VA but also care from other providers for which VA has no regulatory authority. In many cases, it would not be clear who might initiate such safety analyses or be accountable for any identified system improvements. We would suggest however that it is nevertheless critical to attempt these analyses across multiple providers because this is the reality that patients and families face as they navigate these complex systems. We believe that many major safety issues are currently neglected precisely because they concern the coordination and integration of care across multiple providers.

Finally, there is a need for significant research and investment in the development of both current and new approaches. While the methods of incident analysis proposed 20 years ago have spread widely, there has been distressingly little research into the concepts, methods, reliability and outcomes of such analyses. We need, for instance, to develop and evaluate means of involving patients and families, to develop methods of assessing and monitoring the quality of investigations and to consider how the reliability and validity of the findings and recommendations from investigations might be meaningfully assessed. This period of revision offers an opportunity for a more critical and scientific vision to emerge which is truly linked to organisation and system-wide learning and improvement.

References

  1. Leveson N. A systems approach to risk management through leading safety indicators. Reliab Eng Syst Saf. 2015;136:17–34.

    Article  Google Scholar 

  2. Leveson NG. Engineering a safer world. Systems thinking applied to safety. Cambridge Massachusetts: MIT Press; 2011.

    Google Scholar 

  3. Hudson P. Process indicators. Managing safety by the numbers. Saf Sci. 2009;47:483–5.

    Article  Google Scholar 

  4. Vincent C, Amalberti R. Safer healthcare. Strategies for the real world. London: Springer; 2016.

    Book  Google Scholar 

  5. Trbovich P, Shojania KG. Root-cause analysis: swatting at mosquitoes versus draining the swamp. BMJ Qual Saf. 2017;26(5):350–3.

    PubMed  Google Scholar 

  6. Rees P, Edwards A, Powell C, Hibbert P, Williams H, Makeham M, et al. Patient safety incidents involving sick children in primary care in England and Wales: a mixed methods analysis. PLoS Med. 2017;14(1):e1002217.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Vincent C, Taylor-Adams S, Stanhope N. Framework for analysing risk and safety in clinical medicine. BMJ. 1998;316(7138):1154–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. AW W, Lipshutz AK, Pronovost PJ. Effectiveness and efficiency of root cause analysis in medicine. JAMA. 2008;299(6):685–7.

    Article  Google Scholar 

  9. Reason JT. Managing the risks of organisational accidents. Aldershot: Ashgate; 1997.

    Google Scholar 

  10. Vincent C. Understanding and responding to adverse events. N Engl J Med. 2003;348(11):1051–6.

    Article  PubMed  Google Scholar 

  11. Vincent C, Taylor-Adams S, Chapman EJ, Hewett D, Prior S, Strange P, et al. How to investigate and analyse clinical incidents: clinical risk unit and association of litigation and risk management protocol. Br Med J. 2000;320(7237):777–81.

    Article  CAS  Google Scholar 

  12. Taylor-Adams S, Vincent C. Systems analysis of clinical incidents: the London protocol. AVMA Med Legal J. 2004;10(6):211–20.

    Google Scholar 

  13. Spath P. Error reduction in health care: a systems approach to improving patient safety. Washington: AHA Press; 1999.

    Google Scholar 

  14. Vincent C. Analysis of clinical incidents: a window on the system not a search for root causes. Qual Saf Health Care. 2004;13(4):242–3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Peerally MF, Carr S, Waring J, Dixon-Woods M. The problem with root cause analysis. BMJ Quality Safety. 2017;26(5):417–22.

    PubMed  Google Scholar 

  16. Cronin C. Five years of learning from analysis of clinical occurrences in pediatric care using the London protocol. Healthc Q. 2006;9(Sp):16–21.

    Article  PubMed  Google Scholar 

  17. Rees P, Edwards A, Panesar S, Powell C, Carter B, Williams H, et al. Safety incidents in the primary care office setting. Pediatrics. 2015;135(6):1–9.

    Article  Google Scholar 

  18. Franklin BD, Panesar SS, Vincent C, Donaldson LJ. Identifying systems failures in the pathway to a catastrophic event: an analysis of national incident report data relating to vinca alkaloids. BMJ Qual Saf. 2014;23(9):765–72.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Lear R, Riga C, Godfrey AD, Falaschetti E, Cheshire NJ, Van Herzeele I, et al. Multicentre observational study of surgical system failures in aortic procedures and their effect on patient outcomes. Br J Surg. 2016:1467–75.

  20. Dean B, Schachter M, Vincent C, Barber N. Causes of prescribing errors in hospital inpatients: a prospective study. Lancet. 2002;359(9315):1373–8.

    Article  PubMed  Google Scholar 

  21. Kellogg KM, Hettinger Z, Shah M, Wears RL, Sellers CR, Squires M, et al. Our current approach to root cause analysis: is it contributing to our failure to improve patient safety? BMJ Qual Saf. 2017;26(5):381–7.

    PubMed  Google Scholar 

  22. Macrae C. The problem with incident reporting. BMJ Qual Saf. 2016;25(2):71–5.

    Article  PubMed  Google Scholar 

  23. World Health O. Report on ageing and health 2015 [Available from: http://www.who.int/ageing/events/world-report-2015-launch/en/]. Accessed 1 Dec 2017.

  24. Hutchinson A, Coster JE, Cooper KL, McIntosh A, Walters SJ, Bath PA, et al. Assessing quality of care from hospital case notes: comparison of reliability of two methods. Qual Saf Health Care. 2010;19(6):e2.

    CAS  PubMed  Google Scholar 

  25. Barker I, Steventon A, Deeny SR. Association between continuity of care in general practice and hospital admissions for ambulatory care sensitive conditions: cross sectional study of routinely collected, person level data. BMJ. 2017;356.

  26. Commission CQ. Learning from serious incidents in NHS hospitals. 2016.

    Google Scholar 

  27. Leistikow I, Mulder S, Vesseur J, et al. Learning from incidents in healthcare: the journey, not the arrival, matters. BMJ Qual Saf. 2017;26:252–56.

    Article  PubMed  Google Scholar 

  28. Hutchinson A, Coster JE, Cooper KL, Pearson M, McIntosh A, Bath PA. A structured judgement method to enhance mortality case note review: development and evaluation. BMJ Qual Saf. 2013;22(12):1032–40.

    Article  PubMed  Google Scholar 

  29. Harmsen M, Gaal S, van Dulmen S, de Feijter E, Giesen P, Jacobs A. Patient safety in Dutch primary care: study protocol. Implement Sci. 2010;5(50). doi:10.1186/1748-5908-5-50.

  30. Gaal S, Verstappen W, Wolters R, Lankveld H, van Weel C, Wensing M. Prevalence and consequences of patient safety incidents in general practice in the Netherlands: a retrospective medical record review study. Implement Sci. 2011;6(1):37.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Amalberti R, Brami J. ‘Tempos’ management in primary care: a key factor for classifying adverse events, and improving quality and safety. BMJ Qual Saf. 2012;21(9):729–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Brami J, Amalberti R, Wensing M. Patient safety and the control of time in primary care: a review of the French tempos framework by the LINNEAUS collaboration on patient safety in primary care. Eur J Gen Pract. 2015;21(Suppl):45–9.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Lang A, Edwards N, Fleiszer A. Safety in home care: a broadened perspective of patient safety. Int J Qual Health Care. 2008;20(2):130–5.

    Article  PubMed  Google Scholar 

  34. Lang S, Velasco Garrido M, Heintze C. Patients’ views of adverse events in primary and ambulatory care: a systematic review to assess methods and the content of what patients consider to be adverse events. BMC Fam Pract. 2016;17:6.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Weingart SS. What can hospitalized patients tell us about adverse events? Learning from patient-reported incidents. J Gen Intern Med. 2005;20(9):830.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Weissman JS, Schneider EC, Weingart SN, Epstein AM, David-Kasdan J, Feibelmann S, et al. Comparing patient-reported hospital adverse events with medical record review: do patients know something that hospitals do not? Ann Intern Med. 2008;149(2):100–8.

    Article  PubMed  Google Scholar 

  37. Davis R, Sevdalis N, Vincent C. Patient involvement in patient safety: how willing are patients to participate? BMJ Qual Saf. 2011;20(1):108–14.

    Article  CAS  PubMed  Google Scholar 

  38. Leistikow I, Mulder S, Vesseur J, Robben P. Learning from incidents in healthcare: the journey, not the arrival, matters. BMJ Qual Saf. 2016;(3):252–56. doi:10.1136/bmjqs-2015-004853.

  39. Vincent C. Patient safety. 2nd ed. Oxford: Wiley Blackwell; 2010.

    Book  Google Scholar 

  40. Gallagher TH, Studdert D, Levinson W. Disclosing harmful medical errors to patients. N Engl J Med. 2007;356(26):2713–9.

    Article  CAS  PubMed  Google Scholar 

  41. Mello MM, Boothman RC, McDonald T, Driver J, Lembitz A, Bouwmeester D, et al. Communication-and-resolution programs: the challenges and lessons learned from six early adopters. Health Aff (Millwood). 2014;33(1):20–9.

    Article  Google Scholar 

  42. Pham JC, Hoffman C, Popescu I, Ijagbemi OM, Carson KA. A tool for the concise analysis of patient safety incidents. Jt Comm J Qual Patient Saf. 42(1):AP1–3.

  43. Macrae C. Close calls. Managing risk and resilience in airline flight safety. London: Palgrave Macmillan; 2014.

    Google Scholar 

  44. Macrae C, Vincent C. Learning from failure: the need for independent safety investigation in healthcare. J R Soc Med. 2014;107(11):439–43.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Vincent C, Burnett S, Carthey J. Safety measurement and monitoring in healthcare: a framework to guide clinical teams and healthcare organisations in maintaining safety. BMJ Qual Saf. 2014;23(8):670–7.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Li J, Boulanger B, Norton J, Yates A, Swartz CH, Smith A, et al. “SWARMing” to improve patient care: a novel approach to root cause analysis. Jt Comm J Qual Patient Saf. 2015;41(11):494–AP3.

    Article  PubMed  Google Scholar 

  47. Duchscherer C, Davies J. Systematic systems analysis: a practical approach to patient safety reviews. Calgary: Health Quality Council of Alberta; 2012.

    Google Scholar 

  48. Wears RL, Woods DD. Always adapting. Ann Emerg Med. 2007;50(5):517–9.

    Article  PubMed  Google Scholar 

  49. Braithwaite J, Wears RL, Hollnagel E. Resilient health care: turning patient safety on its head. Int J Qual Health Care. 2015;27(5):418–20.

    Article  PubMed  Google Scholar 

  50. Wu AW, Marks CM. Close calls in patient safety: should we be paying closer attention? CMAJ. 2013;185(13):1119–20.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Kerckhoffs MC, van der Sluijs AF, Binnekade JM, Dongelmans DA. Improving patient safety in the ICU by prospective identification of missing safety barriers using the bow-tie prospective risk analysis model. J Patient Saf. 2013;9(3):154–9.

    Article  PubMed  Google Scholar 

  52. Ashley L, Armitage G. Failure mode and effects analysis: an empirical comparison of failure mode scoring procedures. J Patient Saf. 2010;6(4):210–5.

    Article  PubMed  Google Scholar 

  53. Burgmeier J. Failure mode and effect analysis: an application in reducing risk in blood transfusion. Jt Comm J Qual Improv. 2002;28(6):331–9.

    PubMed  Google Scholar 

  54. Cook RI, Wreathall J, Smith A, Cronin DC, Rivero O, Harland RC, et al. Probabilistic risk assessment of accidental ABO-incompatible thoracic organ transplantation before and after 2003. Transplantation. 2007;84(12):1602–9.

    Article  PubMed  Google Scholar 

  55. McNally KM, Page MA, Sunderland B. Failure-mode and effects analysis in improving a drug distribution system. Am J Health Syst Pharm. 1997;54(2):171–7.

    CAS  PubMed  Google Scholar 

  56. Barnard D, Dumkee M, Bains B, Gallivan B. Implementing a good catch program in an integrated health system. Healthc Q. 2006;9 Spec No:22-7.

  57. Cook RI, Woods DD, Miller CA. A tale of two stories: contrasting views of patient safety. Chicago: US National Patient Safety Foundation; 1998.

    Google Scholar 

  58. Turner BA. Man-made disasters. London: Wykeham Publications; 1978.

    Google Scholar 

  59. Weick K, Sutcliffe K. Managing the unexpected. Assuring high performance in an age of complexity. San Francisco: Jossey Bass; 2001.

    Google Scholar 

  60. Wilson KA, Burke CS, Priest HA, Salas E. Promoting health care safety through training high reliability teams. Qual Saf Health Care. 2005;14(4):303–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Sutcliffe KM, Paine L, Pronovost PJ. Re-examining high reliability: actively organising for safety. BMJ Qual Saf. 2017;26(3):248–51.

    Article  PubMed  Google Scholar 

  62. Macrae C. Making risks visible: identifying and interpreting threats to airline flight safety. J Occup Organ Psychol. 2009;82:273–93.

    Article  Google Scholar 

  63. Carthey J, Walker S, Deelchand V, Vincent C, Griffiths W. Breaking the rules: understanding non-compliance with policies and guidelines. Br Med J. 2011:343. doi:10.1136/bmj.d5283.

  64. Braithwaite J, Westbrook MT. Time spent by health managers in two cultures on work pursuits: real time, ideal time and activities’ importance. Int J Health Plann Manag. 2011;26(1):56–69.

    Article  Google Scholar 

  65. Amalberti R, Hourlier S. Human error reduction strategies in health care. In: Carayon P, editor. Handbook of human factors and ergonomics in healthcare and patient safety; 2005.

    Google Scholar 

  66. Cafazzo JA, Trbovich PL, Cassano-Piche A, Chagpar A, Rossos PG, Vicente KJ, et al. Human factors perspectives on a systemic approach to ensuring a safer medication delivery process. Healthc Q. 2009;12 Spec No Patient:70-4.

  67. Mayer J, Mooney B, Gundlapalli A, Harbarth S, Stoddard G, et al. Dissemination and sustainability of a hospital-wide hand hygiene program emphasizing positive reinforcement. Infect Control Hosp Epidemiol. 2011;32(1):59–66.

    Article  PubMed  Google Scholar 

  68. Novoa AM, Pi-Sunyer T, Sala M, Molins E, Castells X. Evaluation of hand hygiene adherence in a tertiary hospital. Am J Infect Control. 2007;35(10):676–83.

    Article  PubMed  Google Scholar 

  69. Pittet D, Hugonnet S, Harbarth S. Effectiveness of a hospital-wide programme to improve compliance with hand hygiene. Infection control programme. Lancet. 2000;356(9238):1307–12.

  70. Pittet D, Simon A, Hugonnet S, Pessoa-Silva C, Sauvan V, Perneger TV. Hand hygiene among physicians: performance, beliefs, and perceptions. Ann Intern Med. 2004;141(1):1–8.

    Article  PubMed  Google Scholar 

  71. Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Mills PD, Neily J, Luan D, Stalhandske E, Weeks WB. Using aggregate root cause analysis to reduce falls and related injuries. Jt Comm J Qual Patient Saf. 2005;31(1):21–31.

    Article  PubMed  Google Scholar 

  73. Taitz J, Genn K, Brooks V, Ross D, Ryan K, Shumack B, et al. System-wide learning from root cause analysis: a report from the New South Wales Root Cause Analysis Review Committee. Qual Saf Health Care. 2010;(6):e63. doi:10.1136/qshc.2008.032144.

  74. Carroll JS, Rudolph JW. Design of high reliability organizations in health care. Qual Saf Health Care. 2006;15(suppl_1):i4–9.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Amalberti R. The paradoxes of almost totally safe transportation systems. Saf Sci. 2001;37(2–3):109–26.

    Article  Google Scholar 

  76. Bates DW. Health information technology and care coordination: the next big opportunity for informatics? Yearb Med Inform. 2015;10(1):11–4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  77. Sheikh A, Sood HS, Bates DW. Leveraging health information technology to achieve the “triple aim” of healthcare reform. J Am Med Inform Assoc. 2015;22(4):849–56.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Charles Vincent is supported by the Health Foundation. We also wish to thank two reviewers for helpful comments and suggestions on an earlier draft of the manuscript.

Funding

Charles Vincent is supported by the Health Foundation.

Availability of data and materials

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

CV and RA conceived the paper and produced an initial draft. All authors contributed equally to subsequent drafts and to the final manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Charles Vincent.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vincent, C., Carthey, J., Macrae, C. et al. Safety analysis over time: seven major changes to adverse event investigation. Implementation Sci 12, 151 (2017). https://doi.org/10.1186/s13012-017-0695-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-017-0695-4

Keywords