Clinical Risk Unit, Department of Psychology, University College London, London WC1E 6BT, UK
Correspondence: Dr Graham Neale
| SUMMARY |
|---|
|
|
|---|
Less than 20% of preventable adverse events were directly related to surgical operations or invasive procedures and less than 10% to misdiagnoses. 53% of preventable adverse events occurred in general ward care (including initial assessment and the use of drugs and intravenous fluids) and 18% in care at the time of discharge. Probable contributory factors in these errors included dependence on diagnoses made by inexperienced clinicians, poor records, poor communication between professional carers, inadequate input by consultants into day-to-day care, and lack of detailed assessment of patients before discharge.
| INTRODUCTION |
|---|
|
|
|---|
Retrospective studies of case records in the United States and Australia have revealed a substantial rate of adverse events in hospital practice. The Harvard Medical Practice Study (HMPS)2,3 identified adverse events in 3.7% of hospital admissions. In 70% the adverse event led to slight or short-lived disability but in 7% the disabilities were permanent and in 14% they contributed to death. Similar rates were found in a study from Colorado and Utah4,5. The Quality in Australian Healthcare Study (QAHCS)6, using different criteria, identified adverse events in 16.6% of admissions, of which half were considered preventable. Adverse events were estimated to account for 8% of hospital bed-days and to cost the Australian healthcare system 4.7 billion dollars a year.
Information on adverse events in Britain
In Britain information on adverse events is indirectly available from
sources including confidential enquiries, studies of claims and complaints,
and research into critical incidents and also from rare but high-profile
incidents such as those at the Bristol Royal
Infirmary7. At a
local level most trusts rely on a combination of incident reporting,
complaints and claims data. Valuable though all these studies and enquiries
are, even when taken together they offer only a partial view. Denominator
information is not available for such studies so we cannot determine the rate
of any class of adverse events.
We have recently reported the results of a preliminary study in two hospitals on the incidence and nature of adverse events (AEs) in patients admitted to hospital8, using methodology developed for the HMPS and QAHCS2,3,6. These studies define AEs as injuries to patients caused by the management of the disease which led to prolongation of hospital stay or to temporary or permanent impairment or disability to the patient at time of discharge. 10.8% of patients were found to have experienced adverse events, half of which were judged preventable. Total costs of preventable adverse events in terms of additional days in hospital were estimated at around £1 billion per annum in the acute sector alone. This figure is in addition to the costs of litigation, staff time, impact on patients and staff, and the wider economic consequences.
The causes of adverse events
In American studies drug-related events were found to be responsible for
about 20% of
incidents3 and
subsequently there have been several papers describing how AEs can be reduced
by information9 and
decision-support10,11,12
systems, as well by improved methods for ordering, transcribing, dispensing
and administering
medications13,14,15.
The Americans also found that AEs arising from the organization of the care of
medical emergencies are often
preventable3a
finding supported by a study in the
UK16. Of
preventable surgical accidents, vascular surgery (including coronary artery
bypass) and colonic surgery seemed to have more than other
specialties4.
Australian researchers initially focused on identifying specific errors and failures underlying adverse events17. The causes of error included: failure in technical performance (35%); failure to act appropriately on available information (16%); failure to arrange for an investigation, a procedure or a consultation (12%); and lack of care and attention to the patient (11%). Overall, cognitive error was deemed to play an important part in 57% of all adverse events. From these results the authors formulated preventive strategies including better implementation of policies or protocols (24%), better formal quality monitoring (21%), better education and training (19%) and more consultation (10%). They concluded that improvement was needed in agreed processes of care, supported by information systems providing knowledge of diseases, protocols for treatment and information on outcomes of care for each patient.
Investigating adverse events
Studies in medicine and other high-risk domains have led to a much broader
understanding of accident causation, with less focus on the individual and
more on pre-existing organizational factors that provide the conditions in
which errors occur. While a particular action or omission may be the immediate
cause of an incident, close analysis usually reveals a series of events and
departures from safe practice, each influenced by the working environment and
the wider organizational
context18.
Accident investigators, whether in medicine or elsewhere, typically rely on a combination of record review and detailed interviews with staff. Clearly some factors, such as fatigue or verbal communication, can only be assessed during interviews or from observation. Examination of the record alone, while providing rich clinical detail, is necessarily limited in the range of background factors that can be investigated. However, we believe that record review is potentially more powerful than has been realized. Rather than identifying specific errors made by individuals, our approach is to determine the point in the hospital process where care became suboptimal and to consider how modes of clinical practice may predispose to adverse events19. Simply identifying human errors may be unduly pejorative and could hinder our understanding of how complex systems fail. In seeking to expand the value of retrospective studies of case records we have critically assessed case-record narratives to identify weaknesses in the process of care and the factors contributing to these. Our aims were twofoldfirst, to define factors in clinical practice in NHS hospitals that predispose to adverse events; second, to explore the review process so that future investigators, including ourselves, may be able to design better methods for identifying causal factors.
| METHOD |
|---|
|
|
|---|
The review team consisted of an experienced nurse working with 4 part-time research nurses. A consultant physician acted as lead medical assessor, working with 2 clinicians (a consultant surgeon and a fully trained specialist registrar in orthopaedic surgery). Each reviewer screened practice sets of notes under supervision until judged fully conversant with the review process. Case records were assessed by the nurse reviewers working from 18 predefined screening criteria. 308 records, identified by the screening process, were then reviewed by clinicians who determined whether or not there was an adverse event and completed a detailed questionnaire. The clinical reviewers were required to write brief narratives of the key points of each patient's hospital admission before completing detailed questionnaires. In cases in which a reviewer's judgment was hindered by lack of subspecialty knowledge the evidence was discussed within the clinical group, and when necessary outside specialist opinion was sought.
Box 1 Case example to demonstrate how narrative analysis can identify contributing factors
| An elderly woman underwent surgery for a fractured neck of femur. Her
general condition was not monitored closely; she was mobilized and discharged
home. A few days later she was readmitted in a confused state with
hyponatraemia. She was treated appropriately but took 24 days to recover. No
single event caused the second illness but during the first admission the
patient's mental state was not noted; fluid balance and food intake was not
monitored; there were no clinical notes recorded during the 24 hours before
discharge; and no details were recorded regarding arrangements for care at
home after discharge.
|
For each adverse event the clinicians assessed its impact on the patient, likely causation and preventability. Records were screened only once, but duplicate review and discussion between 2 or more assessors were used to resolve difficult issues.
Reliability of record review
In this preliminary study we did not formally assess the reliability of
clinical judgments in the context of record review. However, after discussion
with colleagues in the United States and Australia, we took several steps to
maximize consistency and reliability. First, we attempted to replicate the
approach of previous studies in which the reliability of record review was
assessed. In American studies physician consensus causation scores showed a
moderate to good correlation
(
=0.57)20.
In the Australian study there was 80% agreement on the presence of an adverse
event (
=0.55), 58% agreement on preventability (
=0.33) and 87%
agreement for disability
(
=0.49)6.
Second, the project manager and lead clinician (MW and GN) examined the work
of reviewers and discussed difficulties in definition and assessment,
especially in the early phase of their work. Previous studies had found that
many inconsistencies occurred in the early stages, through incorrect
understanding of the review process rather than differences in clinical
judgment. In addition, the project manager reviewed all completed
questionnaires and referred back questionnaires that were not completed
satisfactorily.
Analysis of the case record
For the purposes of this paper the narrative case descriptions and review
questionnaires were reanalysed by the lead clinician in the review team after
the initial record review had been completed. From information in the case
record the nature of the adverse event, in relation to clinical practice at
the relevant point in the process of care, was determined. Where possible,
supplementary information about the grade of the doctor present, the nature of
the suboptimal care and any contributing factors in the notes were identified.
From this information the following more general organizational questions were
posed in order to identify likely contributory factors, as judged from written
records, over the relevant periods:
In this way we were able to define weaknesses in practice that arose from errors occurring within defective clinical systems (see Box 1 for an example).
50 (49%) medical records of 103 patients with identified adverse events were reasonably clear and well structured. However, in the other 53 cases there were deficits including missing laboratory reports (11), inadequate discharge summaries (17), lack of initial medical assessment (7), insufficient clinical progress notes (19) and missing procedure documentation (3). It was difficult to extract information from 37 records because they were so poorly organized. Two or more deficiencies were recorded for 17 cases.
| RESULTS |
|---|
|
|
|---|
|
The narratives of 103 cases in which 112 adverse events had been identified previously were examined. In assessing the narratives 6 additional errors were identified, increasing the total to 118.
Table 2 shows the points in the process of care in which the principal problems occurred, broken down by specialty. Tables 3, 4 and 5 show the principal problems identified at each stage and the probable factors contributing to their occurrence, in medicine, surgery and orthopaedics, respectively. Both the tables and the text that follows are organized to reflect the actual process of care, with problems identified in the same sequence. In the text we provide a summary of the cases and consider the more general contributory factors that may impact on the delivery of care.
|
|
|
|
Problems arising at time of diagnosis
0.6% of admissions (5 cases) were associated with incorrect diagnoses, all
of which seem to have been made by trainee doctors. In all 5 cases the errors
occurred during the early assessment of emergency admissions.
Probable contributory factors
The incorrect diagnoses were made by non-consultant staff and were not
corrected promptly.
Problems arising during preoperative assessment and care
In 3 cases there was failure to guard against postoperative problems
(possible deep vein thrombosis, infection and chest disease); in 2 cases
unnecessary urethral catheterization led to urinary tract infection; and in
one case inadequate assessment led to an elderly patient undergoing an
orthopaedic procedure when she was hypokalaemic.
Probable contributory factors
In these cases ward staff responsible for the preoperative care seemed not
to be working to clear guidelines designed to minimize adverse events.
Problems arising during an operation or an invasive procedure
(including anaesthesia)
This category yielded the highest number of problems (46, more than a third
of the total) of which 10 were deemed preventable.
In general medicine the use of central venous catheters (3) and urinary catheters (1) caused 4 adverse events, of which 3 were infective. In general surgery 10 out of 21 adverse events were infective, 7 due to technical problems and 2 due to bleeding. Postoperative intestinal dysfunction occurred in 2 patients (in one due to obstruction). Overall, only 4 AEs were regarded as preventable (2 infective and 2 technical). In orthopaedics 6 out of 15 AEs were infective and 3 were due to bleeding; in 5 the eventual result was poor. Only 2 AEs were regarded as preventable (both bleeding). 6 problems were related to anaesthesia and only one of these was regarded as preventable.
Probable contributory factors
It seemed that problems arising from ward-based procedures were due to poor
technique and poor monitoring of unsupervised junior staff. Additional
evidence would be required to define underlying factors for AEs arising from
procedures undertaken in operating theatres.
Ward management
Problems in ward management (other than the use of drugs and intravenous
fluids, which are dealt with separately) totalled 30 (26% of all problems) of
which 15 were thought to be preventable. Four deaths occurred in patients
under 75 years of age, in two of which the adverse events were probably
preventable. The other 5 patients who died were all elderly (aged 82-89 years)
and the reviewers agreed that the adverse events might have been prevented but
only with high-dependency care.
More specific problems arising from probable deficiencies in basic care were identified in 19 patients. Pressure sores occurred in 10 cases (7 deemed preventable), chest infections in 4 (one preventable) and falls in 3 (2 of whom fractured a neck of femur); in 2 cases there was poor care of urethral catheters.
Probable contributory factors
Inadequate day-to-day clinical care (i.e. that requiring complex care and
input at consultant level) of the overall medical condition led to AEs in 11
patients and contributed to 4 deaths. Deficiencies in nursing care were
thought to be responsible for at least some of the bed-sores, problems with
catheters and falls in the ward.
Use of drugs and intravenous fluids
Problems arising from the use of drugs and intravenous fluids were
identified in 17 cases, 9 of which were judged preventable. More than half the
cases occurred in a medical ward. 3 cases of overtransfusion were
identified.
14 problems were related to the use of drugs, of which half were judged preventable. In 3 cases drugs were incorrectly prescribed and in 7 cases there were preventable side-effects of medication (e.g. failure to monitor the dose of digoxin leading to toxic effects; inappropriate prolongation of treatment with amiodarone causing thyroid dysfunction).
Probable contributory factors
In the case records surveyed, fluid balance charts were often poorly
maintained and difficult to interpret. Clinical notes seldom included data on
fluid and nutritional status. In adverse events related to drugs there were no
references to possible side-effects until after an adverse event had occurred.
Many drug charts were a confused and much-altered set of written instructions.
Computers were apparently not available to aid prescribing.
Discharge procedures
Poor clinical assessment at the time of discharge from hospital or failure
to educate the patient and/or to liaise adequately with community-based carers
(including general practitioners) were identified as important causes of AEs
in 14 case records. The problems occurred in 6 medical, 1 general surgical and
7 orthopaedic cases.
Discharge from medical wards without adequate assessment led to readmission of 3 patients with heart disease, 2 with anaemia and one with recurrent bronchial asthma. Inadequate pre-discharge assessment on orthopaedic wards also led to several adverse events. One orthopaedic patient was discharged with serious salt and water imbalance and was subsequently readmitted. Inadequate home care packages led to 4 patients being readmitted to hospital within a few days; 2 had fallen at home and as a result had fractured their femurs. Of 2 patients whose discharge from hospital was delayed, one died while awaiting placement.
Contributory factors
A detailed assessment of the patient's condition before discharge was found
in very few case records. In both hospitals there appeared to be little
liaison between members of care teams in preparing the patient for the
transition from hospital to home care. Communication with the general
practitioner and community support services regarding the condition of
patients was patchy.
| DISCUSSION |
|---|
|
|
|---|
Surgical and invasive procedures accounted for 46 AEs of which a quarter (10 cases) were deemed preventable. On the other hand 58% of AEs occurred on the wards (including preoperative and postoperative care, general management, administration of drugs and care at the time of discharge) and two-thirds of these were deemed preventable. The problems ranged from the development of bedsores to difficulties in the management of complex disease.
In 9 patients who died (4 medical and 5 orthopaedic) it seemed that resources were insufficient to provide high-dependency or specialist care, although the AE was regarded as preventable in only 3 cases. 7 of these patients were elderly (aged 70-102) and had multisystem disease (5 following orthopaedic procedures) and they may have been regarded as too frail to warrant elaborate support of failing organs. The other 2 patients had serious organ dysfunction secondary to alcohol abuse.
Hospital-acquired respiratory infection occurred in 4 cases and urinary tract infection in 2. Four of these infections were regarded as not preventable although it was not possible to determine whether or not the provision of more intensive physiotherapy and more scrupulous care of catheters would have prevented at least some of them. Inadequate care of urethral catheters was highlighted in one case, in which pressure necrosis developed on the dorsum of the glans penis. The prescribing of drugs and the use of intravenous infusions gave rise to 11% of the problems identified, half of which were deemed to be probably preventable. The number of problems in this category is probably an underestimate, because the poor quality of prescription records and fluid balance charts made assessment difficult.
At least 9 of the 11 readmissions to hospital (Table 2) could have been prevented by closer attention at the time of discharge from hospital. The main deficiency seems to have been a failure to assess the clinical condition of patients immediately before discharge. In addition there was little or no evidence of liaison between clinicians, nurses and other professional care workers (e.g. physiotherapists), and communication between hospital staff and general practitioners seems to have been poor. Similar problems have been demonstrated repeatedly over the past decade23,24,25. Inadequate care at the time of discharge continues to be an important contributor to AEs in the NHS.
In this study more than half of the problems stemmed from inadequacies of general care on the wards, of which more than half were preventable. If one includes cases related to medication and care taken at the time of discharge from hospital, two-thirds of clearly preventable adverse events arose from deficiencies in ward care. There has been no national programme of confidential enquiries into deaths or serious adverse events arising from ward care in NHS hospitals to parallel those for perioperative, maternal and neonatal deaths. Hence, it is not possible to define optimal strategies for improvement. Contributory factors are likely to include: increasing specialization of senior staff26; insufficient input by trained staff in the ongoing care of patients; inadequate numbers of junior staff, who are insufficiently trained and supervised27; poor organization of ward work and inadequate liaison between professional staff within hospitals; and sloppy discharge procedures23,24,25. The importance of these findings is underlined by studies from the US which indicate that lack of experience of ward doctors leads to longer stays in hospital, more diagnostic tests and hence increased costs27,28. Box 2 provides recommendations as a result of this pilot study.
The value of this analysis is limited by the small scale of the study and the fact that we made changes to the questionnaire during the collection of data. Judgments of preventability were difficult and would need refinement before the launch of a larger study, which would also enable formal reliability of the methods to be tested in the British context. This report shows the potential value of: first, undertaking a much larger carefully designed study based on the retrospective analysis of hospital records, including a planned use of case narratives; secondly, using case record analysis as part of planned reviews of the service provided by individual healthcare trusts; and thirdly, of providing objective evidence on which to base the reorganization of hospital care in the NHS. In particular this pilot study provides objective support for improved general medical care in hospitals as units are becoming increasingly specialized26,29.
Box 2 Suggestions for improvements in general care arising from this pilot study
|
| Acknowledgments |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Escarrabill Discharge planning and home care for end-stage COPD patients Eur. Respir. J., August 1, 2009; 34(2): 507 - 512. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. A Scott Errors in clinical reasoning: causes and remedial strategies BMJ, June 8, 2009; 338(jun08_2): b1860 - b1860. [Full Text] |
||||
![]() |
E N de Vries, M W Hollmann, S M Smorenburg, D J Gouma, and M A Boermeester Development and validation of the SURgical PAtient Safety System (SURPASS) checklist Qual. Saf. Health Care, April 1, 2009; 18(2): 121 - 126. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Vincent, P. Aylin, B. D. Franklin, A. Holmes, S. Iskander, A. Jacklin, and K. Moorthy Is health care getting safer? BMJ, November 13, 2008; 337(nov13_1): a2426 - a2426. [Full Text] |
||||
![]() |
E N de Vries, M A Ramrattan, S M Smorenburg, D J Gouma, and M A Boermeester The incidence and nature of in-hospital adverse events: a systematic review Qual. Saf. Health Care, June 1, 2008; 17(3): 216 - 223. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. C. Dykes, A. Hurley, M. Cashen, S. Bakken, and M. E. Duffy Development and Psychometric Evaluation of the Impact of Health Information Technology (I-HIT) Scale J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 507 - 514. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Jacobs, M. O'Beirne, L. P. Derfiingher, L. Vlach, W. Rosser, and N. Drummond Errors and adverse events in family medicine: Developing and validating a Canadian taxonomy of errors Can Fam Physician, February 1, 2007; 53(2): 270 - 276. [Abstract] [Full Text] [PDF] |
||||
![]() |
M D Witham, P M Jenkins, and M E T McMurdo Using a sentinel adverse incident audit on a Medicine for the Elderly ward Qual. Saf. Health Care, December 1, 2006; 15(6): 446 - 447. [Full Text] [PDF] |
||||
![]() |
R Amalberti, C Vincent, Y Auroy, and G de Saint Maurice Violations and migrations in health care: a framework for understanding and management Qual. Saf. Health Care, December 1, 2006; 15(suppl_1): i66 - i71. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Tamblyn, A. Huang, Y. Kawasumi, G. Bartlett, R. Grad, A. Jacques, M. Dawes, M. Abrahamowicz, R. Perreault, L. Taylor, et al. The Development and Evaluation of an Integrated Electronic Prescribing and Drug Management System for Primary Care J. Am. Med. Inform. Assoc., March 1, 2006; 13(2): 148 - 159. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Jagsi, B. T. Kitch, D. F. Weinstein, E. G. Campbell, M. Hutter, and J. S. Weissman Residents Report on Adverse Events and Their Causes Arch Intern Med, December 12, 2005; 165(22): 2607 - 2613. [Abstract] [Full Text] [PDF] |
||||
![]() |
O A Arah and N S Klazinga How safe is the safety paradigm? Qual. Saf. Health Care, June 1, 2004; 13(3): 226 - 232. [Abstract] [Full Text] [PDF] |
||||
![]() |
M Woloshynowych, G Neale, and C Vincent Case record review of adverse events: a new approach Qual. Saf. Health Care, December 1, 2003; 12(6): 411 - 415. [Abstract] [Full Text] [PDF] |
||||
![]() |
B Dean Adverse drug events: what's the truth? Qual. Saf. Health Care, June 1, 2003; 12(3): 165 - 165. [Full Text] |
||||
![]() |
A. E. Carroll, P. Tarczy-Hornoch, E. O'Reilly, and D. A. Christakis Resident Documentation Discrepancies in a Neonatal Intensive Care Unit Pediatrics, May 1, 2003; 111(5): 976 - 980. [Abstract] [Full Text] [PDF] |
||||
![]() |
P Ramnarayan, A Tomlinson, A Rao, M Coren, A Winrow, and J Britto ISABEL: a web-based differential diagnostic aid for paediatrics: results from an initial performance evaluation Arch. Dis. Child., May 1, 2003; 88(5): 408 - 413. [Abstract] [Full Text] [PDF] |
||||
![]() |
G Neale and M Woloshynowych Retrospective case record review: a blunt instrument that needs sharpening Qual. Saf. Health Care, February 1, 2003; 12(1): 2 - 3. [Full Text] [PDF] |
||||
![]() |
B Dean Learning from prescribing errors Qual. Saf. Health Care, September 1, 2002; 11(3): 258 - 260. [Abstract] [Full Text] [PDF] |
||||
![]() |
R J Lilford Patient safety research: does it have legs? Qual. Saf. Health Care, June 1, 2002; 11(2): 113 - 114. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||