In December 2022, Newman-Toker et al., published a systematic review on emergency department (ED) diagnostic errors with funding from the Agency for Healthcare Research and Quality (AHRQ). CNN highlighted its findings: 7.4 million annual U.S. ED misdiagnoses, 2.6 million harms from preventable errors, and >100,000 permanent, high severity disabilities, and more than 250,000 deaths. According to the study, nearly 6% of ED visits are misdiagnosed.
Explore This Issue
ACEP Now: Vol 42 – No 02 – February 2023In unison, the emergency medicine community recoiled.
Proposing that emergency medicine errors are a leading cause of death, behind heart disease, cancer, and COVID-19, but ahead of all accidents and strokes defies belief. Diving into the methods, it’s clear why. The data supporting these extrapolations are, in a manner of speaking, anemic. Emergency medicine societies, led by American College of Emergency Physicians (ACEP), called them “misleading, incomplete, and erroneous”. ACEP insisted CNN change their article to reflect these objections.
I have something to admit. I was involved. I was a technical expert and peer reviewer. I gave feedback when the authors created search strategies in 2020 via a one-hour Zoom. In 2021, I gave written feedback on a draft. My name is listed prominently on Page 6, which caused me to get doxxed on EMDocs. When the report dropped, people reached out.
A few examples:
“I saw the CNN news story. Did you agree with this?”
“Your name was on the AHRQ report. What was your role?”; and
“What the actual eff?”
My purpose in writing this article is two-fold. First, to briefly defend the technical experts and reviewers. More importantly, how this unfolded is a tragically, missed opportunity to have a discussion about errors. Useful takeaways exist within the dense 744-page tome if you can ignore its erroneous extrapolations and read beyond the abstract.
Regarding my involvement, I was critical of the report’s definition of medical errors. In reference to its national estimates, I wrote it had, “…a fatal flaw and should be removed….Headline grabbing, yes, but this is at best gravely misleading”. The authors disagreed with my review. Other reviewers made similar comments. The reviewers didn’t write it. Having reviewed it doesn’t mean that I, or other reviewers, approve.
I won’t recount our criticisms here, but many were similar ACEP’s. Suffice it to say, medical error research is complicated. Causes for some diagnostic errors are clear. Yet for many, there is no gold standard of diagnostic truth or smoking gun. It’s sometimes impossible to reliability assign root causes for diagnostic errors even with full vetting. Therefore, my view is that combining studies across different populations from different EDs in different countries at different times that define errors in different ways is not meaningful. However, I found some of more qualitative themes useful. Below I describe my four takeaways.
- Know the Malpractice Hotspots
Certain conditions cause more malpractice claims. Yet malpractice allegations are not perfect proxies for diagnostic error rates. Malpractice cases involve an alleged standard of care breach, a large potential payout, and a poor outcome. Nevertheless, malpractice hotspots are good to know (Table 1). Malpractice allegations, even if dismissed, have negative psychological impacts on physicians and take years to resolve. Malpractice hotspots are a good starting point for developing clinical protocols. Protocols can often vaccinate against litigation and improve safety. Say you discharge a HEART score of 3 after appropriate testing. You document that the risk for short-term cardiac events is low (~1%). When lawyers review your “missed” acute myocardial infarction, it’s clear standard of care was followed and the case is often avoided.
- Beware of Atypical Presentations
Atypical (i.e. non-classic) presentations of serious conditions surround malpractice hotspots (Table 2). No emergency physician misses obvious strokes (e.g. slurred speech / arm weakness). But it’s easier to miss when the only symptom is vertigo. When evaluating vertigo, a useful bedside test called the Head Impulse-Nystagmus-Test of Skew (HINTS) exam can help differentiate central versus peripheral symptoms. Additionally, emergency physicians should have a low threshold to thoroughly work-up and consult a specialist for new objective, neurologic findings. A painful abdomen is another area where serious conditions can hide, particularly in older adults. Abdominal CT findings have consistently surprised me more than any other ED test. My rule of thumb: if in any doubt, CT (or ultrasound if a child); if the patient is old, don’t think. CT everyone with new abdominal pain.
- Root Causes of Errors are most often “Thinking” Problems
ED diagnosis is a complex cognitive process, drawing incomplete information from history, prior data from disparate sources, a physical exam, and interpreting diagnostic tests. It is quite miraculously reliable, particularly with expectations of treating more than two patients per hour and increasing emergency department crowding and boarding. Because thinking problems dominate as root causes of malpractice cases (Table 3), standardizing your approach can improve safety. This involves creating protocols for high-risk complaints for malpractice hotspots, particularly where symptoms can be atypical. For example, lower back pain almost always non-serious but a small minority have cord compression. Hardwiring a red flag assessment and a complete lumbar plexus exam into every back pain evaluation may help reduce misdiagnosis.
- SPADE is a good way to track errors
The Symptom-disease Pair Analysis of Diagnostic Error (SPADE) methodology can track ED misdiagnosis of stroke, myocardial infarction, aortic dissection, spinal cord compression, and others. When a trigger condition is diagnosed, a look back can assess for related prior visits. For example, when stroke is diagnosed, recent visits with dizziness, vertigo, or nausea/vomiting should prompt a chart review. SPADE measures could also be developed to assess ED-level quality.
In closing, there are real concerns with parts of the report. But I sincerely hope it’s not outright dismissed, especially given all the energy invested in producing it. Nevertheless, it will undoubtedly be a main course at ED residency journal clubs for years to come. A final bit of advice in this regard. You can’t do justice to the entire report in a single journal club, or even read it in one sitting. Don’t try. Break it into pieces for reading and discussions. Set a goal to understand a few key questions, rather than superficially scanning the whole report.
Table 1: The 15 top emergency medicine malpractice hotspots (in rank order)
- Stroke
- Acute myocardial infarction
- Aortic aneurysm/dissection
- Spinal cord compression/injury
- Venous thromboembolism
- Meningitis/encephalitis
- Sepsis
- Lung cancer
- Traumatic Brain Injury / traumatic intracranial hemorrhage
- Arterial thromboembolism
- Spinal/intracranial abscess
- Cardiac arrhythmia
- Pneumonia
- Gastrointestinal perforation/rupture
- Intestinal obstruction
Adapted from: Newman-Toker et al. Diagnostic Errors in the Emergency Department: A Systematic Review. 2022. Data were drawn from a large database of emergency medicine malpractice claims. The list is in the order of the most common conditions causing serious misdiagnosis-related harms.
Table 2: Common serious ED conditions that present with atypical symptoms
Condition | Atypical presenting symptoms |
Stroke | Headache, vertigo/dizziness, altered mental status or confusion, nausea and/or vomiting, gait disturbances |
Acute Myocardial infarction | Syncope or fall, nausea and/or vomiting, generalized weakness/fatigue/malaise, altered mental status or confusion, shortness of breath |
Aortic aneurysm / dissection | Abdominal pain, fever (caused by aortitis), non-specific pain or no pain at all, syncope, shortness of breath, back pain |
Sepsis | Generalized weakness/fatigue/malaise, altered mental status or confusion (older adults), fever in children |
Adapted from: Newman-Toker et al. Diagnostic Errors in the Emergency Department: A Systematic Review. 2022. Data on these conditions were drawn from several studies in the systematic review.
Table 3: The 10 most common “root causes” identified in ED malpractice litigation (in rank order)
- Thinking problems (i.e. clinical judgment)
- Issues with communication
- Issues related to documentation
- Issues related to lack of insurance
- Clinical environment
- Behavior-related
- Administrative issues
- Supervision issues
- Technical skill
- Electronic health records
Adapted from: Newman-Toker et al. Diagnostic Errors in the Emergency Department: A Systematic Review. 2022. Data were drawn from a large database of emergency medicine malpractice claims.
Jesse M. Pines, MD, MBA, MSCE is the National Director of Clinical Innovation at US Acute Care Solutions. and a Professor of Emergency Medicine at Drexel University.
Pages: 1 2 | Multi-Page
2 Responses to “The AHRQ Diagnostic Errors Study: A Peer Reviewer’s Reaction”
January 27, 2023
David L Meyers, MD, MBE, FACEPWell, the more I read the responses of ACEP and other EM-associated organizations to the AHRQ/Hopkins study, the more embarrassed I am for emergency medicine. Even acknowledging the flaws of the study, the defensive nature of many of those responses and the criticism of the messengers are what one might expect from the troglodytes at the AMA, not from our organization, that purports to have patient well-being and advocacy for them as a major focus.
In the interest of transparency, David Newman-Toker, one of the lead authors on the study, is a friend of mine as well as a former colleague on the board of the Society to Improve Diagnosis in Medicine. He and I have discussed the study on more than one occasion, and I conveyed to him that ACEP’s and patients’ interests would have been much better served by an acknowledgement of the magnitude of the problem of the frequency and severity of diagnostic errors and the associated harm in the course of emergency care, a description of what ACEP and others have been doing to address the problem, our successes and our continuing focus on doing better.
A more reasoned response, like the one just published in JAMA (https://jamanetwork.com/journals/jama/fullarticle/2801049?guestAccessKey=3627c246-c83c-4d31-966f-0d6342f0a69e&utm_source=silverchair&utm_medium=email&utm_campaign=article_alert-jama&utm_content=olf&utm_term=012723) would have been so much more responsible and helpful. What ACEP and its partners in this matter have done has only deepened animosity toward medicine and doctors while accomplishing nothing to improve diagnosis.
I think ACEP is on the wrong side of history in this matter, and I can’t imagine that patients and families, so many of whom have stories about their own personal diagnostic misadventures in the ER (I do; do you?), will find the position of the College and its co-signers credible let alone admirable.
February 3, 2023
Bobby RedwoodThank you Dr. Pines for your thoughtful review of the article, your explanation on the review process, and your high-yield pearls on diagnostic error in the ED.
Don’t worry, we still love you:)