Utility of Predictive Systems to identify Inpatient Diagnostic Errors: The UPSIDE Study
Project Number5R01HS027369-02
Contact PI/Project LeaderAUERBACH, ANDREW D
Awardee OrganizationUNIVERSITY OF CALIFORNIA, SAN FRANCISCO
Description
Abstract Text
PROJECT SUMMARY/ABSTRACT
While much research has been conducted on patient safety since the Institute of Medicine published “To
Err is Human” in 2000, there is a comparative dearth of research on diagnostic errors in the hospital setting.
The broad, long-term objectives of the proposed research is to better understand the incidence, causes, and
risk factors for diagnostic errors in the inpatient setting. This work will provide foundational research for the
development of interventions to reduce these errors, including predictive tools, targets for intervention, and a
methodology for outcome assessment in future trials of interventions. To achieve this overall goal, we will carry
out the following specific aims: 1) To determine the incidence of diagnostic errors among patients who die in
hospital or are transferred to the ICU two days or more after admission to a general medicine service through a
structured, standardized adjudication process of patient records, 2) To combine adjudication data with data
from Vizient to determine which specific factors contribute to risks for diagnostic errors, and to use risk
estimates to calculate incidence and impact of factors contributing to those errors, and 3)To create machine-
learning models that can be used to retrospectively identify patients in whom a diagnostic error was likely to
have taken place. The research will involve a retrospective evaluation of 2000 patients admitted to general
medicine units at 20 US hospitals participating in a national research collaborative and which also contribute
data to a benchmarking and purchasing organization (Vizient). Using the Safer-Diagnosis (Safer-Dx) and
Diagnostic Error Evaluation and Research (DEER) taxonomy tools, both adapted for the inpatient setting,
adjudicators will review electronic medical record data and determine the presence or absence of diagnostic
errors using a rigorous training and continuous review process to ensure reliability across sites, adjudicators,
and time. Standard modelling techniques will be used to understand the population-attributable risk of each of
the DEER process failure points to diagnostic error as well as the contributions of several patient, provider, and
system-level risk factors. Lastly, advanced machine-learning methods will be used to create models that can
identify patients in whom diagnostic error occurred, with superior performance to standard approaches such as
logistic regression. Together, these approaches will provide a broad and representative picture of the incidence
of diagnostic errors among hospitalized patients who have suffered harm, develop models of patient and
system-based factors that make a diagnostic error more or less likely, and build advanced, efficient, and
scalable tools needed to support future surveillance and improvement programs for a variety of institutions.
This research will establish a foundation from which healthcare systems can assess and achieve excellence in
diagnosis in the inpatient setting.
Public Health Relevance Statement
PROJECT NARRATIVE
This study seeks to accurately define the incidence of diagnostic errors among patients suffering serious
inpatient events in a large network of US hospitals. Without a reliable method for determining the presence of
diagnostic errors across many organizations, it is not otherwise possible to understand the incidence, impact,
predictors, and underlying causes of these errors, to create and optimize future solutions to reduce diagnostic
errors, to directly test the effects of these solutions, or to teach physicians how to avoid diagnostic pitfalls in the
future. Our study addresses these issues while being responsive to the RFA’s goals of developing robust
estimates of incidence and risk and using approaches that leverage electronic data, and our approach
represents a novel application of rigorous outcome adjudication and advanced modeling techniques to the
problem of inpatient diagnostic errors.
No Sub Projects information available for 5R01HS027369-02
Publications
Publications are associated with projects, but cannot be identified with any particular year of the project or fiscal year of funding. This is due to the continuous and cumulative nature of knowledge generation across the life of a project and the sometimes long and variable publishing timeline. Similarly, for multi-component projects, publications are associated with the parent core project and not with individual sub-projects.
No Publications available for 5R01HS027369-02
Patents
No Patents information available for 5R01HS027369-02
Outcomes
The Project Outcomes shown here are displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed are those of the PI and do not necessarily reflect the views of the National Institutes of Health. NIH has not endorsed the content below.
No Outcomes available for 5R01HS027369-02
Clinical Studies
No Clinical Studies information available for 5R01HS027369-02
News and More
Related News Releases
No news release information available for 5R01HS027369-02
History
No Historical information available for 5R01HS027369-02
Similar Projects
No Similar Projects information available for 5R01HS027369-02