? ? The Institute of Medicine seminal report on medical errors highlighted the urgency of their identification. Medical errors are estimated to cost the U.S. between $17 billion and $29 billion a year. Clinical laboratories provide about 70% of the data used to make clinical decisions and produce an estimated 70 million errors per year in the U.S. Current methods for detecting clinical laboratory errors can be improved. Our hypothesis is that a Bayesian approach will improve error detection. The long-term objective of this project is to evaluate if Bayesian networks are more accurate than laboratory experts in detecting errors in clinical laboratory data. We use non-diabetic, pre-diabetic and diabetic clinical trial blood panel data as models for this research. ? The specific aims of this proposal are: (1) To construct and validate a Bayesian belief network designed to detect errors in the clinical laboratory values. One that expands on our preliminary work to include other factors that influence measured values. To accomplish this aim we will extract and clean a data set from a randomized controlled trial investigating diabetes treatments. We randomly split the data into a training set and a test set, insert errors into each data set in ways analogous to how they would be rendered naturally and validate a Bayesian belief network from the training data using a 10-fold cross validation. By varying the probability threshold used to classify data as erroneous, we will determine the sensitivity and specificity of the network as well as the area under the receiver operating characteristics curve. Finally, network vs. human expert performance will be compared on measures of sensitivity, specificity, and (z-critical) statistical differences between areas under the receiver operating characteristics curves. (2) To determine whether the Bayesian network in Aim 1 generalizes to pre- and non-diabetic populations. We will test whether the network structure in Aim 1, is effective in detecting laboratory errors in more general data sets with only parameter learning. We will perform a 10-fold cross-validation over learned network parameter estimates in each of a pre- and a non-diabetic data set. We will determine the sensitivity and specificity of the network in each data set as well as the (z-critical) statistical differences between areas under the receiver operating characteristics curve. Finally, network vs. human expert performance will be compared on the aforementioned measures. The project's health-relatedness is evident by its goal of reducing clinical laboratory errors that can adversely affect the health of healthcare recipients. The success of this project will result in the development of a method that clinical laboratories may use to detect errors in practice and save ? both lives and substantial health-care resources. By reducing errors in the clinical laboratory, lives and ? substantial health-care resources will be saved. ? ? ? ?

Agency
National Institute of Health (NIH)
Institute
National Library of Medicine (NLM)
Type
Research Project (R01)
Project #
5R01LM009157-02
Application #
7429792
Study Section
Biomedical Library and Informatics Review Committee (BLR)
Program Officer
Sim, Hua-Chuan
Project Start
2007-06-01
Project End
2010-11-30
Budget Start
2008-06-01
Budget End
2010-11-30
Support Year
2
Fiscal Year
2008
Total Cost
$240,466
Indirect Cost
Name
University of Southern California
Department
Pharmacology
Type
Schools of Pharmacy
DUNS #
072933393
City
Los Angeles
State
CA
Country
United States
Zip Code
90089
Le, Quang A; Doctor, Jason N (2011) Probabilistic mapping of descriptive health status responses onto health state utilities using Bayesian networks: an empirical analysis converting SF-12 into EQ-5D utility index in a national US sample. Med Care 49:451-60
Le, Quang A; Strylewicz, Greg; Doctor, Jason N (2011) Detecting blood laboratory errors using a Bayesian network: an evaluation on liver enzyme tests. Med Decis Making 31:325-37
Doctor, Jason N; Strylewicz, Greg (2010) Detecting 'wrong blood in tube' errors: Evaluation of a Bayesian network approach. Artif Intell Med 50:75-82
Strylewicz, Gregory; Doctor, Jason (2010) Evaluation of an automated method to assist with error detection in the ACCORD central laboratory. Clin Trials 7:380-9
Doctor, Jason N; Miyamoto, John; Bleichrodt, Han (2009) When are person tradeoffs valid? J Health Econ 28:1018-27