A pathologist's assessment is the gold standard for deciding whether cancer is present or absent. However, community pathologists incorrectly diagnose melanoma in up to 17% of cases, while missing it altogether in 2%-13%. We will evaluate the extent of these diagnostic errors, their sources, and their impact on the U.S. population. Techniques that may reduce errors, such as digital transmission of slide images, double reading, and continuing education, will also be evaluated. To achieve our goals, an expert panel of pathologists will establish a diagnosis for cases in 4 test sets using a Delphi approach. More than 100 U.S. pathologists will independently review the same test sets during 2 phases, separated by 6 months.
Our specific aims are: 1. To quantify the extent and evaluate possible sources of pathologists'errors in interpreting biopsy specimens of pigmented lesions. 2. To compare the interpretive performance of pathologists viewing digitized images of glass slides to their performance viewing original glass slides, and to use Web-based technology to gather quantitative information on their visual search process when assessing a case. 3. To assess whether the addition of independent double reading by two or more pathologists on all or a subset of cases can improve interpretive accuracy. 4. To develop and evaluate an individualized Web-based educational intervention to reduce errors. 5. To quantify the implications of false negative and false positive interpretations and the impact of strategies to reduce errors on short-term patient care and associated resource utilization within the U.S. population. In summary, we will evaluate the accuracy of pathologists'interpretation of melanocytic lesions, emphasizing the classification of dysplastic nevi and early stage melanoma, where previous studies reveal a concerning degree of diagnostic error. This large multi-center study of community pathologists addresses a topic of growing clinical importance. Our research team includes international experts in melanoma pathology, statistical measurement of test accuracy, and studies of diagnostic accuracy in clinical medicine. The proposed work is innovative in that we will go beyond simply quantifying the existence of errors. We will study patient and pathologist characteristics associated with inaccurate diagnoses and use a Web-based interface to gather data on pathologists'visual search process in reviewing cases, in order to identify possible reasons for diagnostic errors (e.g., inadequate detection vs. inadequate classification). We will then evaluate methods for improving health care delivery by using digital Web-based technologies, double reading and also an educational program that will be tested in a randomized intervention study. Finally, we will use a model-based analysis to make projections from our data to the clinical implications of inaccurate diagnoses at the U.S. population level.

Public Health Relevance

Surprisingly little research has investigated the accuracy of pathologists in diagnosing melanoma, yet the pathologists'assessment is the """"""""gold standard"""""""" for deciding whether cancer is present or absent and, in the case of skin tissue, whether atypical cells are noted. We propose a series of studies to evaluate the extent and impact of errors in skin pathology interpretation. We will also evaluate possible methods to reduce diagnostic errors including double reading, new technology that digitizes images of slides, and our innovative individualized Web-based CME.

Agency
National Institute of Health (NIH)
Institute
National Cancer Institute (NCI)
Type
Research Project (R01)
Project #
1R01CA151306-01A1
Application #
8107717
Study Section
Health Services Organization and Delivery Study Section (HSOD)
Program Officer
Marcus, Pamela M
Project Start
2011-08-01
Project End
2016-05-31
Budget Start
2011-08-01
Budget End
2012-05-31
Support Year
1
Fiscal Year
2011
Total Cost
$882,806
Indirect Cost
Name
University of Washington
Department
Internal Medicine/Medicine
Type
Schools of Medicine
DUNS #
605799469
City
Seattle
State
WA
Country
United States
Zip Code
98195
Elder, David E; Piepkorn, Michael W; Barnhill, Raymond L et al. (2018) Pathologist characteristics associated with accuracy and reproducibility of melanocytic skin lesion interpretation. J Am Acad Dermatol 79:52-59.e5
Elmore, Joann G; Elder, David E; Barnhill, Raymond L et al. (2018) Concordance and Reproducibility of Melanoma Staging According to the 7th vs 8th Edition of the AJCC Cancer Staging Manual. JAMA Netw Open 1:
Carney, Patricia A; Frederick, Paul D; Reisch, Lisa M et al. (2018) Complexities of perceived and actual performance in pathology interpretation: A comparison of cutaneous melanocytic skin and breast interpretations. J Cutan Pathol 45:478-490
Titus, Linda; Barnhill, Raymond L; Lott, Jason P et al. (2017) The influence of tumor regression, solar elastosis, and patient age on pathologists' interpretation of melanocytic skin lesions. Lab Invest 97:187-193
Zhao, Ge; Lee, Kachiu C; Peacock, Sue et al. (2017) The utilization of spitz-related nomenclature in the histological interpretation of cutaneous melanocytic lesions by practicing pathologists: results from the M-Path study. J Cutan Pathol 44:5-14
Lee, Kachiu C; Peacock, Sue; Weinstock, Martin A et al. (2017) Variation among pathologists' treatment suggestions for melanocytic lesions: A survey of pathologists. J Am Acad Dermatol 76:121-128
Weinstock, M A; Lott, J P; Wang, Q et al. (2017) Skin biopsy utilization and melanoma incidence among Medicare beneficiaries. Br J Dermatol 176:949-954
Lott, Jason P; Elmore, Joann G; Zhao, Ge A et al. (2016) Evaluation of the Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis (MPATH-Dx) classification scheme for diagnosis of cutaneous melanocytic neoplasms: Results from the International Melanoma Pathology Study Group. J Am Acad Dermatol 75:356-63
Carney, Patricia A; Frederick, Paul D; Reisch, Lisa M et al. (2016) How concerns and experiences with medical malpractice affect dermatopathologists' perceptions of their diagnostic practices when interpreting cutaneous melanocytic lesions. J Am Acad Dermatol 74:317-24; quiz 324.e1-8
Onega, Tracy; Reisch, Lisa M; Frederick, Paul D et al. (2016) Use of Digital Whole Slide Imaging in Dermatopathology. J Digit Imaging 29:243-53

Showing the most recent 10 out of 15 publications