A pathologist's assessment is considered the "gold standard" for deciding whether cancer is present or absent and whether atypical epithelium is reported. However, extensive variation between pathologists has been documented, with disagreement in diagnosis of atypical ductal hyperplasia (ADH) in more than 50% of cases and a misclassification rate for cases designated by experts as ductal carcinoma in situ (DCIS) of 17%. We propose to evaluate the extent of variability, its sources and its impact on women undergoing breast biopsy. Our research will also evaluate possible techniques to improve accuracy, such as double reading. To accomplish our study aims we will develop four diagnostic test sets, weighted to include a high percentage of cases with ADH and DCIS, as defined by a panel of international experts. More than 100 U.S. pathologists will independently review the test sets during two phases, separated by 6 months.
Our specific aims are: 1. To assess the accuracy of pathologists in the interpretation of breast pathology specimens and quantify the extent and possible sources of intra- and inter-observer variability. 2. To assess whether independent double reading by two pathologists can improve the accuracy of interpretation of breast pathology specimens. 3. To quantify the implications of variability among pathologists'interpretations of breast specimens on short-term patient care and associated resource utilization within the U.S. population. We hypothesize that the following characteristics are associated with lower accuracy: a) Patient characteristics (age <50 years, dense breast, extensive background proliferative change, ADH and DCIS interpretation): and b) Pathologist characteristics (e.g., less clinical experience). In summary, we will evaluate the accuracy of breast pathology interpretation, emphasizing the classification of ADH and DCIS, where previous studies reveal a concerning degree of diagnostic errors. This large multi- center study of community pathologists addresses a topic that has growing clinical importance. The proposed work is innovative in that we will go beyond simply quantifying the existence of errors. We will study patient and physician characteristics associated with inaccurate diagnoses. We will then evaluate methods for improving health care delivery using double reading. Finally, we will use a systematic method to make projections from our data to clinical implications of inaccurate diagnoses.

Public Health Relevance

Surprisingly little research has investigated the accuracy of pathologists in diagnosing cancer, yet the pathologists'assessment is the gold standard for deciding whether cancer is present or absent and, in the case of breast tissue, whether atypical cells are noted. We propose a series of studies to evaluate the extent and impact of variability in breast pathology interpretation. We will also evaluate the impact of double reading on overall accuracy.

National Institute of Health (NIH)
National Cancer Institute (NCI)
Research Project (R01)
Project #
Application #
Study Section
Health Services Organization and Delivery Study Section (HSOD)
Program Officer
Breen, Nancy
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Washington
Internal Medicine/Medicine
Schools of Medicine
United States
Zip Code
Mercan, Ezgi; Aksoy, Selim; Shapiro, Linda G et al. (2016) Localization of Diagnostically Relevant Regions of Interest in Whole Slide Images: a Comparative Study. J Digit Imaging 29:496-506
Allison, Kimberly H; Rendi, Mara H; Peacock, Sue et al. (2016) Histological features associated with diagnostic agreement in atypical ductal hyperplasia of the breast: illustrative cases from the B-Path study. Histopathology 69:1028-1046
Elmore, Joann G; Nelson, Heidi D; Pepe, Margaret S et al. (2016) Variability in Pathologists' Interpretations of Individual Breast Biopsy Slides: A Population Perspective. Ann Intern Med 164:649-55
Carney, Patricia A; Allison, Kimberly H; Oster, Natalia V et al. (2016) Identifying and processing the gap between perceived and actual agreement in breast pathology interpretation. Mod Pathol 29:717-26
Elmore, Joann G; Longton, Gary M; Carney, Patricia A et al. (2015) Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA 313:1122-32
Lott, Jason P; Piepkorn, Michael W; Elmore, Joann G (2015) Dermatology in an age of fully transparent electronic medical records. JAMA Dermatol 151:477-8
Oster, Natalia V; Geller, Berta M; Carney, Patricia A et al. (2015) Demographic and practice characteristics of pathologists who enjoy breast tissue interpretation. Breast 24:107-11
Reisch, Lisa M; Carney, Patricia A; Oster, Natalia V et al. (2015) Medical malpractice concerns and defensive medicine: a nationwide survey of breast pathologists. Am J Clin Pathol 144:916-22
Allison, Kimberly H; Abraham, Linn A; Weaver, Donald L et al. (2015) Trends in breast biopsy pathology diagnoses among women undergoing mammography in the United States: a report from the Breast Cancer Surveillance Consortium. Cancer 121:1369-78
Geller, Berta M; Nelson, Heidi D; Carney, Patricia A et al. (2014) Second opinion in breast pathology: policy, practice and perception. J Clin Pathol 67:955-60

Showing the most recent 10 out of 15 publications