Does training in the breast imaging reporting and data system (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography?

Wendie A. Berg, Carl J. D'Orsi, Valerie Jackson, Lawrence W. Bassett, Craig A. Beam, Rebecca S. Lewis, Philip E. Crewson

Research output: Contribution to journalArticle

127 Citations (Scopus)

Abstract

PURPOSE: To determine whether training in the Breast Imaging Reporting and Data System (BI-RADS) improves observer performance and agreement with the consensus of experienced breast imagers with regard to mammographic feature analysis and final assessment. MATERIALS AND METHODS: A test set of mammograms was developed, with 54 proven lesions consisting of 28 masses (nine [32%] malignancies) and 26 microcalcifications (10 [38%] malignancies). Three experienced breast imagers reviewed cases independently and by means of consensus. Twenty-three practicing mammogram-interpreting physicians reviewed mammograms before and after a day's lectures on BI-RADS. Observer performance before and after training was measured by means of agreement (κ) with consensus description and assessments, rate of biopsy of malignant and benign lesions, and areas under receiver operating characteristic (ROC) curves. Performance was also measured for 11 participants 2-3 months after training. RESULTS: Improved agreement with consensus feature analysis was found for mass margins and/or asymmetries, with a pretraining generalized κ value of 0.36 and a posttraining generalized κ value of 0.41. Similar improvement was seen for description of calcification morphology (pretraining κ value of 0.36 improving to 0.44 after training). No improvement was seen in describing calcification distribution. Final assessments were more consistent after training, with a pretraining κ value of 0.31, as compared with 0.45 after training. The mean biopsy rate for malignant lesions improved from 73% (range, 53%-89%) before training to 88% (range, 74%-100%) after training, with minimal increase in mean biopsy rate of benign lesions (43% [range, 26%-60%] before to 51% [range, 31%-63%] after training), and no net change in area under the ROC curve, as compared with histopathologic findings. For the subset of participants with delayed follow-up, no significant decline in posttraining results was seen. CONCLUSION: BI-RADS training resulted in improved agreement with the consensus of experienced breast imagers for feature analysis and final assessment. It is important that trainees showed improved rates of recommending biopsy for malignant lesions. This effect was maintained over 2-3 months.

Original languageEnglish (US)
Pages (from-to)871-880
Number of pages10
JournalRadiology
Volume224
Issue number3
StatePublished - Sep 2002
Externally publishedYes

Fingerprint

Mammography
Information Systems
Breast
Biopsy
ROC Curve
Calcinosis
Neoplasms
Physicians

Keywords

  • Breast radiography
  • Diagnostic radiology, observer performance

ASJC Scopus subject areas

  • Radiological and Ultrasound Technology

Cite this

Does training in the breast imaging reporting and data system (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography? / Berg, Wendie A.; D'Orsi, Carl J.; Jackson, Valerie; Bassett, Lawrence W.; Beam, Craig A.; Lewis, Rebecca S.; Crewson, Philip E.

In: Radiology, Vol. 224, No. 3, 09.2002, p. 871-880.

Research output: Contribution to journalArticle

Berg, Wendie A. ; D'Orsi, Carl J. ; Jackson, Valerie ; Bassett, Lawrence W. ; Beam, Craig A. ; Lewis, Rebecca S. ; Crewson, Philip E. / Does training in the breast imaging reporting and data system (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography?. In: Radiology. 2002 ; Vol. 224, No. 3. pp. 871-880.
@article{b8522f14a55745da9ded9528e2c7a91d,
title = "Does training in the breast imaging reporting and data system (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography?",
abstract = "PURPOSE: To determine whether training in the Breast Imaging Reporting and Data System (BI-RADS) improves observer performance and agreement with the consensus of experienced breast imagers with regard to mammographic feature analysis and final assessment. MATERIALS AND METHODS: A test set of mammograms was developed, with 54 proven lesions consisting of 28 masses (nine [32{\%}] malignancies) and 26 microcalcifications (10 [38{\%}] malignancies). Three experienced breast imagers reviewed cases independently and by means of consensus. Twenty-three practicing mammogram-interpreting physicians reviewed mammograms before and after a day's lectures on BI-RADS. Observer performance before and after training was measured by means of agreement (κ) with consensus description and assessments, rate of biopsy of malignant and benign lesions, and areas under receiver operating characteristic (ROC) curves. Performance was also measured for 11 participants 2-3 months after training. RESULTS: Improved agreement with consensus feature analysis was found for mass margins and/or asymmetries, with a pretraining generalized κ value of 0.36 and a posttraining generalized κ value of 0.41. Similar improvement was seen for description of calcification morphology (pretraining κ value of 0.36 improving to 0.44 after training). No improvement was seen in describing calcification distribution. Final assessments were more consistent after training, with a pretraining κ value of 0.31, as compared with 0.45 after training. The mean biopsy rate for malignant lesions improved from 73{\%} (range, 53{\%}-89{\%}) before training to 88{\%} (range, 74{\%}-100{\%}) after training, with minimal increase in mean biopsy rate of benign lesions (43{\%} [range, 26{\%}-60{\%}] before to 51{\%} [range, 31{\%}-63{\%}] after training), and no net change in area under the ROC curve, as compared with histopathologic findings. For the subset of participants with delayed follow-up, no significant decline in posttraining results was seen. CONCLUSION: BI-RADS training resulted in improved agreement with the consensus of experienced breast imagers for feature analysis and final assessment. It is important that trainees showed improved rates of recommending biopsy for malignant lesions. This effect was maintained over 2-3 months.",
keywords = "Breast radiography, Diagnostic radiology, observer performance",
author = "Berg, {Wendie A.} and D'Orsi, {Carl J.} and Valerie Jackson and Bassett, {Lawrence W.} and Beam, {Craig A.} and Lewis, {Rebecca S.} and Crewson, {Philip E.}",
year = "2002",
month = "9",
language = "English (US)",
volume = "224",
pages = "871--880",
journal = "Radiology",
issn = "0033-8419",
publisher = "Radiological Society of North America Inc.",
number = "3",

}

TY - JOUR

T1 - Does training in the breast imaging reporting and data system (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography?

AU - Berg, Wendie A.

AU - D'Orsi, Carl J.

AU - Jackson, Valerie

AU - Bassett, Lawrence W.

AU - Beam, Craig A.

AU - Lewis, Rebecca S.

AU - Crewson, Philip E.

PY - 2002/9

Y1 - 2002/9

N2 - PURPOSE: To determine whether training in the Breast Imaging Reporting and Data System (BI-RADS) improves observer performance and agreement with the consensus of experienced breast imagers with regard to mammographic feature analysis and final assessment. MATERIALS AND METHODS: A test set of mammograms was developed, with 54 proven lesions consisting of 28 masses (nine [32%] malignancies) and 26 microcalcifications (10 [38%] malignancies). Three experienced breast imagers reviewed cases independently and by means of consensus. Twenty-three practicing mammogram-interpreting physicians reviewed mammograms before and after a day's lectures on BI-RADS. Observer performance before and after training was measured by means of agreement (κ) with consensus description and assessments, rate of biopsy of malignant and benign lesions, and areas under receiver operating characteristic (ROC) curves. Performance was also measured for 11 participants 2-3 months after training. RESULTS: Improved agreement with consensus feature analysis was found for mass margins and/or asymmetries, with a pretraining generalized κ value of 0.36 and a posttraining generalized κ value of 0.41. Similar improvement was seen for description of calcification morphology (pretraining κ value of 0.36 improving to 0.44 after training). No improvement was seen in describing calcification distribution. Final assessments were more consistent after training, with a pretraining κ value of 0.31, as compared with 0.45 after training. The mean biopsy rate for malignant lesions improved from 73% (range, 53%-89%) before training to 88% (range, 74%-100%) after training, with minimal increase in mean biopsy rate of benign lesions (43% [range, 26%-60%] before to 51% [range, 31%-63%] after training), and no net change in area under the ROC curve, as compared with histopathologic findings. For the subset of participants with delayed follow-up, no significant decline in posttraining results was seen. CONCLUSION: BI-RADS training resulted in improved agreement with the consensus of experienced breast imagers for feature analysis and final assessment. It is important that trainees showed improved rates of recommending biopsy for malignant lesions. This effect was maintained over 2-3 months.

AB - PURPOSE: To determine whether training in the Breast Imaging Reporting and Data System (BI-RADS) improves observer performance and agreement with the consensus of experienced breast imagers with regard to mammographic feature analysis and final assessment. MATERIALS AND METHODS: A test set of mammograms was developed, with 54 proven lesions consisting of 28 masses (nine [32%] malignancies) and 26 microcalcifications (10 [38%] malignancies). Three experienced breast imagers reviewed cases independently and by means of consensus. Twenty-three practicing mammogram-interpreting physicians reviewed mammograms before and after a day's lectures on BI-RADS. Observer performance before and after training was measured by means of agreement (κ) with consensus description and assessments, rate of biopsy of malignant and benign lesions, and areas under receiver operating characteristic (ROC) curves. Performance was also measured for 11 participants 2-3 months after training. RESULTS: Improved agreement with consensus feature analysis was found for mass margins and/or asymmetries, with a pretraining generalized κ value of 0.36 and a posttraining generalized κ value of 0.41. Similar improvement was seen for description of calcification morphology (pretraining κ value of 0.36 improving to 0.44 after training). No improvement was seen in describing calcification distribution. Final assessments were more consistent after training, with a pretraining κ value of 0.31, as compared with 0.45 after training. The mean biopsy rate for malignant lesions improved from 73% (range, 53%-89%) before training to 88% (range, 74%-100%) after training, with minimal increase in mean biopsy rate of benign lesions (43% [range, 26%-60%] before to 51% [range, 31%-63%] after training), and no net change in area under the ROC curve, as compared with histopathologic findings. For the subset of participants with delayed follow-up, no significant decline in posttraining results was seen. CONCLUSION: BI-RADS training resulted in improved agreement with the consensus of experienced breast imagers for feature analysis and final assessment. It is important that trainees showed improved rates of recommending biopsy for malignant lesions. This effect was maintained over 2-3 months.

KW - Breast radiography

KW - Diagnostic radiology, observer performance

UR - http://www.scopus.com/inward/record.url?scp=0036721187&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036721187&partnerID=8YFLogxK

M3 - Article

VL - 224

SP - 871

EP - 880

JO - Radiology

JF - Radiology

SN - 0033-8419

IS - 3

ER -