Inter- and intraobserver variability in the evaluation of dynamic breast cancer MRI

J Magn Reson Imaging. 2006 Dec;24(6):1316-25. doi: 10.1002/jmri.20768.

Abstract

Purpose: To quantify variations within and between observers ascribable to manual region of interest (ROI) placement in patients with breast cancer undergoing dynamic MRI.

Materials and methods: Expert and nonexpert observers independently outlined tumor ROIs on 30 dynamic T(1)-weighted (T(1)W) MRI scans on five occasions over two months. Lesion size (number of pixels) and kinetic parameter estimates, including the transfer constant (K(trans)), were calculated for each ROI placement. Inter- and intraobserver variability was assessed with respect to the interval between drawings, lesion morphology, and observer experience.

Results: For the nonexpert, the variability reduced with decreasing time intervals between ROI drawings (the coefficient of variance (wCV) values at two months, two weeks, one day, and same-day time intervals were respectively 11.6%, 10.7%, 4.8%, and 2.6% for lesion size, and 8.9%, 9.7%, 6.7%, and 3.2% for K(trans)). For the expert observer, the variability was smaller overall and more constant, but improved for same-day ROI placements (region size wCV: 7.5%, 6.2%, 7.1%, and 3.7%; K(trans) wCV: 5.4%, 5.3%, 5.6%, and 4.5%).

Conclusion: Significant observer variability in manual ROI placement occurs in dynamic MRI of breast cancer. For serial patient studies, ROI placements should be outlined at the same sitting to minimize observer error.

Publication types

  • Evaluation Study

MeSH terms

  • Adult
  • Aged
  • Breast Neoplasms / pathology*
  • Female
  • Humans
  • Magnetic Resonance Imaging / statistics & numerical data*
  • Middle Aged
  • Observer Variation*
  • Professional Competence / statistics & numerical data*
  • Quality Assurance, Health Care / methods
  • ROC Curve
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Task Performance and Analysis*