Inter- and intraobserver variability in the assessment of brain arteriovenous malformation angioarchitecture and endovascular treatment results

AJNR Am J Neuroradiol. 2007 Mar;28(3):524-7.

Abstract

Background and purpose: Several angiographic features of brain arteriovenous malformations (BAVMs) have been associated with an increased risk of hemorrhage. However, interpretation of these features may not be consistent between observers. We conducted a study to determine inter- and intraobserver agreement of various angioarchitectural characteristics of BAVM.

Materials and methods: Two experienced interventional neuroradiologists independently reviewed pre- and post-endovascular treatment angiograms from 50 consecutive patients. Axial CT and/or MR images before treatment were included. We collected the following data: Spetzler-Martin grades, number of involved arterial territories, associated aneurysms by location (circle of Willis, feeding artery, intranidal, and venous), and nidus reduction after endovascular treatment (<33%, 33%-66%, and >66%). The reviewers were compared with each other, and 1 was compared with himself after a 3-month interval. Measures of agreement were performed by using the kappa statistic (kappa) for nominal data and the weighted kappa for ordinal data.

Results: Inter- and intraobserver agreement were higher for assessment of the Spetzler-Martin grade (weighted kappa = 0.70/0.75) and nidus size reduction after endovascular treatment (kappa = 0.74/0.77). Inter- and intraobserver agreement were inferior for findings concerning feeding artery aneurysms (kappa = 0.19/0.36), intranidal aneurysms (kappa = 0.34/0.35), and venous aneurysms (kappa = 0.50/0.67).

Conclusion: Angiographic characteristics of BAVMs considered as risk factors for hemorrhage, such as aneurysms, are not reliably detected on global angiograms between different observers. In contrast, the Spetzler-Martin grading system and angiographic results of endovascular treatment can be used with high observer agreement.

Publication types

  • Validation Study

MeSH terms

  • Adult
  • Cerebral Angiography / standards
  • Cerebral Angiography / statistics & numerical data*
  • Cohort Studies
  • Embolization, Therapeutic*
  • Humans
  • Intracranial Arteriovenous Malformations / diagnostic imaging*
  • Intracranial Arteriovenous Malformations / epidemiology
  • Intracranial Arteriovenous Malformations / therapy*
  • Male
  • Observer Variation
  • Reproducibility of Results
  • Retrospective Studies
  • Risk Factors
  • Severity of Illness Index*
  • Tomography, X-Ray Computed