Objectives: Automated systems to analyse nailfold videocapillaroscopy (NVC) images are needed to promptly and comprehensively characterise patients with systemic sclerosis (SSc) or Raynaud's phenomenon (RP). We previously developed, and validated in-house, a deep convolutional neural network-based algorithm to classify NVC-captured images according to the presence/absence of structural abnormalities and/or microhaemorrhages. We present its external clinical validation.
Methods: A total of 1,164 NVC images of RP patients were annotated by 5 trained capillaroscopists according to the following categories: normal capillary; dilation; giant capillary; abnormal shape; tortuosity; microhaemorrhage. The images were also presented to the algorithm. Matches and discrepancies between algorithm predictions and those annotations obtained by consensus of ≥3 or ≥4 interobservers were analysed.
Results: Consensus among ≥3 capillaroscopists was achieved in 86.9% of images, 75.8% of which were correctly predicted by the algorithm. Consensus among ≥4 experts occurred in 52.0% of cases, in which 87.1% of the algorithm's results matched with those of the expert panel. The algorithm's positive predictive value was >80% for microhaemorrhages and unaltered, giant or abnormal capillaries. Sensitivity was >75% for dilations and tortuosities. Negative predictive value and specificity were >89% for all categories.
Conclusions: This external clinical validation suggests that this algorithm is useful to assist in the diagnosis and follow-up of SSc or RP patients in a timely manner. It may also be helpful in the management of patients with any pathology presenting with microvascular changes, as the algorithm has been designed to also be useful for research aiming at extending the usage of nailfold capillaroscopy to more conditions.