Metric Learning in Histopathological Image Classification: Opening the Black Box

Sensors (Basel). 2023 Jun 28;23(13):6003. doi: 10.3390/s23136003.

Abstract

The application of machine learning techniques to histopathology images enables advances in the field, providing valuable tools that can speed up and facilitate the diagnosis process. The classification of these images is a relevant aid for physicians who have to process a large number of images in long and repetitive tasks. This work proposes the adoption of metric learning that, beyond the task of classifying images, can provide additional information able to support the decision of the classification system. In particular, triplet networks have been employed to create a representation in the embedding space that gathers together images of the same class while tending to separate images with different labels. The obtained representation shows an evident separation of the classes with the possibility of evaluating the similarity and the dissimilarity among input images according to distance criteria. The model has been tested on the BreakHis dataset, a reference and largely used dataset that collects breast cancer images with eight pathology labels and four magnification levels. Our proposed classification model achieves relevant performance on the patient level, with the advantage of providing interpretable information for the obtained results, which represent a specific feature missed by the all the recent methodologies proposed for the same purpose.

Keywords: BreakHis; WSI; breast cancer imaging; classification interpretability; embedding; metric learning; patient level accuracy; triplet networks; visualization.

MeSH terms

  • Breast Neoplasms* / diagnostic imaging
  • Female
  • Humans
  • Machine Learning
  • Neural Networks, Computer*

Grants and funding

This research has been supported by Piano Nazionale per gli investimenti Complementari al PNRR, project DARE-Digital Lifelong Prevention, CUP B53C22006460001, Decreto Direttoriale (Direzione Generale Ricerca) Ministero Università e Ricerca n. 1511 del 30/09/2022. Additional support to G.L.B. has been granted by the University of Palermo FFR (Fondo Finalizzato alla ricerca di Ateneo) year 2023.