Spatio-spectral classification of hyperspectral images for brain cancer detection during surgical operations

PLoS One. 2018 Mar 19;13(3):e0193721. doi: 10.1371/journal.pone.0193721. eCollection 2018.

Abstract

Surgery for brain cancer is a major problem in neurosurgery. The diffuse infiltration into the surrounding normal brain by these tumors makes their accurate identification by the naked eye difficult. Since surgery is the common treatment for brain cancer, an accurate radical resection of the tumor leads to improved survival rates for patients. However, the identification of the tumor boundaries during surgery is challenging. Hyperspectral imaging is a non-contact, non-ionizing and non-invasive technique suitable for medical diagnosis. This study presents the development of a novel classification method taking into account the spatial and spectral characteristics of the hyperspectral images to help neurosurgeons to accurately determine the tumor boundaries in surgical-time during the resection, avoiding excessive excision of normal tissue or unintentionally leaving residual tumor. The algorithm proposed in this study to approach an efficient solution consists of a hybrid framework that combines both supervised and unsupervised machine learning methods. Firstly, a supervised pixel-wise classification using a Support Vector Machine classifier is performed. The generated classification map is spatially homogenized using a one-band representation of the HS cube, employing the Fixed Reference t-Stochastic Neighbors Embedding dimensional reduction algorithm, and performing a K-Nearest Neighbors filtering. The information generated by the supervised stage is combined with a segmentation map obtained via unsupervised clustering employing a Hierarchical K-Means algorithm. The fusion is performed using a majority voting approach that associates each cluster with a certain class. To evaluate the proposed approach, five hyperspectral images of surface of the brain affected by glioblastoma tumor in vivo from five different patients have been used. The final classification maps obtained have been analyzed and validated by specialists. These preliminary results are promising, obtaining an accurate delineation of the tumor area.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Brain Neoplasms / diagnostic imaging*
  • Brain Neoplasms / surgery
  • Cluster Analysis
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Intraoperative Period
  • Neurosurgical Procedures*
  • Supervised Machine Learning
  • Unsupervised Machine Learning

Grants and funding

This research was totally funded by the European Commission (https://ec.europa.eu/) through the FP7 FET Open (Seventh Framework Programme) programme ICT- 2011.9.2, European Project HELICoiD “HypErspectral Imaging Cancer Detection” under Grant Agreement 618080 (GMC). There was no additional external funding received for this study. The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.