Semi-supervised CycleGAN for domain transformation of chest CT images and its application to opacity classification of diffuse lung diseases

Int J Comput Assist Radiol Surg. 2021 Nov;16(11):1925-1935. doi: 10.1007/s11548-021-02490-2. Epub 2021 Oct 16.

Abstract

Purpose: The performance of deep learning may fluctuate depending on the imaging devices and settings. Although domain transformation such as CycleGAN for normalizing images is useful, CycleGAN does not use information on the disease classes. Therefore, we propose a semi-supervised CycleGAN with an additional classification loss to transform images suitable for the diagnosis. The method is evaluated by opacity classification of chest CT.

Methods: (1) CT images taken at two hospitals (source and target domains) are used. (2) A classifier is trained on the target domain. (3) Class labels are given to a small number of source domain images for semi-supervised learning. (4) The source domain images are transformed to the target domain. (5) A classification loss of the transformed images with class labels is calculated.

Results: The proposed method showed an F-measure of 0.727 in the domain transformation from hospital A to B, and 0.745 in that from hospital B to A, where significant differences are between the proposed method and the other three methods.

Conclusions: The proposed method not only transforms the appearance of the images but also retains the features being important to classify opacities, and shows the best precision, recall, and F-measure.

Keywords: CT; Classification; CycleGAN; Diffuse lung diseases; Domain transformation; Semi-supervised learning.

MeSH terms

  • Humans
  • Image Processing, Computer-Assisted*
  • Lung Diseases* / diagnostic imaging
  • Supervised Machine Learning
  • Tomography, X-Ray Computed