Voxel-Wise Medical Imaging Transformation and Adaption Based on CycleGAN and Score-Based Diffusion

Stud Health Technol Inform. 2023 May 18:302:1027-1028. doi: 10.3233/SHTI230337.

Abstract

Supervised methods, such as those utilized in classification, prediction, and segmentation tasks for medical images, experience a decline in performance when the training and testing datasets violate the i.i.d (independent and identically distributed) assumption. Hence we adopted the CycleGAN(Generative Adversarial Networks) method to cycle training the CT(Computer Tomography) data from different terminals/manufacturers, which aims to eliminate the distribution shift from diverse data terminals. But due to the model collapse problem of the GAN-based model, the images we generated suffer serious radiology artifacts. To eliminate the boundary marks and artifacts, we adopted a score-based generative model to refine the images voxel-wisely. This novel combination of two generative models makes the transformation between diverse data providers to a higher fidelity level without sacrificing any significant features. In future works, we will evaluate the original datasets and generative datasets by experimenting with a broader range of supervised methods.

Keywords: CT; CycleGAN; Machine Learning methods; Score-based Generative Model.

MeSH terms

  • Artifacts
  • Image Processing, Computer-Assisted* / methods
  • Radiography
  • Tomography, X-Ray Computed*