Spatial feature fusion convolutional network for liver and liver tumor segmentation from CT images

Abstract

Purpose: The accurate segmentation of liver and liver tumors from CT images can assist radiologists in decision-making and treatment planning. The contours of liver and liver tumors are currently obtained by manual labeling, which is time-consuming and subjective. Computer-aided segmentation methods have been widely used in the segmentation of liver and liver tumors. However, due to the diversity of shape, volume, and image intensity, the segmentation is still a difficult task. In this study, we present a Spatial Feature Fusion Convolutional Network (SFF-Net) to automatically segment liver and liver tumors from CT images.

Methods: First, we extract side-outputs at each convolutional block in SFF-Net to make full use of multiscale features. Second, skip-connections are added in the down-sampling phase, therefore, the spatial information can be efficiently transferred to later layers. Third, we present feature fusion blocks (FFBs) to merge spatial features and high-level semantic features from early layers and later layers, respectively. Finally, a fully connected 3D conditional random fields (CRFs) is applied to refine the liver and liver tumor segmentation results.

Results: We test our method on the MICCAI 2017 Liver Tumor Segmentation (LiTS) challenge dataset. The Dice Global (DG) score, Dice per case (DC) score, Volume Overlap Error (VOE), Average Symmetric Surface Distance (ASSD), and tumor precision score are calculated to evaluate the liver and liver tumor segmentation accuracies. For the liver segmentation, DG is 0.955; DC is 0.937; VOE is 0.106; and ASSD is 3.678. For the tumor segmentation, DG is 0.746; DC is 0.592; VOE is 0.416; ASSD is 1.585 and the tumor precision score is 0.369.

Conclusions: The SFF-Net learns more spatial information by adding skip-connections and feature fusion blocks. The experiments validate that our method can accurately segment liver and liver tumors from CT images.

Keywords: CT images; automatic segmentation; feature fusion; liver; liver tumor; spatial information.