[An automatic pulmonary nodules detection algorithm with multi-scale information fusion]

Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2020 Jun 25;37(3):434-441. doi: 10.7507/1001-5515.201910047.
[Article in Chinese]

Abstract

Lung nodules are the main manifestation of early lung cancer. So accurate detection of lung nodules is of great significance for early diagnosis and treatment of lung cancer. However, the rapid and accurate detection of pulmonary nodules is a challenging task due to the complex background, large detection range of pulmonary computed tomography (CT) images and the different sizes and shapes of pulmonary nodules. Therefore, this paper proposes a multi-scale feature fusion algorithm for the automatic detection of pulmonary nodules to achieve accurate detection of pulmonary nodules. Firstly, a three-layer modular lung nodule detection model was designed on the deep convolutional network (VGG16) for large-scale image recognition. The first-tier module of the network is used to extract the features of pulmonary nodules in CT images and roughly estimate the location of pulmonary nodules. Then the second-tier module of the network is used to fuse multi-scale image features to further enhance the details of pulmonary nodules. The third-tier module of the network was fused to analyze the features of the first-tier and the second-tier module of the network, and the candidate box of pulmonary nodules in multi-scale was obtained. Finally, the candidate box of pulmonary nodules under multi-scale was analyzed with the method of non-maximum suppression, and the final location of pulmonary nodules was obtained. The algorithm is validated by the data of pulmonary nodules on LIDC-IDRI common data set. The average detection accuracy is 90.9%.

肺结节是早期肺癌的主要表现形式,准确检测肺结节对肺癌的早期诊断和治疗具有重要意义。然而,由于肺部计算机断层扫描(CT)图像背景复杂、检测范围大,且肺结节大小不一、形态各异,所以快速准确检测肺结节是一项极具挑战的工作。为此,本文提出了一种融合多尺度特征的肺结节自动检测算法,实现了肺结节的准确检测。首先,在用于大规模图像识别的深度卷积网络(VGG16)上设计了具有三层模块结构的肺结节检测模型,利用网络第一层模块提取 CT 图像中肺结节特征并粗略地估计肺结节位置;然后利用网络第二层模块融合多尺度的图像特征信息进一步增强肺结节细节特征;而网络第三层模块融合分析第一层和第二层模块的特征,得到多尺度下肺结节候选框;最后利用非极大值抑制方法对多尺度下肺结节候选框进行概率分析,得到最终的肺结节位置。本文应用肺部影像数据库联盟(LIDC)公共数据集上的肺结节数据对所提算法进行了验证,平均检测精度达到 90.9%。本研究成果可应用于肺结节自动筛查系统,有助于提升肺结节筛查精度。.

Keywords: computed tomography images; feature fusion; multi scale; pulmonary nodule detection.

MeSH terms

  • Algorithms*
  • Humans
  • Lung Neoplasms*
  • Multiple Pulmonary Nodules* / diagnostic imaging
  • Radiographic Image Interpretation, Computer-Assisted
  • Solitary Pulmonary Nodule* / diagnostic imaging
  • Tomography, X-Ray Computed

Grants and funding

国家自然科学基金(61703133,61473112);河北省青年基金(F2018201070);河北省青年拔尖人才(BJ2019044);河北省科技支撑计划(F2017201222)