HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

Comput Biol Med. 2024 Jan:168:107832. doi: 10.1016/j.compbiomed.2023.107832. Epub 2023 Dec 7.

Abstract

Background and objective: Non-rigid image registration plays a significant role in computer-aided diagnosis and surgical navigation for brain diseases. Registration methods that utilize convolutional neural networks (CNNs) have shown excellent accuracy when applied to brain magnetic resonance images (MRI). However, CNNs have limitations in understanding long-range spatial relationships in images, which makes it challenging to incorporate contextual information. And in intricate image registration tasks, it is difficult to achieve a satisfactory dense prediction field, resulting in poor registration performance.

Methods: This paper proposes a multi-level deformable unsupervised registration model that combines Transformer and CNN to achieve non-rigid registration of brain MRI. Firstly, utilizing a dual encoder structure to establish the dependency relationship between the global features of two images and to merge features of varying scales, as well as to preserve the relative spatial position information of feature maps at different scales. Then the proposed multi-level deformation strategy utilizes different deformable fields of varying resolutions generated by the decoding structure to progressively deform the moving image. Ultimately, the proposed quadruple attention module is incorporated into the decoding structure to merge feature information from various directions and emphasize the spatial features in the dominant channels.

Results: The experimental results on multiple brain MR datasets demonstrate that the promising network could provide accurate registration and is comparable to state-of-the-art methods.

Conclusion: The proposed registration model can generate superior deformable fields and achieve more precise registration effects, enhancing the auxiliary role of medical image registration in various fields and advancing the development of computer-aided diagnosis, surgical navigation, and related domains.

Keywords: Encoder-decoder architecture; Feature fusion; Medical images; Non-rigid registration; Transformer model.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Brain* / diagnostic imaging
  • Diagnosis, Computer-Assisted
  • Image Processing, Computer-Assisted
  • Neural Networks, Computer
  • Surgery, Computer-Assisted*