Democratization of deep learning for segmenting cartilage from MRIs of human knees: Application to data from the osteoarthritis initiative

J Orthop Res. 2023 Aug;41(8):1754-1766. doi: 10.1002/jor.25509. Epub 2023 Jan 7.

Abstract

In this study, we aimed to democratize access to convolutional neural networks (CNN) for segmenting cartilage volumes, generating state-of-the-art results for specialized, real-world applications in hospitals and research. Segmentation of cross-sectional and/or longitudinal magnetic resonance (MR) images of articular cartilage facilitates both clinical management of joint damage/disease and fundamental research. Manual delineation of such images is a time-consuming task susceptible to high intra- and interoperator variability and prone to errors. Thus, enabling reliable and efficient analyses of MRIs of cartilage requires automated segmentation of cartilage volumes. Two main limitations arise in the development of hospital- or population-specific deep learning (DL) models for image segmentation: specialized knowledge and specialized hardware. We present a relatively easy and accessible implementation of a DL model to automatically segment MRIs of human knees with state-of-the-art accuracy. In representative examples, we trained CNN models in 6-8 h and obtained results quantitatively comparable to state-of-the-art for every anatomical structure. We established and evaluated our methods using two publicly available MRI data sets originating from the Osteoarthritis Initiative, Stryker Imorphics, and Zuse Institute Berlin (ZIB), as representative test cases. We use Google Colabfor editing and adapting the Python codes and selecting the runtime environment leveraging high-performance graphical processing units. We designed our solution for novice users to apply to any data set with relatively few adaptations requiring only basic programming skills. To facilitate the adoption of our methods, we provide a complete guideline for using our methods and software, as well as the software tools themselves. Clinical significance: We establish and detail methods that clinical personal can apply to create their own DL models without specialized knowledge of DL nor specialized hardware/infrastructure and obtain results comparable with the state-of-the-art to facilitate both clinical management of joint damage/disease and fundamental research.

Keywords: deep learning; democratization; knee cartilage; magnetic resonance image; osteoarthritis; segmentation.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Cartilage, Articular* / diagnostic imaging
  • Cross-Sectional Studies
  • Deep Learning*
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Joint Diseases*
  • Magnetic Resonance Imaging / methods
  • Osteoarthritis*