Large language models for structured reporting in radiology: performance of GPT-4, ChatGPT-3.5, Perplexity and Bing

Radiol Med. 2023 Jul;128(7):808-812. doi: 10.1007/s11547-023-01651-4. Epub 2023 May 29.

Abstract

Structured reporting may improve the radiological workflow and communication among physicians. Artificial intelligence applications in medicine are growing fast. Large language models (LLMs) are recently gaining importance as valuable tools in radiology and are currently being tested for the critical task of structured reporting. We compared four LLMs models in terms of knowledge on structured reporting and templates proposal. LLMs hold a great potential for generating structured reports in radiology but additional formal validations are needed on this topic.

Keywords: Artificial intelligence (AI); Computed tomography (CT); GPT-4; Generative pre-trained transformer (GPT)-based models; Large language models (LLMs); Structured report.

MeSH terms

  • Artificial Intelligence*
  • Communication
  • Humans
  • Language
  • Radiography
  • Radiology*