Machine learning-based natural language processing to extract PD-L1 expression levels from clinical notes

Health Informatics J. 2023 Jul-Sep;29(3):14604582231198021. doi: 10.1177/14604582231198021.

Abstract

Introduction: PD-L1 expression is used to determine oncology patients' response to and eligibility for immunologic treatments; however, PD-L1 expression status often only exists in unstructured clinical notes, limiting ability to use it in population-level studies. Methods: We developed and evaluated a machine learning based natural language processing (NLP) tool to extract PD-L1 expression values from the nationwide Veterans Affairs electronic health record system. Results: The model demonstrated strong evaluation performance across multiple levels of label granularity. Mean precision of the overall PD-L1 positive label was 0.859 (sd, 0.039), recall 0.994 (sd, 0.013), and F1 0.921 (0.024). When a numeric PD-L1 value was identified, the mean absolute error of the value was 0.537 on a scale of 0 to 100. Conclusion: We presented an accurate NLP method for deriving PD-L1 status from clinical notes. By reducing the time and manual effort needed to review medical records, our work will enable future population-level studies in cancer immunotherapy.

Keywords: PD-l1; cancer; electronic health records; machine learning; natural language processing.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.
  • Research Support, Non-U.S. Gov't

MeSH terms

  • B7-H1 Antigen*
  • Electronic Health Records
  • Humans
  • Machine Learning
  • Medical Records
  • Natural Language Processing*
  • Software

Substances

  • B7-H1 Antigen