Span-based single-stage joint entity-relation extraction model

PLoS One. 2023 Feb 7;18(2):e0281055. doi: 10.1371/journal.pone.0281055. eCollection 2023.

Abstract

Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in existing entity relation extraction approaches, we propose a joint entity relation extraction model (SMHS) based on a span-level multi-head selection mechanism, transforming entity relation extraction into a span-level multi-head selection problem. Our model uses span-tagger and span-embedding to construct span semantic vectors, utilizes LSTM and multi-head self-attention mechanism for span feature extraction, multi-head selection mechanism for span-level relation decoding, and introduces span classification task for multi-task learning to decode out the relation triad in a single-stage. Experiments on the classic English dataset NYT and the publicly available Chinese relationship extraction dataset DuIE 2.0 show that this method achieves better results than the baseline method, which verifies the effectiveness of this method. Source code and data are published here(https://github.com/Beno-waxgourd/NLP.git).

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Learning
  • Semantics*
  • Software
  • Text Messaging*

Grants and funding

This study was supported by the ”13th Five-Year Plan” Science and Technology Project (JJKH20200677KJ) of the Department of Education of Jilin Province, China.