Enhancer-LSTMAtt: A Bi-LSTM and Attention-Based Deep Learning Method for Enhancer Recognition

Biomolecules. 2022 Jul 17;12(7):995. doi: 10.3390/biom12070995.

Abstract

Enhancers are short DNA segments that play a key role in biological processes, such as accelerating transcription of target genes. Since the enhancer resides anywhere in a genome sequence, it is difficult to precisely identify enhancers. We presented a bi-directional long-short term memory (Bi-LSTM) and attention-based deep learning method (Enhancer-LSTMAtt) for enhancer recognition. Enhancer-LSTMAtt is an end-to-end deep learning model that consists mainly of deep residual neural network, Bi-LSTM, and feed-forward attention. We extensively compared the Enhancer-LSTMAtt with 19 state-of-the-art methods by 5-fold cross validation, 10-fold cross validation and independent test. Enhancer-LSTMAtt achieved competitive performances, especially in the independent test. We realized Enhancer-LSTMAtt into a user-friendly web application. Enhancer-LSTMAtt is applicable not only to recognizing enhancers, but also to distinguishing strong enhancer from weak enhancers. Enhancer-LSTMAtt is believed to become a promising tool for identifying enhancers.

Keywords: convolution neural network; deep learning; enhancer; feed-forward attention; long-short term memory; promoter; residual neural network.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Deep Learning*
  • Neural Networks, Computer

Grants and funding

This research was funded by National Natural Science Foundation of China [62162025, 61672356], by Hunan Provincial Natural Science Foundation of China [2022JJ50177, 2020JJ4034], by Scientific Research Fund of Hunan Provincial Education Department [21A0466, 19A215], and by Shaoyang University Innovation Foundation for Postgraduate [CX2021SY033].