TAHDNet: Time-aware hierarchical dependency network for medication recommendation

Abstract

Medication recommendation is a hot topic in the research of applying neural networks to the healthcare area. Although extensive progressions have been made, current researches still face the following challenges: (i). Existing methods are poor at efficiently capturing and leveraging local and global dependency information from patient visit records. (ii). Current time-aware models based on irregularly interval medical records tend to ignore periodic variability in patient conditions, which limits the representational learning capability of these models. Therefore, we propose a Dynamic Time-aware Hierarchical Dependency Network (TAHDNet) for the medication recommendation task to address these challenges. Firstly, we use a Transformer-based model to learn the global information of the whole patient record through a self-supervised pre-training process. Secondly, a 1D-CNN model is used to learn the local dependencies on visitation level. Thirdly, we propose a dynamic time-aware module with a fused temporal decay function to assign different weights among different time intervals dynamically through a key-value attention mechanism. Experimental results on real-world datasets demonstrate the effectiveness of the model proposed in this paper.

Keywords: Attention mechanism; Medication recommendation; Time-aware.