MGAT: Multi-view Graph Attention Networks

Neural Netw. 2020 Dec:132:180-189. doi: 10.1016/j.neunet.2020.08.021. Epub 2020 Aug 27.

Abstract

Multi-view graph embedding is aimed at learning low-dimensional representations of nodes that capture various relationships in a multi-view network, where each view represents a type of relationship among nodes. Multitudes of existing graph embedding approaches concentrate on single-view networks, that can only characterize one simple type of proximity relationships among objects. However, most of the real-world complex systems possess multiple types of relationships among entities. In this paper, a novel approach of graph embedding for multi-view networks is proposed, named Multi-view Graph Attention Networks (MGAT). We explore an attention-based architecture for learning node representations from each single view, the network parameters of which are constrained by a novel regularization term. In order to collaboratively integrate multiple types of relationships in different views, a view-focused attention method is explored to aggregate the view-wise node representations. We evaluate the proposed algorithm on several real-world datasets, and it demonstrates that the proposed approach outperforms existing state-of-the-art baselines.

Keywords: Attention; Graph embedding; Multi-view networks.

MeSH terms

  • Algorithms*
  • Attention*
  • Machine Learning*
  • Neural Networks, Computer*