Heterogeneous Graph Transformer
University of California, Los Angeles · Microsoft Research (United Kingdom)
Abstract
Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making it infeasible to represent heterogeneous structures. In this paper, we present the Heterogeneous Graph Transformer (HGT) architecture for modeling Web-scale heterogeneous graphs. To model heterogeneity, we design node- and edge-type dependent parameters to characterize the heterogeneous attention over each edge, empowering HGT to maintain dedicated representations for different types of nodes and edges. To handle Web-scale graph data, we design the heterogeneous mini-batch graph…
Citation impact
- FWCI
- 81.96
- Percentile
- 100%
- References
- 24
Authors
4Topics & keywords
- Computer science
- Scalability
- Theoretical computer science
- Graph
- Homogeneous
- Transformer
- Distributed computing
- Data mining