Utilizing Edge Features in Graph Neural Networks via Variational Information Maximization

by   Pengfei Chen, et al.

Graph Neural Networks (GNNs) achieve an impressive performance on structured graphs by recursively updating the representation vector of each node based on its neighbors, during which parameterized transformation matrices should be learned for the node feature updating. However, existing propagation schemes are far from being optimal since they do not fully utilize the relational information between nodes. We propose the information maximizing graph neural networks (IGNN), which maximizes the mutual information between edge states and transform parameters. We reformulate the mutual information as a differentiable objective via a variational approach. We compare our model against several recent variants of GNNs and show that our model achieves the state-of-the-art performance on multiple tasks including quantum chemistry regression on QM9 dataset, generalization capability from QM9 to larger molecular graphs, and prediction of molecular bioactivities relevant for drug discovery. The IGNN model is based on an elegant and fundamental idea in information theory as explained in the main text, and it could be easily generalized beyond the contexts of molecular graphs considered in this work. To encourage more future work in this area, all datasets and codes used in this paper will be released for public access.


page 1

page 2

page 3

page 4


ChiENN: Embracing Molecular Chirality with Graph Neural Networks

Graph Neural Networks (GNNs) play a fundamental role in many deep learni...

Unsupervised Graph Representation by Periphery and Hierarchical Information Maximization

Deep representation learning on non-Euclidean data types, such as graphs...

Learning Graph-Level Representation for Drug Discovery

Predicating macroscopic influences of drugs on human body, like efficacy...

Graph Information Bottleneck

Representation learning of graph-structured data is challenging because ...

Physical Pooling Functions in Graph Neural Networks for Molecular Property Prediction

Graph neural networks (GNNs) are emerging in chemical engineering for th...

Molecular graph generation with Graph Neural Networks

The generation of graph-structured data is an emerging problem in the fi...

Bosonic Random Walk Networks for Graph Learning

The development of Graph Neural Networks (GNNs) has led to great progres...

Please sign up or login with your details

Forgot password? Click here to reset