Bayesian Robust Graph Contrastive Learning

05/27/2022
by   Yancheng Wang, et al.
0

Graph Neural Networks (GNNs) have been widely used to learn node representations and with outstanding performance on various tasks such as node classification. However, noise, which inevitably exists in real-world graph data, would considerably degrade the performance of GNNs as the noise is easily propagated via the graph structure. In this work, we propose a novel and robust method, Bayesian Robust Graph Contrastive Learning (BRGCL), which trains a GNN encoder to learn robust node representations. The BRGCL encoder is a completely unsupervised encoder. Two steps are iteratively executed at each epoch of training the BRGCL encoder: (1) estimating confident nodes and computing robust cluster prototypes of node representations through a novel Bayesian nonparametric method; (2) prototypical contrastive learning between the node representations and the robust cluster prototypes. Experiments on public and large-scale benchmarks demonstrate the superior performance of BRGCL and the robustness of the learned node representations. The code of BRGCL is available at <https://github.com/BRGCL-code/BRGCL-code>.

READ FULL TEXT

page 3

page 5

page 8

page 10

page 11

page 13

page 14

page 16

research
07/03/2021

On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs

Graph neural networks (GNNs) have been widely used in various graph-rela...
research
04/27/2022

SCGC : Self-Supervised Contrastive Graph Clustering

Graph clustering discovers groups or communities within networks. Deep l...
research
03/12/2023

ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyond

Oversmoothing is a common phenomenon in a wide range of Graph Neural Net...
research
11/08/2021

Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods

Graph Neural Networks (GNNs) have achieved state of the art performance ...
research
08/26/2020

Learning Robust Node Representation on Graphs

Graph neural networks (GNN), as a popular methodology for node represent...
research
07/24/2023

MARIO: Model Agnostic Recipe for Improving OOD Generalization of Graph Contrastive Learning

In this work, we investigate the problem of out-of-distribution (OOD) ge...
research
04/29/2022

RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learning

Graph contrastive learning has gained significant progress recently. How...

Please sign up or login with your details

Forgot password? Click here to reset