When Do We Need GNN for Node Classification?

10/30/2022
by   Sitao Luan, et al.
1

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically distributed () samples. Though GNNs are believed to outperform basic NNs in real-world tasks, it is found that in some cases, GNNs have little performance gain or even underperform graph-agnostic NNs. To identify these cases, based on graph signal processing and statistical hypothesis testing, we propose two measures which analyze the cases in which the edge bias in features and labels does not provide advantages. Based on the measures, a threshold value can be given to predict the potential performance advantages of graph-aware models over graph-agnostic models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2021

Is Heterophily A Real Nightmare For Graph Neural Networks To Do Node Classification?

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using...
research
12/16/2020

Edge Entropy as an Indicator of the Effectiveness of GNNs over CNNs for Node Classification

Graph neural networks (GNNs) extend convolutional neural networks (CNNs)...
research
09/09/2019

Learning Visual Dynamics Models of Rigid Objects using Relational Inductive Biases

Endowing robots with human-like physical reasoning abilities remains cha...
research
10/14/2022

Revisiting Heterophily For Graph Neural Networks

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using...
research
01/20/2021

Directed Acyclic Graph Neural Networks

Graph-structured data ubiquitously appears in science and engineering. G...
research
08/29/2020

Efficient Robustness Certificates for Discrete Data: Sparsity-Aware Randomized Smoothing for Graphs, Images and More

Existing techniques for certifying the robustness of models for discrete...
research
05/03/2023

Beyond Homophily: Reconstructing Structure for Graph-agnostic Clustering

Graph neural networks (GNNs) based methods have achieved impressive perf...

Please sign up or login with your details

Forgot password? Click here to reset