Brain Network Transformer

by   Xuan Kan, et al.

Human brains are commonly modeled as networks of Regions of Interest (ROIs) and their connections for the understanding of brain functions and mental disorders. Recently, Transformer-based models have been studied over different types of data, including graphs, shown to bring performance gains widely. In this work, we study Transformer-based models for brain network analysis. Driven by the unique properties of data, we model brain networks as graphs with nodes of fixed size and order, which allows us to (1) use connection profiles as node features to provide natural and low-cost positional information and (2) learn pair-wise connection strengths among ROIs with efficient attention weights across individuals that are predictive towards downstream analysis tasks. Moreover, we propose an Orthonormal Clustering Readout operation based on self-supervised soft clustering and orthonormal projection. This design accounts for the underlying functional modules that determine similar behaviors among groups of ROIs, leading to distinguishable cluster-aware node embeddings and informative graph embeddings. Finally, we re-standardize the evaluation pipeline on the only one publicly available large-scale brain network dataset of ABIDE, to enable meaningful comparison of different models. Experiment results show clear improvements of our proposed Brain Network Transformer on both the public ABIDE and our restricted ABCD datasets. The implementation is available at


page 1

page 2

page 3

page 4


Transformer-Based Hierarchical Clustering for Brain Network Analysis

Brain networks, graphical models such as those constructed from MRI, hav...

Beyond the Snapshot: Brain Tokenized Graph Transformer for Longitudinal Brain Functional Connectome Embedding

Under the framework of network-based neurodegeneration, brain functional...

Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

Human brains lie at the core of complex neurobiological systems, where t...

Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention

Functional connectivity (FC) between regions of the brain can be assesse...

Biologically Inspired Neural Path Finding

The human brain can be considered to be a graphical structure comprising...

Self-supervised Representation Learning of Neuronal Morphologies

Understanding the diversity of cell types and their function in the brai...

Multi-scale graph principal component analysis for connectomics

In brain connectomics, the cortical surface is parcellated into differen...

Please sign up or login with your details

Forgot password? Click here to reset