Feedback Graph Convolutional Network for Skeleton-based Action Recognition

by   Hao Yang, et al.

Skeleton-based action recognition has attracted considerable attention in computer vision since skeleton data is more robust to the dynamic circumstance and complicated background than other modalities. Recently, many researchers have used the Graph Convolutional Network (GCN) to model spatial-temporal features of skeleton sequences by an end-to-end optimization. However, conventional GCNs are feedforward networks which are impossible for low-level layers to access semantic information in the high-level layers. In this paper, we propose a novel network, named Feedback Graph Convolutional Network (FGCN). This is the first work that introduces the feedback mechanism into GCNs and action recognition. Compared with conventional GCNs, FGCN has the following advantages: (1) a multi-stage temporal sampling strategy is designed to extract spatial-temporal features for action recognition in a coarse-to-fine progressive process; (2) A dense connections based Feedback Graph Convolutional Block (FGCB) is proposed to introduce feedback connections into the GCNs. It transmits the high-level semantic features to the low-level layers and flows temporal information stage by stage to progressively model global spatial-temporal features for action recognition; (3) The FGCN model provides early predictions. In the early stages, the model receives partial information about actions. Naturally, its predictions are relatively coarse. The coarse predictions are treated as the prior to guide the feature learning of later stages for a accurate prediction. Extensive experiments on the datasets, NTU-RGB+D, NTU-RGB+D120 and Northwestern-UCLA, demonstrate that the proposed FGCN is effective for action recognition. It achieves the state-of-the-art performance on the three datasets.


page 1

page 2

page 3

page 4


Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Graph convolutional networks (GCNs), which can model the human body skel...

Improving Skeleton-based Action Recognitionwith Robust Spatial and Temporal Features

Recently skeleton-based action recognition has made signif-icant progres...

Multi-Dimensional Refinement Graph Convolutional Network with Robust Decouple Loss for Fine-Grained Skeleton-Based Action Recognition

Graph convolutional networks have been widely used in skeleton-based act...

RFC-HyPGCN: A Runtime Sparse Feature Compress Accelerator for Skeleton-Based GCNs Action Recognition Model with Hybrid Pruning

Skeleton-based Graph Convolutional Networks (GCNs) models for action rec...

Adaptive Local-Component-aware Graph Convolutional Network for One-shot Skeleton-based Action Recognition

Skeleton-based action recognition receives increasing attention because ...

Video Is Graph: Structured Graph Module for Video Action Recognition

In the field of action recognition, video clips are always treated as or...

SC4D: A Sparse 4D Convolutional Network for Skeleton-Based Action Recognition

In this paper, a new perspective is presented for skeleton-based action ...

Please sign up or login with your details

Forgot password? Click here to reset