Semi-supervised Keypoint Localization

01/20/2021
by   Olga Moskvyak, et al.
0

Knowledge about the locations of keypoints of an object in an image can assist in fine-grained classification and identification tasks, particularly for the case of objects that exhibit large variations in poses that greatly influence their visual appearance, such as wild animals. However, supervised training of a keypoint detection network requires annotating a large image dataset for each animal species, which is a labor-intensive task. To reduce the need for labeled data, we propose to learn simultaneously keypoint heatmaps and pose invariant keypoint representations in a semi-supervised manner using a small set of labeled images along with a larger set of unlabeled images. Keypoint representations are learnt with a semantic keypoint consistency constraint that forces the keypoint detection network to learn similar features for the same keypoint across the dataset. Pose invariance is achieved by making keypoint representations for the image and its augmented copies closer together in feature space. Our semi-supervised approach significantly outperforms previous methods on several benchmarks for human and animal body landmark localization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2022

Pseudo-Labeled Auto-Curriculum Learning for Semi-Supervised Keypoint Localization

Localizing keypoints of an object is a basic visual problem. However, su...
research
03/30/2023

Few-shot Geometry-Aware Keypoint Localization

Supervised keypoint localization methods rely on large manually labeled ...
research
06/16/2022

TUSK: Task-Agnostic Unsupervised Keypoints

Existing unsupervised methods for keypoint learning rely heavily on the ...
research
01/27/2018

Fine-grained Visual Categorization using PAIRS: Pose and Appearance Integration for Recognizing Subcategories

In Fine-grained Visual Categorization (FGVC), the differences between si...
research
12/12/2021

Few-shot Keypoint Detection with Uncertainty Learning for Unseen Species

Current non-rigid object keypoint detectors perform well on a chosen kin...
research
09/29/2020

CoKe: Localized Contrastive Learning for Robust Keypoint Detection

Today's most popular approaches to keypoint detection learn a holistic r...
research
12/16/2021

Coherence Learning using Keypoint-based Pooling Network for Accurately Assessing Radiographic Knee Osteoarthritis

Knee osteoarthritis (OA) is a common degenerate joint disorder that affe...

Please sign up or login with your details

Forgot password? Click here to reset