Generating Features with Increased Crop-related Diversity for Few-Shot Object Detection

by   Jingyi Xu, et al.

Two-stage object detectors generate object proposals and classify them to detect objects in images. These proposals often do not contain the objects perfectly but overlap with them in many possible ways, exhibiting great variability in the difficulty levels of the proposals. Training a robust classifier against this crop-related variability requires abundant training data, which is not available in few-shot settings. To mitigate this issue, we propose a novel variational autoencoder (VAE) based data generation model, which is capable of generating data with increased crop-related diversity. The main idea is to transform the latent space such latent codes with different norms represent different crop-related variations. This allows us to generate features with increased crop-related diversity in difficulty levels by simply varying the latent norm. In particular, each latent code is rescaled such that its norm linearly correlates with the IoU score of the input crop w.r.t. the ground-truth box. Here the IoU score is a proxy that represents the difficulty level of the crop. We train this VAE model on base classes conditioned on the semantic code of each class and then use the trained model to generate features for novel classes. In our experiments our generated features consistently improve state-of-the-art few-shot object detection methods on the PASCAL VOC and MS COCO datasets.


page 1

page 12

page 13


Few-Shot Object Detection via Synthetic Features with Optimal Transport

Few-shot object detection aims to simultaneously localize and classify t...

Generating Representative Samples for Few-Shot Classification

Few-shot learning (FSL) aims to learn new categories with a few visual s...

Hallucination Improves Few-Shot Object Detection

Learning to detect novel objects from few annotated examples is of great...

Few-Shot Object Detection via Variational Feature Aggregation

As few-shot object detectors are often trained with abundant base sample...

Proposal Distribution Calibration for Few-Shot Object Detection

Adapting object detectors learned with sufficient supervision to novel c...

OS2D: One-Stage One-Shot Object Detection by Matching Anchor Features

In this paper, we consider the task of one-shot object detection, which ...

Latent-Space Inpainting for Packet Loss Concealment in Collaborative Object Detection

Edge devices, such as cameras and mobile units, are increasingly capable...

Please sign up or login with your details

Forgot password? Click here to reset