research
∙
08/28/2023
HoloFusion: Towards Photo-realistic 3D Generative Modeling
Diffusion-based image generators can now produce high-quality and divers...
share
research
∙
07/27/2023
Online Clustered Codebook
Vector Quantisation (VQ) is experiencing a comeback in machine learning,...
research
∙
07/22/2023
Replay: Multi-modal Multi-view Acted Videos for Casual Holography
We introduce Replay, a collection of multi-view, multi-modal videos of h...
research
∙
07/14/2023
CoTracker: It is Better to Track Together
Methods for video motion prediction either estimate jointly the instanta...
research
∙
06/15/2023
Diffusion Models for Zero-Shot Open-Vocabulary Segmentation
The variety of objects in the real world is nearly unlimited and is thus...
research
∙
06/14/2023
EPIC Fields: Marrying 3D Geometry and Video Understanding
Neural rendering is fuelling a unification of learning, 3D geometry and ...
research
∙
06/13/2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data
We present Viewset Diffusion: a framework for training image-conditioned...
research
∙
06/07/2023
Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusion
Instance segmentation in 3D is a challenging task due to the lack of lar...
research
∙
05/03/2023
DynamicStereo: Consistent Dynamic Depth from Stereo Videos
We consider the problem of reconstructing a dynamic scene observed from ...
research
∙
04/20/2023
Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusion
We present Farm3D, a method to learn category-specific 3D reconstructors...
research
∙
04/13/2023
What does CLIP know about a red circle? Visual prompt engineering for VLMs
Large-scale Vision-Language Models, such as CLIP, learn powerful image-t...
research
∙
04/06/2023
Training-Free Layout Control with Cross-Attention Guidance
Recent diffusion-based generators can produce high-quality images based ...
research
∙
04/06/2023
Continual Detection Transformer for Incremental Object Detection
Incremental object detection (IOD) aims to train an object detector in p...
research
∙
03/29/2023
HoloDiffusion: Training a 3D Diffusion Model using 2D Images
Diffusion models have emerged as the best approach for generative modeli...
research
∙
03/21/2023
Real-time volumetric rendering of dynamic humans
We present a method for fast 3D reconstruction and real-time rendering o...
research
∙
02/21/2023
PC^2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstruction
Reconstructing the 3D shape of an object from a single RGB image is a lo...
research
∙
02/21/2023
RealFusion: 360° Reconstruction of Any Object from a Single Image
We consider the problem of reconstructing a full 360 photographic model ...
research
∙
01/20/2023
Novel-View Acoustic Synthesis
We introduce the novel-view acoustic synthesis (NVAS) task: given the si...
research
∙
12/06/2022
Self-Supervised Correspondence Estimation via Multiview Registration
Video provides us with the spatio-temporal consistency needed for visual...
research
∙
11/22/2022
MagicPony: Learning Articulated 3D Animals in the Wild
We consider the problem of learning a function that can estimate the 3D ...
research
∙
11/07/2022
Common Pets in 3D: Dynamic New-View Synthesis of Real-Life Deformable Categories
Obtaining photorealistic reconstructions of objects from sparse views is...
research
∙
10/21/2022
Unsupervised Multi-object Segmentation by Predicting Probable Motion Patterns
We propose a new approach to learn to segment multiple image objects wit...
research
∙
09/07/2022
Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations
We present Neural Feature Fusion Fields (N3F), a method that improves de...
research
∙
09/07/2022
Measuring the Interpretability of Unsupervised Representations via Quantized Reverse Probing
Self-supervised visual representation learning has recently attracted si...
research
∙
06/13/2022
SNeS: Learning Probably Symmetric Neural Surfaces from Incomplete Data
We present a method for the accurate 3D reconstruction of partly-symmetr...
research
∙
05/16/2022
Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion
Motion, measured via optical flow, provides a powerful cue to discover a...
research
∙
05/16/2022
Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization
Unsupervised localization and segmentation are long-standing computer vi...
research
∙
01/07/2022
Generalized Category Discovery
In this paper, we consider a highly general image recognition setting wh...
research
∙
12/23/2021
BANMo: Building Animatable 3D Neural Models from Many Casual Videos
Prior work for articulated 3D shape reconstruction often relies on speci...
research
∙
12/08/2021
Audio-Visual Synchronisation in the wild
In this paper, we consider the problem of audio-visual synchronisation a...
research
∙
11/11/2021
Unsupervised Part Discovery from Contrastive Reconstruction
The goal of self-supervised visual representation learning is to learn s...
research
∙
11/05/2021
The Curious Layperson: Fine-Grained Image Recognition without Expert Labels
Most of us are not experts in specific fields, such as ornithology. None...
research
∙
10/19/2021
NeuralDiff: Segmenting 3D objects that move in egocentric videos
Given a raw video sequence taken from a freely-moving camera, we study t...
research
∙
10/12/2021
Open-Set Recognition: A Good Closed-Set Classifier is All You Need
The ability to identify whether or not a test sample belongs to one of t...
research
∙
09/27/2021
PASS: An ImageNet replacement for self-supervised pretraining without humans
Computer vision has long relied on ImageNet and other large datasets of ...
research
∙
09/16/2021
Real Time Monocular Vehicle Velocity Estimation using Synthetic Data
Vision is one of the primary sensing modalities in autonomous driving. I...
research
∙
09/16/2021
Lifting 2D Object Locations to 3D by Discounting LiDAR Outliers across Objects and Views
We present a system for automatic converting of 2D mask object predictio...
research
∙
08/31/2021
DensePose 3D: Lifting Canonical Surface Maps of Articulated Objects to the Third Dimension
We tackle the problem of monocular 3D reconstruction of articulated obje...
research
∙
07/22/2021
DOVE: Learning Deformable 3D Objects by Watching Videos
Learning deformable 3D objects from 2D images is an extremely ill-posed ...
research
∙
06/29/2021
AutoNovel: Automatically Discovering and Learning Novel Visual Categories
We tackle the problem of discovering novel classes in an image collectio...
research
∙
06/17/2021
Discovering Relationships between Object Categories via Universal Canonical Maps
We tackle the problem of learning the geometry of multiple categories of...
research
∙
06/17/2021
NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go
We present NeuroMorph, a new neural network architecture that takes as i...
research
∙
06/15/2021
Predicting Unreliable Predictions by Shattering a Neural Network
Piecewise linear neural networks can be split into subfunctions, each wi...
research
∙
06/09/2021
Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers
In video transformers, the time dimension is often treated in the same w...
research
∙
05/17/2021
Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models
Recent research has shown that numerous human-interpretable directions e...
research
∙
05/05/2021
Moving SLAM: Fully Unsupervised Deep Learning in Non-Rigid Scenes
We propose a method to train deep networks to decompose videos into 3D g...
research
∙
04/13/2021
Self-supervised object detection from audio-visual correspondence
We tackle the problem of learning object detectors without supervision. ...
research
∙
04/06/2021
Localizing Visual Sounds the Hard Way
The objective of this work is to localize sound sources that are visible...
research
∙
03/30/2021
Unsupervised Learning of 3D Object Categories from Videos in the Wild
Our goal is to learn a deep network that, given a small number of images...
research
∙
03/18/2021