research
∙
08/18/2023
Diff2Lip: Audio Conditioned Diffusion Models for Lip-Synchronization
The task of lip synchronization (lip-sync) seeks to match the lips of hu...
share
research
∙
05/28/2023
SimpSON: Simplifying Photo Cleanup with Single-Click Distracting Object Segmentation Network
In photo editing, it is common practice to remove visual distractions to...
research
∙
04/11/2023
MOST: Multiple Object localization with Self-supervised Transformers for object discovery
We tackle the challenging task of unsupervised object localization in th...
research
∙
04/05/2023
HNeRV: A Hybrid Neural Representation for Videos
Implicit neural representations store videos as neural networks and have...
research
∙
03/28/2023
ASIC: Aligning Sparse in-the-wild Image Collections
We present a method for joint alignment of sparse in-the-wild image coll...
research
∙
03/25/2023
FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views
We present FlexNeRF, a method for photorealistic freeviewpoint rendering...
research
∙
03/24/2023
Towards Scalable Neural Representation for Diverse Videos
Implicit neural representations (INR) have gained increasing attention i...
research
∙
03/13/2023
Align and Attend: Multimodal Summarization with Dual Contrastive Losses
The goal of multimodal summarization is to extract the most important in...
research
∙
02/15/2023
COVID-VTS: Fact Extraction and Verification on Short Video Platforms
We introduce a new benchmark, COVID-VTS, for fact-checking multi-modal i...
research
∙
12/07/2022
Teaching Matters: Investigating the Role of Supervision in Vision Transformers
Vision Transformers (ViTs) have gained significant popularity in recent ...
research
∙
11/18/2022
CNeRV: Content-adaptive Neural Representation for Visual Data
Compression and reconstruction of visual data have been widely studied i...
research
∙
11/08/2022
BT^2: Backward-compatible Training with Basis Transformation
Modern retrieval system often requires recomputing the representation of...
research
∙
06/16/2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning
By leveraging contrastive learning, clustering, and other pretext tasks,...
research
∙
05/17/2022
Disentangling Visual Embeddings for Attributes and Objects
We study the problem of compositional zero-shot learning for object-attr...
research
∙
04/18/2022
Neural Space-filling Curves
We present Neural Space-filling Curves (SFCs), a data-driven approach to...
research
∙
04/06/2022
LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification
We introduce LilNetX, an end-to-end trainable technique for neural netwo...
research
∙
03/29/2022
ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localization
Weakly-supervised temporal action localization aims to recognize and loc...
research
∙
03/28/2022
ObjectFormer for Image Manipulation Detection and Localization
Recent advances in image editing techniques have posed serious challenge...
research
∙
03/08/2022
Occupancy Map Prediction for Improved Indoor Robot Navigation
In the typical path planning pipeline for a ground robot, we build a map...
research
∙
01/31/2022
Leveraging Bitstream Metadata for Fast and Accurate Video Compression Correction
Video compression is a central feature of the modern internet powering t...
research
∙
01/12/2022
Sparsely Annotated Object Detection: A Region-based Semi-supervised Approach
Research shows a noticeable drop in performance of object detectors when...
research
∙
12/14/2021
Dual-Key Multimodal Backdoors for Visual Question Answering
The success of deep learning has enabled advances in multimodal tasks th...
research
∙
12/08/2021
Burn After Reading: Online Adaptation for Cross-domain Streaming Data
In the context of online privacy, many methods propose complex privacy a...
research
∙
11/02/2021
PatchGame: Learning to Signal Mid-level Patches in Referential Games
We study a referential game (a type of signaling game) where two agents ...
research
∙
10/26/2021
A Frequency Perspective of Adversarial Robustness
Adversarial examples pose a unique challenge for deep learning systems. ...
research
∙
10/26/2021
NeRV: Neural Representations for Videos
We propose a novel neural representation for videos (NeRV) which encodes...
research
∙
10/26/2021
HR-RCNN: Hierarchical Relational Reasoning for Object Detection
Incorporating relational reasoning in neural networks for object recogni...
research
∙
07/09/2021
Diverse Video Generation using a Gaussian Process Trigger
Generating future frames given a few context (or past) frames is a chall...
research
∙
06/17/2021
No-frills Dynamic Planning using Static Planners
In this paper, we address the task of interacting with dynamic environme...
research
∙
06/17/2021
Learning to Predict Visual Attributes in the Wild
Visual attributes constitute a large portion of information contained in...
research
∙
06/01/2021
Rethinking Pseudo Labels for Semi-Supervised Object Detection
Recent advances in semi-supervised object detection (SSOD) are largely d...
research
∙
05/10/2021
Towards Discovery and Attribution of Open-world GAN Generated Images
With the recent progress in Generative Adversarial Networks (GANs), it i...
research
∙
05/04/2021
The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memory
We tackle object category discovery, which is the problem of discovering...
research
∙
04/29/2021
Learned Spatial Representations for Few-shot Talking-Head Synthesis
We propose a novel approach for few-shot talking-head synthesis. While r...
research
∙
04/14/2021
StEP: Style-based Encoder Pre-training for Multi-modal Image Synthesis
We propose a novel approach for multi-modal Image-to-image (I2I) transla...
research
∙
03/09/2021
Knowledge Evolution in Neural Networks
Deep learning relies on the availability of a large corpus of data (labe...
research
∙
03/04/2021
SVMax: A Feature Embedding Regularizer
A neural network regularizer (e.g., weight decay) boosts performance by ...
research
∙
01/26/2021
Deep Video Inpainting Detection
This paper studies video inpainting detection, which localizes an inpain...
research
∙
12/29/2020
2D or not 2D? Adaptive 3D Convolution Selection for Efficient Video Recognition
3D convolutional networks are prevalent for video recognition. While ach...
research
∙
12/15/2020
GTA: Global Temporal Attention for Video Action Understanding
Self-attention learns pairwise interactions via dot products to model lo...
research
∙
12/08/2020
The Lottery Ticket Hypothesis for Object Recognition
Recognition tasks, such as object recognition and keypoint estimation, h...
research
∙
11/17/2020
Analyzing and Mitigating Compression Defects in Deep Learning
With the proliferation of deep learning methods, many computer vision pr...
research
∙
11/03/2020
Learning Visual Representations for Transfer Learning by Suppressing Texture
Recent literature has shown that features obtained from supervised train...
research
∙
10/16/2020
Pose And Joint-Aware Action Recognition
Most human action recognition systems typically consider static appearan...
research
∙
09/07/2020
Improved Modeling of 3D Shapes with Multi-view Depth Maps
We present a simple yet effective general-purpose framework for modeling...
research
∙
08/28/2020
All About Knowledge Graphs for Actions
Current action recognition systems require large amounts of training dat...
research
∙
07/24/2020
MiCo: Mixup Co-Training for Semi-Supervised Domain Adaptation
Semi-supervised domain adaptation (SSDA) aims to adapt models from a lab...
research
∙
07/23/2020
End-to-end Learning of Compressible Features
Pre-trained convolutional neural networks (CNNs) are powerful off-the-sh...
research
∙
07/19/2020
A Generic Visualization Approach for Convolutional Neural Networks
Retrieval networks are essential for searching and indexing. Compared to...
research
∙
07/02/2020