research
∙
06/06/2023
Active Sparse Conversations for Improved Audio-Visual Embodied Navigation
Efficient navigation towards an audio-goal necessitates an embodied agen...
share
research
∙
03/24/2023
Aligning Step-by-Step Instructional Diagrams to Video Demonstrations
Multimodal alignment facilitates the retrieval of instances from one mod...
research
∙
10/29/2022
Learning Audio-Visual Dynamics Using Scene Graphs for Audio Source Separation
There exists an unequivocal distinction between the sound produced by a ...
research
∙
10/22/2022
H-SAUR: Hypothesize, Simulate, Act, Update, and Repeat for Understanding Object Articulations from Interactions
The world is filled with articulated objects that are difficult to deter...
research
∙
10/14/2022
AVLEN: Audio-Visual-Language Embodied Navigation in 3D Environments
Recent years have seen embodied visual navigation advance in two distinc...
research
∙
02/18/2022
(2.5+1)D Spatio-Temporal Scene Graphs for Video Question Answering
Spatio-temporal scene-graph approaches to video-based reasoning tasks su...
research
∙
12/21/2021
Max-Margin Contrastive Learning
Standard contrastive learning approaches usually require a large number ...
research
∙
11/01/2021
MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation
Recent advances in generative adversarial networks (GANs) have led to re...
research
∙
10/13/2021
Audio-Visual Scene-Aware Dialog and Reasoning using Audio-Visual Transformers with Joint Student-Teacher Learning
In previous work, we have proposed the Audio-Visual Scene-Aware Dialog (...
research
∙
10/06/2021
A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Prediction
Predicting the future frames of a video is a challenging task, in part d...
research
∙
09/24/2021
Visual Scene Graphs for Audio Source Separation
State-of-the-art approaches for visually-guided audio source separation ...
research
∙
08/31/2021
InSeGAN: A Generative Approach to Segmenting Identical Instances in Depth Images
In this paper, we present InSeGAN, an unsupervised 3D generative adversa...
research
∙
06/24/2021
Generalized One-Class Learning Using Pairs of Complementary Classifiers
One-class learning is the classic problem of fitting a model to the data...
research
∙
04/13/2021
Learning Log-Determinant Divergences for Positive Definite Matrices
Representations in the form of Symmetric Positive Definite (SPD) matrice...
research
∙
10/06/2020
Optimizing Deep Neural Networks via Discretization of Finite-Time Convergent Flows
In this paper, we investigate in the context of deep neural networks, th...
research
∙
07/23/2020
Sound2Sight: Generating Visual Dynamics from Sound and Context
Learning associations across modalities is critical for robust multimoda...
research
∙
07/11/2020
Representation Learning via Adversarially-Contrastive Optimal Transport
In this paper, we study the problem of learning compact (low-dimensional...
research
∙
07/08/2020
Spatio-Temporal Scene Graphs for Video Dialog
The Audio-Visual Scene-aware Dialog (AVSD) task requires an agent to ind...
research
∙
06/15/2020
Dense Non-Rigid Structure from Motion: A Manifold Viewpoint
Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geome...
research
∙
04/28/2020
Inferring Temporal Compositions of Actions Using Probabilistic Automata
This paper presents a framework to recognize temporal compositions of at...
research
∙
04/06/2020
LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihood
Modern face alignment methods have become quite accurate at predicting t...
research
∙
01/17/2020
Spatio-Temporal Ranked-Attention Networks for Video Captioning
Generating video descriptions automatically is a challenging task that i...
research
∙
11/14/2019
The Eighth Dialog System Technology Challenge
This paper introduces the Eighth Dialog System Technology Challenge. In ...
research
∙
09/05/2019
Discriminative Video Representation Learning Using Support Vector Classifiers
Most popular deep models for action recognition in videos generate indep...
research
∙
08/16/2019
GODS: Generalized One-class Discriminative Subspaces for Anomaly Detection
One-class learning is the classic problem of fitting a model to data for...
research
∙
05/15/2019
Game Theoretic Optimization via Gradient-based Nikaido-Isoda Function
Computing Nash equilibrium (NE) of multi-player games has witnessed rene...
research
∙
01/25/2019
Audio-Visual Scene-Aware Dialog
We introduce the task of scene-aware dialog. Given a follow-up question ...
research
∙
07/24/2018
Learning Discriminative Video Representations Using Adversarial Perturbations
Adversarial perturbations are noise-like patterns that can subtly change...
research
∙
07/12/2018
Sem-GAN: Semantically-Consistent Image-to-Image Translation
Unpaired image-to-image translation is the problem of mapping an image i...
research
∙
06/21/2018
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features
Dialog systems need to understand dynamic visual scenes in order to have...
research
∙
06/01/2018
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7
Scene-aware dialog systems will be able to have conversations with users...
research
∙
03/27/2018
Non-Linear Temporal Subspace Representations for Activity Recognition
Representations that can compactly and effectively capture the temporal ...
research
∙
03/26/2018
Video Representation Learning Using Discriminative Pooling
Popular deep models for action recognition in videos generate independen...
research
∙
03/01/2018
Scalable Dense Non-rigid Structure-from-Motion: A Grassmannian Perspective
This paper addresses the task of dense non-rigid structure from motion (...
research
∙
01/26/2018
Neural Algebra of Classifiers
The world is fundamentally compositional, so it is natural to think of v...
research
∙
09/19/2017
Human Action Forecasting by Learning Task Grammars
For effective human-robot interaction, it is important that a robotic as...
research
∙
08/05/2017
Learning Discriminative Alpha-Beta-divergence for Positive Definite Matrices (Extended Version)
Symmetric positive definite (SPD) matrices are useful for capturing seco...
research
∙
07/24/2017
Human Pose Forecasting via Deep Markov Models
Human pose forecasting is an important problem in computer vision with a...
research
∙
05/24/2017
Sequence Summarization Using Order-constrained Kernelized Feature Subspaces
Representations that can compactly and effectively capture temporal evol...
research
∙
04/10/2017
DeepPermNet: Visual Permutation Learning
We present a principled approach to uncover the structure of visual data...
research
∙
04/07/2017
Generalized Rank Pooling for Activity Recognition
Most popular deep models for action recognition split video sequences in...
research
∙
04/06/2017
Action Representation Using Classifier Decision Boundaries
Most popular deep learning based models for action recognition are desig...
research
∙
01/19/2017
Higher-order Pooling of CNN Features via Kernel Linearization for Action Recognition
Most successful deep learning algorithms for action recognition extend m...
research
∙
01/12/2017
Ordered Pooling of Optical Flow Sequences for Action Recognition
Training of Convolutional Neural Networks (CNNs) on long video sequences...
research
∙
04/01/2016
Tensor Representations via Kernel Linearization for Action Recognition from 3D Skeletons (Extended Version)
In this paper, we explore tensor representations that can compactly capt...
research
∙
09/09/2015
Dictionary Learning and Sparse Coding for Third-order Super-symmetric Tensors
Super-symmetric tensors - a higher-order extension of scatter matrices -...
research
∙
07/10/2015