research
∙
03/31/2023
Zero-shot Referring Image Segmentation with Global-Local Context Features
Referring image segmentation (RIS) aims to find a segmentation mask give...
share
research
∙
03/29/2023
AVFormer: Injecting Vision into Frozen Speech Models for Zero-Shot AV-ASR
Audiovisual automatic speech recognition (AV-ASR) aims to improve the ro...
research
∙
03/25/2023
IFSeg: Image-free Semantic Segmentation via Vision-Language Model
Vision-language (VL) pre-training has recently gained much attention for...
research
∙
03/21/2023
CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation
Existing works on open-vocabulary semantic segmentation have utilized la...
research
∙
02/27/2023
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
In this work, we introduce Vid2Seq, a multi-modal single-stage dense eve...
research
∙
11/18/2022
AVATAR submission to the Ego4D AV Transcription Challenge
In this report, we describe our submission to the Ego4D AudioVisual (AV)...
research
∙
06/15/2022
AVATAR: Unconstrained Audiovisual Speech Recognition
Audio-visual automatic speech recognition (AV-ASR) is an extension of AS...
research
∙
04/01/2022
Learning Audio-Video Modalities from Image Captions
A major challenge in text-video and text-audio retrieval is the lack of ...
research
∙
01/20/2022
End-to-end Generative Pretraining for Multimodal Video Captioning
Recent video and language pretraining frameworks lack the ability to gen...
research
∙
12/10/2020
Look Before you Speak: Visually Contextualized Utterances
While most conversational AI systems focus on textual dialogue only, con...
research
∙
11/21/2019
Reinforcing an Image Caption Generator Using Off-Line Human Feedback
Human ratings are currently the most accurate way to assess the quality ...
research
∙
10/03/2019
Regularizing Neural Networks via Stochastic Branch Layers
We introduce a novel stochastic regularization technique for deep neural...
research
∙
09/28/2018
Confidence Calibration in Deep Neural Networks through Stochastic Inferences
We propose a generic framework to calibrate accuracy and confidence (sco...
research
∙
08/06/2018
CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Maps
Image geolocalization is the task of identifying the location depicted i...
research
∙
08/06/2018
Attentive Semantic Alignment with Offset-Aware Correlation Kernels
Semantic correspondence is the problem of establishing correspondences a...
research
∙
09/23/2017
Visual Reference Resolution using Attention Memory for Visual Dialog
Visual dialog is a task of answering a series of inter-dependent questio...
research
∙
12/06/2016
MarioQA: Answering Questions by Watching Gameplay Videos
We present a framework to analyze various aspects of models for video qu...
research
∙
06/08/2016
Progressive Attention Networks for Visual Attribute Prediction
We propose a novel attention model that can accurately attend to target ...
research
∙
11/18/2015