research
∙
07/17/2023
Video-Mined Task Graphs for Keystep Recognition in Instructional Videos
Procedural activity understanding requires perceiving human actions in t...
share
research
∙
06/06/2023
Learning to Ground Instructional Articles in Videos through Narrations
In this paper we present an approach for localizing steps of procedural ...
research
∙
05/09/2022
Scaling up sign spotting through sign language dictionaries
The focus of this work is sign spotting - given a video of an isolated s...
research
∙
12/08/2021
Audio-Visual Synchronisation in the wild
In this paper, we consider the problem of audio-visual synchronisation a...
research
∙
11/05/2021
BBC-Oxford British Sign Language Dataset
In this work, we introduce the BBC-Oxford British Sign Language (BOBSL) ...
research
∙
10/29/2021
Visual Keyword Spotting with Attention
In this paper, we consider the task of spotting spoken keywords in silen...
research
∙
10/14/2021
Sub-word Level Lip Reading With Visual Attention
The goal of this paper is to learn strong lip reading models that can re...
research
∙
05/06/2021
Aligning Subtitles in Sign Language Videos
The goal of this work is to temporally align asynchronous subtitles in s...
research
∙
04/13/2021
Self-supervised object detection from audio-visual correspondence
We tackle the problem of learning object detectors without supervision. ...
research
∙
04/06/2021
Localizing Visual Sounds the Hard Way
The objective of this work is to localize sound sources that are visible...
research
∙
03/30/2021
Read and Attend: Temporal Localisation in Sign Language Videos
The objective of this work is to annotate sign instances across a broad ...
research
∙
10/08/2020
Watch, read and lookup: learning to spot signs from multiple supervisors
The focus of this work is sign spotting - given a video of an isolated s...
research
∙
09/02/2020
Seeing wake words: Audio-visual Keyword Spotting
The goal of this work is to automatically determine whether and when a w...
research
∙
08/10/2020
Self-Supervised Learning of Audio-Visual Objects from Video
Our objective is to transform a video into a set of discrete audio-visua...
research
∙
07/23/2020
BSL-1K: Scaling up co-articulated sign language recognition using mouthing cues
Recent progress in fine-grained gesture and action classification, and m...
research
∙
07/02/2020
Spot the conversation: speaker diarisation in the wild
The goal of this paper is speaker diarisation of videos collected 'in th...
research
∙
11/28/2019
ASR is all you need: cross-modal distillation for lip reading
The goal of this work is to train strong models for visual speech recogn...
research
∙
07/11/2019
My lips are concealed: Audio-visual speech enhancement through obstructions
Our objective is an audio-visual model for separating a single speaker f...
research
∙
09/06/2018
Deep Audio-Visual Speech Recognition
The goal of this work is to recognise phrases and sentences being spoken...
research
∙
09/03/2018
LRS3-TED: a large-scale dataset for visual speech recognition
This paper introduces a new multi-modal dataset for visual and audio-vis...
research
∙
06/15/2018
Deep Lip Reading: a comparison of models and an online application
The goal of this paper is to develop state-of-the-art models for lip rea...
research
∙
04/11/2018
The Conversation: Deep Audio-Visual Speech Enhancement
Our goal is to isolate individual speakers from multi-talker simultaneou...
research
∙
05/24/2017
Counterfactual Multi-Agent Policy Gradients
Cooperative multi-agent systems can be naturally used to model many real...
research
∙
02/28/2017