research
∙
08/09/2023
Evaluating the Generation Capabilities of Large Chinese Language Models
This paper presents CG-Eval, the first comprehensive evaluation of the g...
share
research
∙
07/31/2023
AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?
Can we better anticipate an actor's future actions (e.g. mix eggs) by kn...
research
∙
07/17/2023
Does Visual Pretraining Help End-to-End Reasoning?
We aim to investigate whether end-to-end learning of visual reasoning ca...
research
∙
07/13/2023
NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception
Multi-agent multi-lidar sensor fusion between connected vehicles for coo...
research
∙
07/07/2023
Goal-Conditioned Predictive Coding as an Implicit Planner for Offline Reinforcement Learning
Recent work has demonstrated the effectiveness of formulating decision m...
research
∙
07/07/2023
Federated Learning over a Wireless Network: Distributed User Selection through Random Access
User selection has become crucial for decreasing the communication costs...
research
∙
06/20/2023
Dense Video Object Captioning from Disjoint Supervision
We propose a new task and model for dense video object captioning – dete...
research
∙
06/20/2023
How can objects help action recognition?
Current state-of-the-art video models process a video clip as a long seq...
research
∙
06/15/2023
Winning Solution for the CVPR2023 Visual Anomaly and Novelty Detection Challenge: Multimodal Prompting for Data-centric Anomaly Detection
This technical report introduces the winning solution of the team \texti...
research
∙
06/13/2023
AVIS: Autonomous Visual Information Seeking with Large Language Models
In this paper, we propose an autonomous information seeking visual quest...
research
∙
05/18/2023
Segment Any Anomaly without Training via Hybrid Prompt Regularization
We present a novel framework, i.e., Segment Any Anomaly + (SAA+), for ze...
research
∙
04/24/2023
End-to-End Spatio-Temporal Action Localisation with Video Transformers
The most performant spatio-temporal action localisation models use exter...
research
∙
03/22/2023
Reconfigurable Intelligent Surface-aided Secret Key Generation in Multi-Cell Systems
Physical-layer key generation (PKG) exploits the reciprocity and randomn...
research
∙
03/14/2023
Blockchain Based Spectrum Sharing
Spectrum sharing has long been considered as method to improve spectrum ...
research
∙
03/08/2023
Comparing Trajectory and Vision Modalities for Verb Representation
Three-dimensional trajectories, or the 3D position and rotation of objec...
research
∙
02/22/2023
Steerable Equivariant Representation Learning
Pre-trained deep image representations are useful for post-training task...
research
∙
01/25/2023
DEJA VU: Continual Model Generalization For Unseen Domains
In real-world applications, deep learning models often run in non-statio...
research
∙
12/10/2022
REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge Memory
In this paper, we propose an end-to-end Retrieval-Augmented Visual Langu...
research
∙
10/12/2022
Contrastive introspection (ConSpec) to rapidly identify invariant steps for success
Reinforcement learning (RL) algorithms have achieved notable success in ...
research
∙
09/01/2022
A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detection
Surface defect detection is one of the most essential processes for indu...
research
∙
08/14/2022
TL;DW? Summarizing Instructional Videos with Task Relevance Cross-Modal Saliency
YouTube users looking for instructions for a specific task may spend a l...
research
∙
07/08/2022
Beyond Transfer Learning: Co-finetuning for Action Localisation
Transfer learning is the predominant paradigm for training deep networks...
research
∙
06/23/2022
Do Trajectories Encode Verb Meaning?
Distributional models learn representations of words from text, but are ...
research
∙
06/15/2022
AVATAR: Unconstrained Audiovisual Speech Recognition
Audio-visual automatic speech recognition (AV-ASR) is an extension of AS...
research
∙
04/01/2022
Learning Audio-Video Modalities from Image Captions
A major challenge in text-video and text-audio retrieval is the lack of ...
research
∙
03/31/2022
Do Vision-Language Pretrained Models Learn Primitive Concepts?
Vision-language pretrained models have achieved impressive performance o...
research
∙
01/31/2022
Trajectory Balance: Improved Credit Assignment in GFlowNets
Generative Flow Networks (GFlowNets) are a method for learning a stochas...
research
∙
11/01/2021
Masking Modalities for Cross-modal Video Retrieval
Pre-training on large scale unlabelled datasets has shown impressive per...
research
∙
09/21/2021
Does Vision-and-Language Pretraining Improve Lexical Grounding?
Linguistic representations derived from text alone have been criticized ...
research
∙
08/22/2021
DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
Due to the stochasticity of human behaviors, predicting the future traje...
research
∙
07/06/2021
Discrete-Valued Neural Communication
Deep learning has advanced from fully connected architectures to structu...
research
∙
06/30/2021
Attention Bottlenecks for Multimodal Fusion
Humans perceive the world by concurrently processing and fusing high-dim...
research
∙
06/28/2021
HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps
High Definition (HD) maps are maps with precise definitions of road lane...
research
∙
05/13/2021
Episodic Transformer for Vision-and-Language Navigation
Interaction and navigation defined by natural language instructions in d...
research
∙
04/06/2021
Local Metrics for Multi-Object Tracking
This paper introduces temporally local metrics for Multi-Object Tracking...
research
∙
04/01/2021
Composable Augmentation Encoding for Video Representation Learning
We focus on contrastive methods for self-supervised video representation...
research
∙
03/29/2021
ViViT: A Video Vision Transformer
We present pure-transformer based models for video classification, drawi...
research
∙
03/29/2021
Unified Graph Structured Models for Video Understanding
Accurate video understanding involves reasoning about the relationships ...
research
∙
01/07/2021
Learning Temporal Dynamics from Cycles in Narrated Video
Learning to model how the world changes as time elapses has proven a cha...
research
∙
09/19/2020
Sum Secret Key Rate Maximization for TDD Multi-User Massive MIMO Wireless Networks
Physical-layer key generation (PKG) based on channel reciprocity has rec...
research
∙
08/19/2020
TNT: Target-driveN Trajectory Prediction
Predicting the future behavior of moving agents is essential for real wo...
research
∙
07/29/2020
Learning Video Representations from Textual Web Supervision
Videos found on the Internet are paired with pieces of text, such as tit...
research
∙
07/21/2020
Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Despite the recent advances in video classification, progress in spatio-...
research
∙
07/21/2020
Multi-modal Transformer for Video Retrieval
The task of retrieving video content relevant to natural language querie...
research
∙
05/20/2020
What makes for good views for contrastive learning
Contrastive learning between multiple views of the data has recently ach...
research
∙
05/18/2020
Beam-Domain Secret Key Generation for Multi-User Massive MIMO Networks
Physical-layer key generation (PKG) in multi-user massive MIMO networks ...
research
∙
05/08/2020
VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation
Behavior prediction in dynamic, multi-agent systems is an important prob...
research
∙
03/30/2020
Speech2Action: Cross-modal Supervision for Action Recognition
Is it possible to guess human action from dialogue alone? In this work w...
research
∙
06/19/2019
Unsupervised Learning of Object Structure and Dynamics from Videos
Extracting and predicting object structure and dynamics from videos with...
research
∙
06/13/2019