b'Hanwang Zhang'

research

∙ 09/17/2023

Towards Debiasing Frame Length Bias in Text-Video Retrieval via Causal Intervention

Many studies focus on improving pretraining or developing new backbones ...

0 Burak Satar, et al. ∙

research

∙ 08/26/2023

Empowering Dynamics-aware Text-to-Video Diffusion with Large Language Models

Text-to-video (T2V) synthesis has gained increasing attention in the com...

0 Hao Fei, et al. ∙

research

∙ 08/18/2023

Invariant Training 2D-3D Joint Hard Samples for Few-Shot Point Cloud Recognition

We tackle the data scarcity challenge in few-shot point cloud recognitio...

0 Xuanyu Yi, et al. ∙

research

∙ 08/08/2023

Empowering Vision-Language Models to Follow Interleaved Vision-Language Instructions

Multimodal Large Language Models (MLLMs) have recently sparked significa...

0 Juncheng Li, et al. ∙

research

∙ 07/17/2023

Random Boxes Are Open-world Object Detectors

We show that classifiers trained with random region proposals achieve st...

0 Yanghao Wang, et al. ∙

research

∙ 06/30/2023

DisCo: Disentangled Control for Referring Human Dance Generation in Real World

Generative AI has made significant strides in computer vision, particula...

0 Tan Wang, et al. ∙

research

∙ 06/12/2023

Fast Diffusion Model

Despite their success in real data synthesis, diffusion models (DMs) oft...

0 Zike Wu, et al. ∙

research

∙ 06/07/2023

An Overview of Challenges in Egocentric Text-Video Retrieval

Text-video retrieval contains various challenges, including biases comin...

0 Burak Satar, et al. ∙

research

∙ 05/23/2023

Decoupled Kullback-Leibler Divergence Loss

In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence...

0 Jiequan Cui, et al. ∙

research

∙ 03/25/2023

Equivariant Similarity for Vision-Language Foundation Models

This study explores the concept of equivariance in vision-language found...

0 Tan Wang, et al. ∙

research

∙ 03/22/2023

Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection

Weakly Supervised Video Anomaly Detection (WSVAD) is challenging because...

0 Hui Lv, et al. ∙

research

∙ 03/17/2023

Semantic Scene Completion with Cleaner Self

Semantic Scene Completion (SSC) transforms an image of single-view depth...

0 Fengyun Wang, et al. ∙

research

∙ 01/29/2023

Debiased Fine-Tuning for Vision-language Models by Prompt Regularization

We present a new paradigm for fine-tuning large-scale visionlanguage pre...

0 Beier Zhu, et al. ∙

research

∙ 01/05/2023

Adaptively Clustering Neighbor Elements for Image Captioning

We design a novel global-local Transformer named Ada-ClustFormer (ACF) t...

0 Zihua Wang, et al. ∙

research

∙ 01/05/2023

Learning Trajectory-Word Alignments for Video-Language Tasks

Aligning objects with words plays a critical role in Image-Language BERT...

0 Xu Yang, et al. ∙

research

∙ 11/23/2022

Evaluating and Mitigating Static Bias of Action Representations in the Background and the Foreground

Deep neural networks for video action recognition easily learn to utiliz...

0 Haoxin Li, et al. ∙

research

∙ 11/20/2022

Attention-based Class Activation Diffusion for Weakly-Supervised Semantic Segmentation

Extracting class activation maps (CAM) is a key step for weakly-supervis...

0 Jianqiang Huang, et al. ∙

research

∙ 10/23/2022

Respecting Transfer Gap in Knowledge Distillation

Knowledge distillation (KD) is essentially a process of transferring a t...

0 Yulei Niu, et al. ∙

research

∙ 10/04/2022

Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning

Humans tend to decompose a sentence into different parts like sth do sth...

0 Xu Yang, et al. ∙

research

∙ 08/06/2022

Class Is Invariant to Context and Vice Versa: On Learning Invariance for Out-Of-Distribution Generalization

Out-Of-Distribution generalization (OOD) is all about learning invarianc...

0 Jiaxin Qi, et al. ∙

research

∙ 07/27/2022

Identifying Hard Noise in Long-Tailed Sample Distribution

Conventional de-noising methods rely on the assumption that all samples ...

0 Xuanyu Yi, et al. ∙

research

∙ 07/27/2022

NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation

Nearly all existing scene graph generation (SGG) models have overlooked ...

2 Lin Li, et al. ∙

research

∙ 07/25/2022

Equivariance and Invariance Inductive Bias for Learning from Insufficient Data

We are interested in learning robust models from insufficient data, with...

0 Tan Wang, et al. ∙

research

∙ 07/19/2022

Invariant Feature Learning for Generalized Long-Tailed Classification

Existing long-tailed classification (LT) methods only focus on tackling ...

0 Kaihua Tang, et al. ∙

research

∙ 06/29/2022

On Non-Random Missing Labels in Semi-Supervised Learning

Semi-Supervised Learning (SSL) is fundamentally a missing label problem,...

0 Xinting Hu, et al. ∙

research

∙ 06/29/2022

Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022

In this report, we present our approach for EPIC-KITCHENS-100 Multi-Inst...

0 Burak Satar, et al. ∙

research

∙ 06/26/2022

RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval

Seas of videos are uploaded daily with the popularity of social channels...

0 Burak Satar, et al. ∙

research

∙ 05/30/2022

Prompt-aligned Gradient for Prompt Tuning

Thanks to the large pre-trained vision-language models (VLMs) like CLIP,...

0 Beier Zhu, et al. ∙

research

∙ 05/24/2022

Certified Robustness Against Natural Language Attacks by Causal Intervention

Deep learning models have achieved great success in many fields, yet the...

0 Haiteng Zhao, et al. ∙

research

∙ 03/02/2022

Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation

Extracting class activation maps (CAM) is arguably the most standard ste...

0 Zhaozheng Chen, et al. ∙

research

∙ 12/31/2021

Deconfounded Visual Grounding

We focus on the confounding bias between language and location in the vi...

1 Jianqiang Huang, et al. ∙

research

∙ 12/29/2021

Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification

We address the overlooked unbiasedness in existing long-tailed classific...

0 Beier Zhu, et al. ∙

research

∙ 12/22/2021

How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?

The fine-tuning of pre-trained language models has a great success in ma...

0 Xinhsuai Dong, et al. ∙

research

∙ 11/01/2021

Introspective Distillation for Robust Question Answering

Question answering (QA) models are well-known to exploit data bias, e.g....

0 Yulei Niu, et al. ∙

research

∙ 10/28/2021

Self-Supervised Learning Disentangled Group Representation as Feature

A good visual representation is an inference map from observations (imag...

0 Tan Wang, et al. ∙

research

∙ 10/03/2021

Counterfactual Samples Synthesizing and Training for Robust Visual Question Answering

Today's VQA models still tend to capture superficial linguistic correlat...

0 Long Chen, et al. ∙

research

∙ 08/24/2021

Auto-Parsing Network for Image Captioning and Visual Question Answering

We propose an Auto-Parsing Network (APN) to discover and exploit the inp...

0 Xu Yang, et al. ∙

research

∙ 08/19/2021

Causal Attention for Unbiased Visual Recognition

Attention module does not always help deep models learn causal features ...

0 Tan Wang, et al. ∙

research

∙ 07/23/2021

Transporting Causal Mechanisms for Unsupervised Domain Adaptation

Existing Unsupervised Domain Adaptation (UDA) literature adopts the cova...

0 Zhongqi Yue, et al. ∙

research

∙ 06/17/2021

Adversarial Visual Robustness by Causal Intervention

Adversarial training is the de facto most promising defense against adve...

0 Kaihua Tang, et al. ∙

research

∙ 06/06/2021

Empowering Language Understanding with Counterfactual Reasoning

Present language understanding methods have demonstrated extraordinary a...

0 Fuli Feng, et al. ∙

research

∙ 05/12/2021

VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching

The prevailing framework for matching multimodal inputs is based on a tw...

0 Wenbo Ma, et al. ∙

research

∙ 04/15/2021

TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graph

Multi-hop Question Answering (QA) is a challenging task because it requi...

0 Jiaxin Shi, et al. ∙

research

∙ 03/24/2021

The Blessings of Unlabeled Background in Untrimmed Videos

Weakly-supervised Temporal Action Localization (WTAL) aims to detect the...

0 Yuan Liu, et al. ∙

research

∙ 03/05/2021

Causal Attention for Vision-Language Tasks

We present a novel attention mechanism: Causal Attention (CATT), to remo...

0 Xu Yang, et al. ∙

research

∙ 03/02/2021

Distilling Causal Effect of Data in Class-Incremental Learning

We propose a causal framework to explain the catastrophic forgetting in ...

1 Xinting Hu, et al. ∙

research

∙ 03/01/2021

Counterfactual Zero-Shot and Open-Set Visual Recognition

We present a novel counterfactual framework for both Zero-Shot Learning ...

0 Zhongqi Yue, et al. ∙

research

∙ 09/28/2020

Interventional Few-Shot Learning

We uncover an ever-overlooked deficiency in the prevailing Few-Shot Lear...

0 Zhongqi Yue, et al. ∙

research

∙ 09/28/2020

Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect

As the class size grows, maintaining a balanced dataset across many clas...

0 Kaihua Tang, et al. ∙

research

∙ 09/26/2020

Causal Intervention for Weakly-Supervised Semantic Segmentation

We present a causal inference framework to improve Weakly-Supervised Sem...

1 Dong Zhang, et al. ∙

Hanwang Zhang

Featured Co-authors