research
∙
09/18/2023
Multimodal Foundation Models: From Specialists to General-Purpose Assistants
This paper presents a comprehensive survey of the taxonomy and evolution...
share
research
∙
04/28/2023
An Empirical Study of Multimodal Model Merging
Model merging (e.g., via interpolation or task arithmetic) fuses multipl...
research
∙
11/21/2022
Exploring Discrete Diffusion Models for Image Captioning
The image captioning task is typically realized by an auto-regressive me...
research
∙
10/17/2022
Vision-Language Pre-training: Basics, Recent Advances, and Future Trends
This paper surveys vision-language pre-training (VLP) methods for multim...
research
∙
07/20/2022
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
In this paper, we present NUWA-Infinity, a generative model for infinite...
research
∙
11/24/2021
Scaling Up Vision-Language Pre-training for Image Captioning
In recent years, we have witnessed significant performance boost in the ...
research
∙
11/23/2021
Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling
In this paper, we propose UNICORN, a vision-language (VL) model that uni...
research
∙
11/03/2021
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Vision-and-language (VL) pre-training has proven to be highly effective ...
research
∙
06/01/2021
Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models
With large-scale pre-training, the past two years have witnessed signifi...
research
∙
04/30/2020
APo-VAE: Text Generation in Hyperbolic Space
Natural language often exhibits inherent hierarchical structure ingraine...
research
∙
11/10/2019
Distilling the Knowledge of BERT for Text Generation
Large-scale pre-trained language model, such as BERT, has recently achie...
research
∙
11/09/2019
Hierarchical Graph Network for Multi-hop Question Answering
In this paper, we present Hierarchical Graph Network (HGN) for multi-hop...
research
∙
09/04/2019
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
This paper presents a new metric called TIGEr for the automatic evaluati...
research
∙
02/01/2019
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog
This paper presents Recurrent Dual Attention Network (ReDAN) for visual ...
research
∙
12/20/2018
Sequential Attention GAN for Interactive Image Editing via Dialogue
In this paper, we introduce a new task - interactive image editing via c...
research
∙
11/28/2017
