research
∙
09/20/2023
StructChart: Perception, Structuring, Reasoning for Visual Chart Understanding
Charts are common in literature across different scientific fields, conv...
share
research
∙
09/19/2023
SPOT: Scalable 3D Pre-training via Occupancy Prediction for Autonomous Driving
Annotating 3D LiDAR point clouds for perception tasks including 3D objec...
research
∙
09/11/2023
UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebase
Point-, voxel-, and range-views are three representative forms of point ...
research
∙
09/11/2023
ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulation
Domain shifts such as sensor type changes and geographical situation var...
research
∙
09/08/2023
Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation
Modern displays are capable of rendering video content with high dynamic...
research
∙
09/07/2023
A-Eval: A Benchmark for Cross-Dataset Evaluation of Abdominal Multi-Organ Segmentation
Although deep learning have revolutionized abdominal multi-organ segment...
research
∙
09/07/2023
ImageBind-LLM: Multi-modality Instruction Tuning
We present ImageBind-LLM, a multi-modality instruction tuning method of ...
research
∙
08/30/2023
SAM-Med2D
The Segment Anything Model (SAM) represents a state-of-the-art research ...
research
∙
08/29/2023
DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior
We present DiffBIR, which leverages pretrained text-to-image diffusion m...
research
∙
08/25/2023
OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
Large language models (LLMs) have revolutionized natural language proces...
research
∙
08/21/2023
MGMAE: Motion Guided Masking for Video Masked Autoencoding
Masked autoencoding has shown excellent performance on self-supervised v...
research
∙
08/13/2023
Shrinking Class Space for Enhanced Certainty in Semi-Supervised Learning
Semi-supervised learning is attracting blooming attention, due to its su...
research
∙
08/11/2023
Foundation Model is Efficient Multimodal Multitask Model Selector
This paper investigates an under-explored but important problem: given a...
research
∙
08/07/2023
Tiny LVLM-eHub: Early Multimodal Experiments with Bard
Recent advancements in Large Vision-Language Models (LVLMs) have demonst...
research
∙
08/03/2023
The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World
We present the All-Seeing (AS) project: a large-scale data and model for...
research
∙
07/27/2023
Scaling TransNormer to 175 Billion Parameters
We present TransNormerLLM, the first linear attention-based Large Langua...
research
∙
07/27/2023
Text-guided Foundation Model Adaptation for Pathological Image Classification
The recent surge of foundation models in computer vision and natural lan...
research
∙
07/25/2023
FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learning
Federated learning (FL) enables a decentralized machine learning paradig...
research
∙
07/20/2023
Meta-Transformer: A Unified Framework for Multimodal Learning
Multimodal learning aims to build models that can process and relate inf...
research
∙
07/20/2023
Boosting Federated Learning Convergence with Prototype Regularization
As a distributed machine learning technique, federated learning (FL) req...
research
∙
07/14/2023
Drive Like a Human: Rethinking Autonomous Driving with Large Language Models
In this paper, we explore the potential of using a large language model ...
research
∙
07/13/2023
InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation
This paper introduces InternVid, a large-scale video-centric multimodal ...
research
∙
07/13/2023
LimSim: A Long-term Interactive Multi-scenario Traffic Simulator
With the growing popularity of digital twin and autonomous driving in tr...
research
∙
07/10/2023
AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
With the advance of text-to-image models (e.g., Stable Diffusion) and co...
research
∙
07/03/2023
JourneyDB: A Benchmark for Generative Image Understanding
While recent advancements in vision-language models have revolutionized ...
research
∙
06/25/2023
Faster Segment Anything: Towards Lightweight SAM for Mobile Applications
Segment anything model (SAM) is a prompt-guided vision foundation model ...
research
∙
06/20/2023
Align, Adapt and Inject: Sound-guided Unified Image Generation
Text-guided image generation has witnessed unprecedented progress due to...
research
∙
06/15/2023
Retrieving-to-Answer: Zero-Shot Video Question Answering with Frozen Large Language Models
Video Question Answering (VideoQA) has been significantly advanced from ...
research
∙
06/15/2023
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
Large Vision-Language Models (LVLMs) have recently played a dominant rol...
research
∙
06/13/2023
Robustness of SAM: Segment Anything Under Corruptions and Beyond
Segment anything model (SAM), as the name suggests, is claimed to be cap...
research
∙
06/09/2023
DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Clouds
Existing offboard 3D detectors always follow a modular pipeline design t...
research
∙
06/02/2023
Denoising Diffusion Semantic Segmentation with Mask Prior Modeling
The evolution of semantic segmentation has long been dominated by learni...
research
∙
06/01/2023
AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Dataset
It is a long-term vision for Autonomous Driving (AD) community that the ...
research
∙
06/01/2023
DiffRoom: Diffusion-based High-Quality 3D Room Reconstruction and Generation
We present DiffRoom, a novel framework for tackling the problem of high-...
research
∙
05/29/2023
DiffRate : Differentiable Compression Rate for Efficient Vision Transformers
Token compression aims to speed up large-scale vision transformers (e.g....
research
∙
05/25/2023
Ghost in the Minecraft: Generally Capable Agents for Open-World Enviroments via Large Language Models with Text-based Knowledge and Memory
The captivating realm of Minecraft has attracted substantial research in...
research
∙
05/25/2023
Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation
Recently, video object segmentation (VOS) referred by multi-modal signal...
research
∙
05/24/2023
Networks are Slacking Off: Understanding Generalization Problem in Image Deraining
Deep deraining networks, while successful in laboratory benchmarks, cons...
research
∙
05/22/2023
VideoLLM: Modeling Video Sequence with Large Language Models
With the exponential growth of video data, there is an urgent need for a...
research
∙
05/18/2023
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
Foundation models have made significant strides in various applications,...
research
∙
05/18/2023
VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks
Large language models (LLMs) have notably accelerated progress towards a...
research
∙
05/10/2023
VideoChat: Chat-Centric Video Understanding
In this study, we initiate an exploration into video understanding by in...
research
∙
05/09/2023
InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
We present an interactive visual framework named InternGPT, or iGPT for ...
research
∙
05/09/2023
Causal Discovery with Unobserved Variables: A Proxy Variable Approach
Discovering causal relations from observational data is important. The e...
research
∙
05/06/2023
LEO: Generative Latent Image Animator for Human Video Synthesis
Spatio-temporal coherency is a major challenge in synthesizing high qual...
research
∙
05/02/2023
Long-Term Rhythmic Video Soundtracker
We consider the problem of generating musical soundtracks in sync with r...
research
∙
04/29/2023
Segment Anything Model (SAM) Meets Glass: Mirror and Transparent Objects Cannot Be Easily Detected
Meta AI Research has recently released SAM (Segment Anything Model) whic...
research
∙
04/28/2023
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
How to efficiently transform large language models (LLMs) into instructi...
research
∙
04/24/2023
Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation
Diffusion models have attained impressive visual quality for image synth...
research
∙
04/19/2023