b'Ziwei Liu'

research

∙ 09/20/2023

FreeU: Free Lunch in Diffusion U-Net

In this paper, we uncover the untapped potential of diffusion U-Net, whi...

0 Chenyang Si, et al. ∙

research

∙ 09/14/2023

Large-Vocabulary 3D Diffusion Model with Transformer

Creating diverse and high-quality 3D assets with an automatic generative...

0 Ziang Cao, et al. ∙

research

∙ 09/05/2023

ReliTalk: Relightable Talking Portrait Generation from a Single Video

Recent years have witnessed great progress in creating vivid audio-drive...

0 Haonan Qiu, et al. ∙

research

∙ 09/01/2023

CityDreamer: Compositional Generative Model of Unbounded 3D Cities

In recent years, extensive research has focused on 3D natural scene gene...

0 Haozhe Xie, et al. ∙

research

∙ 08/20/2023

Towards Real-World Visual Tracking with Temporal Contexts

Visual tracking has made significant improvements in the past few decade...

0 Ziang Cao, et al. ∙

research

∙ 08/18/2023

HumanLiff: Layer-wise 3D Human Generation with Diffusion Model

3D human generation from 2D images has achieved remarkable progress thro...

0 Shoukang Hu, et al. ∙

research

∙ 08/15/2023

Link-Context Learning for Multimodal LLMs

The ability to learn from context with novel concepts, and deliver appro...

0 Yan Tai, et al. ∙

research

∙ 08/14/2023

Hierarchy Flow For High-Fidelity Image-to-Image Translation

Image-to-image (I2I) translation comprises a wide spectrum of tasks. Her...

0 Weichen Fan, et al. ∙

research

∙ 08/10/2023

Temporally-Adaptive Models for Efficient Video Understanding

Spatial convolutions are extensively used in numerous deep video models....

0 Ziyuan Huang, et al. ∙

research

∙ 07/28/2023

Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for TDD MultiUser MIMO Systems

In this letter, we investigate the discrete phase shift design of the in...

0 Fengyu Zhao, et al. ∙

research

∙ 07/27/2023

Performance of RIS-Assisted Full-Duplex Space Shift Keying With Imperfect Self-Interference Cancellation

In this paper, we consider a full-duplex (FD) space shift keying (SSK) c...

0 Xusheng Zhu, et al. ∙

research

∙ 07/25/2023

Benchmarking and Analyzing Generative Data for Visual Recognition

Advancements in large pre-trained generative models have expanded their ...

0 Bo Li, et al. ∙

research

∙ 07/19/2023

Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis

Cross-modality medical image synthesis is a critical topic and has the p...

0 Lingting Zhu, et al. ∙

research

∙ 07/17/2023

Pair then Relation: Pair-Net for Panoptic Scene Graph Generation

Panoptic Scene Graph (PSG) is a challenging task in Scene Graph Generati...

0 Jinghao Wang, et al. ∙

research

∙ 07/13/2023

InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation

This paper introduces InternVid, a large-scale video-centric multimodal ...

0 Yi Wang, et al. ∙

research

∙ 06/26/2023

FunQA: Towards Surprising Video Comprehension

Surprising videos, e.g., funny clips, creative performances, or visual i...

0 Binzhu Xie, et al. ∙

research

∙ 06/15/2023

Segment Any Point Cloud Sequences by Distilling Vision Foundation Models

Recent advancements in vision foundation models (VFMs) have opened up ne...

2 Youquan Liu, et al. ∙

research

∙ 06/15/2023

OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detection

Out-of-Distribution (OOD) detection is critical for the reliable operati...

0 Jingyang Zhang, et al. ∙

research

∙ 06/13/2023

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

Large text-to-image diffusion models have exhibited impressive proficien...

0 Shuai Yang, et al. ∙

research

∙ 06/08/2023

MIMIC-IT: Multi-Modal In-Context Instruction Tuning

High-quality instructions and responses are essential for the zero-shot ...

0 Bo Li, et al. ∙

research

∙ 06/07/2023

GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation

Recent advances in deep learning have witnessed many successful unsuperv...

0 Shuai Yang, et al. ∙

research

∙ 06/01/2023

DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection

Existing deepfake detection methods fail to generalize well to unseen or...

0 Rui Shao, et al. ∙

research

∙ 05/30/2023

Learning without Forgetting for Vision-Language Models

Class-Incremental Learning (CIL) or continual learning is a desired capa...

0 Da-Wei Zhou, et al. ∙

research

∙ 05/22/2023

RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars

Synthesizing high-fidelity head avatars is a central problem for compute...

3 Dongwei Pan, et al. ∙

research

∙ 05/18/2023

ConsistentNeRF: Enhancing Neural Radiance Fields with 3D Consistency for Sparse View Synthesis

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruct...

0 Shoukang Hu, et al. ∙

research

∙ 05/09/2023

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator

Despite recent advances in syncing lip movements with any audio waves, c...

0 Jiazhi Guan, et al. ∙

research

∙ 05/05/2023

Otter: A Multi-Modal Model with In-Context Instruction Tuning

Large language models (LLMs) have demonstrated significant universal cap...

0 Bo Li, et al. ∙

research

∙ 04/20/2023

Collaborative Diffusion for Multi-Modal Face Generation and Editing

Diffusion models arise as a powerful generative tool recently. Despite t...

10 Ziqi Huang, et al. ∙

research

∙ 04/19/2023

Transformer-Based Visual Segmentation: A Survey

Visual segmentation seeks to partition images, video frames, or point cl...

24 Xiangtai Li, et al. ∙

research

∙ 04/18/2023

Variational Relational Point Completion Network for Robust 3D Classification

Real-scanned point clouds are often incomplete due to viewpoint, occlusi...

0 Liang Pan, et al. ∙

research

∙ 04/17/2023

Text2Performer: Text-Driven Human Video Generation

Text-driven content creation has evolved to be a transformative techniqu...

0 Yuming Jiang, et al. ∙

research

∙ 04/13/2023

RoboBEV: Towards Robust Bird's Eye View Perception under Corruptions

The recent advances in camera-based bird's eye view (BEV) representation...

10 Shaoyuan Xie, et al. ∙

research

∙ 04/06/2023

DiffMimic: Efficient Motion Mimicking with Differentiable Physics

Motion mimicking is a foundational task in physics-based character anima...

4 Jiawei Ren, et al. ∙

research

∙ 04/05/2023

Detecting and Grounding Multi-Modal Media Manipulation

Misinformation has become a pressing issue. Fake media, in both visual a...

0 Rui Shao, et al. ∙

research

∙ 03/30/2023

Robo3D: Towards Robust and Reliable 3D Perception against Corruptions

The robustness of 3D perception systems under natural corruptions from e...

10 Lingdong Kong, et al. ∙

research

∙ 03/30/2023

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling

Synthetic data has emerged as a promising source for 3D human research a...

1 Zhitao Yang, et al. ∙

research

∙ 03/28/2023

SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesis

Neural Radiance Field (NeRF) significantly degrades when only a limited ...

0 Guangcong Wang, et al. ∙

research

∙ 03/28/2023

F^2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories

This paper presents a novel grid-based NeRF called F2-NeRF (Fast-Free-Ne...

0 Peng Wang, et al. ∙

research

∙ 03/23/2023

ReVersion: Diffusion-Based Relation Inversion from Images

Diffusion models gain increasing popularity for their generative capabil...

2 Ziqi Huang, et al. ∙

research

∙ 03/23/2023

A Simple and Generic Framework for Feature Distillation via Channel-wise Transformation

Knowledge distillation is a popular technique for transferring the knowl...

0 Ziwei Liu, et al. ∙

research

∙ 03/22/2023

SHERF: Generalizable Human NeRF from a Single Image

Existing Human NeRF methods for reconstructing 3D humans typically rely ...

0 Shoukang Hu, et al. ∙

research

∙ 03/16/2023

Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation

Animating virtual avatars to make co-speech gestures facilitates various...

0 Lingting Zhu, et al. ∙

research

∙ 03/13/2023

Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need

Class-incremental learning (CIL) aims to adapt to emerging new classes w...

0 Da-Wei Zhou, et al. ∙

research

∙ 03/10/2023

StyleGANEX: StyleGAN-Based Manipulation Beyond Cropped Aligned Faces

Recent advances in face manipulation using StyleGAN have produced impres...

0 Shuai Yang, et al. ∙

research

∙ 03/09/2023

Rethinking Range View Representation for LiDAR Segmentation

LiDAR segmentation is crucial for autonomous driving perception. Recent ...

0 Lingdong Kong, et al. ∙

research

∙ 02/18/2023

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

The Pretrained Foundation Models (PFMs) are regarded as the foundation f...

0 Ce Zhou, et al. ∙

research

∙ 02/14/2023

Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation

Creating the photo-realistic version of people sketched portraits is use...

0 Yasheng Sun, et al. ∙

research

∙ 02/07/2023

Deep Class-Incremental Learning: A Survey

Deep models, e.g., CNNs and Vision Transformers, have achieved impressiv...

0 Da-Wei Zhou, et al. ∙

research

∙ 02/02/2023

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections

In this work, we present SceneDreamer, an unconditional generative model...

0 Zhaoxi Chen, et al. ∙

research

∙ 01/31/2023

What Makes Good Examples for Visual In-Context Learning?

Large-scale models trained on broad data have recently become the mainst...

0 Yuanhan Zhang, et al. ∙

Ziwei Liu

Featured Co-authors