research
∙
09/18/2023
HumTrans: A Novel Open-Source Dataset for Humming Melody Transcription and Beyond
This paper introduces the HumTrans dataset, which is publicly available ...
share
research
∙
09/18/2023
Unified Pretraining Target Based Video-music Retrieval With Music Rhythm And Video Optical Flow Information
Background music (BGM) can enhance the video's emotion. However, selecti...
research
∙
09/09/2023
Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video
Synthesizing realistic videos according to a given speech is still an op...
research
∙
09/04/2023
StyleAdapter: A Single-Pass LoRA-Free Model for Stylized Image Generation
This paper presents a LoRA-free method for stylized image generation tha...
research
∙
09/01/2023
Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training
The single-speaker singing voice synthesis (SVS) usually underperforms a...
research
∙
08/29/2023
Exploring Model Transferability through the Lens of Potential Energy
Transfer learning has become crucial in computer vision tasks due to the...
research
∙
08/27/2023
Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views
Reconstructing 3D objects from extremely sparse views is a long-standing...
research
∙
08/22/2023
Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning
Text-to-music generation (T2M-Gen) faces a major obstacle due to the sca...
research
∙
08/20/2023
ViT-Lens: Towards Omni-modal Representations
Though the success of CLIP-based training recipes in vision-language mod...
research
∙
08/18/2023
Guide3D: Create 3D Avatars from Text and Image Guidance
Recently, text-to-image generation has exhibited remarkable advancements...
research
∙
08/16/2023
OmniZoomer: Learning to Move and Zoom in on Sphere at High-Resolution
Omnidirectional images (ODIs) have become increasingly popular, as their...
research
∙
07/27/2023
GET3D–: Learning GET3D from Unconstrained Image Collections
The demand for efficient 3D model generation techniques has grown expone...
research
∙
07/16/2023
Planting a SEED of Vision in Large Language Model
We present SEED, an elaborate image tokenizer that empowers Large Langua...
research
∙
07/11/2023
Neural Point-based Volumetric Avatar: Surface-guided Neural Points for Efficient and Photorealistic Volumetric Head Avatar
Rendering photorealistic and dynamically moving human heads is crucial f...
research
∙
07/07/2023
NOFA: NeRF-based One-shot Facial Avatar Reconstruction
3D facial avatar reconstruction has been a significant research topic in...
research
∙
07/05/2023
DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Models
Image super-resolution (SR) with generative adversarial networks (GAN) h...
research
∙
07/05/2023
DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models
Despite the ability of existing large-scale text-to-image (T2I) models t...
research
∙
06/29/2023
ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models
Given sparse views of an object, estimating their camera poses is a long...
research
∙
06/29/2023
DreamDiffusion: Generating High-Quality Images from Brain EEG Signals
This paper introduces DreamDiffusion, a novel method for generating high...
research
∙
06/27/2023
On the Universal Adversarial Perturbations for Efficient Data-free Adversarial Detection
Detecting adversarial samples that are carefully crafted to fool the mod...
research
∙
06/27/2023
DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization
Adversarial training is one of the best-performing methods in improving ...
research
∙
06/23/2023
Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation
Scene Graph Generation (SGG) aims to structurally and comprehensively re...
research
∙
06/22/2023
TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter
Visual foundation models like CLIP excel in learning feature representat...
research
∙
06/12/2023
InstructP2P: Learning to Edit 3D Point Clouds with Text Instructions
Enhancing AI systems to perform tasks following human instructions can s...
research
∙
06/12/2023
Sticker820K: Empowering Interactive Retrieval with Stickers
Stickers have become a ubiquitous part of modern-day communication, conv...
research
∙
06/06/2023
SGAT4PASS: Spherical Geometry-Aware Transformer for PAnoramic Semantic Segmentation
As an important and challenging problem in computer vision, PAnoramic Se...
research
∙
06/01/2023
Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance
Creating a vivid video from the event or scenario in our imagination is ...
research
∙
06/01/2023
Inserting Anybody in Diffusion Models via Celeb Basis
Exquisite demand exists for customizing the pretrained large text-to-ima...
research
∙
05/29/2023
Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models
Public large-scale text-to-image diffusion models, such as Stable Diffus...
research
∙
05/23/2023
TVTSv2: Learning Out-of-the-box Spatiotemporal Visual Representations at Scale
The ultimate goal for foundation models is realizing task-agnostic, i.e....
research
∙
05/21/2023
A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition
Existing models for named entity recognition (NER) are mainly based on l...
research
∙
05/20/2023
What Makes for Good Visual Tokenizers for Large Language Models?
We empirically investigate proper pre-training methods to build good vis...
research
∙
05/11/2023
SparseGNV: Generating Novel Views of Indoor Scenes with Sparse Input Views
We study to generate novel views of indoor scenes given sparse input vie...
research
∙
04/27/2023
π-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation
Foundation models have achieved great advances in multi-task learning wi...
research
∙
04/24/2023
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video
We introduce HOSNeRF, a novel 360 free-viewpoint rendering method that r...
research
∙
04/18/2023
SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes
Online reconstructing and rendering of large-scale indoor scenes is a lo...
research
∙
04/17/2023
MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing
Despite the success in large-scale text-to-image generation and text-con...
research
∙
04/10/2023
Improved Test-Time Adaptation for Domain Generalization
The main challenge in domain generalization (DG) is to handle the distri...
research
∙
04/06/2023
TagGPT: Large Language Models are Zero-shot Multimodal Taggers
Tags are pivotal in facilitating the effective distribution of multimedi...
research
∙
04/03/2023
DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
We present DreamAvatar, a text-and-shape guided framework for generating...
research
∙
04/03/2023
Learning Anchor Transformations for 3D Garment Animation
This paper proposes an anchor-based deformation model, namely AnchorDEF,...
research
∙
04/02/2023
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking Tasks
In this paper, we study masked autoencoder (MAE) pretraining on videos f...
research
∙
03/30/2023
LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
Recently, diffusion models have achieved great success in image synthesi...
research
∙
03/24/2023
Accelerating Vision-Language Pretraining with Free Language Modeling
The state of the arts in vision-language pretraining (VLP) achieves exem...
research
∙
03/21/2023
BoPR: Body-aware Part Regressor for Human Shape and Pose Estimation
This paper presents a novel approach for estimating human body shape and...
research
∙
03/21/2023
HRDFuse: Monocular 360°Depth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributions
Depth estimation from a monocular 360 image is a burgeoning problem owin...
research
∙
03/20/2023
HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting
We present a simple yet effective method for skeleton-free motion retarg...
research
∙
03/15/2023
Skinned Motion Retargeting with Residual Perception of Motion Semantics Geometry
A good motion retargeting cannot be reached without reasonable considera...
research
∙
02/17/2023
Binary Embedding-based Retrieval at Tencent
Large-scale embedding-based retrieval (EBR) is the cornerstone of search...
research
∙
02/16/2023