Object Wake-up: 3-D Object Reconstruction, Animation, and in-situ Rendering from a Single Image

by   Xinxin Zuo, et al.

Given a picture of a chair, could we extract the 3-D shape of the chair, animate its plausible articulations and motions, and render in-situ in its original image space? The above question prompts us to devise an automated approach to extract and manipulate articulated objects in single images. Comparing with previous efforts on object manipulation, our work goes beyond 2-D manipulation and focuses on articulable objects, thus introduces greater flexibility for possible object deformations. The pipeline of our approach starts by reconstructing and refining a 3-D mesh representation of the object of interest from an input image; its control joints are predicted by exploiting the semantic part segmentation information; the obtained object 3-D mesh is then rigged & animated by non-rigid deformation, and rendered to perform in-situ motions in its original image space. Quantitative evaluations are carried out on 3-D reconstruction from single images, an established task that is related to our pipeline, where our results surpass those of the SOTAs by a noticeable margin. Extensive visual results also demonstrate the applicability of our approach.


page 1

page 4

page 5

page 7

page 8


RealFusion: 360° Reconstruction of Any Object from a Single Image

We consider the problem of reconstructing a full 360 photographic model ...

Neural Field Representations of Articulated Objects for Robotic Manipulation Planning

Traditional approaches for manipulation planning rely on an explicit geo...

Style Agnostic 3D Reconstruction via Adversarial Style Transfer

Reconstructing the 3D geometry of an object from an image is a major cha...

Virtual View Networks for Object Reconstruction

All that structure from motion algorithms "see" are sets of 2D points. W...

Category-Specific Object Reconstruction from a Single Image

Object reconstruction from a single image -- in the wild -- is a problem...

Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

We address the novel task of jointly reconstructing the 3D shape, textur...

Black-Box Test-Time Shape REFINEment for Single View 3D Reconstruction

Much recent progress has been made in reconstructing the 3D shape of an ...

Please sign up or login with your details

Forgot password? Click here to reset