End-to-end Graph-constrained Vectorized Floorplan Generation with Panoptic Refinement

07/27/2022
by   Jiachen Liu, et al.
0

The automatic generation of floorplans given user inputs has great potential in architectural design and has recently been explored in the computer vision community. However, the majority of existing methods synthesize floorplans in the format of rasterized images, which are difficult to edit or customize. In this paper, we aim to synthesize floorplans as sequences of 1-D vectors, which eases user interaction and design customization. To generate high fidelity vectorized floorplans, we propose a novel two-stage framework, including a draft stage and a multi-round refining stage. In the first stage, we encode the room connectivity graph input by users with a graph convolutional network (GCN), then apply an autoregressive transformer network to generate an initial floorplan sequence. To polish the initial design and generate more visually appealing floorplans, we further propose a novel panoptic refinement network(PRN) composed of a GCN and a transformer network. The PRN takes the initial generated sequence as input and refines the floorplan design while encouraging the correct room connectivity with our proposed geometric loss. We have conducted extensive experiments on a real-world floorplan dataset, and the results show that our method achieves state-of-the-art performance under different settings and evaluation metrics.

READ FULL TEXT
research
08/23/2021

PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimation

RGB-D based 6D pose estimation has recently achieved remarkable progress...
research
08/02/2020

Relation Extraction with Self-determined Graph Convolutional Network

Relation Extraction is a way of obtaining the semantic relationship betw...
research
02/03/2022

Skeleton-Based Action Segmentation with Multi-Stage Spatial-Temporal Graph Convolutional Neural Networks

The ability to identify and temporally segment fine-grained actions in m...
research
06/29/2017

Graph Convolution: A High-Order and Adaptive Approach

In this paper, we presented a novel convolutional neural network framewo...
research
12/04/2019

Better Understanding Hierarchical Visual Relationship for Image Caption

The Convolutional Neural Network (CNN) has been the dominant image featu...
research
10/15/2021

Multi-Tailed, Multi-Headed, Spatial Dynamic Memory refined Text-to-Image Synthesis

Synthesizing high-quality, realistic images from text-descriptions is a ...
research
03/30/2022

Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction

This paper presents a high-quality human motion prediction method that a...

Please sign up or login with your details

Forgot password? Click here to reset