FaceLift: A transparent deep learning framework to beautify urban scenes

by   Sagar Joglekar, et al.

In the area of computer vision, deep learning techniques have recently been used to predict whether urban scenes are likely to be considered beautiful: it turns out that these techniques are able to make accurate predictions. Yet they fall short when it comes to generating actionable insights for urban design. To support urban interventions, one needs to go beyond predicting beauty, and tackle the challenge of recreating beauty. Unfortunately, deep learning techniques have not been designed with that challenge in mind. Given their "black-box nature", these models cannot be directly used to explain why a particular urban scene is deemed to be beautiful. To partly fix that, we propose a deep learning framework called Facelift, that is able to both beautify existing urban scenes (Google Street views) and explain which urban elements make those transformed scenes beautiful. To quantitatively evaluate our framework, we cannot resort to any existing metric (as the research problem at hand has never been tackled before) and need to formulate new ones. These new metrics should ideally capture the presence/absence of elements that make urban spaces great. Upon a review of the urban planning literature, we identify five main metrics: walkability, green spaces, openness, landmarks and visual complexity. We find that, across all the five metrics, the beautified scenes meet the expectations set by the literature on what great spaces tend to be made of. This result is further confirmed by a 20-participant expert survey in which FaceLift have been found to be effective in promoting citizen participation. All this suggests that, in the future, as our framework's components are further researched and become better and more sophisticated, it is not hard to imagine technologies that will be able to accurately and efficiently support architects and planners in the design of spaces we intuitively love.


page 3

page 5

page 6

page 7

page 10

page 13

page 14

page 15


Urban morphology meets deep learning: Exploring urban forms in one million cities, town and villages across the planet

Study of urban form is an important area of research in urban planning/d...

URBAN-i: From urban scenes to mapping slums, transport modes, and pedestrians in cities using deep learning and computer vision

Within the burgeoning expansion of deep learning and computer vision acr...

Urban-Semantic Computer Vision: A Framework for Contextual Understanding of People in Urban Spaces

Increasing computational power and improving deep learning methods have ...

Treepedia 2.0: Applying Deep Learning for Large-scale Quantification of Urban Tree Cover

Recent advances in deep learning have made it possible to quantify urban...

CityTrack: Improving City-Scale Multi-Camera Multi-Target Tracking by Location-Aware Tracking and Box-Grained Matching

Multi-Camera Multi-Target Tracking (MCMT) is a computer vision technique...

Re-designing cities with conditional adversarial networks

This paper introduces a conditional generative adversarial network to re...

Quantifying urban streetscapes with deep learning: focus on aesthetic evaluation

The disorder of urban streetscapes would negatively affect people's perc...

Please sign up or login with your details

Forgot password? Click here to reset