Image Cropping with Composition and Saliency Aware Aesthetic Score Map

by   Yi Tu, et al.

Aesthetic image cropping is a practical but challenging task which aims at finding the best crops with the highest aesthetic quality in an image. Recently, many deep learning methods have been proposed to address this problem, but they did not reveal the intrinsic mechanism of aesthetic evaluation. In this paper, we propose an interpretable image cropping model to unveil the mystery. For each image, we use a fully convolutional network to produce an aesthetic score map, which is shared among all candidate crops during crop-level aesthetic evaluation. Then, we require the aesthetic score map to be both composition-aware and saliency-aware. In particular, the same region is assigned with different aesthetic scores based on its relative positions in different crops. Moreover, a visually salient region is supposed to have more sensitive aesthetic scores so that our network can learn to place salient objects at more proper positions. Such an aesthetic score map can be used to localize aesthetically important regions in an image, which sheds light on the composition rules learned by our model. We show the competitive performance of our model in the image cropping task on several benchmark datasets, and also demonstrate its generality in real-world applications.


page 1

page 3

page 4

page 7


Salient Object Detection by Lossless Feature Reflection

Salient object detection, which aims to identify and locate the most sal...

Salient Instance Segmentation via Subitizing and Clustering

The goal of salient region detection is to identify the regions of an im...

Blind Surveillance Image Quality Assessment via Deep Neural Network Combined with the Visual Saliency

The intelligent video surveillance system (IVSS) can automatically analy...

Fusing Saliency Maps with Region Proposals for Unsupervised Object Localization

In this paper we address the problem of unsupervised localization of obj...

Valid P-Value for Deep Learning-Driven Salient Region

Various saliency map methods have been proposed to interpret and explain...

Saliency Fusion in Eigenvector Space with Multi-Channel Pulse Coupled Neural Network

Saliency computation has become a popular research field for many applic...

Interpretable Partitioned Emebedding for Customized Fashion Outfit Composition

Intelligent fashion outfit composition becomes more and more popular in ...

Please sign up or login with your details

Forgot password? Click here to reset