Computational identification of significant actors in paintings through symbols and attributes

02/04/2021
by   David G. Stork, et al.
10

The automatic analysis of fine art paintings presents a number of novel technical challenges to artificial intelligence, computer vision, machine learning, and knowledge representation quite distinct from those arising in the analysis of traditional photographs. The most important difference is that many realist paintings depict stories or episodes in order to convey a lesson, moral, or meaning. One early step in automatic interpretation and extraction of meaning in artworks is the identifications of figures (actors). In Christian art, specifically, one must identify the actors in order to identify the Biblical episode or story depicted, an important step in understanding the artwork. We designed an automatic system based on deep convolutional neural networks and simple knowledge database to identify saints throughout six centuries of Christian art based in large part upon saints symbols or attributes. Our work represents initial steps in the broad task of automatic semantic interpretation of messages and meaning in fine art.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
01/13/2021

Machine learning approach for biopsy-based identification of eosinophilic esophagitis reveals importance of global features

Goal: Eosinophilic esophagitis (EoE) is an allergic inflammatory conditi...
research
02/05/2021

Symbolic Behaviour in Artificial Intelligence

The ability to use symbols is the pinnacle of human intelligence, but ha...
research
02/13/2018

Automatic localization and decoding of honeybee markers using deep convolutional neural networks

The honeybee is a fascinating model for the emergence of collective beha...
research
07/13/2017

Learning Photography Aesthetics with Deep CNNs

Automatic photo aesthetic assessment is a challenging artificial intelli...
research
04/10/2019

Context-Aware Embeddings for Automatic Art Analysis

Automatic art analysis aims to classify and retrieve artistic representa...
research
03/30/2022

How Deep is Your Art: An Experimental Study on the Limits of Artistic Understanding in a Single-Task, Single-Modality Neural Network

Mathematical modeling and aesthetic rule extraction of works of art are ...
research
05/17/2021

Graph Neural Networks for Knowledge Enhanced Visual Representation of Paintings

We propose ArtSAGENet, a novel multimodal architecture that integrates G...

Please sign up or login with your details

Forgot password? Click here to reset