Image Inspired Poetry Generation in XiaoIce

by   Wen-Feng Cheng, et al.

Vision is a common source of inspiration for poetry. The objects and the sentimental imprints that one perceives from an image may lead to various feelings depending on the reader. In this paper, we present a system of poetry generation from images to mimic the process. Given an image, we first extract a few keywords representing objects and sentiments perceived from the image. These keywords are then expanded to related ones based on their associations in human written poems. Finally, verses are generated gradually from the keywords using recurrent neural networks trained on existing poems. Our approach is evaluated by human assessors and compared to other generation baselines. The results show that our method can generate poems that are more artistic than the baseline methods. This is one of the few attempts to generate poetry from images. By deploying our proposed approach, XiaoIce has already generated more than 12 million poems for users since its release in July 2017. A book of its poems has been published by Cheers Publishing, which claimed that the book is the first-ever poetry collection written by an AI in human history.


page 2

page 6


Controlling keywords and their positions in text generation

One of the challenges in text generation is to control generation as int...

Automatic Comment Generation via Multi-Pass Deliberation

Deliberation is a common and natural behavior in human daily life. For e...

Rhythm, Chord and Melody Generation for Lead Sheets using Recurrent Neural Networks

Music that is generated by recurrent neural networks often lacks a sense...

Visual Story Generation Based on Emotion and Keywords

Automated visual story generation aims to produce stories with correspon...

Keywords Guided Method Name Generation

High quality method names are descriptive and readable, which are helpfu...

Automatic Trimap Generation for Image Matting

Image matting is a longstanding problem in computational photography. Al...

Please sign up or login with your details

Forgot password? Click here to reset