Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model

by   Shishi Xiao, et al.

Pictorial visualization seamlessly integrates data and semantic context into visual representation, conveying complex information in a manner that is both engaging and informative. Extensive studies have been devoted to developing authoring tools to simplify the creation of pictorial visualizations. However, mainstream works mostly follow a retrieving-and-editing pipeline that heavily relies on retrieved visual elements from a dedicated corpus, which often compromise the data integrity. Text-guided generation methods are emerging, but may have limited applicability due to its predefined recognized entities. In this work, we propose ChartSpark, a novel system that embeds semantic context into chart based on text-to-image generative model. ChartSpark generates pictorial visualizations conditioned on both semantic context conveyed in textual inputs and data information embedded in plain charts. The method is generic for both foreground and background pictorial generation, satisfying the design practices identified from an empirical research into existing pictorial visualizations. We further develop an interactive visual interface that integrates a text analyzer, editing module, and evaluation module to enable users to generate, modify, and assess pictorial visualizations. We experimentally demonstrate the usability of our tool, and conclude with a discussion of the potential of using text-to-image generative model combined with interactive interface for visualization design.


page 1

page 5

page 6

page 7


viz2viz: Prompt-driven stylized visualization generation using a diffusion model

Creating stylized visualization requires going beyond the limited, abstr...

LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models

Systems that support users in the automatic creation of visualizations m...

ScrollyVis: Interactive visual authoring of guided dynamic narratives for scientific scrollytelling

Visual stories are an effective and powerful tool to convey specific inf...

Communicating Visualizations without Visuals: Investigation of Visualization Alternative Text for People with Visual Impairments

Alternative text is critical in communicating graphics to people who are...

Chart2Vec: A Universal Embedding of Context-Aware Visualizations

The advances in AI-enabled techniques have accelerated the creation and ...

Literal Encoding: Text is a first-class data encoding

Digital humanities are rooted in text analysis. However, most visualizat...

Generative 3D Animation Pipelines: Automating Facial Retargeting Workflows

Design tools in the 3D industry, while powerful, are still tedious and l...

Please sign up or login with your details

Forgot password? Click here to reset