How to evaluate data visualizations across different levels of understanding

by   Alyxander Burns, et al.

Understanding a visualization is a multi-level process. A reader must extract and extrapolate from numeric facts, understand how those facts apply to both the context of the data and other potential contexts, and draw or evaluate conclusions from the data. A well-designed visualization should support each of these levels of understanding. We diagnose levels of understanding of visualized data by adapting Bloom's taxonomy, a common framework from the education literature. We describe each level of the framework and provide examples for how it can be applied to evaluate the efficacy of data visualizations along six levels of knowledge acquisition - knowledge, comprehension, application, analysis, synthesis, and evaluation. We present three case studies showing that this framework expands on existing methods to comprehensively measure how a visualization design facilitates a viewer's understanding of visualizations. Although Bloom's original taxonomy suggests a strong hierarchical structure for some domains, we found few examples of dependent relationships between performance at different levels for our three case studies. If this level-independence holds across new tested visualizations, the taxonomy could serve to inspire more targeted evaluations of levels of understanding that are relevant to a communication goal.


page 2

page 3

page 4

page 5

page 6

page 7

page 8

page 9


A Qualitative Analysis of Common Practices in Annotations: A Taxonomy and Design Space

Annotations are a vital component of data externalization and collaborat...

The Spatial-Perceptual Design Space: a new comprehension for Data Visualization

We revisit the design space of visualizations aiming at identifying and ...

Revisiting the Design Patterns of Composite Visualizations

Composite visualization is a popular design strategy that represents com...

Mixed Multi-Model Semantic Interaction for Graph-based Narrative Visualizations

Narrative sensemaking is an essential part of understanding sequential d...

Calliope-Net: Automatic Generation of Graph Data Facts via Annotated Node-link Diagrams

Graph or network data are widely studied in both data mining and visuali...

CrossCode: Multi-level Visualization of Program Execution

Program visualizations help to form useful mental models of how programs...

Visualizing Event Sequence Data for User Behavior Evaluation of In-Vehicle Information Systems

With modern IVIS becoming more capable and complex than ever, their eval...

Please sign up or login with your details

Forgot password? Click here to reset