Doom or deliciousness: challenges and opportunities for visualization in the age of generative models

Different types of data visualization (and the prompts used to create them) as imagined by text-to-image generative models. While these examples are delicious (in their graphical intrigue and exploration of style), they risk doom by potentially creating misplaced trust.
Different types of data visualization (and the prompts used to create them) as imagined by text-to-image generative models. While these examples are delicious (in their graphical intrigue and exploration of style), they risk doom by potentially creating misplaced trust.
Abstract
Generative text-to-image models (as exemplified by DALL-E, MidJourney, and Stable Diffusion) have recently made enormous technological leaps, demonstrating impressive results in many graphical domains—from logo design to digital painting and photographic composition. However, the quality of these results has led to existential crises in some fields of art, leading to questions about the role of human agency in the production of meaning in a graphical context. Such issues are central to visualization, and while these generative models have yet to be widely applied to visualization, it seems only a matter of time until their integration is manifest. Seeking to circumvent similar ponderous dilemmas, we attempt to understand the roles that generative models might play across visualization. We do so by constructing a framework that characterizes what these technologies offer at various stages of the visualization workflow, augmented and analyzed through semi-structured interviews with 21 experts from related domains. Through this work, we map the space of opportunities and risks that might arise in this intersection, identifying doomsday prophecies and delicious low-hanging fruits that are ripe for research.
Materials
PDF | Preprint | Supplement | BibTeX
Authors
Victor Schetinger
Mennatallah El-Assady
Andrew McNutt
Matthias Miller
Citation
Thumbnail image for publication titled: Doom or deliciousness: challenges and opportunities for visualization in the age of generative models
Doom or deliciousness: challenges and opportunities for visualization in the age of generative models

Victor Schetinger, Sara Di Bartolomeo, Mennatallah El-Assady, Andrew McNutt, Matthias Miller, and Jane Adams. Computer Graphics Forum—EuroVis/CGF. 2023.

PDF | Preprint | Supplement | BibTeX


Khoury Vis Lab — Northeastern University
West Village H, Room 302
440 Huntington Ave, Boston, MA 02115, USA