Abstract

This paper presents the Imagery Modes framework for analysing the designer–genAI interaction, complementing established metaphor-based accounts. Developed through Constructivist Grounded Theory and structured using Activity Theory, the framework focuses on the micro-dynamics of a single input–output exchange. It identifies four sequential sub-actions—crafting, processing, generating, and evaluating—that trace the relations between subjects (designer, genAI) and instruments (input, output). Central to the framework is the concept of “output imagery”, defined as the clarity with which the designer envisions the expected output prior to the interaction. Three modes of interaction are identified: Before, During, and After Imagery. The findings highlight the fluid and non-linear character of the designer-genAI interaction, showing how designers shift between modes across sequences. Finally, the framework clarifies the interplay between agency and sense of agency, showing that while agency varies linearly, sense of agency depends on alignment between expectations and outputs within each mode.

Keywords

Human-AI Interaction, Generative AI (genAI), Interaction Patterns, Agency and Sense of Agency

Creative Commons License

Creative Commons Attribution-NonCommercial 4.0 International License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

Share

COinS
 
Jun 8th, 9:00 AM Jun 12th, 5:00 PM

Deconstructing the Designer-genAI Interaction in the Design Process: A Framework for Surfacing Micro-Dynamics and Agency

This paper presents the Imagery Modes framework for analysing the designer–genAI interaction, complementing established metaphor-based accounts. Developed through Constructivist Grounded Theory and structured using Activity Theory, the framework focuses on the micro-dynamics of a single input–output exchange. It identifies four sequential sub-actions—crafting, processing, generating, and evaluating—that trace the relations between subjects (designer, genAI) and instruments (input, output). Central to the framework is the concept of “output imagery”, defined as the clarity with which the designer envisions the expected output prior to the interaction. Three modes of interaction are identified: Before, During, and After Imagery. The findings highlight the fluid and non-linear character of the designer-genAI interaction, showing how designers shift between modes across sequences. Finally, the framework clarifies the interplay between agency and sense of agency, showing that while agency varies linearly, sense of agency depends on alignment between expectations and outputs within each mode.

 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.