Abstract

The focus group methods remain a cornerstone of co-design practice but continue to face persistent challenges, such as participant recruitment, groupthink, and the efficiency of extracting design insights. This paper explores how Large Language Models (LLMs) could offer an alternative approach while preserving the benefits of common focus group methods. Therefore, we propose FocusGPT, a prototype system where customizable LLMs-based multi-agents simulate stakeholders to facilitate discussions and generate design insights. Through a formative study with 16 design professionals, we identified key requirements for developing and refining such a system. Our informal pilot trials suggest that FocusGPT could potentially serve as an additional option to help designers gather different perspectives. Despite promising applications, significant limitations exist in the accuracy of multi-agents representation, designer over reliance on LLMs outputs, and the black-box nature of LLMs. This research contributes to the understanding how LLMs might responsibly augment, rather than replace, focus groups in co-design practice.

Keywords

AI-enhanced Design Tool; Co-design Practice; Large Language Models

Creative Commons License

Creative Commons Attribution-NonCommercial 4.0 International License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

Conference Track

Track 4 - Human-Centered AI

Share

COinS
 
Dec 2nd, 9:00 AM Dec 5th, 5:00 PM

FocusGPT: The Design of LLMs-based Focus Group for Empowering Co-design Practice

The focus group methods remain a cornerstone of co-design practice but continue to face persistent challenges, such as participant recruitment, groupthink, and the efficiency of extracting design insights. This paper explores how Large Language Models (LLMs) could offer an alternative approach while preserving the benefits of common focus group methods. Therefore, we propose FocusGPT, a prototype system where customizable LLMs-based multi-agents simulate stakeholders to facilitate discussions and generate design insights. Through a formative study with 16 design professionals, we identified key requirements for developing and refining such a system. Our informal pilot trials suggest that FocusGPT could potentially serve as an additional option to help designers gather different perspectives. Despite promising applications, significant limitations exist in the accuracy of multi-agents representation, designer over reliance on LLMs outputs, and the black-box nature of LLMs. This research contributes to the understanding how LLMs might responsibly augment, rather than replace, focus groups in co-design practice.

 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.