Abstract
This paper presents an expert-driven co-design process for defining gesture-based interactions in immersive environments. Existing co-design methods often struggles with expressing abstract design elements, reaching consensus among diverse users, and translating qualitative feedback into actionable outcomes. We propose a four-stage co-design process for improving gesture-based interaction design, consisting of data collection, co-design session, expert discussion, and design decision-making, which integrates expert knowledge with embodied practice. We developed this co-design framework and apply it to a foot-based interaction project exploring habitual foot actions as natural inputs for virtual- physical switching experience. Through collaborative sessions, experts defined and evaluated appropriate foot gestures for intuitive interactions. Our co-design experience highlights the importance of physical practice for validating design ideas, the negotiation dynamics among experts, and the persistent challenges in translating feedback into precise interaction outcomes. Overall, expert co- design can expand the gestural design space, deepen embodied design insights, and support cost- effective iteration, offering methodological guidance for structuring collaboration and refining co- design workflows in embodied interaction design.
Keywords
Gesture-based interaction; Co-design; Embodiment; Expert engagement
DOI
https://doi.org/10.21606/iasdr.2025.383
Citation
Liu, Z., Centre, P.J., Yan, S., Jiang, H., Centre, P.J., Yan, F., Duh, H.B.,and Centre, T.P.(2025) From Body to Interface: Co-design Gesture-based Interactions with Experts for Immersive Experiences, in Chang, C.-Y., and Hsu, Y. (eds.), IASDR 2025: Design Next, 02-05 December, Taiwan. https://doi.org/10.21606/iasdr.2025.383
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Conference Track
Track 6 - Co-creation
From Body to Interface: Co-design Gesture-based Interactions with Experts for Immersive Experiences
This paper presents an expert-driven co-design process for defining gesture-based interactions in immersive environments. Existing co-design methods often struggles with expressing abstract design elements, reaching consensus among diverse users, and translating qualitative feedback into actionable outcomes. We propose a four-stage co-design process for improving gesture-based interaction design, consisting of data collection, co-design session, expert discussion, and design decision-making, which integrates expert knowledge with embodied practice. We developed this co-design framework and apply it to a foot-based interaction project exploring habitual foot actions as natural inputs for virtual- physical switching experience. Through collaborative sessions, experts defined and evaluated appropriate foot gestures for intuitive interactions. Our co-design experience highlights the importance of physical practice for validating design ideas, the negotiation dynamics among experts, and the persistent challenges in translating feedback into precise interaction outcomes. Overall, expert co- design can expand the gestural design space, deepen embodied design insights, and support cost- effective iteration, offering methodological guidance for structuring collaboration and refining co- design workflows in embodied interaction design.