Applying AI Fine-Tuning and VR 3D Sketching for Conceptual Design Proposals: A Case Study of Footwear Design

Authors

• Hao-Yu Han, National Taiwan University of Science and Technology, TaiwanFollow
• Ming-Huang Lin, National Taiwan University of Science and Technology, TaiwanFollow
• Yun-Wen Lee, National Taiwan University of Science and Technology, Taiwan; National Tsing Hua University, TaiwanFollow

Abstract

Generative AI tools such as ChatGPT and Vizcom can produce creative 2D images, however, their stylistic appearances remain difficult to control. This study proposes a design pathway based on LoRA fine-tuning technique. First, a fine-tuning model of Nike A.I.R. concept shoes and automotive surface styles were trained. Then, these two different vocabulary elements were combined and generatively tested to explore their feasibility in footwear design. The process included dataset preparation, parameter adjustment, generation testing, and VR 3D modeling. Results showed that this method can effectively generate innovative forms within a given framework, making it particularly suitable for early design exploration. In addition, by adjusting the weights of the fine-tuning model and using the VR design software Gravity Sketch, designers can effectively control the proportions of the generated image elements, enhancing the control and creativity of AI-assisted footwear design.

Keywords

generative AI, LoRA fine-tuning, VR, footwear design

DOI

https://doi.org/10.21606/drs.2026.680

Citation

Han, H., Lin, M., and Lee, Y. (2026) Applying AI Fine-Tuning and VR 3D Sketching for Conceptual Design Proposals: A Case Study of Footwear Design, in Simeone, L., Gray, C. M., Verhoeven, A., de Götzen, A., Bakırlıoğlu, Y., Zohar, H., Stead, M., and Buwert, P. (eds.), DRS2026: Edinburgh, 8–12 June, Edinburgh, United Kingdom. https://doi.org/10.21606/drs.2026.680

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License