Abstract
As multimodal user interfaces (MUIs) significantly enrich user experience with connected and autonomous vehicles (CAVs), a seamless modality combination and multimodal switch is the key to enhancing human interaction's efficiency and usability across multiple interfaces in vehicles. From the theoretical review, we discuss the concept of seamlessness. Based on the consideration of driving automation upgrade and multi-tasking dynamics, we introduce two seamless dimensions of the new design space of multimodal user interfaces in both chronological and spatial orders. We propose a framework incorporating the design space and discuss the factors influencing the performance of multimodal seamlessness with the driving tasks constantly changing. Further, we present three design practices using this framework to illustrate the design methods. We also discuss the framework's potentials and limitations for designing the human-machine interaction in CAVs.
Keywords
seamlessness, multimodal user interface, automotive human-machine-interaction
DOI
https://doi.org/10.21606/drs.2022.163
Citation
Song, F., Wang, W., Lin, H., and Tian, Y. (2022) A framework for designing the seamless automotive multimodal experience in future connected and autonomous vehicles, in Lockton, D., Lenzi, S., Hekkert, P., Oak, A., Sádaba, J., Lloyd, P. (eds.), DRS2022: Bilbao, 25 June - 3 July, Bilbao, Spain. https://doi.org/10.21606/drs.2022.163
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Conference Track
Research Paper
Included in
A framework for designing the seamless automotive multimodal experience in future connected and autonomous vehicles
As multimodal user interfaces (MUIs) significantly enrich user experience with connected and autonomous vehicles (CAVs), a seamless modality combination and multimodal switch is the key to enhancing human interaction's efficiency and usability across multiple interfaces in vehicles. From the theoretical review, we discuss the concept of seamlessness. Based on the consideration of driving automation upgrade and multi-tasking dynamics, we introduce two seamless dimensions of the new design space of multimodal user interfaces in both chronological and spatial orders. We propose a framework incorporating the design space and discuss the factors influencing the performance of multimodal seamlessness with the driving tasks constantly changing. Further, we present three design practices using this framework to illustrate the design methods. We also discuss the framework's potentials and limitations for designing the human-machine interaction in CAVs.