Abstract

As multimodal user interfaces (MUIs) significantly enrich user experience with connected and autonomous vehicles (CAVs), a seamless modality combination and multimodal switch is the key to enhancing human interaction's efficiency and usability across multiple interfaces in vehicles. From the theoretical review, we discuss the concept of seamlessness. Based on the consideration of driving automation upgrade and multi-tasking dynamics, we introduce two seamless dimensions of the new design space of multimodal user interfaces in both chronological and spatial orders. We propose a framework incorporating the design space and discuss the factors influencing the performance of multimodal seamlessness with the driving tasks constantly changing. Further, we present three design practices using this framework to illustrate the design methods. We also discuss the framework's potentials and limitations for designing the human-machine interaction in CAVs.

Keywords

seamlessness, multimodal user interface, automotive human-machine-interaction

Creative Commons License

Creative Commons Attribution-NonCommercial 4.0 International License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

Conference Track

Research Paper

COinS
 
Jun 25th, 9:00 AM

A framework for designing the seamless automotive multimodal experience in future connected and autonomous vehicles

As multimodal user interfaces (MUIs) significantly enrich user experience with connected and autonomous vehicles (CAVs), a seamless modality combination and multimodal switch is the key to enhancing human interaction's efficiency and usability across multiple interfaces in vehicles. From the theoretical review, we discuss the concept of seamlessness. Based on the consideration of driving automation upgrade and multi-tasking dynamics, we introduce two seamless dimensions of the new design space of multimodal user interfaces in both chronological and spatial orders. We propose a framework incorporating the design space and discuss the factors influencing the performance of multimodal seamlessness with the driving tasks constantly changing. Further, we present three design practices using this framework to illustrate the design methods. We also discuss the framework's potentials and limitations for designing the human-machine interaction in CAVs.

 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.