Abstract

Our perceptual system allows us to experience and make meaning of the world through different modalities. We can move between feeling, seeing and hearing things and still makes sense of our world. Our cognitive activities are transmodal. In interaction design this means that both our design processes and our users’ interactions are transmodal. We have gained insights into how transitions between modalities, both in the design context and in the users’ interaction context, modulate meaning and experience, by analysing three interactive systems: SimProv, VibEd, and Sightlence. We propose that a transmodal design approach facilitate designers to realize the communicative potential of different modalities, and hence present users with a transmodal perspective on their interaction space that allow for continuous rearrangement and use of modalities.

Keywords:

situated cognition; transmodal design; transmodality; interaction design

Creative Commons License

Creative Commons Attribution-Noncommercial 4.0 License
This work is licensed under a Creative Commons Attribution-Noncommercial 4.0 License

Share

COinS
 
Jun 17th, 12:00 AM

Perception, Meaning and Transmodal Design

Our perceptual system allows us to experience and make meaning of the world through different modalities. We can move between feeling, seeing and hearing things and still makes sense of our world. Our cognitive activities are transmodal. In interaction design this means that both our design processes and our users’ interactions are transmodal. We have gained insights into how transitions between modalities, both in the design context and in the users’ interaction context, modulate meaning and experience, by analysing three interactive systems: SimProv, VibEd, and Sightlence. We propose that a transmodal design approach facilitate designers to realize the communicative potential of different modalities, and hence present users with a transmodal perspective on their interaction space that allow for continuous rearrangement and use of modalities.

 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.