Abstract
Integrating virtual content with real objects is crucial for advancing MR technologies toward greater intelligence and usability. Object-centered user interfaces strongly support this goal. However, existing research often lacks an organized design space and methodology, making practical application challenging. Building on Jacob et al.’s Reality-Based Interaction (RBI) framework—which emphasizes interactions resembling real-world experiences—this study introduces the four reality levels into object-centered user interactions in MR, constructing a design space from category considerations and interaction process. We propose design elementsfocusingonspatialinformation,3Dicons, spatial menus, and interaction behaviors. Using this framework, we developed an MR game prototype based on Chinese mythology “Shan Hai Jing", illustrating a novel approach to the design of object-centered MR user interfaces.
Keywords
Mixed Reality; Object-Centered User Interface; Reality Based Interaction; Design Space
DOI
https://doi.org/10.21606/iasdr.2025.854
Citation
Wang, Y., Hu, Y.,and Shen, X.(2025) RBI Based Design Space Exploration for Object-Centered MR User Interactions, in Chang, C.-Y., and Hsu, Y. (eds.), IASDR 2025: Design Next, 02-05 December, Taiwan. https://doi.org/10.21606/iasdr.2025.854
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Conference Track
Track 3 - Design, Art & Technology
RBI Based Design Space Exploration for Object-Centered MR User Interactions
Integrating virtual content with real objects is crucial for advancing MR technologies toward greater intelligence and usability. Object-centered user interfaces strongly support this goal. However, existing research often lacks an organized design space and methodology, making practical application challenging. Building on Jacob et al.’s Reality-Based Interaction (RBI) framework—which emphasizes interactions resembling real-world experiences—this study introduces the four reality levels into object-centered user interactions in MR, constructing a design space from category considerations and interaction process. We propose design elementsfocusingonspatialinformation,3Dicons, spatial menus, and interaction behaviors. Using this framework, we developed an MR game prototype based on Chinese mythology “Shan Hai Jing", illustrating a novel approach to the design of object-centered MR user interfaces.