Exploring Ease of Use in a Mixed Reality Tabletop Environment
Interactive Experience Design, Stockholm University - 2023
----------------------------------------
OVERVIEW:
In this exciting project, our team explored how to make mixed reality (MR) tabletop experiences super user-friendly. Partnering with Ericsson, we drew inspiration from their virtual reality (VR) setups to design an engaging MR prototype.
Mixed reality seamlessly blends the real and virtual worlds, offering unique interaction opportunities. We focused on creating a natural and intuitive user experience, moving beyond traditional ease of use measurements.
Using tabletop technology with projection mapping, we developed a prototype that allows users to interact with both real and virtual objects in a seamless environment. Our goal was to find new ways to enhance ease of use in MR, making it accessible and enjoyable for everyone.
WHAT WE DID:
Participants performed two main tasks: adding robots and switching modes. They interacted with the prototype through three technologies: Arduino Uno, image tracking, and hand tracking. For adding robots, they could press a physical button, place a physical robot, or use a pinching motion to pick up a virtual robot. To switch color modes, participants could turn a knob, use a carousel, or adjust a virtual slider.
Tabletop Environment: Inspired by Ericsson’s 5G AI Slicing Experience in VR, we created a mixed reality tabletop environment visualizing network slicing. The setup included physical and virtual elements, with a cityscape featuring buildings and data centers. Different data centers received unique data streams, represented by colors, originating from a central "factory" where digital robots were added. This setup aimed to illustrate the concept of network slicing effectively.
Conclusion Summary:
In this study, we explored how to enhance ease of use in interactive mixed reality (MR) tabletop experiences. We developed a prototype combining virtual and physical elements using projection mapping. Our findings highlighted that the lack of design standards for MR tabletop experiences can lead to disruptions. We also noted that ease of use is influenced by the design elements specific to immersive technologies, such as field of view and the need for multisensory feedback.
Additionally, we discovered that user familiarity with design elements and previous experiences impact ease of use. To improve usability in MR tabletop experiences, we suggest:
1. Providing clear guidance on system interactions, especially hand tracking.
2. Offering multisensory feedback for tasks requiring precision.
3. Using simple designs like buttons and knobs for critical interactions.
4. Incorporating familiar 3D objects with realistic interactions.
These recommendations aim to create more intuitive and user-friendly MR tabletop environments.
WATCH VIDEO TO LEARN MORE:
SKILLS:
- Mixed Reality Design: Creating immersive and interactive MR environments that blend virtual and physical elements.
- Usability Testing: Conducting pilot tests and structured user testing to identify and resolve issues, ensuring ease of use.
- Prototyping: Developing functional prototypes using technologies like Arduino, image tracking, and hand tracking.
- User Interaction Design: Designing intuitive user interactions with MR systems, including hand tracking and multisensory feedback.
- Project Management: Coordinating a multi-step research process, including data collection, analysis, and participant management.
- Technical Setup and Integration: Managing complex technical setups involving hardware and software integration (Unity, sensors, projectors).
PROJECT GALLERY:
FeatureD:
We're thrilled to share that our innovative project on mixed reality tabletop experiences has been featured in an article by the Department of Computer and System Sciences at Stockholm University. This project, in collaboration with Ericsson, delves into creating seamless and user-friendly mixed reality environments.
