5 Best Practices for Designing Mixed Reality Data Visualization
Spatial computing has made Mixed Reality (MR) a game-changer in how we visualize, interact with, and make sense of complex data, particularly when the data set is inherently three dimensional.
Whether you're working with computer-generated datasets, or digitally transforming human-made data, MR and spatial computing provide immersive, interactive ways to explore and better understand information. To get the most out of MR data visualization tools, like Aura, developers need to build the apps with unique spatial considerations in mind. After building award-winning mixed reality platforms ourselves, here and the five specific best practices we bring to each of our initiatives:
1. Let Users Easily Manipulate Data in Real-Time
Throwing a 3D model into mixed reality and letting people look at it isn’t helpful or valuable. One of the key strengths of MR, over 2D screens, is its ability to allow users to manipulate 3D data, and do it in real-time. Harnessing this capability is twofold:
Your MR data visualization tool must allow for live updates to the data stream. In industries like manufacturing or logistics, where machine-generated data is constantly evolving, users need the ability to see changes as they occur and act on them.
Incorporate real-time manipulation capabilities using features like view filtering, drilling down into datasets with simple gestures, or adjusting visualizations as new data streams come in. This helps users stay engaged with the data and make informed decisions based on up-to-date information.
Use motion sensors or hand gestures to let users manipulate data without needing input devices like buttons or controllers. This natural interaction enhances the MR experience.
Two of the ways we do this in Aura is with a pinch and drag gesture so users can quickly and easily mark up the data hands-free as well as scrub along a timeline to jump to a specific point.
Annotation
Timeline scrubbing
2. Make it True Multi-User
One of the unique features of MR is multi-user experience that mimics real-life interactions. To pull this off effectively users must be able to work together in real time, explore the data from different perspectives, and discuss insights within the same virtual space.
In Aura, not only can multiple users join the same data visualization session, but the data set can be “anchored” to a common central point. This ensures that all users are reviewing the data set from the common angle, just as if they were sitting around a powerpoint. When one user points something out to another, their colleagues' impression of the point in the data they are being directed to is the same as theirs.
3. Use Context-Aware Data Displays
Not all information is relevant at all times. A major challenge in data visualization is presenting the right data to the right people, at the right time. In MR, context-aware data displays can help solve this issue uniquely by dynamically adjusting what’s shown based on the user’s environment, role, or current focus.
Aura with pilot centric data displays
In the example shown, Aura for Flight Debriefs displays the aircraft sensor data in the format of a Primary Flight Display and Engine Stack. The pilots in the session are used to reviewing this data at a glance in the cockpit while in flight and replicating how they see the information in real life, rather than displaying it as a table, enables quicker training debriefs. The data display in this case acts as a central billboard, with each user viewing it as straight on to facilitate easy discussions.
4. Consider User’s Cognitive Load
When your 3D physical space is unlimited in a headset, it unlocks users' abilities to bring multiple data sets into the same scene while introducing the problem of potentially overwhelming the user. To balance displaying relevant data with keeping the app usable, consider the user’s cognitive load in your design. Cognitive load is the mental effort required to process information and the amount of information that can be held in working memory at any given time.
For example if a user is examining the real-time performance of a specific machine in a session where there are multiple machines visible, the MR tool could highlight critical KPIs (Key Performance Indicators) related to that machine while temporarily downplaying less relevant data by fading, blurring or graying out the data not in the users direct line of sight by leveraging the device’s eye tracking sensors.
5. Integrate Predictive Analytics and Machine Learning
The value of data visualization isn't just in showing what has happened, but also in forecasting what’s likely to happen next. Predictive analytics and machine learning (ML) are powerful tools for transforming raw data into actionable insights. For your MR data visualization tool to add value, it should show historical and real-time data and incorporate predictive analytics to help users forecast trends and potential outcomes.
Design your machine learning models integrations to be flexible and modular rather than embedding a specific method or solution. This enables you and your clients to sub out different models so you can compare the predictive insights and prevent vendor lock. The ML and AI wars are still being waged and today’s most popular model may not be the best available in 2 months, let alone in 2 years.
Mixed Reality offers an unmatched opportunity to transform how we visualize and interact with data. To capitalize on MR's potential, your data visualization apps must be more useful than current 2D alternatives. AKA it has to be worth tearing your eyes away from a screen and putting on a headset. To optimize your MR app follow best practices that prioritize interactivity, collaboration, context-awareness, cognitive load, and predictive capabilities. By incorporating these practices, you can unlock deeper insights, improve decision-making, and provide users with a more dynamic, engaging experience.
At Dauntless XR, we specialize in building XR software solutions that empower users to see and act on data like never before. Reach out today to learn how our MR data visualization platform Aura can help you leverage the power of your data to drive innovation and efficiency.
