[AR-XR] Smart Blueding – Real-Time Data Visualization App

2.3k words

(Client: Smart Blueding | Developed at Kalank / Augmenty)

Overview

Smart Blueding is an augmented reality (AR) and mixed reality (MR) application designed to visualize real-time industrial data. Developed for iOS, Android, and Meta Quest 3, the app enables operators to monitor, interact with, and configure machine data directly on-site.

This project involved a strong IoT integration, allowing users to pull live data from machines and display it in an immersive AR/XR environment.

My Contributions

AR Development & Real-Time Data Visualization

  • Developed the AR interface in Unity using AR Foundation, ensuring a smooth real-time data display.
  • Implemented image tracking and plane tracking, enabling accurate positioning of visual data within industrial spaces.
  • Optimized performance for mobile devices & Meta Quest 3, ensuring seamless cross-platform compatibility.

IoT Integration & Data Handling

  • Designed a customizable backend system using Google Sheets & CSV, allowing clients to remotely configure layouts & displayed data.
  • Integrated MQTT protocol to enable live data streaming from industrial machines.
  • Developed a scalable and secure architecture for real-time data retrieval and processing.

UI/UX Design & User Interaction

  • Designed an intuitive user interface optimized for industrial operators.
  • Developed a 2D/3D menu system for customizable data visualization and navigation.
  • Ensured that users could rearrange panels dynamically, adapting the display to their needs.

Porting to Meta Quest 3 (XR Features)

  • Adapted the application to mixed reality (MR) on Meta Quest 3, enhancing spatial awareness & interaction.
  • Implemented hand tracking and spatial anchors, enabling gesture-based interaction with machine data.
  • Created interactive 3D data visualization elements, making real-time analytics more accessible.

Technical Documentation & Project Management

  • Wrote the project specifications document, ensuring clear alignment with client needs.
  • Created technical documentation in both French and English, guiding future maintenance & improvements.
  • Provided detailed API documentation, assisting developers in integrating and extending the system.
  • Maintained communication with clients, providing regular updates, delivering builds, and handling feedback to ensure alignment with their expectations.

Testing, Debugging & Performance Optimization

  • Conducted multi-platform testing to ensure stability across mobile, AR, and MR platforms.
  • Optimized loading times and data update rates, improving performance for real-time interactions.
  • Identified and resolved key UI bugs & interaction inconsistencies to refine the user experience.