Meet Mitilesh Muley from ART (Advanced Realtime Tracking) as he walks through an immersive cycling demo: a standard Garmin trainer is paired with a motion platform and a head-tracked display so the bike physically tilts with the virtual uphill/downhill terrain while your viewpoint updates in real time. https://ar-tracking.com/en
—
HDMI® Technology is the foundation for the worldwide ecosystem of HDMI-connected devices; integrated with displays, set-top boxes, laptops, audio video receivers and other product types. Because of this global usage, manufacturers, resellers, integrators and consumers must be assured that their HDMI® products work seamlessly together and deliver the best possible performance by sourcing products from licensed HDMI Adopters or authorized resellers. For HDMI Cables, consumers can look for the official HDMI® Cable Certification Labels on packaging. Innovation continues with the latest HDMI 2.2 Specification that supports higher 96Gbps bandwidth and next-gen HDMI Fixed Rate Link technology to provide optimal audio and video for a wide range of device applications. Higher resolutions and refresh rates are supported, including up to 12K@120 and 16K@60. Additionally, more high-quality options are supported, including uncompressed full chroma formats such as 8K@60/4:4:4 and 4K@240/4:4:4 at 10-bit and 12-bit color.
—
The core idea is outside-in optical tracking: infrared cameras observe retroreflective markers on the headset and props, then tracking software (ART’s DTRACK) turns those 2D observations into a continuously streamed 3D pose. In compact setups this can be a plug-and-play stereo unit like SMARTTRACK3, while higher-end cameras such as ARTTRACK6/M target high frame rate and low latency for tight VR control loops today.
Why the “little balls” on the glasses? A single marker gives 3DoF position, but a multi-marker target yields full 6DoF pose with millimeter-level stability, which matters when perspective shifts are obvious to the eye. Markerless computer-vision tracking can work, but accuracy and occlusion handling are harder; ART also points toward deep-learning approaches like CAPTA when you need to track objects without tagging there.
Beyond this cycling rig, the same pipeline maps to flight simulation, maintenance rehearsal, ergonomics testing, in-car HMI prototyping, and mixed-reality manufacturing workflows where humans and tools must align with a digital twin. ART describes deployments from small lab volumes to hall-scale multi-camera arrays, with thousands of installations and long-running customer programs in the field of work.
Filmed on the Supercomputing SC25 show floor in St Louis with the HLRS booth nearby, the interview highlights how precise 6DoF tracking becomes infrastructure for interactive HPC visualization, CAVE/XR labs, and real-time engines like Unity or Unreal via VRPN/OpenVR style data streams. The takeaway is simple: when you need repeatable, low-jitter pose data for simulation and training, robust marker targets plus calibrated IR camera geometry still win, fast.
I’m publishing about 90+ videos from Embedded World North America 2025, I upload about 4 videos per day at 5AM/11AM/5PM/11PM CET/EST. Join https://www.youtube.com/charbax/join for Early Access to all 90 videos (once they’re all queued in next few days) Check out all my Embedded World North America videos in my Embedded World playlist here: https://www.youtube.com/playlist?list=PL7xXqJFxvYvjgUpdNMBkGzEWU6YVxR8Ga
This video was filmed using the DJI Pocket 3 ($669 at https://amzn.to/4aMpKIC using the dual wireless DJI Mic 2 microphones with the DJI lapel microphone https://amzn.to/3XIj3l8 ), watch all my DJI Pocket 3 videos here https://www.youtube.com/playlist?list=PL7xXqJFxvYvhDlWIAxm_pR9dp7ArSkhKK
Click the “Super Thanks” button below the video to send a highlighted comment under the video! Brands I film are welcome to support my work in this way 😁
Check out my video with Daylight Computer about their revolutionary Sunlight Readable Transflective LCD Display for Healthy Learning: https://www.youtube.com/watch?v=U98RuxkFDYY
