Realfiction’s Multi-View 3D Display with Eye Tracking and Scanning Light Modulator

Posted by – May 7, 2026
Category: Exclusive videos

Realfiction presents its multi-view 3D display technology, which is capable of sending different images to individual viewers simultaneously. Stenu, Head of R&D, explains that this allows for a true 3D experience with a look-around perspective, similar to a hologram, but with full color and motion. The system achieves strong parallax, enabling objects to appear far off the screen while remaining sharp and in focus. Unlike traditional lenticular displays, this approach can create a unique sense of individual eye contact, a feature demonstrated with an avatar that can direct its gaze to specific people in a group.


HDMI® Technology is the foundation for the worldwide ecosystem of HDMI-connected devices; integrated with displays, set-top boxes, laptops, audio video receivers and other product types. Because of this global usage, manufacturers, resellers, integrators and consumers must be assured that their HDMI® products work seamlessly together and deliver the best possible performance by sourcing products from licensed HDMI Adopters or authorized resellers. For HDMI Cables, consumers can look for the official HDMI® Cable Certification Labels on packaging. Innovation continues with the latest HDMI 2.2 Specification that supports higher 96Gbps bandwidth and next-gen HDMI Fixed Rate Link technology to provide optimal audio and video for a wide range of device applications. Higher resolutions and refresh rates are supported, including up to 12K@120 and 16K@60. Additionally, more high-quality options are supported, including uncompressed full chroma formats such as 8K@60/4:4:4 and 4K@240/4:4:4 at 10-bit and 12-bit color.

The core of the technology is a lens-less system that combines an LED display (a mini-LED panel was used in the demonstration unit) with a light modulator. The modulator features light valves that form slits, which scan sequentially from side to side across the display. The LED panel’s output is scanned in synchronization with the modulator. This entire process is controlled by an algorithm that receives input from an eye-tracking system, ensuring that the correct image is directed precisely into each of the viewer’s eyes.

For eye tracking, Realfiction integrates a unit from Himax that can track up to six individual eyes, corresponding to three people at once. Each person can be shown a distinct image or view, enabling a shared but personalized 3D experience. The company previously researched lens-based systems but moved to this scanning light modulator approach because it is more scalable for mass manufacturing and avoids common optical issues associated with lenses, such as internal reflections and aberrations.

The current prototype is a 4-inch display, an evolution from the initial proof-of-concept. The company has also developed a 7-inch version, which was not yet ready for public exhibition but represents the next step in their roadmap. This newer model incorporates the Himax eye tracking, color, and a standard HDMI input. The technology’s scanning nature, which moves side-to-side rather than top-to-bottom, can cause interference artifacts when filmed with a standard camera due to conflicting frame rates.

Potential applications for this technology include creating more personal and emotional connections with AI avatars in settings like hotel check-in kiosks or other self-service points. The ability to establish direct, individual eye contact could also be used to create hyper-realistic faces for humanoid robots, making human-robot interaction feel more natural and engaging. The system’s ability to direct attention to specific individuals in a group is a key differentiator from 2D displays where an avatar looking at the camera appears to look at everyone at once.

source https://www.youtube.com/watch?v=LTccZzfZyxA