Press release: Making the invisible visible; Making the assistance and safety systems of the new Mercedes-Benz A-Class understandable through mixed reality

In order to ensure the comprehensive high quality of advice at Mercedes-Benz, the worldwide sales organization is currently being trained as part of the Global Training Experience in Ibiza. In focus: the latest vehicle generations, innovative technologies and elementary brand themes.

Particular attention is being paid to the current generation of the A-Class: the state-of-the-art compact-class vehicle, which will be in the showrooms from May this year, has the multimedia infotainment system Mercedes-Benz User Experience (MBUX for short). Thanks to artificial intelligence, the high-performance system adapts to the needs of its users. In terms of driving safety, the new A-Class offers an unprecedented range of assistance and safety systems for the compact class. Here the A-class meets the demands of the luxury class.

With the complex interaction of radar and camera sensors, the following elementary didactic question arises: How can the interaction of the individual systems be explained in a plausible manner? The complex connections between the installed technologies often remain hidden from the naked eye. To meet this challenge, Mercedes-Benz Global Training called in support. With the experts of Wegesrand Expert network and its technology and development partner IJsfontein Interactive Media created a real-time experience directly on the vehicle using Microsoft HoloLens technology.

“Today, the use of sensors and camera systems in combination with intelligent software creates technical possibilities to make driving safer. With Mixed Reality, the mixing and interaction of reality and visualization, the invisible becomes visible and thus comprehensible for the user,” explains Wegesrand-Managing Director Thorsten Unger.

The physical A-Class is at the center of the 6-minute, digitally guided tour. The HoloLens data glasses developed by Microsoft provide virtual information that goes beyond the mere visible elements of the assistance and safety systems. Functions and performance characteristics become clear through case studies. In this way, users can find out, for example, how potential collisions can be prevented by modern technology and thus receive elementary information that is important for the consultation situation with the customer.

Using the data glasses, users can find out what the A-Class detects via sensors and cameras and how it reacts to potentially dangerous situations: visual and acoustic warnings, situation-specific brake assistance or autonomous emergency braking. Towards the end of the virtually supported vehicle tour, all assistance systems are shown in action. In this way, the interaction of the various technical elements can be seen.

“Figuratively speaking, the user becomes part of an infographic that constantly changes in the context of use. So we interweave the virtually illustrated functions and information on the assistance and safety systems with the real vehicle to create a holistic experience,” explains Hayo Waagenar, Creative Director at IJsfontein, the procedure of the application.

IJsfontein Interactive Media Ltd

IJsfontein Interactive Media offers game-based learning solutions and has many years of project experience, consulting and conception expertise in the field of "games and education". Research projects and teaching activities also establish an extensive transfer of science and practice. Since 1997, more than 50 employees have been working on projects with well-known companies, institutions and educational institutions that have received numerous awards. IJsfontein operates offices in Amsterdam, Mönchengladbach and Berlin.